Job Closed

This listing is no longer active.

Pavago

Pavago specializes in connecting businesses with top-tier offshore talent in operations, sales, and marketing, offering a comprehensive recruitment solution designed to reduce cost

Data Engineer

Location

Pakistan

Posted

60 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Engineer

Pavago

Job Title: Data Engineer Position Type: Full-Time, Remote Working Hours: U.S. client business hours (with flexibility for pipeline monitoring and data refresh cycles) About the Role: Our client is seeking a Data Engineer to design, build, and maintain reliable data pipelines and infrastructure that deliver clean, accessible, and actionable data. This role requires strong software engineering fundamentals, experience with modern data stacks, and an eye for quality and scalability. The Data Engineer ensures data flows seamlessly from source systems to warehouses and BI tools, powering decision-making across the business. Responsibilities: Pipeline Development: - Build and maintain ETL/ELT pipelines using Python, SQL, or Scala. - Orchestrate workflows with Airflow, Prefect, Dagster, or Luigi. - Ingest structured and unstructured data from APIs, SaaS platforms, relational databases, and streaming sources. Data Warehousing: - Manage data warehouses (Snowflake, BigQuery, Redshift). - Design schemas (star/snowflake) optimized for analytics. - Implement partitioning, clustering, and query performance tuning. Data Quality & Governance: - Implement validation checks, anomaly detection, and logging for data integrity. - Enforce naming conventions, lineage tracking, and documentation (dbt, Great Expectations). - Maintain compliance with GDPR, HIPAA, or industry-specific regulations. Streaming & Real-Time Data: - Develop and monitor streaming pipelines with Kafka, Kinesis, or Pub/Sub. - Ensure low-latency ingestion for time-sensitive use cases. Collaboration: - Partner with analysts and data scientists to provide curated, reliable datasets. - Support BI teams in building dashboards (Tableau, Looker, Power BI). - Document data models and pipelines for knowledge transfer. Infrastructure & DevOps: - Containerize data services with Docker and orchestrate in Kubernetes. - Automate deployments via CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI). - Manage cloud infrastructure using Terraform or CloudFormation. What Makes You a Perfect Fit: - Passion for clean, reliable, and scalable data. - Strong problem-solving skills with debugging mindset. - Balance of software engineering rigor and data intuition. - Collaborative communicator who thrives in cross-functional environments. Required Experience & Skills (Minimum): - 3+ years in data engineering or back-end development. - Strong Python and SQL skills. - Experience with at least one major data warehouse (Snowflake, Redshift, BigQuery). - Familiarity with pipeline orchestration tools (Airflow, Prefect). Ideal Experience & Skills: - Experience with dbt for transformations and data modeling. - Streaming data experience (Kafka, Kinesis, Pub/Sub). - Cloud-native data platforms (AWS Glue, GCP Dataflow, Azure Data Factory). - Background in regulated industries (healthcare, finance) with strict compliance. What Does a Typical Day Look Like? A Data Engineer’s day revolves around keeping pipelines running, improving reliability, and enabling teams with high-quality data. You will: - Check pipeline health in Airflow/Prefect and resolve any failed jobs. - Ingest new data sources, writing connectors for APIs or SaaS platforms. - Optimize SQL queries and warehouse performance to reduce costs and latency. - Collaborate with analysts/data scientists to deliver clean datasets for dashboards and models. - Implement validation checks to prevent downstream reporting issues. - Document and monitor pipelines so they’re reproducible, scalable, and audit-ready. In essence: you ensure the business has accurate, timely, and trustworthy data powering every decision. Key Metrics for Success (KPIs): - Pipeline uptime ≥ 99%. - Data freshness within agreed SLAs (hourly, daily, weekly). - Zero critical data quality errors reaching BI/analytics. - Cost-optimized queries and warehouse performance. - Positive feedback from data consumers (analysts, scientists, leadership). Interview Process: - Initial Phone Screen - Video Interview with Pavago Recruiter - Technical Task (e.g., build a small ETL pipeline or optimize a SQL query) - Client Interview with Engineering/Data Team - Offer & Background Verification

Related Categories

Related Job Pages

More Data Engineer Jobs

Cox Enterprises logo

Senior Data Engineer

Cox Enterprises

Cox Enterprises, a top media, communications, and automotive repair company, operates via three major divisions: Cox Media Group, Cox Communications, and Cox Au

Data Engineer60 days ago

• Design and implement robust data architectures supporting structured and unstructured data from internal and external sources • Build and maintain scalable, secure data pipelines using cloud-based and distributed technologies • Establish data structures and routing mechanisms based on business and technical requirements • Develop and execute automated test cases to validate ETL workflows, data pipelines, and reporting logic • Create regression test suites to ensure ongoing data integrity and system stability • Analyze current and historical performance data to identify trends, variances, and opportunities • Collaborate with data consumers, project managers, and business stakeholders to define logical and physical database designs for analytics models • Identify and implement improvements in internal data management and testing processes

United States
$101.5K - $169.1K / year
Job Closed
Cohere logo

Data Engineer

Cohere

At Cohere, our mission is to build machines that understand the world, and to make them safely accessible to all.

Data Engineer60 days ago
Full TimeRemoteTeam 11-50H1B Sponsor

• Work directly on storage infrastructure, product launches, and new customer experiences built on one of the most advanced AI systems in the world • Collaborate daily with researchers and engineers who are some of the best in the world at what they do • Run implementations end-to-end and see initiatives through to real outcomes — no waiting around to be told what to do • Partner across research, marketing, sales, and finance to help define how Cohere grows, with your recommendations feeding directly into products and strategy

New York
Amplify logo

SIOP Data and Model Specialist

Amplify

A pioneer in K–12 education, Amplify partners with educators to make learning rigorous and riveting for every student.

Data Engineer60 days ago
Full TimeRemoteTeam 1,001-5,000Since 2000H1B Sponsor

Role Description Amplify is seeking a SIOP Data & Model Specialist to join our Central Services Technology team. This role owns the technology backbone and planning science of Supply Chain Sales, Inventory, and Operations Planning (SIOP), building and governing the framework that underpins forecasting, demand/supply planning, and scenario modeling. You'll serve as a bridge between supply chain expertise and technical implementation, owning planners' Excel templates and the structured planning technology layer (currently dbt-based) while leading the transition from spreadsheets to a policy-driven planning process. The ideal candidate brings deep expertise in forecasting, inventory modeling, demand/supply planning, and operational workflows, with the ability to translate supply chain subject matter knowledge into scalable planning solutions. You'll drive forecasting accuracy and scenario modeling while partnering closely with planners to gain a deeper understanding of day-to-day operations. Success is measured by operational metrics, including fill rate, forecast value add (FVA), inventory turns, and expedite costs, as you collaborate with Data/Technology teams on architecture and Finance on policy guardrails to enable long-term supply chain resilience. Essential Responsibilities - Governance & Decision Rights: - Approve/deny changes to planning templates and dbt models. - Set and govern policy parameters (service levels, safety stock, MOQ/EOQ, freeze fences). - Gate planning releases and prioritize SIOP backlog. - Call stop-the-line on non-compliant processes. - Model Development: - Lead migration from Excel to governed dbt frameworks in Snowflake. - Collaborate with analytics engineers to build forecast models (time-series, causal), inventory policies (multi-echelon), and FVA diagnostics. - Develop demand sensing approaches of market data to improve FVA. - Maintain semantic layer with version control and clear documentation. - Data Integration & Quality: - Own integrations with NetSuite and Salesforce. - Partner with data engineering on ETL processes. - Establish data quality rules. - Monitor data health proactively and enforce quality standards and validation processes. - Scenario Planning & Analytics: - Build and manage dbt sandbox for "what-if" analysis. - Run scenario planning for build-to-stock and adoptions. - Develop simulation capabilities for supply chain configurations and demand fluctuations. - Create dashboards for planning visibility. - Collaboration & Training: - Train planners and establish certification for template/dbt usage. - Mentor colleagues on modeling and technology best practices. - Partner with Finance on working-capital targets. - Generate and review Pull Requests for production integration. - Process Standardization: - Standardize master data needed for SIOP with Product Data Integrity. - Publish playbooks for call-downs and expedites. - Track adoption and compliance. - Ensure roadmap alignment with business objectives. Qualifications - Bachelor’s degree in Industrial Engineering, Operations Research, Applied Statistics or other engineering- or analytics-based discipline (MS preferred). - 6–10+ years experience in planning science (forecasting, inventory optimization) with hands-on modeling. - Strong SQL and dbt experience; advanced Excel skill set, and at minimum a familiarity with Atlan / Snowflake or an equivalent platform. - Proven product ownership of analytics/plan platforms including management of the backlog, releases, and change control. - Demonstrated change leadership with planners with measurable FVA and adoption wins. - Experience working in a cross-functional or centralized technology/process improvement team. Preferred Qualifications - Experience with ERP and CRM (preferably, NetSuite and Salesforce) integration. - An understanding of K-12 education business model and seasonality. - Experience in dealing with complex independent and dependent demand scenarios driven by complex kits and BOMs. - Excellent communication skills with the ability to convey complex data models to non-technical stakeholders. - Familiarity with continuous improvement methodologies (e.g., Lean, Six Sigma), quality assurance practices, or structured project/change management frameworks. Benefits - Salary is only one component of the Amplify Total Rewards package, which includes a 401(k) plan, competitive health insurance and mental health options, basic life insurance, paid time off, parental leave, and access to best-in-class development programs. - The gross salary range for this role is $120,000 - $140,000. - This role is eligible to earn an annual discretionary bonus that rewards individual and company performance. Company Description Amplify is an Equal Opportunity Employer. Amplify makes employment decisions based on qualifications and merit, and does not discriminate based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability status, veteran status, or any other legally protected characteristic or status. Amplify is committed to providing reasonable accommodations for qualified individuals with disabilities, including disabled veterans. If you have a disability and need an accommodation in connection with the application or hiring process, please email hiringaccommodations@amplify.com. If you are selected for employment, a background check will be required. As required by state and local laws and district policies, you may be required to provide additional documentation, such as proof of vaccination, or submit to enhanced background screening, such as fingerprinting. Amplify is an E-Verify participant.

United States
$120K - $140K / year
Boeing logo

Lead Data Steward - VIRTUAL

Boeing

A leading global aerospace company and top U.S. exporter, Boeing develops, manufactures and services commercial airplanes, defense products and space systems for customers in more than 150 countries. Our U.S. and global workforce and supplier base drive innovation, economic opportunity, sustainability and community impact. Boeing is committed to fostering a culture based on our core values of safety, quality and integrity.

Data Engineer60 days ago
Full TimeRemoteTeam 10,001+Since 1916H1B Sponsor

Lead Data Steward - VIRTUAL Company: The Boeing Company At Boeing Digital Services, you’ll be a part of a team that creates innovative digital solutions and analytics that drive the future and evolution of Digital Services and enable our customers to transform the way they do business. Using agile digital technology, our solutions optimize all aspects of the aircraft operations and maintenance ecosystem including safety, environmental sustainability, and efficiency. Boeing Digital Services is seeking Lead Data Steward, reporting to the Software Development Manager. The Lead Data Steward will be responsible for delivery of cutting-edge aviation data analytics products. As part of an integrated product team the Lead Data Steward will be part of technical team taking responsibility for Data Analysis, Data Maintenance and Data product development. This role will work with portfolio leadership, development teams and stakeholders to establish and drive the implementation, technical strategies and roadmaps for the success of each product and initiative. This position has been identified as a virtual opportunity and will not require the selected candidate to relocate. Position Responsibilities: - Lead stewardship for Aviation Operations data domains (flight telemetry, flight plans, maintenance, sensors, logs), owning data product roadmaps and delivery. - Define and enforce data product contracts: schema, semantics, SLAs, lineage, ownership, quality rules, and access policies. - Define and validate end-to-end data flows on Azure Databricks (ingest → transform → publish) to meet Machine Learning (ML) and Business Intelligence (BI) requirements. - Establish and operationalize a data quality framework and monitoring (completeness, accuracy, timeliness, schema drift) using tools and automated tests. - Drive metadata and catalog governance (business glossary, tags, descriptions, sample queries, contact points) and champion adoption of Unity Catalog or equivalent. - Lead change management for schema and feature changes, ensuring reproducibility and minimizing downstream impact to ML/BI assets. - Mentor and coordinate cross-functional teams (Data Engineers, Data Scientists, Product Owners, Ops SMEs) to deliver and maintain data products. - Oversee data access management and Role Based Access Control (RBAC), ensuring compliance with aviation security, privacy, and regulatory requirements. - Define runbooks, incident response procedures, and operational KPIs for data product health and reliability. - Act as the primary liaison for stakeholders, prioritizing enhancements, and resolving production escalations quickly. - Promote continuous improvement through data profiling, harmonization, enrichment, and automation of manual data tasks. Basic Qualifications (Required Skills/Experience): - 8+ years’ of experience in data stewardship, data governance, data engineering, or related roles - 2+ years’ in a senior/lead capacity - 2+ years’ experience implementing strategy related to data quality tooling and pipelines Preferred Qualifications (Desired Skills/Experience): - Prior experience in aviation/flight operations, or working with time-series, telemetry, and sensor datasets - Familiarity with ML feature stores, MLOps practices, and ensuring feature lineage and reproducibility - Familiarization with Azure Databricks and Delta Lake, including designing transformative jobs, clusters, and job orchestration - Familiarization of Bronze/Silver/Gold layering and best practices for feature readiness and ML use cases - Understanding of RBAC/IAM on Cloud and managing secure data access in enterprise environments - Understanding of cloud ecosystem: Storage, Monitoring and Deployment - Understanding of Data distribution ecosystem like Databricks - Experience with metadata/catalog tools (preferably Unity Catalog or Alation) - Understanding of CI/CD for data pipelines, Git-based workflows, and infrastructure-as-code patterns - Excellent stakeholder management, written and verbal communication skills, and ability to translate business needs to technical requirements - Bachelor’s degree in Computer Science, Data Science, Engineering, Aviation, or related field or equivalent experience Drug Free Workplace: Boeing is a Drug Free Workplace where post offer applicants and employees are subject to testing for marijuana, cocaine, opioids, amphetamines, PCP, and alcohol when criteria is met as outlined in our policies. Pay & Benefits: At Boeing, we strive to deliver a Total Rewards package that will attract, engage, and retain the top talent. Elements of the Total Rewards package include competitive base pay and variable compensation opportunities. The Boeing Company also provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health insurance, flexible spending accounts, health savings accounts, retirement savings plans, life and disability insurance programs, and a number of programs that provide for both paid and unpaid time away from work. The specific programs and options available to any given employee may vary depending on eligibility factors such as geographic location, date of hire, and the applicability of collective bargaining agreements. Pay is based upon candidate experience and qualifications, as well as market and business considerations. Summary pay range: $138,550 - $215,050 Language Requirements: Not Applicable Education: Not Applicable Relocation: Relocation assistance is not a negotiable benefit for this position. Export Control Requirement: This is not an Export Control position. Safety Sensitive: This is not a Safety Sensitive Position. Security Clearance: This position does not require a Security Clearance. Visa Sponsorship: Employer will not sponsor applicants for employment visa status. Contingent Upon Award Program This position is not contingent upon program award Shift: Shift 1 (United States of America) Stay safe from recruitment fraud! The only way to apply for a position at Boeing is via our Careers website. Learn how to protect yourself from recruitment fraud - Recruitment Fraud Warning Boeing is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national origin, gender, sexual orientation, gender identity, age, physical or mental disability, genetic factors, military/veteran status or other characteristics protected by law. EEO is the law Boeing EEO Policy Request an Accommodation Applicant Privacy Boeing Participates in E – Verify - E-Verify (English) - E-Verify (Spanish) Right to Work Statement - Right to Work (English) - Right to Work (Spanish)

United States
$138K - $215K / year
Job Closed