We help Aussie companies find top 3% remote talent in the Philippines & Nepal for a single finder's fee.
Lead Data Engineer
Location
Philippines
Posted
15 days ago
Salary
A$4K - A$5K / month
Seniority
Lead
Job Description
Lead Data Engineer
Hunt St
Role Description Looking for Philippines-based candidates. Job Role: Lead Data Engineer Compensation range: $4,000-5,000 AUD / Monthly (depending on experience and client discretion) Engagement type: Independent Contractor Agreement Work Schedule: This role is expected to align with the AU business hours (approx. 9 AM - 5 PM, Monday to Friday) for collaboration, but as a contractor, you’ll have flexibility in how you manage your time. Role Overview: This role is central to the successful design, build, and ongoing governance of a DataHub. The Lead Data Engineer acts as the primary interface between offshore and onshore teams, setting architectural direction and engineering standards while ensuring consistent code quality and adherence to agreed design principles. During the build phase, the role oversees architecture decisions, coordinates with IT teams on core data layer delivery, and approves work prior to UAT release. As delivery transitions from build to run, the role shifts into operational ownership—managing DataHub SLAs, overseeing new dataset intake, and serving as the escalation point for production issues. The role also requires strong stakeholder engagement, including facilitating agile ceremonies and communicating effectively with both technical and non-technical audiences across a distributed, cross-timezone team. Key Responsibilities - Own the dbt project architecture, including model structure, naming conventions, testing standards, CI/CD pipelines, and documentation frameworks to ensure consistency across all engineering work. - Manage the dataset delivery backlog with onshore stakeholders, including phase scoping, validation of source data availability, and sequencing of builds to maximise business value. - Govern code quality by reviewing all Silver and Gold models prior to UAT, ensuring no production deployment occurs without lead approval. - Own the end-to-end dataset handover process from Build to Run, including test sign-off, data catalogue documentation, observability configuration, and operational runbooks. - Coordinate and prioritise work across Build and Run workstreams operating in parallel, ensuring alignment and delivery efficiency. - Participate in standups (async where required) and lead sprint demonstrations on a fortnightly basis. - In Run steady state operations, own DataHub SLA performance, oversee new dataset onboarding, and act as the final escalation point for production support issues. Run & Steady-State Responsibilities - Own DataHub SLA performance, ensuring pipeline uptime and data freshness commitments are met across all production Gold datasets. - Manage new dataset intake from onshore teams, scoping requests and determining whether they require a new build phase or can be absorbed into the Run team. - Act as the primary escalation point for onshore stakeholders and the final offshore escalation for critical incidents that cannot be resolved by the data operations team. Qualifications - 7+ years data engineering experience (including 2+ years in a team lead or principal engineer role) - Snowflake (advanced): warehouse management, RBAC, dynamic data masking, Snowflake Tasks, performance tuning, and query optimisation - dbt Cloud (advanced): incremental models, snapshots, macros, packages, Semantic Layer / MetricFlow, CI/CD using GitHub Actions - Python (intermediate): Snowpark, pipeline scripting, and data quality automation - Data modelling (expert): dimensional modelling, medallion architecture (Bronze / Silver / Gold), and retail data models (orders, inventory, customers) - Git (advanced): branching strategies, PR workflows, and managing shared dbt projects across multiple engineers - Azure Data Factory (intermediate): pipeline monitoring and troubleshooting; ability to engage IT credibly on pipeline issues (build owned by IT) - Retail domain knowledge (preferred): familiarity with order management, inventory planning, and DTC data structures - AI & Automation Tools: Hands-on experience with tools such as GitHub Copilot, Cursor, Claude (or similar LLMs), Snowflake Cortex AI_COMPLETE, Elementary, and data observability platforms for AI-assisted development, SQL debugging, anomaly detection, alert classification, incident reporting, and workflow automation. What Success Looks Like - Excited to build and scale a modern data platform from the ground up - Proven experience leading data engineering teams and maintaining engineering quality standards - Comfortable working with separate upstream data delivery teams - Has built dbt medallion architecture projects (Bronze / Silver / Gold) from scratch - Strong quality ownership; confident holding back datasets not ready for UAT - Uses AI tooling naturally as part of day-to-day engineering workflows - Owns AI triage pipeline accuracy and incident log quality - Ensures alerts are acknowledged and resolved within agreed SLAs - Maintains accurate documentation and quality certifications across Gold datasets - Experienced in operating and tuning data pipeline monitoring and alerting processes - Able to communicate incidents clearly to business stakeholders in concise, non-technical language - Thrives in stable, operational environments where reliability is critical - Understands escalation boundaries and collaborates effectively with senior engineers Work Arrangement & Expectations This is a remote role that will be set up as an independent contractor engagement. To ensure alignment and transparency, successful candidates will be expected to: - Disclose any existing ongoing roles or client work - Reflect this engagement on their LinkedIn profile (clearly marked as “Independent Contractor”)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Principal Consultant - Azure Data Engineer
BrightClaimGenpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way.
Role Description Inviting applications for the role of Principal Consultant Azure Data Engineer with Gen AI Skills. In this role you will design, build, and maintain scalable data pipelines and platforms that power business intelligence, advanced analytics, and AI-driven solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver high-quality, reliable data products. - Design, develop, and maintain robust ETL/ELT data pipelines on Azure cloud infrastructure (Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics). - Build and optimize large-scale data processing workflows using Azure Databricks and Apache Spark. - Collaborate with AI/ML teams to engineer data pipelines and feature stores that support Generative AI and machine learning models. - Leverage Microsoft Copilot and AI-assisted tools to accelerate development, automate repetitive tasks, and improve code quality. - Write, optimize, and maintain complex SQL queries, stored procedures, and data models for analytical workloads. - Ensure data quality, lineage, governance, and security across all data assets. - Develop and maintain data documentation, metadata management, and data cataloging practices. - Participate in code reviews, architecture discussions, and agile ceremonies. - Support and enhance BI/visualization dashboards using Tableau or equivalent tools (Power BI, Looker, etc.) for actionable business insights. Qualifications - Bachelors - Business Analytics - Bachelors - Computer Science - Bachelors - Statistics - Masters - Data Science - Certified Data Management Professional - Riversand - Databricks Certified Associate Developer for Apache Spark 3.0 - Databricks Academy - Databricks Certified Associate Developer for Apache Spark - Databricks Academy - Microsoft Certified: Azure Data Engineer Associate - Microsoft - Oracle Database 12c Certified Implementation Specialist - Oracle Requirements - Agile Methodology - Banking Capital Markets - Client Relations - Cloud Computing - Collaboration Tools - Commercial Sales - Consumer Packaged Goods (CPG) - Databricks Platform - Data Engineering - Data Literacy - Design Thinking - Electronic Hardware - Executive Presence - Inclusion - Manufacturing Equipment - People Leadership - Personal Effectiveness - Risk Management - Semiconductors - Snowflake (Platform) - Sourcing and Procurement - Storytelling Benefits - Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter. - Make an impact – Help global enterprises solve business challenges that matter. - Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead. - Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day. - Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress.
Lead Consultant- Sr.Data Engineer (DBT+Snowflake)
BrightClaimGenpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way.
Role Description The Supply Chain Management Lead Analyst plays a critical role in overseeing and optimizing the supply chain processes of the organization. This role is responsible for analyzing supply chain data, identifying inefficiencies, and developing strategies to improve the efficiency and effectiveness of the supply chain operations. - Analyze supply chain data to identify trends and opportunities for improvement; - Develop and implement supply chain strategies to optimize inventory management and reduce costs; - Collaborate with cross-functional teams to streamline processes and enhance communication throughout the supply chain; - Monitor supply chain performance metrics and provide regular reports to management; - Identify risks and develop contingency plans to ensure supply chain continuity in the event of disruptions; - Stay current on industry trends and best practices in supply chain management to recommend innovative solutions for continuous improvement. Qualifications - Bachelors - Business Analytics - Bachelors - Computer Science - Bachelors - Statistics - Masters - Data Science Requirements - APICS Certified in Production and Inventory Management (CPIM) - APICS - Certified Supply Chain Professional certification (CSCP) - Certified Procurement Professional (CPP) - Certified Professional in Supply Management (CPSM) - Certified Supply Chain Professional (CSCP) - Indian Institute of Management, Trichy Benefits - Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter - Make an impact – Help global enterprises solve business challenges that matter - Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead - Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day - Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
• Design and optimize complex ABAP CDS views, including Basic, Composite, and Consumption views, using associations, joins, and analytical annotations. • Develop and deploy real-time analytical queries, KPI tiles, and Fiori-based dashboards. • Collaborate with functional teams to map business processes in Materials Management (MM) and Supply Chain (SCM) into technical reporting requirements. • Extend standard SAP VDMs to meet custom business needs while maintaining system performance through HANA push-down techniques. • Manage the full lifecycle from requirements gathering in "Fit-to-Standard" workshops to technical design, unit testing, and deployment across DEV/QA/PROD environments.
Senior Data Engineer
CDWCDW Corporation is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments. For more information about CDW, please visit www.CDW.com. Our broad array of products and services range from hardware and software to integrated IT solutions such as security, cloud, hybrid infrastructure and digital experience.
• Build and maintain scalable data pipelines, ETL and ELT processes, and data models within the Databricks platform. • Design, develop, and deploy data and AI solutions using Databricks, Spark, Delta Lake, and related technologies. • Develop batch and streaming pipelines using tools such as Databricks Workflows and Azure Data Factory. • Design logical data flow diagrams and normalized schemas, implementing Lakehouse patterns such as the Medallion Architecture (Bronze, Silver, Gold layers). • Ensure data quality, integrity, security, and governance throughout the data lifecycle, including use of Unity Catalog. • Optimize Spark jobs and data transformations through effective partitioning, caching, and join strategies. • Monitor pipeline execution, identify failures, and troubleshoot complex data processing issues. • Collaborate with data architects, analysts, data scientists, and business stakeholders to understand requirements and deliver solutions. • Support documentation of data processes, standards, and data flows.
