Smart Working logo
Smart Working

Empowering companies to work with the best engineers in the world

Senior Data Engineer – Contractual

Data EngineerData EngineerContractRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United Kingdom

Posted

2 days ago

Salary

0

Seniority

Senior

Bachelor Degree7 yrs expEnglishAirflowAWSETLKafkaPythonSQL

Job Description

Senior Data Engineer – Contractual

Smart Working

• Manage and optimise Snowflake data warehouses. • Overhaul Snowflake warehouse performance through materialisation strategies, dynamic tables, and clustering optimisation. • Build scalable ETL/ELT pipelines using dbt, Airflow, Fivetran, and AWS DMS. • Build ingestion pipelines using DMS and Fivetran. • Develop modelling layers in dbt using medallion architecture principles. • Transform raw data into clean, reliable, and business-ready models using dbt and AI-assisted tooling for documentation and testing. • Integrate data from multiple sources, including CRM systems, payment platforms, gaming platforms, and other operational systems. • Own initiatives focused on data quality improvements and monitoring, including anomaly detection and automated alerting. • Monitor and optimise platform performance, cost efficiency, and security. • Work closely with cross-functional teams across product development, data, operations, and analytics functions. • Collaborate with the data science team and support colleagues with reporting and analytics activities when required. • Support the organisation’s move towards real-time data ingestion and ETL using technologies such as DMS, Kafka, and Kinesis. • Help mentor other engineers within the team. • Contribute to the team's AI strategy and promote effective use of AI tools across engineering workflows. • Produce and maintain clear, comprehensive documentation to support scalability, transparency, and long-term platform sustainability. • Communicate effectively with both technical and non-technical stakeholders and proactively raise blockers when encountered.

Job Requirements

  • 7+ years in Data Engineering.
  • Solid hands-on experience with AWS.
  • You really know ELT design and data warehousing best practices.
  • You're an expert in optimising Snowflake.
  • You're a dbt pro (macros, testing, modularisation).
  • Excellent SQL and Python skills.
  • Good CI/CD and Git skills.
  • You have used AI coding assistants to work efficiently.

Benefits

  • Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter)
  • No Weekend Work: Real work-life balance, not just words
  • Support That Matters: Mentorship, community, and forums where ideas are shared
  • True Belonging: A long-term career where your contributions are valued

Related Categories

Related Job Pages

More Data Engineer Jobs

Müller's Solutions logo

Technical Lead – Data Migration, Testing & Quality Execution

Müller's Solutions

Tech Solutions company where we believe in empowering businesses to leap forward, by providing top-tier tech resourcs.

Data Engineer2 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Lead end-to-end data migration activities, including planning, mapping, transformation, validation, and reconciliation. • Define and execute data migration strategies and methodologies for Skadina implementations. • Oversee functional, integration, system, regression, and User Acceptance Testing (UAT) activities. • Ensure data quality, integrity, and consistency throughout migration and deployment phases. • Develop and review test plans, test cases, test scripts, and quality metrics. • Coordinate defect management, issue resolution, and root cause analysis activities. • Collaborate with architects, business analysts, developers, and business stakeholders to ensure successful project delivery. • Support cutover planning, deployment activities, and post-go-live stabilization. • Monitor project quality standards and ensure compliance with established processes and best practices. • Provide technical leadership and mentorship to project teams during migration and testing phases. • Prepare and maintain technical documentation, migration plans, and testing reports.

United Arab Emirates

Role Description Enable Data is seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks. The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure. Responsibilities - Architecture & Solution Design - Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions. - Design end-to-end data architectures on Microsoft Azure. - Define data ingestion, transformation, storage, governance, and consumption strategies. - Create scalable, secure, and cost-effective data solutions aligned with business objectives. - Establish architectural standards, design patterns, and best practices for data engineering teams. - Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions. - Design, develop, and modernize enterprise data platforms on Azure. - Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions. - Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices. - Strong hands-on experience in PySpark, Python, and SQL. - Expertise in Azure Databricks and Azure data ecosystem. - Experience designing and implementing scalable data architectures. - Ability to analyze, optimize, refactor, and redesign existing data pipelines. - Develop and maintain ETL/ELT solutions and data products. - Performance tuning, troubleshooting, and data quality implementation. - Mentor and guide junior developers and conduct code reviews. - Collaborate with cross-functional teams to deliver end-to-end data solutions. Requirements - Azure Data Lake, Azure Data Factory, Azure Synapse. - Data warehousing, lakehouse architecture, and cloud migration. - CI/CD, Git, and Agile development practices. Role Type - Senior Individual Contributor with Technical Leadership responsibilities.

India
Enable Data logo

Lead Data Engineer – Data Architect

Enable Data

A leading provider of advanced data, application, and cloud engineering services.

Data Engineer2 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Architecture & Solution Design • Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions. • Design end-to-end data architectures on Microsoft Azure. • Define data ingestion, transformation, storage, governance, and consumption strategies. • Create scalable, secure, and cost-effective data solutions aligned with business objectives. • Establish architectural standards, design patterns, and best practices for data engineering teams. • Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions. • Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions. • Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices. • Strong hands-on experience in PySpark, Python, and SQL • Expertise in Azure Databricks and Azure data ecosystem • Experience designing and implementing scalable data architectures • Ability to analyze, optimize, refactor, and redesign existing data pipelines • Develop and maintain ETL/ELT solutions and data products • Performance tuning, troubleshooting, and data quality implementation • Mentor and guide junior developers and conduct code reviews • Collaborate with cross-functional teams to deliver end-to-end data solutions

India
Arbital Health logo

Senior Product Manager, Data Platform

Arbital Health

We are a neutral third-party adjudication utility that is accelerating the $1 trillion shift to value-based care

Data Engineer2 days ago
Full TimeRemoteTeam 1-10Since 2023H1B No Sponsor

• Own the product roadmap for Arbital’s data pipeline platform, including ingestion, transformation, calculation, validation, audit trail, and AI consumption layers • Define and prioritize pipeline capabilities based on client needs, implementation learnings, engineering constraints, and long-term platform scalability goals • Translate complex healthcare data requirements from claims processing to VBC contract logic into structured, buildable product specs • Partner with leadership to align pipeline investments with Arbital’s broader product and go-to-market strategy • Write detailed PRDs, user stories, and technical specifications for platform features, configurations, and automation tooling • Work directly with engineering to scope, sequence, and ship pipeline improvements — balancing speed, quality, and flexibility • Define acceptance criteria and lead QA processes for new pipeline & platform capabilities, ensuring outputs meet accuracy and performance standards • Drive platform delivery end-to-end, owning prioritization, cross-team dependencies, and release coordination • Develop deep fluency in Arbital’s data models, pipeline architecture, and healthcare data standards (claims, eligibility, attribution, CMS/ACO files), and actuarial concepts (IBNR, rebates, contract terms) • Work hands-on with data — running SQL queries, reviewing pipeline outputs, and validating logic — to inform product decisions and support debugging • Define standards for data quality, deduplication, business rule configuration, lineage, and pipeline observability across all client environments • Evaluate and recommend tooling improvements across the platform stack (e.g., Airflow, Databricks, AWS) in partnership with engineering • Serve as the primary product owner for data capabilities across implementation, engineering, actuarial, and data science teams • Partner closely with the Implementation team to surface recurring client configuration needs and turn them into scalable platform features • Collaborate with actuarial and data science teams to ensure pipeline logic correctly supports attribution, aggregation, and actuarial use cases • Communicate roadmap priorities, tradeoffs, and delivery status clearly to both technical teams and non-technical stakeholders

United States
$170K - $200K / year