EXL logo
EXL

We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay

AWS Data Engineer

Cloud EngineerCloud EngineerFull TimeRemoteSeniorTeam 10,001+H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

1 day ago

Salary

0

Seniority

Senior

Bachelor Degree4 yrs expEnglishAmazon RedshiftAWSPySparkPythonSQL

Job Description

AWS Data Engineer

EXL

• Design and build robust, scalable data transformation pipelines using SQL, DBT, and Jinja templating • Develop and maintain data architecture and standards for Data Integration and Data Warehousing projects using DBT and Amazon Redshift • Collaborate with cross-functional teams to gather requirements and deliver dimensional data models that serve as a single source of truth • Own the full stack of data modeling in DBT to empower analysts, data scientists, and BI engineers • Enhance and maintain the analytics codebase, including DBT models, SQL scripts, and ERD documentation • Ensure data quality, governance alignment, and operational readiness of data pipelines • Apply software engineering best practices such as version control, CI/CD, and code reviews • Optimize SQL queries for performance, scalability, and maintainability across large datasets • Implement best practices for SQL performance tuning, including partitioning, clustering, and materialized views • Build and manage infrastructure as code using AWS CDK for scalable and repeatable deployments. Integrate and automate deployment workflows using AWS CodeCommit, CodePipeline, and related DevOps tools • Support Agile development processes and collaborate with offshore teams • Perform comprehensive data profiling on staging datasets to assess completeness, accuracy, consistency, timeliness, and conformity with business rules before downstream ingestion. • Conduct gap analysis between source, staging, and target data models to identify missing attributes, mismatched definitions, and transformation issues impacting reporting and analytics. • Partner with business SMEs, product owners, and analytics teams to clarify data definitions, resolve ambiguities, and prioritize remediation of critical data gaps.

Job Requirements

  • Bachelor’s or Master’s (preferred) degree in a quantitative or technical field such as Statistics, Mathematics, Computer Science, Information Technology, Computer Engineering or equivalent
  • 4+ years of experience in data engineering and analytics on modern data platforms
  • 3+ years’ extensive experience with DBT or similar data transformation tools, including building complex & maintainable DBT models and developing DBT packages/macros
  • Deep familiarity with dimensional modeling/data warehousing concepts and expertise in designing, implementing, operating, and extending enterprise dimensional models
  • Understand change data capture concepts
  • Experience working with AWS Services (Lambda, Step Functions, MWAA, Glue, Redshift)
  • Hands-on experience with AWS CDK, CodeCommit, and CodePipeline for infrastructure automation and CI/CD
  • Python proficiency or general knowledge of Jinja templating in Python and/or PySpark
  • Agile experience and willingness to work with extended offshore teams and assist with design and code reviews with customer
  • A great teammate and self-starter, strong detail orientation is critical in this role.

Benefits

  • Work From Home

Related Categories

Related Job Pages

More Cloud Engineer Jobs

ContractRemoteTeam 1,001-5,000Since 1905H1B No Sponsor

• Own the architecture, engineering, and lifecycle of Brightsolid's cloud platforms and services. • Lead Cloud Engineering and Network teams ensuring delivery of high-quality, scalable, secure infrastructure • Drive engineering excellence through automation, standardisation, and modern operating models • Maintain full accountability for multi-tenant cloud platforms, both internal and customer-facing • Lead the transition from legacy environments to open-source platforms (Ubuntu, OpenStack, Kubernetes) • Ensure platforms meet defined SLAs, resilience, compliance, and security requirements • Lead network engineering and datacentre strategy across all Brightsolid facilities • Ensure high-availability, resilient, and high-performance connectivity and infrastructure • Own disaster recovery, capacity planning, and infrastructure lifecycle management • Own the strategy, architecture, and operation of all engineering and business-critical tooling across the group • Provide full lifecycle ownership of key enterprise platforms, including: - ITSM and Service Management platforms (e.g. ServiceNow or equivalent) - CRM and customer engagement platforms (e.g. Salesforce or equivalent) - Monitoring, observability, and alerting platforms - Automation, CI/CD, and DevOps tooling - Identity, access management, and security tooling • Define and enforce standards for tooling rationalisation, reducing duplication and driving platform consistency across the organisation • Lead the transition from fragmented tools towards a cohesive, platform-led operating model, where tooling is: - API-driven - Automated-first - Integrated into engineering workflows and service delivery • Work cross-functionally with Product, Sales, and Customer Success teams to support solution development and delivery • Build and lead high-performing Cloud Engineering and Network teams • Define and manage KPIs across platform availability, performance, cost, and customer outcomes • Foster a culture of innovation, accountability, and continuous improvement

United Kingdom
Full TimeRemoteTeam 51-200Since 2020H1B No Sponsor

• You'll be working on the backend of an Amsterdam-based trading platform, contributing directly to system architecture design, technical decision-making, and the evolution of a serverless AWS-based infrastructure • The environment is dynamic and intentionally ambiguous — the right candidate will bring structure and technical clarity, not wait for it.

Portugal
HavocAI logo

Staff Cloud Platform Engineer

HavocAI

Autonomous Solutions for Maritime Operations

Full TimeRemoteTeam 11-50Since 2024H1B No Sponsor

• Drive execution and technical excellence across cloud platform projects • Set infrastructure standards, conduct design and code reviews, and guide architectural decisions • Shape the cloud platform roadmap in partnership with product and engineering leadership • Foster a culture of ownership, quality, automation, and continuous improvement • Design, build, and operate scalable AWS infrastructure using Infrastructure as Code • Build and maintain Kubernetes-based platforms, including EKS, and container workflows for application teams • Build self-service tooling and paved paths that enable teams to deploy and operate services safely • Ensure the platform reliably supports both application and data workloads • Design platform capabilities with reliability, scalability, security, and cost efficiency in mind • Optimize cloud systems for performance, scalability, resilience, and cost efficiency • Identify and resolve infrastructure bottlenecks, scaling limits, and reliability risks • Establish reliability practices, including SLIs, SLOs, error budgets, and incident response • Improve observability, maintainability, and operational readiness across cloud platform services • Partner with backend, SRE, data, autonomy, and security teams to deliver platform capabilities across the stack • Support end-to-end system design from edge devices to cloud infrastructure • Coordinate across teams to build and maintain release processes and CI/CD pipelines • Help align platform capabilities with product, engineering, security, and mission needs • Enforce secure cloud practices, including IAM least privilege, secrets management, and network segmentation • Maintain high standards for automation, testing, observability, documentation, and infrastructure reliability • Support technical reviews, design discussions, and production readiness efforts • Build systems with security, scalability, and long-term maintainability in mind

United States
$190K - $215K / year
HavocAI logo

Senior Cloud Platform Engineer

HavocAI

Autonomous Solutions for Maritime Operations

Full TimeRemoteTeam 11-50Since 2024H1B No Sponsor

• Drive execution and technical excellence across cloud platform projects • Set infrastructure standards, conduct design and code reviews, and guide architectural decisions • Contribute to the cloud platform roadmap in partnership with product and engineering leadership • Foster a culture of ownership, quality, automation, and continuous improvement • Design, build, and operate scalable AWS infrastructure using Infrastructure as Code • Build and maintain Kubernetes-based platforms, including EKS, and container workflows for application teams • Build self-service tooling and paved paths that enable teams to deploy and operate services safely • Ensure the platform reliably supports both application and data workloads • Design platform capabilities with reliability, scalability, security, and cost efficiency in mind • Optimize cloud systems for performance, scalability, resilience, and cost efficiency • Identify and resolve infrastructure bottlenecks, scaling limits, and reliability risks • Establish reliability practices, including SLIs, SLOs, error budgets, and incident response • Improve observability, maintainability, and operational readiness across cloud platform services • Partner with backend, SRE, data, autonomy, and security teams to deliver platform capabilities across the stack • Support end-to-end system design from edge devices to cloud infrastructure • Coordinate across teams to build and maintain release processes and CI/CD pipelines • Help align platform capabilities with product, engineering, security, and mission needs • Enforce secure cloud practices, including IAM least privilege, secrets management, encryption, and network segmentation • Maintain high standards for automation, testing, observability, documentation, and infrastructure reliability • Champion a DevSecOps culture by embedding security into CI/CD pipelines and the software development lifecycle • Implement cloud security controls, vulnerability management, and continuous compliance monitoring • Support compliance with frameworks such as FedRAMP, NIST 800-53, and DoD Impact Levels, including IL4 and IL5 • Build systems with security, scalability, and long-term maintainability in mind

United States
$175K - $200K / year