We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay
AWS Data Engineer
Location
India
Posted
1 day ago
Salary
0
Seniority
Senior
Job Description
AWS Data Engineer
EXL
• Design and build robust, scalable data transformation pipelines using SQL, DBT, and Jinja templating • Develop and maintain data architecture and standards for Data Integration and Data Warehousing projects using DBT and Amazon Redshift • Collaborate with cross-functional teams to gather requirements and deliver dimensional data models that serve as a single source of truth • Own the full stack of data modeling in DBT to empower analysts, data scientists, and BI engineers • Enhance and maintain the analytics codebase, including DBT models, SQL scripts, and ERD documentation • Ensure data quality, governance alignment, and operational readiness of data pipelines • Apply software engineering best practices such as version control, CI/CD, and code reviews • Optimize SQL queries for performance, scalability, and maintainability across large datasets • Implement best practices for SQL performance tuning, including partitioning, clustering, and materialized views • Build and manage infrastructure as code using AWS CDK for scalable and repeatable deployments. Integrate and automate deployment workflows using AWS CodeCommit, CodePipeline, and related DevOps tools • Support Agile development processes and collaborate with offshore teams • Perform comprehensive data profiling on staging datasets to assess completeness, accuracy, consistency, timeliness, and conformity with business rules before downstream ingestion. • Conduct gap analysis between source, staging, and target data models to identify missing attributes, mismatched definitions, and transformation issues impacting reporting and analytics. • Partner with business SMEs, product owners, and analytics teams to clarify data definitions, resolve ambiguities, and prioritize remediation of critical data gaps.
Job Requirements
- Bachelor’s or Master’s (preferred) degree in a quantitative or technical field such as Statistics, Mathematics, Computer Science, Information Technology, Computer Engineering or equivalent
- 4+ years of experience in data engineering and analytics on modern data platforms
- 3+ years’ extensive experience with DBT or similar data transformation tools, including building complex & maintainable DBT models and developing DBT packages/macros
- Deep familiarity with dimensional modeling/data warehousing concepts and expertise in designing, implementing, operating, and extending enterprise dimensional models
- Understand change data capture concepts
- Experience working with AWS Services (Lambda, Step Functions, MWAA, Glue, Redshift)
- Hands-on experience with AWS CDK, CodeCommit, and CodePipeline for infrastructure automation and CI/CD
- Python proficiency or general knowledge of Jinja templating in Python and/or PySpark
- Agile experience and willingness to work with extended offshore teams and assist with design and code reviews with customer
- A great teammate and self-starter, strong detail orientation is critical in this role.
Benefits
- Work From Home
Related Guides
Related Categories
Related Job Pages
More Cloud Engineer Jobs
• Own the architecture, engineering, and lifecycle of Brightsolid's cloud platforms and services. • Lead Cloud Engineering and Network teams ensuring delivery of high-quality, scalable, secure infrastructure • Drive engineering excellence through automation, standardisation, and modern operating models • Maintain full accountability for multi-tenant cloud platforms, both internal and customer-facing • Lead the transition from legacy environments to open-source platforms (Ubuntu, OpenStack, Kubernetes) • Ensure platforms meet defined SLAs, resilience, compliance, and security requirements • Lead network engineering and datacentre strategy across all Brightsolid facilities • Ensure high-availability, resilient, and high-performance connectivity and infrastructure • Own disaster recovery, capacity planning, and infrastructure lifecycle management • Own the strategy, architecture, and operation of all engineering and business-critical tooling across the group • Provide full lifecycle ownership of key enterprise platforms, including: - ITSM and Service Management platforms (e.g. ServiceNow or equivalent) - CRM and customer engagement platforms (e.g. Salesforce or equivalent) - Monitoring, observability, and alerting platforms - Automation, CI/CD, and DevOps tooling - Identity, access management, and security tooling • Define and enforce standards for tooling rationalisation, reducing duplication and driving platform consistency across the organisation • Lead the transition from fragmented tools towards a cohesive, platform-led operating model, where tooling is: - API-driven - Automated-first - Integrated into engineering workflows and service delivery • Work cross-functionally with Product, Sales, and Customer Success teams to support solution development and delivery • Build and lead high-performing Cloud Engineering and Network teams • Define and manage KPIs across platform availability, performance, cost, and customer outcomes • Foster a culture of innovation, accountability, and continuous improvement
• You'll be working on the backend of an Amsterdam-based trading platform, contributing directly to system architecture design, technical decision-making, and the evolution of a serverless AWS-based infrastructure • The environment is dynamic and intentionally ambiguous — the right candidate will bring structure and technical clarity, not wait for it.
• Drive execution and technical excellence across cloud platform projects • Set infrastructure standards, conduct design and code reviews, and guide architectural decisions • Shape the cloud platform roadmap in partnership with product and engineering leadership • Foster a culture of ownership, quality, automation, and continuous improvement • Design, build, and operate scalable AWS infrastructure using Infrastructure as Code • Build and maintain Kubernetes-based platforms, including EKS, and container workflows for application teams • Build self-service tooling and paved paths that enable teams to deploy and operate services safely • Ensure the platform reliably supports both application and data workloads • Design platform capabilities with reliability, scalability, security, and cost efficiency in mind • Optimize cloud systems for performance, scalability, resilience, and cost efficiency • Identify and resolve infrastructure bottlenecks, scaling limits, and reliability risks • Establish reliability practices, including SLIs, SLOs, error budgets, and incident response • Improve observability, maintainability, and operational readiness across cloud platform services • Partner with backend, SRE, data, autonomy, and security teams to deliver platform capabilities across the stack • Support end-to-end system design from edge devices to cloud infrastructure • Coordinate across teams to build and maintain release processes and CI/CD pipelines • Help align platform capabilities with product, engineering, security, and mission needs • Enforce secure cloud practices, including IAM least privilege, secrets management, and network segmentation • Maintain high standards for automation, testing, observability, documentation, and infrastructure reliability • Support technical reviews, design discussions, and production readiness efforts • Build systems with security, scalability, and long-term maintainability in mind
• Drive execution and technical excellence across cloud platform projects • Set infrastructure standards, conduct design and code reviews, and guide architectural decisions • Contribute to the cloud platform roadmap in partnership with product and engineering leadership • Foster a culture of ownership, quality, automation, and continuous improvement • Design, build, and operate scalable AWS infrastructure using Infrastructure as Code • Build and maintain Kubernetes-based platforms, including EKS, and container workflows for application teams • Build self-service tooling and paved paths that enable teams to deploy and operate services safely • Ensure the platform reliably supports both application and data workloads • Design platform capabilities with reliability, scalability, security, and cost efficiency in mind • Optimize cloud systems for performance, scalability, resilience, and cost efficiency • Identify and resolve infrastructure bottlenecks, scaling limits, and reliability risks • Establish reliability practices, including SLIs, SLOs, error budgets, and incident response • Improve observability, maintainability, and operational readiness across cloud platform services • Partner with backend, SRE, data, autonomy, and security teams to deliver platform capabilities across the stack • Support end-to-end system design from edge devices to cloud infrastructure • Coordinate across teams to build and maintain release processes and CI/CD pipelines • Help align platform capabilities with product, engineering, security, and mission needs • Enforce secure cloud practices, including IAM least privilege, secrets management, encryption, and network segmentation • Maintain high standards for automation, testing, observability, documentation, and infrastructure reliability • Champion a DevSecOps culture by embedding security into CI/CD pipelines and the software development lifecycle • Implement cloud security controls, vulnerability management, and continuous compliance monitoring • Support compliance with frameworks such as FedRAMP, NIST 800-53, and DoD Impact Levels, including IL4 and IL5 • Build systems with security, scalability, and long-term maintainability in mind



