Job Closed

This listing is no longer active.

EXL logo
EXL

We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay

AWS Data Architect

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

81 days ago

Salary

$130K - $160K / year

Seniority

Senior

Job Description

AWS Data Architect

EXL

• Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs. • Design, implement, and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency. • Utilize AWS services (S3, Glue, EMR, Redshift, Lambda, Kinesis, MWAA, etc.) to build and optimize data pipelines and storage solutions. • Champion the use of data lakehouse architecture and optimize its performance for analytical and operational workloads. • Identify the gaps and opportunities in the current system and suggest/implement to optimise the processes and costs. • Lead and guide data engineering teams to develop, maintain, and optimize ETL processes for data ingestion, transformation, and loading. • Implement real-time data processing solutions using technologies such as Apache Kafka and AWS Kinesis. • Collaborate with data scientists, business stakeholders and analysts to ensure data availability and quality, enabling effective analytics and reporting. • Leverage DBT for data modelling and transformation to support self-service analytics and data governance. • Architect and implement data integration solutions for API ingestion, enabling data from diverse sources to be captured, transformed, and ingested into our data lakehouse. • Utilize Airbyte and custom APIs to ensure efficient, reliable, and secure data transfers. • Manage data integration pipelines to support real-time and batch data processing. • Design, configure, and maintain workflow orchestration using Apache Airflow to automate ETL processes and data pipeline executions. • Monitor and optimize job scheduling, error handling, and performance of data workflows. • Implement data security protocols, access controls, and encryption to safeguard sensitive data, especially PIIs. • Ensure compliance with data privacy regulations and industry standards. • Collaborate with cross-functional teams to understand data requirements and provide data solutions to meet their needs. • Maintain comprehensive documentation for data engineering and data architecture processes and solutions. • Guide the team in setting up cloud Infra and automate using tools like terraform, cloud formation, Jenkins etc • Guide the operations team in setting up automated monitoring & alerts mechanism

Job Requirements

  • Bachelor's or higher degree in a relevant field.
  • 6+ years of proven experience in data engineering, cloud architecture, and AWS services.
  • Extensive knowledge of data lakehouse technologies, Hudi, DBT, Airbyte, Redshift, Glue, Kinesis and Apache Airflow.
  • Strong expertise in programming languages like SQL, Python and processing frameworks like PySpark
  • Strong expertise in real-time data processing.
  • Excellent problem-solving and analytical skills.
  • Strong communication and teamwork abilities.
  • Passion for Sports/Gaming/Entertainment is preferred

Related Categories

Related Job Pages

More Data Engineer Jobs

Modash logo

Senior Product Data Engineer

Modash

Influencer tools for growth focused marketers! 💌

Data Engineer81 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Start your day with a short standup • Heads-down focus time to plan, build, iterate, and launch • Minimal meetings — maximum ownership • Creating an understanding of the creators location, age, and interests at scale • Creating systems to extract collaborations between creators and brands from raw social data • Shaping the future of AI-assisted search, exploring how LLMs and embeddings can enhance search and recommendations.

Estonia
Capco logo

Test Environment & Data Coordinator (Polish is Mandatory) (She/He/They)

Capco

Capco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries

Data Engineer81 days ago
Full TimeRemoteTeam 1,001-5,000Since 1998H1B Sponsor

CAPCO POLAND Location: Warsaw, Poland At Capco Poland, we’re not just another consultancy - we’re the spark behind digital transformation in the financial world. As a global leader in technology and management consulting, we thrive on helping clients tackle the toughest challenges across banking, payments, capital markets, wealth, and asset management. Our secret? A culture that’s fast, flexible, and fiercely entrepreneurial. We move quickly, think creatively, and always put our people first. We’re passionate about growth - both for our clients and ourselves - and that means attracting the very best talent to join us on this exciting journey. We’re proud to be: • Trailblazers in banking, payments, capital markets, wealth, and asset management • Champions of an agile, nimble, and innovative work environment • Dedicated to building a team of top-notch professionals who share our drive and vision Enable high-quality programme delivery by coordinating test environments, deployments, and data readiness across complex banking platforms. THE ROLE We are seeking a Test Environment & Data Coordinator to support large-scale banking and payments transformation programmes by managing test data preparation, environment coordination, and deployment dependencies across multiple testing phases. You will play a critical role in ensuring testing teams have stable environments, accurate datasets, and timely support for end-to-end testing activities. Working closely with vendors, PMO, IT teams, and business stakeholders, you will help drive programme readiness and support issue resolution across complex delivery landscapes. Fluency in Polish is mandatory. KEY RESPONSIBILITIES: - Coordinate test data preparation activities and manage datasets required for testing across F&F and MVP scenarios - Manage environment dependencies and coordinate deployment processes across multiple test environments - Monitor environment availability, data readiness, and testing support activities to ensure smooth programme execution - Support issue resolution and unblocking activities by collaborating with IT teams, vendors, and programme stakeholders - Work closely with PMO, business teams, and testing teams to align environment and data readiness with programme timelines SKILLS & EXPERIENCES TO GET THE JOB DONE: - Experience coordinating test environments, deployments, or test data activities within banking or enterprise technology programmes - Strong understanding of testing lifecycles, environment management, and dependency coordination - Experience supporting SIT, UAT, regression, or end-to-end testing activities across multiple environments - Familiarity with release management, deployment coordination, and defect or incident tracking processes - Strong organisational, communication, and stakeholder management skills with attention to detail - Experience working within banking, cards, or payments transformation programmes - Exposure to CI/CD pipelines, DevOps processes, or release management tooling - Knowledge of database validation, data masking, or test data management practices - Experience working with vendors and distributed delivery teams - Understanding of agile or hybrid delivery methodologies IMPORTANT - Fluent Polish (spoken and written) is mandatory - Good command of English for documentation and collaboration - Availability to work on-site, with partial remote work - 3 days per week from the office in Warsaw ONLINE RECRUITMENT PROCESS STEPS - Screening call with the Recruiter - Hiring Manager Technical Interview - Client Interview - Feedback/Offer We offer a flexible collaboration model based on a B2B contract, with the opportunity to work on diverse projects. #LI-HYBRID

Poland
Job Closed
Sime logo

Data Engineer

Sime

Bridging Opportunities

Data Engineer81 days ago
Full TimeRemoteTeam 10,001+Since 1910H1B No Sponsor

• Analyse data and provide actionable insights to support business decisions • Design, build, and optimise scalable data pipelines and transformation processes • Develop and standardise data architecture and migration frameworks • Ensure data quality, reconciliation, and accuracy across systems • Collaborate with business and technical stakeholders to ensure clear communication and alignment • Uphold strong accountability, teamwork, and sound judgment in delivery

Australia
Job Closed
Intercare Holdings Insurance Services logo

Director, Data Platform

Intercare Holdings Insurance Services

Extraordinary People. Extraordinary Results.

Data Engineer81 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

• Own the Azure Fabric architecture end-to-end: workspace topology, OneLake / Iceberg storage strategy, dev/test/prod separation, capacity sizing, governance • Lead a 4-person surge team (Data Architect, two Data Engineers, Business Analyst) through a 6-month build • Define the Bronze ? Silver ? Semantic layered architecture, with a Gold semantic schema expressed in AvonRisk business terms so reports, dashboards, and AI models survive future claims-platform migrations • Drive the Fabric Mirroring validation for our claims system and design the ADF fallback where Mirroring isn't viable • Architect multi-tenant PHI security: client-segregated PHI workspace + masked cross-tenant analytics layer, with RLS and Fabric secure data sharing for client portal access • Stand up the customer-facing analytics portal (Power BI Embedded or Fabric-native) with a 10+ client pilot live by end of Month 6 • Establish data catalog, lineage, DQ, and governance using Microsoft Purview and Fabric-native tools • Operate the platform as a permanent capability — uptime, performance, capacity, cost • Onboard additional source systems as AvonRisk grows through acquisition and new programs • Build the AI/ML feature foundation that underpins our agent roadmap • Collaborate closely with product builders, claims operations, and client-facing teams to keep the semantic model aligned with business needs

California + 1 moreAll locations: California | Texas
$190K - $220K / year
Job Closed