Job Closed
This listing is no longer active.
We are dedicated to hiring rockstars for the best jobs on mixed Costa Rican, Colombian and US teams.
Senior Data Engineer
Location
United States
Posted
151 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
SMASH
• Design and implement a scalable, GCP-native data strategy aligned with machine learning and analytics initiatives. • Build, operate, and evolve reusable data products that deliver compounding business value. • Architect and govern squad-owned data storage strategies using BigQuery, AlloyDB, ODS, and transactional systems. • Develop high-performance data transformations and analytical workflows using Python and SQL. • Lead ingestion and streaming strategies using Pub/Sub, Datastream (CDC), and Cloud Dataflow (Apache Beam). • Orchestrate data workflows using Cloud Composer (Airflow) and manage transformations with Dataform. • Modernize legacy data assets and decouple procedural logic from operational databases into analytical platforms. • Apply Dataplex capabilities to enforce data governance, quality, lineage, and discoverability. • Collaborate closely with engineering, product, and data science teams in an iterative, squad-based environment. • Drive technical decision-making, resolve ambiguity, and influence data architecture direction. • Ensure data solutions are secure, scalable, observable, and aligned with best practices.
Job Requirements
- 8+ years of professional experience in data engineering or a related discipline.
- Expert-level proficiency in Python and SQL for scalable data transformation and analysis.
- Deep expertise with Google Cloud Platform data services, especially BigQuery.
- Hands-on experience with AlloyDB (PostgreSQL) and Cloud SQL (PostgreSQL).
- Strong understanding of domain-driven data design and data product thinking.
- Proven experience architecting ingestion pipelines using Pub/Sub and Datastream (CDC).
- Expertise with Dataform, Cloud Composer (Airflow), and Cloud Dataflow (Apache Beam).
- Experience modernizing legacy data systems and optimizing complex SQL/procedural logic.
- Ability to work independently and lead initiatives with minimal guidance.
- Strong critical thinking, problem-solving, and decision-making skills.
Benefits
- Flexible work arrangements
- Professional development
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, build, and maintain scalable, efficient data pipelines for ETL/ELT processes on AWS. • Develop, test, and deploy robust solutions using SQL and Python for data transformation and analysis. • Implement and manage data warehousing solutions using Redshift Serverless and other AWS data services. • Leverage dbt (Data Build Tool) for data modeling, transformation, and documentation. • Utilize workflow orchestration tools such as Temporal for pipeline automation. • Work with healthcare quality metrics for value-based care and ensure data alignment with industry standards. • Collaborate with stakeholders to integrate population health tools and analytics into data workflows. • Develop and maintain familiarity with FHIR data models and healthcare interoperability standards. • Ensure compliance with HIPAA and other healthcare regulatory requirements in all data handling processes. • Identify and resolve performance bottlenecks in data pipelines, ensuring high availability and reliability. • Optimize data storage and querying performance within Redshift Serverless and AWS infrastructure. • Stay current with emerging trends in data engineering and healthcare technology. • Partner with data and engineering teams to ensure data is accessible and meets business requirements. • Develop scalable solutions for integrating complex healthcare datasets, ensuring data quality and accuracy. • Contribute to the design and implementation of secure, scalable, and efficient data architecture on AWS.
Senior Data Engineer
CapgeminiFounded in 1967, Capgemini is revered as one of the world's leading consulting, technology, and outsourcing agencies. In 2016 alone, the company reported global
• Provide technical leadership, analytical expertise, and program oversight in data engineering • Collaborate with software developers, data scientists, and product managers to understand requirements • Contribute technical expertise in data engineering to design and implement data solutions • Participate in planning sessions to develop data pipeline architecture • Design data ingestion, transformation, and storage workflows that are scalable • Implement data quality checks and validation procedures • Conduct comprehensive testing, including unit, integration, and system testing • Document data engineering processes, pipeline configurations, and data flows • Foster effective collaboration with cross-functional teams • Communicate complex technical information clearly and effectively • Manage projects, including planning, execution, and delivery
• Contribute to enterprise data transformation initiatives • Design and implement data ingestion pipelines • Monitor and optimize data ingestion and processing workflows • Collaborate with cross-functional teams • Support continuous improvement of the data platform
• Engage in a large-scale data transformation initiative • Analyze and modernize complex data transformation logic • Architect and implement end-to-end data ingestion frameworks • Define and analyze performance metrics • Perform advanced performance tuning for Databricks operations • Provide technical leadership and mentorship



