Job Closed
This listing is no longer active.
Advancing healthcare quality through innovation
Senior Data Engineer
Location
United States
Posted
104 days ago
Salary
$100K - $130K / year
Seniority
Senior
Job Description
Senior Data Engineer
LivantaLLC
• Responsible for designing, building, and maintaining efficient, scalable, and fully automated data pipelines and architectures that support various business needs • Design, develop, and maintain scalable data pipelines to collect, process, and transform data from various sources • Integrate data from multiple sources, ensuring data quality and consistency across the organization • Build and maintain data storage solutions, including data warehouses and data lakes, ensuring optimal performance and reliability • Implement data transformation and enrichment processes to prepare data for analytics and reporting • Leverage cloud technologies, particularly AWS, to optimize and manage data infrastructure • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions • Create and maintain comprehensive documentation for data pipelines, data models, and related processes • Mentor and guide junior data engineers/analysts on data engineering best practices and industry standards
Job Requirements
- Minimum of 4 years of experience in data engineering or a related field
- Strong experience with data pipeline/orchestration and ETL development using tools such as Apache Airflow, Kubernetes, Databricks Workflows or similar
- Demonstrated experience in designing highly efficient programs capable of processing terabytes of data
- Strong proficiency in SQL and experience with relational databases (e.g., SQLServer, PostgreSQL) and NoSQL databases (e.g., MongoDB, OpenSearch)
- Experience with cloud technologies, particularly AWS (e.g., S3, Redshift, Glue, Lambda, Athena)
- Proficient in writing data programs in R, Python, Scala, or similar language
- Familiarity with big data technologies such as Apache Spark, Databricks, or similar
- Familiarity with data visualization tools and data migration methods
- Excellent problem-solving skills and attention to detail
- Strong communication and interpersonal skills, with the ability to work effectively with diverse teams and stakeholders
Benefits
- Equal employment opportunities
- Reasonable accommodation for disabilities
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Contribute to the development and enhancement of internal tools and applications using technologies such as Cloverleaf, Azure DevOps, and data integration frameworks. • Implement and optimize data integration workflows to ensure seamless connectivity between systems and applications. • Participate in Agile ceremonies and collaborate with cross-functional teams to deliver high-quality software. • Assist in debugging, testing, and documenting code/routes. • Explore and apply modern engineering practices including CI/CD, cloud-native development, and data integration strategies. • Engage in team events, lunch & learns, and training activities throughout the program.
• Design, develop, and maintain scalable data pipelines. • Build and optimize data infrastructure. • Implement data quality monitoring and validation frameworks. • Optimize data storage, processing, and query performance for large-scale datasets. • Design and implement data models for analytics and reporting use cases. • Develop tools and automation to improve data engineering workflows and productivity. • Ensure data governance, security, and compliance standards are met. • Participate in on-call rotation to support production data systems.
Senior Data Engineer, ETL Cloud Data Platforms
AnkuraWe help clients Protect, Create, and Recover Value.
• Design, develop, and maintain ETL/ELT pipelines on cloud-based data platforms • Build data ingestion, transformation, and orchestration workflows using tools such as Azure Data Factory, Airflow, Fivetran, or similar • Develop transformations and data processing logic using platforms such as Databricks, Snowflake, or equivalent • Work with structured and semi-structured data from multiple source systems (APIs, databases, files) • Collaborate with analytics, BI, and data science teams to deliver curated, analytics-ready datasets • Implement data quality checks, logging, monitoring, and error handling • Participate in technical design discussions, effort estimates, and sprint planning • Produce clear and maintainable technical documentation
• Design, code, test, debug and document programs and scripts using agreed standards and tools, ensuring well-structured deliverables. • Ensure data quality and implement tools and frameworks to automate the detection of data quality issues. • Profile data sources and develop ETL processes, with knowledge of data modeling fundamentals, using SQL, Python and ETL/ELT support tools. • Assist management in preparing estimates and proposals for clients. • Plan effective solutions for data storage, security, sharing and publication within the organization. • Create and update documentation of process flows and business rules. • Maintain existing pipelines and process large volumes of data as needed.




