Job Closed
This listing is no longer active.
Creating remarkable health experiences, freeing people to be their best.
Senior Data Engineer – Cloud Data Products, Analytic Enablement
Location
Louisiana + 4 moreAll locations: Louisiana | North Carolina | Maryland | Pennsylvania | Washington
Posted
4 days ago
Salary
$102.7K - $164.6K / year
Seniority
Senior
Job Description
Senior Data Engineer – Cloud Data Products, Analytic Enablement
Highmark Health
• Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems • Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs • Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs • Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly • Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations. • Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking • Mentor other associate and intermediate data engineers as needed • Perform data analysis and provide insights to support decision-making across various departments • Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed
Job Requirements
- 5 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems
- 5 years of experience in a data engineering, ETL development, or data management role.
- 5 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).
- 5 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery)
- 7+ years of experience in designing, developing, and meticulously implementing robust data solutions, encompassing sophisticated structuring and transformation of data from diverse, complex source systems.
- 7+ years of experience in producing high-quality, efficient, and maintainable data-related code that underpins critical stakeholder applications.
- 7+ years of experience working across a multitude of technology systems, consistently designing innovative solutions or developing impactful data solutions specifically within the complex healthcare or insurance industry.
- 7+ years of experience in strategically translating intricate business requirements, design mockups, prototypes, and user stories into precise technical designs and highly impactful, scalable data solutions.
- 7+ years of experience with both SQL and Python, utilizing these languages for sophisticated data manipulation, advanced analytical insights, and the development of resilient data pipelines.
- 5+ years of experience leveraging core GCP data services, including BigQuery, DataFlow, Cloud Composer (Managed Airflow), DataProc, and Cloud Run, optimizing their use for cloud-native data architectures.
- 5+ years of experience with traditional on-premise database systems, including Oracle, Teradata, and DB2, bridging legacy and modern data landscapes.
- 5+ years of experience operating within Unix/Linux environments, including scripting and system-level data operations.
- Holds practical experience with dbt (data build tool) for advanced data transformation and the development of sophisticated analytical data models.
- Experienced with cutting-edge data virtualization tools such as Starburst (Trino) or other composable data platforms, enabling unified access to distributed data assets.
- Skilled in leveraging advanced data quality engines (e.g., Monte Carlo, Soda) to ensure proactive data observability, integrity, and reliability across the data landscape.
- Familiar with sophisticated data catalog systems (e.g., Atlan, Collibra) for comprehensive metadata management, discovery, and robust data governance.
- Holds practical experience with Lakehouse technologies and modern open table formats (e.g., Apache Iceberg, Delta Lake), contributing to scalable and flexible data architectures.
Benefits
- None specified
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
First Help FinancialWe provide auto loans to the underserved and care for our customers and partners with exceptional service.
Role Description First Help Financial, recently voted as a "Great Place to Work" for the fifth year in a row, is seeking a Senior Data Engineer to join our highly skilled and innovative team. First Help Financial is embarking on a new growth phase involving multiple game-changing projects. What you will do: - Lead data engineering delivery to build reliable, scalable pipeline leveraging Snowflake, Sigma and other applications to support complex data analytics and self-service reporting. - Drive integration with popular tools and services in the broader data warehousing ecosystem. - Optimize architectural performance across the Data stack by refining execution parameters and enforcing best practice strategies to maximize resource efficiency and throughput. - Establish and evolve a data governance operating model across data quality, lineage, metadata management, stewardship, cataloging, and lifecycle management. - Perform advanced code-level analysis and resource profiling to identify and mitigate systemic root causes, ensuring the stability and reliability of high-scale production workloads. - Coordinate with internal stakeholders to ensure effective communication, issue resolution, and on-time delivery of projects. - Participate in weekend and weekday on call rotation. Qualifications - 8+ years of experience in designing, building, testing, and maintaining data pipelines and data platforms. - 5 years of hands-on experience as a technical lead on a Data Engineering team, serving as the go-to person to resolve critical issues. - Expertise in SQL databases or data warehouses (such as Oracle, SQL Server, MySQL, Postgres and AWS RDS) and ETL technologies (such as Rivery, Informatica, DataStage, Talend, Fivetran). - Strong knowledge of data architecture, distributed processing, data modeling, and platform reliability engineering. - Hands-on experience with modern data warehouse and cloud data platform architectures including AWS and Snowflake. - Experience establishing and operating enterprise data governance capabilities, including data quality, lineage, metadata, and stewardship practices. - Demonstrable mastery of AI tools to enhance productivity and efficiency in daily tasks is a plus. - Working experience in financial services, especially auto finance and lending is preferred. - Proven ability to influence cross-functionally, such as with internal stakeholders or engineering teams. - Expert level knowledge in Python is desired. - Self-motivated and proactive, with a strong ability to identify issues and challenge the status quo. - Degree in Computer Science or related field/experience. Benefits - Great Perks – We offer generous salaries, social activities, monthly lunches, and a robust employee recognition and talent development program to enhance your career with us. - Culture - We are believers in maintaining a healthy work-life balance. While we work hard and care deeply about our customers and partners, we want you to have room for your family, friends, and yourself. - Growth - Company growth provides unprecedented career growth. FHF’s extraordinary year over year growth in revenue and new markets provides opportunity for you to establish and develop your career growth. We engage each employee to build a career plan that benefits everyone, and we have a proven record of investing in you. - Diversity and Inclusion - FHF is committed to building a culture that respects and embraces all walks of life, inclusive of all genders, race, culture, age, sexual orientation, and other identities. We will make accommodations when interviewing anyone with special needs.
Conversational Data Collection Associate (Audio Recording) - Swiss/Austrian Ger
Volga PartnersSmart and Reliable Technology Solutions
Role Description We are looking for individuals to record natural conversations using provided scripts. You will work with a partner and play a specific role (such as Customer or Support Agent). The goal is to create clear, natural-sounding audio recordings by following simple instructions. This project involves recording natural conversations based on customer support scenarios. Depending on the assignment, recordings may be completed individually or with a partner, with roles such as Customer or Support Agent. - Verifying account details - Solving basic technical issues - Explaining simple policies This project involves recording approximately 1 hour of natural audio conversations based on provided prompts and instructions. Participants may be asked to record in one or two languages, depending on the assignment. All recordings must be completed in a quiet, noise-free environment to ensure audio quality. Qualifications - Strong communication skills in required language(s) - Ability to follow instructions - Attention to detail - Willingness to work with a partner - Ability to meet deadlines Requirements - Speak naturally (like a real conversation, not robotic) - Follow all instructions carefully - Ensure clear audio with no background noise - Be available to re-record if needed - Computer or laptop with internet access - Working microphone - Basic knowledge of: - Google Sheets - Google Drive - Zencastr - Ability to download, rename, and upload files Benefits - You will be paid for up to 1 hour per assignment, based on approved work. - Payment depends on audio quality and following instructions. - Work that does not meet quality standards may be rejected or require re-recording. - Payment is processed after successful quality review. - $75 USD per hour. Agreement & Acknowledgement Selected participants will be required to sign an agreement and acknowledgement form confirming: - Understanding of the task and instructions - Acceptance of quality and payment terms - Consent to use of recorded data for the project Must be residing in Italy, Switzerland, or Austria.
Conversational Data Collection Associate (Audio Recording)
Volga PartnersSmart and Reliable Technology Solutions
Role Description We are looking for individuals to record natural conversations using provided scripts. You will work with a partner and play a specific role (such as Customer or Support Agent). The goal is to create clear, natural-sounding audio recordings by following simple instructions. This project involves recording natural conversations based on customer support scenarios. Depending on the assignment, recordings may be completed individually or with a partner, with roles such as Customer or Support Agent. - Verifying account details - Solving basic technical issues - Explaining simple policies This project involves recording approximately 1 hour of natural audio conversations based on provided prompts and instructions. Participants may be asked to record in one or two languages, depending on the assignment. All recordings must be completed in a quiet, noise-free environment to ensure audio quality. Qualifications - Strong communication skills in required language(s) - Ability to follow instructions - Attention to detail - Willingness to work with a partner - Ability to meet deadlines Requirements - Speak naturally (like a real conversation, not robotic) - Follow all instructions carefully - Ensure clear audio with no background noise - Be available to re-record if needed Technical Requirements - Computer or laptop with internet access - Working microphone - Basic knowledge of: - Google Sheets - Google Drive - Zencastr - Ability to download, rename, and upload files Payment - You will be paid for up to 1 hour per assignment, based on approved work. - Payment depends on audio quality and following instructions. - Work that does not meet quality standards may be rejected or require re-recording. - Payment is processed after successful quality review. - $45 USD per hour. Agreement & Acknowledgement - Selected participants will be required to sign an agreement and acknowledgement form confirming: - Understanding of the task and instructions - Acceptance of quality and payment terms - Consent to use of recorded data for the project - Must be residing in Spain or France.
• Operate and evolve the Data Lake: work with data in its Raw, Processed and Refined zones, including deduplication processes, cataloging and storage optimization (Parquet, Iceberg). • Operate and monitor streaming pipelines via Kafka: create topics, connectors, ACLs, credentials and monitor consumer lag for real-time streaming pipelines. • Contribute to the evolution of the Data Platform API: create and maintain modules of our platform that abstract ingestion processes for users and developers (which may be via files, CDC or data streaming), data processing on Big Data platforms (Spark / Redshift) and pipeline orchestration (Airflow). • Investigate and resolve incidents: interpret failures in pipelines, dataset loads, data duplication and cluster errors, and assist in incident resolution. • Use and contribute to Infrastructure as Code (IaC): use Terraform and operate AWS resources under team guidance. • Participate in modernization and integration initiatives with AI tools: use LLMs to build agents and create tools that integrate AI into our systems (MCP Servers). • Documentation and monitoring maintenance: contribute to technical documentation of our tools and architecture. Maintain our observability tools.



