Highmark Health logo
Highmark Health

Creating remarkable health experiences, freeing people to be their best.

Senior Data Engineer

Data EngineerData EngineerOtherRemoteSeniorTeam 10,001+Since 1852H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

78 days ago

Salary

$78.9K - $147K / year

Seniority

Senior

No structured requirement data.

Job Description

Senior Data Engineer

Highmark Health

Company : enGenJob Description : JOB SUMMARY This role is an integral senior member of a technical team, responsible for supporting the design, development, and maintenance of the organization's data infrastructure, ensuring the efficient and reliable flow of data across various systems. This position is responsible for ensuring the reliable movement, transformation, and storage of data across various platforms. The incumbent will work closely with data professionals, analysts, and engineers to build and optimize data pipelines, ensuring data quality and integrity. The ideal candidate is adaptable, solution-oriented, and capable of collaborating across multiple teams to support a broad range of data initiatives. The incumbent and team will be involved in every aspect of the data process, from idea generation, analysis, design, build, and support, using the latest technologies and design patterns. ESSENTIAL RESPONSIBILITIES - Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems - Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs - Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs - Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly - Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations. - Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking - Mentor other associate and intermediate data engineers as needed - Perform data analysis and provide insights to support decision-making across various departments - Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed - Other duties as assigned or requested. EXPERIENCE Required - 5 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems - 5 years of experience in a data engineering, ETL development, or data management role. - 5 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB). - 5 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery) Preferred - 7 years of experience with data pipeline and workflow management tools (e.g., Apache Airflow, AWS Glue, Azure Data Factory). - 7 years of experience defining system architectures and exploring technical feasibility trade-offs for optimizing short term execution while planning for long term technical capabilities - 7 years of experience working with a variety of technology systems, designing solutions or developing data solutions in healthcare - 7 years of experience with cloud platforms (AWS, Azure, GCP) and their respective data services - 7 years of experience in data governance, data quality, and data security best practices - 7 years of experience translating requirements, design mockups, prototypes or user stories into technical designs - 7 years of experience in producing data-related code that is fault-tolerant, efficient, and maintainable SKILLS - Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment - Adaptability: Strong ability to take on diverse tasks and projects, adapting to the evolving needs of the organization - Analytical Thinking: Strong analytical skills with a focus on detail and accuracy - Interest and ability to learn other data development technologies/languages as needed - Technical Proficiency: Comfortable with a range of data tools and technologies, with a willingness to learn new skills as needed - Strong track record in designing and implementing large-scale data sources - Strong sense of ownership, urgency, and drive - Demonstrated passion for user experience and improving usability - Team Collaboration: A team player who can work effectively in cross-functional environments - Experience and willingness to mentor junior data engineers and help develop their skills and leadership EDUCATION Required - Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field Preferred - Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field LICENSES or CERTIFICATIONS Required - None Preferred - None Language (Other than English): None Travel Requirement: 0% - 25% PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS Position Type Office- or Remote-based Teaches / trains others Occasionally Travel from the office to various work sites or from site-to-site Rarely Works primarily out-of-the office selling products/services (sales employees) Never Physical work site required No Lifting: up to 10 pounds Constantly Lifting: 10 to 25 pounds Occasionally Lifting: 25 to 50 pounds Rarely Disclaimer: The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job. Compliance Requirement: This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies. As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company’s Handbook of Privacy Policies and Practices and Information Security Policy. Furthermore, it is every employee’s responsibility to comply with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements. Pay Range Minimum: $78,900.00 Pay Range Maximum: $147,500.00 Base pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets. Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law. We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below. For accommodation requests, please contact HR Services Online at HRServices@highmarkhealth.org California Consumer Privacy Act Employees, Contractors, and Applicants Notice

Related Categories

Related Job Pages

More Data Engineer Jobs

Cushman & Wakefield logo

Lead Data Engineer

Cushman & Wakefield

Headquartered in Chicago, Illinois, Cushman & Wakefield is a privately-held, international real estate company serving developers, investors, lenders, and occup

Data Engineer78 days ago

• Helps architect and lead the development of enterprise-scale data platforms • Assist the project delivery team with scoping and planning integration projects • Contribute to the design, implementation, and support of data artifacts in the data lakehouse and databases • Collaborates with cross-functional stakeholders to translate business and technical requirements into scalable data solutions • Manage and mentor a small team of data engineers

California
$86.6K - $101.9K / year
NielsenIQ logo

Data Architect

NielsenIQ

NielsenIQ is an industry leader in data analytics and global measurement. The company delivers information to partners, retailers, and manufacturers through pow

Data Engineer78 days ago

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We are seeking a Data Architect to own and evolve the end-to-end architecture behind the Consumer Canvas platform. You will work across Snowflake, Databricks, identity systems, ingestion pipelines, and activation layers — ensuring our data is scalable, secure, privacy-compliant, and highly performant. You will partner closely with Data Engineering, Data Science, Machine Learning, and Product teams to build next-gen solutions that power the future of consumer insights and advertising activation. This is not a migration or maintenance role — it is a strategic influence position with the opportunity to architect new systems, components, and methodologies from the ground up. - Own the end-to-end architecture of the Consumer Canvas product. - Design systems across ingestion, identity spine creation, enrichment, governance, and activation workflows. - Collaborate with cross-functional partners (Data Scientists, ML Engineers, Data Engineers, Product Owners). - Define and enforce PII governance, privacy controls, and security best practices. - Translate complex business and technical requirements into scalable architecture. - Support technical teams with architectural guidance and model/structure design. - Participate directly in design, prototyping, and testing cycles within an Agile environment. - Act as a senior technical thought partner, providing mentorship (non-manager role). Qualifications - 5+ years of experience in Data Architecture or related technical leadership roles. - Hands-on experience with Snowflake (including Data Clean Rooms) and/or Databricks. - Strong SQL and experience with Python, PySpark, and Spark. - Proven experience working with PII data, privacy constraints, and governance frameworks (critical & non-negotiable). - Data modeling expertise (conceptual, logical, physical). - Experience designing scalable data pipelines and cloud-native architectures. - Strong communication skills and ability to influence cross-functional stakeholders. Requirements - Experience in Ad-Tech, Martech, Media, Consumer Data, or Identity Ecosystems (Nice-to-Have). - Familiarity with Medallion Architecture (Bronze/Silver/Gold) (Nice-to-Have). - Azure services (ADF, Azure Data Lake, Azure DevOps) (Nice-to-Have). - Containers & orchestration (Docker, Kubernetes) (Nice-to-Have). - Experience with audience activation platforms (e.g., Trade Desk, LiveRamp) (Nice-to-Have). Benefits - Flexible working environment. - Volunteer time off. - LinkedIn Learning. - Employee-Assistance-Program (EAP).

United States
$130K - $138K / year
Job Closed
Kong Inc. logo

Senior Data Engineer

Kong Inc.

The cloud connectivity company. Powering connections to build a reliable digital world.

Data Engineer78 days ago
OtherRemoteTeam 201-500Since 2017H1B No Sponsor

• Design, build, and maintain ETL/ELT pipelines using Fivetran + Snowflake integrations to ingest data from a variety of sources into our Snowflake data warehouse • Develop and manage robust data models in Snowflake, ensuring data is structured for performance, reliability, and ease of use by analysts and business stakeholders • Use Hightouch to operationalize data by syncing warehouse data to downstream CRM, marketing, and sales tools • Monitor pipeline health, troubleshoot data quality issues, and implement alerting to proactively catch failures • Document data models, pipelines, and lineage to support a culture of data literacy and self-service analytics • Integrate Claude and other LLMs directly with our Snowflake data warehouse, enabling AI-powered querying, summarization, and insight generation on top of live revenue data • Build and maintain data sources, semantic layers, and search services within Snowflake Cortex and connected AI platforms • Design and deploy AI agents that can reason over structured and unstructured revenue data to support go-to-market workflows • Architect and manage multi-step agent workflows, coordinating across tools, APIs, and data sources to automate complex analytical and operational tasks • Evaluate and implement orchestration frameworks (e.g., LangChain, LlamaIndex, or custom solutions) best suited to our use cases • Run rigorous evaluations of AI tools, models, and platforms to determine the best solution for each use case (e.g., Snowflake Cortex vs. Claude vs. Gemini vs. custom fine-tuned models) • Develop evaluation frameworks covering quality, latency, cost, and security to inform build vs. buy decisions and guide our overall AI roadmap • Stay current on the rapidly evolving AI landscape and proactively recommend new tools or approaches as the space matures • Implement and manage row-level security (RLS) in Snowflake to ensure AI tools only surface data that users are authorized to see • Maintain and evolve role-based access controls (RBAC) alongside new RLS policies • Contribute to data governance practices, including access controls, PII handling, and schema management • Partner with Data, Security, and Legal teams to establish AI data governance standards and guardrails • Monitor and manage AI credit consumption across Snowflake Cortex, API usage, and other platforms to keep spending within budget • Identify and implement optimizations — such as caching, prompt tuning, model selection, and query efficiency improvements — to reduce cost without sacrificing quality • Build reporting to give stakeholders visibility into AI spend and usage trends • Partner with Revenue Operations, Finance, and Sales to understand data needs and translate them into scalable engineering solutions • Collaborate across technical and non-technical teams to deliver data and AI solutions that directly influence revenue strategy

California
$125K - $175K / year
Job Closed
First Advantage logo

Data Engineer (US Remote)

First Advantage

Founded in 2003, First Advantage provides comprehensive background-check insights and solutions, enabling employers and housing providers to make confident choices, diminish risks,

Data Engineer78 days ago

At First Advantage (Nasdaq: FA), people are at the heart of everything we do. From our customers and partners to our greatest advantage — our team members. Operating with empathy and compassion, First Advantage fosters a global inclusive workforce devoted to the diverse voices that make up our talent and products. Our team members empower each other to be their authentic selves and treat all with respect, integrity, and fairness. Say hello to a rewarding career and come join a leading provider of mission-critical background screening solutions to some of the most recognized Fortune 100 and Global 500 brands. What We Do: We are on the frontline of recruitment enabling organizations to Hire Smarter. Onboard Faster™ First Advantage is an HR Tech company delivering innovative solutions and insights to enable our clients to manage risk and hire the best talent. Leveraging an advanced technology platform, First Advantage builds fully scalable, configurable screening programs that meet the unique needs of over 30,000 clients. Headquartered in Atlanta, GA and with an internationally distributed workforce spanning 17 countries with about 5,000 employees, First Advantage performs over 100 million screens in over 200 countries and territories annually. We are seeking a Data Engineer with solid Python/PySpark programming skills to join the Data Engineering Team and help us build the Data Analytics Platform in Azure cloud. Who You Are: You are self-motivated and ready to “roll up your sleeves." While you are an independent contributor, you are also collaborative. You can spearhead a project and see it through from start to completion. As a team player, you navigate cross-functional teams and work well with team members in other business units and departments toward a common goal. An Innovator — you see gaps in current processes or workflows as an opportunity to improve and try something new. A lifelong learner and always seeking out opportunities to learn and upskill, you understand the importance of thorough and secure screenings and are interested in the Human Capital sector and the confluence of people, process, and technology. What You'll Do: - Develop reusable, metadata-driven data pipelines - Automate and optimize any data platform related processes - Build integrations with data sources and data consumers - Add data transformation methods to shared ETL libraries - Write unit tests - Develop solutions for the Databricks data platform monitoring - Proactively resolve any performance or quality issues in ETL processes - Cooperate with infrastructure engineering team to set up cloud resources - Contribute to data platform wiki / documentation - Perform code reviews and ensures code quality - Initiate and implements improvements to the data platform architecture What You Need to be Successful: - Programming: Python/PySpark, SQL - Proficient in building robust data pipelines using Databricks Spark - Experienced in dealing with large and complex datasets - Knowledgeable about building data transformations modules organized as libraries (Python packages) - Familiar with Databricks Delta optimization techniques (partitioning, z-ordering, compaction, etc.) - Experienced in developing CI/CD pipelines - Experienced in leveraging event brokers (Kafka /Event Hubs / Kinesis) to integrate with data sources and data consumers - Understanding of basic networking concepts - Familiar with Agile Software Development methodologies (Scrum) Nice to Have Skills: - Understanding of stream processing challenges and familiarity with Spark Structured Streaming - Experience with IaC (Terraform, Bicep or other) - Experience running containerized applications (Azure Container Apps, Kubernetes) - Experience building event sourcing solutions - Familiarity with platforms for change data capture (e.g. Debezium) - Knowledge of Azure cloud native solutions (e.g. Azure Data Factory, Azure Function App, Azure Container Instances) Why First Advantage is Your Next Big Career Move First Advantage is going through a technology transformation! We are looking for experts who are excited to work with advanced technologies and provide best-in-class user experiences, drive the development and deployment of scalable solutions, and smoothly guide our agile teams and clients through meaningful changes as we continue to expand our impact. Additional benefits offered to our eligible people include: - Competitive benefits package, including health care, life insurance and Multisport, - Challenging projects. - Spacious, modern, and fully equipped office space in the heart of Krakow. - Flexibility and possibility to work remotely. - Superior co-working and personal development experience. What Are You Waiting For? Apply Today! You have learned a little about us today – we want to learn about you! If you think this position and our company are a great fit for your areas of interest and expertise, tell us about you by applying now! The base salary range for this position is approximately $75,000-90,000 annually plus there is additional opportunity for Variable Compensation. This range reflects our good faith estimate to pay fairly as to what our ideal candidates are likely to expect, and we tailor our offers within the range based on the selected candidate’s experience, industry knowledge, technical and communication skills, and other factors that may prove relevant during the interview process. United States Equal Opportunity Employment: First Advantage is proud to be a global leader in removing barriers and supporting our community members to ensure the changing demographics of the workforce are reflected in our hiring and employment practices. We value all of our candidates, employees, and clients, and place great emphasis on hiring and supporting qualified individuals in each role. We are an equal opportunity employer. We do not discriminate on the basis of race, color, ethnicity, ancestry, religion, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, veteran status, genetic information, or any other area protected by applicable law.

United States
$75K - $90K / year