Kemper logo
Kemper

Affordable protection in an ever-changing world.

Principal Data Engineer

Data EngineerData EngineerFull TimeRemoteLeadTeam 5,001-10,000Since 1912H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

20 days ago

Salary

$111.9K - $186.7K / year

Seniority

Lead

Job Description

Principal Data Engineer

Kemper

Role Description The Principal Data Engineer serves as a senior technical leader responsible for architecting, developing, and governing enterprise-scale data platforms, pipelines, and analytics solutions. This role provides hands-on technical leadership across data engineering initiatives, cloud modernization efforts, real-time integrations, and enterprise data strategy. The ideal candidate combines deep expertise in modern data engineering technologies with strong leadership capabilities to guide engineering teams, establish best practices, and deliver scalable, secure, and high-performing data solutions that support analytics, reporting, AI/ML, and operational business functions. Position Responsibilities - Enterprise Data Architecture & Engineering: - Design, development, and optimize enterprise-scale data pipelines and integration frameworks supporting analytics, reporting, operational, and AI/ML workloads. - Architect scalable data lake, warehouse, and real-time streaming solutions using cloud-native technologies. - Design and maintain logical and physical data models aligned with enterprise architecture standards and normalization best practices. - Build robust ingestion, transformation, orchestration, and delivery pipelines across structured and semi-structured data sources. - Architect cross-functional data solutions that integrate data from core insurance systems (e.g., policy admin, claims, billing, CRM) and third-party sources. - Technical Leadership: - Serve as the technical lead for data engineering initiatives and provide architectural guidance across engineering teams. - Mentor and coach junior and mid-level engineers while promoting engineering excellence and continuous improvement. - Establish best practices for coding standards, CI/CD, infrastructure as code, monitoring, observability, and operational support. - Lead design reviews, technical solutioning sessions, and enterprise architecture discussions. - Cloud & Platform Engineering: - Develop cloud-native data solutions using AWS, Azure, and modern data platforms including Snowflake, Spark, Kafka, Airflow, Glue, and related technologies. - Drive modernization initiatives involving hybrid-cloud and multi-cloud architectures. - Build reusable frameworks and automation solutions to improve scalability, reliability, and engineering productivity. - Data Integration & Processing: - Integrate enterprise data from core operational systems, third-party vendors, APIs, and streaming platforms. - Develop and optimize ETL/ELT pipelines using SQL, Informatica/IICS, Python, Spark, and cloud-native processing tools. - Ensure high-performance query optimization, workload tuning, and efficient data processing across enterprise platforms. - Governance, Security & Compliance: - Ensure compliance with enterprise security standards, governance policies, and regulatory requirements including HIPAA, SOX, GDPR, and NAIC standards applicable. - Implement data quality, metadata management, lineage, auditing, and observability capabilities. - Partner with cybersecurity, governance, and compliance teams to enforce secure and compliant data engineering practices. - Leadership & Collaboration: - Collaborate with architects, analysts, actuaries, data scientists, developers, and business stakeholders to deliver scalable and trusted data solutions. - Translate complex business requirements into enterprise data architectures and engineering solutions. - Support strategic initiatives including underwriting analytics, claims automation, customer analytics, and regulatory reporting. - Provide technical mentorship and architectural oversight to junior and mid-level engineers across teams. Qualifications - 10+ years of experience in data engineering, data architecture, or software engineering. - Expert-level experience with SQL, Python, Snowflake, and enterprise ETL/ELT frameworks. - Hands-on experience with cloud-native data engineering tools and platforms (e.g., AWS Glue, S3, Snowflake, Kafka, Airflow). - Proven experience leading large-scale enterprise data initiatives and mentoring engineering teams. - Strong understanding of data governance, security, scalability, and performance optimization. - Experience working in regulated industries and understanding data privacy, security, and compliance frameworks. - Strong understanding of insurance industry data (especially P&C and Life domains), including data from policy admin systems (e.g., Guidewire, Life/400), claims platforms, and actuarial models. - Insurance industry experience (P&C and/or Life) preferred. - Experience with real-time streaming and event-driven architecture a plus. - Experience in Spark, Kafka, Airflow, DBT, and Infrastructure as Code frameworks preferred. - Familiarity with DevOps and CI/CD pipelines for data engineering platforms. - Experience in working with IDMC/IICS or DBT a plus. - Experience in Data warehousing with Data vault 2.0 preferred. - Knowledge of Git for version control and collaboration. - Bachelor’s or master’s degree in computer science, Engineering, Information Systems, Data Science, or related fields or equivalent work experience. Requirements - This position can be worked hybrid out of a local Kemper office, including Chicago or Downers Grove, IL. Remote working arrangements may be available to non-local candidates. - Sponsorship is not accepted for this opportunity. - The range for this position is $111,900 to $186,700. When determining candidate offers, we consider experience, skills, education, certifications, and geographic location among other factors. - This job is eligible for an annual discretionary bonus and Kemper benefits (Medical, Dental, Vision, PTO, 401k, etc.). Benefits - Medical, Dental, Vision - PTO - 401k Company Description Kemper is one of the nation’s leading specialized insurers. Our success is a direct reflection of the talented and diverse people who make a positive difference in the lives of our customers every day. We believe a high-performing culture, valuable opportunities for personal development and professional challenge, and a healthy work-life balance can be highly motivating and productive. Kemper’s products and services are making a real difference to our customers, who have unique and evolving needs. By joining our team, you are helping to provide an experience to our stakeholders that delivers on our promises.

Related Categories

Related Job Pages

More Data Engineer Jobs

Machinify logo

Staff Data Engineer – Core Migrations

Machinify

The future of payment integrity.

Data Engineer20 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

• Lead discovery & technical due diligence — get to the bottom of poorly documented legacy systems (ETL, stored procedures, reporting layers, file feeds), reconstruct the business logic, and capture it in the lineage maps, mapping specs, and risk analyses everyone builds from. • Reverse-engineer complex legacy systems using agents— you will be responsible for reverse-engineering complex, undocumented legacy systems (SSIS packages, stored procedures) where business logic is embedded, not documented. You must be able to reconstruct the intent of these systems to build modern, stable equivalents. • Drive ambiguity to resolution — spot the unknowns early, own the open questions, and pull answers from clients, SMEs, and Operations instead of waiting to be unblocked. • Architect & build the migration pipelines — turn intricate legacy logic into production-grade Airflow DAGs and Spark jobs on the Machinify platform, edge cases, payer-specific carve-outs, and business-rule exceptions included, owning the full flow from ingestion through reconciliation to steady-state handoff. • Make and document the hard architectural calls — own the decisions that matter (pipeline design, partitioning strategy, validation approach) and leave a clear trail of the reasoning so others can learn from and build on it. • Prove correctness at scale — build automated reconciliation frameworks that confirm, with confidence, that migrated output matches the source down to the row. • Own the program end to end — be the single technical owner from kickoff through go-live and hypercare: scope, sequence, and track the work, surface risks before they bite, align Operations, Client Success, Platform Engineering, SMEs, and the client, and drive UAT through to sign-off. • Raise the bar for the practice — Institutionalize migration knowledge by codifying runbooks and retrospectives, mentor L3/L4 engineers to build independent capability, and turn recurring migration pain points into scalable, reusable tooling.

United States
$180K - $220K / year
Versant logo

Senior Data Engineer - AWS Data Platform

Versant

VERSANT is a leading force in news, sports and entertainment - home to iconic and trusted brands that inspire, inform, and delight audiences. Our unique combination of content, technology and services enriches the cultural fabric, igniting passions, sparking conversations, and connecting people to what they love most. As an independent, publicly traded company, VERSANT brings together powerhouse cable networks - including USA Network, CNBC, MS NOW (formerly MSNBC), Oxygen, E!, SYFY, and Golf Channel - with dynamic digital and direct-to-consumer brands such as Fandango, Rotten Tomatoes, GolfNow, GolfPass, and SportsEngine. Together, these businesses reflect our commitment to delivering exceptional experiences across every screen and service. VERSANT is an industry-changing media company fueled by innovation and an entrepreneurial spirit. With a strong foundation and a forward-looking vision, VERSANT empowers creativity, embraces change, and drives connection in an ever-evolving world.

Data Engineer20 days ago

Role Description This opportunity is within our Fandango group – a collection of trusted entertainment brands that guide over 50 million movie and TV fans throughout their viewing journey. Our platforms help audiences find, watch, and enjoy content with ease. Our team thrives on shaping how people discover and experience entertainment, one screen at a time. - Design and develop data pipelines, data marts, and schemas to support our data warehousing environments and analytical requirements. - Database architecture and design of data warehouses & data marts to support presentation layers, elastic cubes, reporting, and analytics. - Hands-on experience with T-SQL or PSQL development, query tuning, table development, stored procedures, functions. - Hands-on experience with creating indexes to enhance performance of workloads. - Hands-on experience with development of ETL/ELT processes; share responsibilities for monitoring the data warehouse and data marts. - Hands-on development and support of data pipelines in Airflow, AWS Glue, Azure Data Factory, Python, Golang. - Hands-on experience with cloud environments: Azure, AWS, GCP. - Troubleshoot and resolve data issues in production systems. - Communicate with business users and project managers to resolve business problems and create solutions. - Use technical experience to suggest better solutions to new and existing problems. - Involvement with other IT departments providing systems communication processes. - Meet with various IT groups to address issues/concerns, including other business unit IT groups and the technical operations group. - Mentor other Data Engineers. - Identify software solutions needed for new projects. - Weekly reporting to management on project status and issues. - On-call production support. Qualifications - 7+ years of data warehousing / OLAP experience. - 7+ years multidimensional database architecture and design experience. - 5+ years of SQL Experience. - 3+ years of Python Experience. - 2+ years of Redshift Experience. - 2+ years of NoSQL Experience. - Team and vendor partner management. - Clear understanding of principles and techniques of Web development. - Experience with AWS Glue and Airflow. - Experience with API. - Dimensional database architecture experience. - Formal systems life cycle methodology experience. Requirements - Cloud Data Warehouse operations experience. - Tableau, SSRS, big data and Realtime BI experience. - Experience with data streaming. Benefits - This position has been designated as fully remote, meaning that the position is expected to contribute from a non-Versant worksite, most commonly an employee’s residence.

United States
MediaRadar, Inc. logo

Senior Data Engineer

MediaRadar, Inc.

Sales enablement platforms customized for media, and ad tech companies that help you close more deals.

Data Engineer20 days ago
Full TimeRemoteTeam 201-500Since 2007H1B No Sponsor

• We are looking for a highly technical, hands-on Senior Data Engineer to drive the evolution of our data delivery platform while leading a team of data engineers. • This is a player-coach role: you will architect our next-generation data stack, build proofs-of-concept (POCs), and prove out new technologies before we commit to them at scale — and you will also manage and grow a team of engineers who report directly to you. • You will partner closely with engineering leadership to shape the technical direction of our pipelines while staying hands-on in the systems yourself • We are deliberately moving away from a locked-in, vendor-heavy stack toward a flexible, largely open-source architecture that keeps our options open. • We also expect our engineers to work in a modern, AI-assisted way — using AI coding tools and prompt-based workflows to move faster without compromising quality. • You should be energized by evaluating tools, building POCs, and making pragmatic, evidence-based decisions about what we adopt next. • This is a build-and-prove role — you are expected to write code, design schemas, profile queries, and get into the details to understand the "how" and "why" behind every pipeline, while also mentoring your team to do the same.

United States
PwC logo

Data Engineer

PwC

Build what’s next — with tech that matters PwC provides professional services across Audit and Assurance, Advisory and Tax — powered by a global network of over 370,000 people in 149 countries. You may know us for our business expertise, but technology is core to how we help clients move faster, build trust and deliver meaningful outcomes. As a technologist, you’ll work on agile teams with experienced engineers and product thinkers — using AI, cloud, cybersecurity and more to design scalable, real-world solutions. You’ll keep learning, stay challenged and be part of a network where your growth is built in — and your work drives what’s next.

Data Engineer20 days ago
Full TimeRemoteTeam 10,001+Since 1998H1B Sponsor

• You will design, build and maintain scalable, reliable data pipelines and data platforms supporting analytical and reporting solutions • You will work on end-to-end data engineering solutions – from data ingestion, through transformation and storage, to serving curated datasets for analytics and reporting • You will develop and optimize ETL / ELT pipelines using Databricks (Apache Spark, SQL, Python) and Delta Lake technologies • You will be responsible for data modelling, data structures and performance optimization in analytical data stores (lakehouse / data warehouse) • You will implement and maintain data quality, data validation and monitoring mechanisms ensuring accuracy, consistency and reliability of processed data • You will collaborate closely with data analysts, BI developers and business stakeholders to translate business and regulatory requirements into robust technical solutions • You will contribute to architecture decisions related to data platforms, data processing patterns and technology choices • You will support and mentor junior data engineers, helping them grow their technical and consulting competencies • You will actively participate in client-facing work – discussing requirements, presenting solutions and explaining technical concepts in an accessible way • In addition to project work, you will keep up with latest data engineering, cloud and Anti Financial Crime trends and contribute to internal initiatives and accelerators.

Poland