Total Performance Consulting

Your partner for AI, consulting, software development, and nearshore staffing.

Senior Data Engineer

Location

United States

Posted

14 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Total Performance Consulting

Role Description Own the data platform end-to-end on Azure Databricks, partner with business teams, and ship AI-ready solutions that impact physician growth and member services. The data engineer role is changing. The traditional pattern — build a pipeline, hand it off, wait for someone else to figure out if the data is right—doesn’t work anymore. The engineers who create the most value now are the ones who go deep into the business domain, understand the problem firsthand, and use AI tools to move from question to working solution in hours instead of sprints. MDVIP’s Analytics team is looking for a Senior Data Engineer who operates as a hybrid technical product owner: - Builds and maintains the data platform on Azure Databricks. - Sits with business stakeholders, interrogates the problem, and owns the outcome end-to-end. - Finds, validates requirements, and ships the solution using Claude Code and agentic development patterns. This is what it means to shift the engineer left into the business domain. You’re not a pipeline builder waiting for a ticket. You’re the person who understands how physician network growth, member engagement, and operational performance actually work—and who builds the data infrastructure that makes the entire Analytics team faster, sharper, and more impactful. Qualifications - BS in Computer Science, Data Science, or related field; 6+ years in data engineering or a hybrid data engineering/analytics role. - Deep hands-on experience with Azure Databricks—notebooks, Delta Lake, Unity Catalog, and production-scale pipelines. - Strong Python and SQL; experience with PySpark and distributed data processing. - Built and operated data pipelines that serve analytics, ML models, and operational systems—not just batch ETL jobs. - Worked directly with business stakeholders to define requirements, shape data products, and deliver measurable outcomes. - Active, daily use of AI coding tools (Claude Code, Copilot, or similar) as a force multiplier. - Strong communication skills with a track record of presenting technical work to non-technical audiences. Requirements - Own the Data Platform: - Design, build, and operate MDVIP’s data platform on Azure Databricks—ingestion, transformation, storage, and serving layers that power analytics, AI models, and operational reporting. - Build and maintain data pipelines across MDVIP’s ecosystem: Salesforce, SQL Server, Snowflake, third-party sources, and the new cloud-native payments platform. - Engineer for quality and trust—validation checks, anomaly detection, lineage tracking, and documentation that ensure every downstream consumer can rely on the data. - Write clean, version-controlled, production-grade code. - Go Deep Into the Business Domain: - Partner directly with business stakeholders across physician growth, member services, finance, and operations to understand how data drives decisions. - Act as a technical product owner for your domain areas: own the backlog, prioritize based on business impact, and ship iteratively. - Translate ambiguous business questions into data models, feature tables, and curated datasets. - Close the loop — follow your data through to the dashboard, the model, or the operational workflow and validate that it’s actually driving the outcome. - Drive AI-First Engineering Practices: - Use Claude Code and agentic development as your primary workflow. - Build data infrastructure that is AI-ready: well-documented, semantically clear, and structured for AI tools and agents. - Scout, evaluate, and adopt emerging AI tools and platforms. - Share what you learn. Document patterns, run demos, and help the broader team adopt AI-first workflows with confidence. Benefits - Remote: fully - Location: Milton

Related Categories

Related Job Pages

More Data Engineer Jobs

Mediavine logo

Data Engineer II

Mediavine

Mediavine is a leading programmatic ad tech partner helping independent publishers build sustainable businesses

Data Engineer14 days ago
Full TimeRemoteTeam 201-500Since 2004H1B No Sponsor

Role Description The Data & Analytics team consists of data analysts, data engineers, and analytics engineers working to build the most effective platform and tools to help uncover opportunities and make decisions with data here at Mediavine. A Data Engineer at Mediavine will help build and maintain our data infrastructure, including: - Building scalable data pipelines - Managing transformation processes - Ensuring data quality and security at all steps - Writing and maintaining code in Python and SQL - Developing on AWS - Selecting and using third-party tools like Rundeck, Metabase, and others Essential Responsibilities include: - Create data pipelines that make data available for analytic and application use cases - Develop self-healing, resilient processes - Create meaningful data quality notifications - Lead projects from a technical standpoint, creating project Technical Design Documents - Support data analysts and analytics engineers - Participate in code reviews - Build or implement tooling around data quality, governance, and lineage - Provide next-level support for data issues - Work with data analysts and analytics engineers to standardize transformation logic - Enable analytics engineers and data analysts by providing data modeling guidance Qualifications - 3+ years of experience in a data engineering role - Strong Python skills (understands tradeoffs, optimization, etc.) - Strong SQL skills (CTEs, window functions, optimization) - Experience working in cloud environments (AWS preferred, GCS, Azure) - Experience managing complex dbt environments with hundreds or more flows - Understanding of how to best structure data for analytics - Familiarity with calling APIs to retrieve data - Experience working with DevOps to deploy, scale, and monitor data infrastructure - Scheduler experience either traditional or DAG based - Experience using LM-powered tools for code generation, documentation, and architectural diagramming - Comfortable working with multi-TB cloud data warehouses (Snowflake preferred) - Experience with other DBMS systems (Postgres in particular) - Ability to travel up to approx 15% Requirements - Experience with web analysis such as creating data structures that support product funnels, user behavior, and decision path analysis - Understanding of Snowflake external stages, file formats, and snowpipe - Experience managing the semantic layer in either dbt or Snowflake - Experience with orchestration tools across different technologies and stacks - Knowledge of Ad Tech, Google Ad Manager - The ability to make your teammates laugh - Familiarity with event tracking systems (Snowplow, etc.) - Experience with one or more major BI tools (Omni, Sigma, Metabase, etc.) Benefits - 100% remote - Comprehensive benefits including Medical, Dental, Vision, Disability, and Life Insurance - 401(k) with company matching - Generous PTO - Wellness initiatives and employer-sponsored mental health resources - Professional development opportunities - Inclusive, collaborative, and entrepreneurial company culture

United States
Flowon - Gamification Lab logo

BI, Big Data, Data Warehouse Instructor – Google BigQuery

Flowon - Gamification Lab

The commotion power of games directed to solve problems.

Data Engineer14 days ago
Part TimeRemoteTeam 1-10Since 2018H1B No Sponsor

• Deliver live, remote classes and mentor students, answering questions and providing feedback on assignments and projects. • Analyze and contrast architectures of transactional systems and decision-support systems, optimizing the flow of information for corporate analytics. • Develop Business Intelligence projects, identifying key convergences and divergences with Big Data initiatives to create scalable data strategies. • Manage the full lifecycle of Business Intelligence projects, from data ingestion to strategic visualization. • Design and operationalize Data Warehouses on Google BigQuery, applying storage and processing techniques to generate high-performance insights.

Brazil
R$1.9K - R$2.3K / month
Avenga logo

Senior Data Engineer

Avenga

A global IT engineering and consulting company specializing in custom software development.

Data Engineer14 days ago
Full TimeRemoteTeam 5,001-10,000H1B No Sponsor

• Technical analysis and documentation of complex data flows and system architectures in a payments processing environment • Creation and maintenance of data mappings between source and target systems in distributed Big Data environments • Close collaboration with business and IT departments for requirements gathering and implementation • Development and optimization of data pipelines using Spark-Scala and SQL on Google Cloud Platform • Modelling and implementation of Dataform transformations and integration into existing cloud architectures • Management and monitoring of batch processes via automation tools (UC4) • Independent execution of testing and quality assurance activities • Preparation of status reports and presentation of results to stakeholders • Active participation in agile team ceremonies and Scrum processes

Bulgaria

Title: Electronic Data Interchange Coordinator Location: Concord United States Job Description: Northeast Delta Dental in Concord, NH is seeking to hire a full-time, remote, Electronic Data Interchange (EDI) Coordinator who will provide accurate, secure, and expedited enrollment for employer groups and Third-Party Administrators (TPAs). Our EDI Coordinator position earns a competitive salary at $24.00 - $25.00/hour depending on experience. We provide fantastic benefits including health, life, dental, vision, short-term disability (STD), long-term disability (LTD), paid time off (PTO), paid holidays, a 401(k) plan, an independent retirement advisor, an employee assistance program, a tuition reimbursement program, and more! If this sounds like the right opportunity for you, apply today! ABOUT NORTHEAST DELTA DENTAL: Northeast Delta Dental - a nonprofit member of Delta Dental Plans Association (DDPA) - is the region's most trusted name in dental insurance for companies, individuals, and families throughout Maine, New Hampshire, and Vermont. A DAY IN THE LIFE OF AN EDI COORDINATOR: - Promotes accurate electronic file feeds by educating and training employer groups and TPAs about file formatting and requirements. - Implements electronic group enrollments by receiving and entering eligibility records into the custom enterprise system. Updates current records as needed. - Reviews enrollment data for accuracy by comparing and analyzing error reports and performing audits. Collaborates with TPAs and employer groups to reconcile discrepancies and update records. - Improves claims adjudication by performing scenario testing, researching errors, and updating enrollment data in the custom enterprise system. - Provides excellent customer service to employer groups by processing electronic eligibility files accurately and in a timely fashion; answering calls, and responding to email inquiries. - Provides training, guidance, and information on electronic enrollment by maintaining and enhancing knowledge about the process and rules around setting up and receiving 834 transactions, electronic enrollment files, the subscriber benefit administration tool, and eligibility modules in the custom enterprise system. - Maintains accurate process and procedure reference guides by documenting, reviewing, and updating department manuals, training materials, and related documentation. THE EXPERTISE AND SKILLS YOU WILL BRING: - Associates Degree in Business, Computer Science, or related field, plus at least two years of progressively responsible eligibility or enrollment experience or an equivalent combination of training, education, and/or experience. - Must be proficient in the use of the Microsoft Office suite. Experience with online enrollment tools, electronic enrollment file formats, and the Health Insurance Marketplace preferred. - Must be authorized to work for any employer in the United States without sponsorship now and in the future. WORK SCHEDULE: The typical work schedule for this position is Monday - Friday, 8:00 a.m. - 4:00 p.m. All candidates must be authorized to work for any employer in the United States without sponsorship now and in the future. Northeast Delta Dental is proud to be an equal opportunity employer. IF YOU ARE READY TO JOIN OUR TEAM ~ APPLY TODAY! Location: 03301

New Hampshire
$24 - $25 / hour