Connecting the world’s health data to improve patient outcomes.
Senior Engineer – Ingestion & Streaming Frameworks
Location
United States
Posted
8 days ago
Salary
$150K - $190K / year
Seniority
Senior
Job Description
Senior Engineer – Ingestion & Streaming Frameworks
Datavant
• Design, build, and operate the ingestion frameworks that pull data from operational databases, vendor APIs, document streams, and third-party feeds into Snowflake, Iceberg, and Databricks • Own and evolve the ingestion stack (AWS DMS, MWAA / Airflow, Fivetran) and design new patterns for API sources • Build self-service tooling so product engineers can onboard new sources without becoming experts in our infrastructure • Write and review the Terraform behind our ingestion infrastructure • Partner with product, data, and analytics teams to pick the right ingestion pattern for each source and stand it up end-to-end • Lead production troubleshooting and incident response, and turn each incident into a durable platform fix • Raise the bar on engineering quality, observability, cost discipline, and security in everything the team ships • Mentor mid-career engineers and pull peers along through code review, pairing, and design feedback
Job Requirements
- 6+ years in data engineering, platform engineering, or data-focused software engineering
- 3+ years of hands-on AWS with real strength in networking (VPC, subnets, routing, PrivateLink, security groups), IAM (roles, policies, permission boundaries), and the data services this role touches
- 2+ years writing production Terraform or equivalent IaC
- 1+ years building self-service tooling, internal platforms, or paved-path frameworks
- Strong SQL skills and the ability to reason about how data physically lives in a warehouse or lake
- Production experience with Snowflake or an equivalent cloud data warehouse and a workflow orchestrator (Airflow / MWAA preferred)
- Hands-on experience with at least one ingestion approach: CDC tooling (DMS, Debezium), managed connectors (Fivetran, Airbyte), or rolling your own pipelines for API sources
- Solid CI/CD discipline in GitHub or equivalent
- AI-native working style: daily use of Claude Code, Cursor, Copilot, or equivalent
- Working knowledge of Python is expected; mastery isn’t the bar
- Clear written and verbal communication, especially in async, remote settings.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Senior Software Engineer
SciLeadsWe are the lead generation platform for science. Ranked number 10 in Deloitte's Technology Fast 50 Ireland 2023
• Ownership of the full software development life cycle. • Work with cloud base architecture focusing on scalability and performance. • Address data challenges by implementing robust data engineering practices. • Code quality reviews and team collaboration. • Adopt a customer-first approach: Maintain a strong focus on customer needs and be relentless about delivering value.
Software Developer, SME
MKS2 TechnologiesAustin-based SDVOSB delivering application development, cybersecurity, instructional design and training to DOD and VA.
• Provide support services for all aspects of the Reliability and Maintainability Information System (REMIS) software development process. • Ensure software development uses Agile methodologies, test-driven development principles, with robust documentation, user centered design, and an extensible infrastructure. • Maintain application software and COTS software. • Responsible for the design, coding, testing, quality assurance, deployment, software configuration management, and program documentation.
• Lead the analytics front and ensure the efficiency of the consumption layer; • Define development standards and best practices for Power BI; • Support the team of analysts in migrating reports from MicroStrategy to Power BI and in creating new reports; • Assist in analyzing technical requirements and producing documentation; • Validate data consistency between the Silver, Gold layers and the reports; • Serve as the technical link between the analytics team and the engineering team; • Conduct report publication processes in the production environment; • Ensure integration between Gold layers and analytical dashboards; • Monitor the quality and performance of reports and dashboards.
Role Description Provide support for maintaining the Delta 8 training database and other tracking systems via PEX. This also includes maintaining AF Form and training completion. - Experience with PEX – Patriot Excalibur is a must - RF, EM, and thermal simulation and modelling - Over 15 years of RF product development for performance-oriented applications - Systems-level understanding of RF front-ends - Architecture/requirement understanding from Antenna through the ADC - Space Payload electronics - TS/SCI Secret security clearance within 24 months of hire - Awareness of how Engineering contributes to Business achieving objectives - Risk Mitigation: ability to identify potential problems well in advance and determine appropriate risk mitigation Location can also be in Colorado, and Oxnard, California. Qualifications - Must have experience in Mission Design Series - Mission Qualification Training - Mission Task List - NIPR Non-Secure Internet Protocol Router Network Company Description




