Datavant logo
Datavant

Connecting the world’s health data to improve patient outcomes.

Senior Engineer – Ingestion & Streaming Frameworks

Full-stack EngineerSoftware EngineerFull TimeRemoteSeniorTeam 201-500Since 2017H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

8 days ago

Salary

$150K - $190K / year

Seniority

Senior

Bachelor Degree6 yrs expEnglishAirflowAWSCloudPythonSQLTerraform

Job Description

Senior Engineer – Ingestion & Streaming Frameworks

Datavant

• Design, build, and operate the ingestion frameworks that pull data from operational databases, vendor APIs, document streams, and third-party feeds into Snowflake, Iceberg, and Databricks • Own and evolve the ingestion stack (AWS DMS, MWAA / Airflow, Fivetran) and design new patterns for API sources • Build self-service tooling so product engineers can onboard new sources without becoming experts in our infrastructure • Write and review the Terraform behind our ingestion infrastructure • Partner with product, data, and analytics teams to pick the right ingestion pattern for each source and stand it up end-to-end • Lead production troubleshooting and incident response, and turn each incident into a durable platform fix • Raise the bar on engineering quality, observability, cost discipline, and security in everything the team ships • Mentor mid-career engineers and pull peers along through code review, pairing, and design feedback

Job Requirements

  • 6+ years in data engineering, platform engineering, or data-focused software engineering
  • 3+ years of hands-on AWS with real strength in networking (VPC, subnets, routing, PrivateLink, security groups), IAM (roles, policies, permission boundaries), and the data services this role touches
  • 2+ years writing production Terraform or equivalent IaC
  • 1+ years building self-service tooling, internal platforms, or paved-path frameworks
  • Strong SQL skills and the ability to reason about how data physically lives in a warehouse or lake
  • Production experience with Snowflake or an equivalent cloud data warehouse and a workflow orchestrator (Airflow / MWAA preferred)
  • Hands-on experience with at least one ingestion approach: CDC tooling (DMS, Debezium), managed connectors (Fivetran, Airbyte), or rolling your own pipelines for API sources
  • Solid CI/CD discipline in GitHub or equivalent
  • AI-native working style: daily use of Claude Code, Cursor, Copilot, or equivalent
  • Working knowledge of Python is expected; mastery isn’t the bar
  • Clear written and verbal communication, especially in async, remote settings.

Benefits

  • Health insurance
  • 401(k) matching
  • Flexible work hours
  • Paid time off
  • Remote work options

Related Job Pages

More Full-stack Engineer Jobs

SciLeads logo

Senior Software Engineer

SciLeads

We are the lead generation platform for science. Ranked number 10 in Deloitte's Technology Fast 50 Ireland 2023

Full TimeRemoteTeam 51-200Since 2014H1B No Sponsor

• Ownership of the full software development life cycle. • Work with cloud base architecture focusing on scalability and performance. • Address data challenges by implementing robust data engineering practices. • Code quality reviews and team collaboration. • Adopt a customer-first approach: Maintain a strong focus on customer needs and be relentless about delivering value.

United Kingdom
MKS2 Technologies logo

Software Developer, SME

MKS2 Technologies

Austin-based SDVOSB delivering application development, cybersecurity, instructional design and training to DOD and VA.

Full TimeRemoteTeam 201-500Since 2008H1B No Sponsor

• Provide support services for all aspects of the Reliability and Maintainability Information System (REMIS) software development process. • Ensure software development uses Agile methodologies, test-driven development principles, with robust documentation, user centered design, and an extensible infrastructure. • Maintain application software and COTS software. • Responsible for the design, coding, testing, quality assurance, deployment, software configuration management, and program documentation.

United States
$50 - $55 / hour
Full TimeRemoteTeam 10,001+H1B Sponsor

• Lead the analytics front and ensure the efficiency of the consumption layer; • Define development standards and best practices for Power BI; • Support the team of analysts in migrating reports from MicroStrategy to Power BI and in creating new reports; • Assist in analyzing technical requirements and producing documentation; • Validate data consistency between the Silver, Gold layers and the reports; • Serve as the technical link between the analytics team and the engineering team; • Conduct report publication processes in the production environment; • Ensure integration between Gold layers and analytical dashboards; • Monitor the quality and performance of reports and dashboards.

Brazil
Job Closed
Full TimeRemoteTeam 51-200

Role Description Provide support for maintaining the Delta 8 training database and other tracking systems via PEX. This also includes maintaining AF Form and training completion. - Experience with PEX – Patriot Excalibur is a must - RF, EM, and thermal simulation and modelling - Over 15 years of RF product development for performance-oriented applications - Systems-level understanding of RF front-ends - Architecture/requirement understanding from Antenna through the ADC - Space Payload electronics - TS/SCI Secret security clearance within 24 months of hire - Awareness of how Engineering contributes to Business achieving objectives - Risk Mitigation: ability to identify potential problems well in advance and determine appropriate risk mitigation Location can also be in Colorado, and Oxnard, California. Qualifications - Must have experience in Mission Design Series - Mission Qualification Training - Mission Task List - NIPR Non-Secure Internet Protocol Router Network Company Description

United States