Senior Data Engineer
Location
United States
Posted
19 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Vytalize Health
• Lead development of the agentic connector pipeline — automating source profiling, field mapping, dbt model generation, and validation • Design and build AI-assisted data ingestion workflows using LLM APIs and agentic orchestration frameworks • Own the first 2–3 end-to-end agent-built connectors as proof of concept for the broader team • Establish internal AI tooling standards and patterns; mentor team on agentic development practices • Design, build, and maintain data pipelines and systems to meet business needs • Implement data quality control processes and contribute to observability frameworks • Document new and existing systems, designs, processes, and procedures • Work on-call 3–9% of the year, one week at a time, to support production failures and emergent business needs • Mentor and learn from colleagues through pair/mob programming, design reviews, and Lunch & Learns
Job Requirements
- 5+ years of experience in data engineering or a related field
- 1–2+ years of hands-on experience building with LLM APIs and agentic frameworks
- Strong Python and SQL proficiency
- Experience with Databricks and AWS
- Strong understanding of data lake architecture, data modeling, and medallion patterns (Bronze/Silver/Gold)
- Experience building and consuming APIs
- Experience with data quality control and pipeline observability
- Strong debugging, problem-solving, and analytical skills
- Excellent written and verbal communication skills
- Comfortable working in a fast-moving, ambiguous environment
Benefits
- None specified
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Lead Data Engineer – Migration & Integration
EnrouteWe deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.
• Lead the technical execution of the migration from Oracle and Boomi to Azure SQL and Azure Data Factory. • Guide architecture and design decisions across database migration, ETL migration, integration, validation, and deployment activities. • Serve as the main technical point of contact with the client. • Translate client requirements, priorities, and constraints into actionable technical direction for the team. • Coordinate the work of the database migration and ETL / ADF engineers. • Review and validate technical designs, source-to-target mappings, migration approaches, and implementation plans. • Provide hands-on technical guidance and troubleshooting support when needed. • Help resolve complex issues related to data conversion, pipeline design, performance, compatibility, validation, and reconciliation. • Track project timeline, deliverables, dependencies, risks, and open decisions. • Ensure the team is aligned on priorities, scope, quality expectations, and delivery commitments. • Communicate project status, risks, blockers, and key decisions to client stakeholders and internal leadership. • Support planning for testing, production cutover, rollback considerations, and post-migration stabilization. • Ensure technical documentation is created and maintained throughout the engagement. • Promote best practices for data migration, ETL design, security, performance, monitoring, and maintainability.
Staff Data Engineer
MissionWiredWe're MissionWired, and we develop effective and innovative digital strategies that help our partners change the world.
• Solving our unique data-lake challenges: transforming and seamlessly normalizing highly varied partner datasets (such as donation data); • Design robust batch-processing pipelines capable of extracting and loading massive datasets from a variety of internal, external, and public sources; • Developing processes for data mining, data modeling, and data production; • Leveraging modern technology knowledge to champion evolving industry trends, updated design patterns, and engineering excellence across the team; • Autonomously scope, design, and execute complex data projects from day one, turning ambiguous requirements into clear, decisive technical plans; • Developing robust testing and monitoring systems for scheduled processes; • Collaborating with cross-functional teams to support their data infrastructure needs; • Joining each and every one of your colleagues in creating an inclusive workspace.
Data Engineer – Ads Product & Tech
SpotifyPassionate music fans. Innovative tech pros. Perfect harmony. Join our band.
• Maintain and enhance Spotify’s reporting pipelines, ensuring they remain business-critical • Build large-scale batch and real-time data pipelines to efficiently collect, process, and store reporting-related data • Make enhancements to data models and ETL code to improve pipeline efficiency and data quality • Design, develop, and maintain high-performance backend services and APIs to power Spotify’s advertising platform • Work closely with stakeholders to understand and translate business requirements into technical solutions • Write scalable, testable, maintainable, and high-quality code • Collaborate with engineers, product managers, and other stakeholders, embracing learning and leadership opportunities daily • Monitor daily execution, diagnose issues, and ensure SLAs are met by maintaining and fixing business-critical pipelines
Role Description We are seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for building and maintaining integrations, automating data workflows, and ensuring data accuracy and availability across educational platforms. You’ll play a key role in supporting school operations. - Develop and maintain custom integrations and ETL processes between K-12 data and internal/external systems. - Design, implement, and optimize data pipelines. - Collaborate with stakeholders to understand data needs and deliver robust, scalable solutions. - Maintain technical documentation for systems, data models, and processes. - Monitor and troubleshoot data flow issues and respond to API changes. - Participate in cross-functional projects related to school operations, enrollment, attendance, and performance data. - Perform quality assurance (QA) on downstream data to ensure accuracy, consistency, and alignment with customer requirements. Qualifications - 4+ years of experience in a software engineering, data engineering, or SIS specialist role. - Hands-on experience with Student Information Systems or other K-12 platforms, including APIs, data exports/imports, and plugin development. - Strong skills in SQL, Python, and ETL/ELT tools. - Experience working with RESTful APIs, SFTP, and other data exchange methods. - Experience in working with educational data. - Familiarity with data warehousing concepts. - Experience with data quality assurance practices and tools, including validation and reconciliation of datasets. - Strong attention to detail and ability to translate customer data requirements into technical specifications and QA checks. - Ability to work independently in a fully remote position. Benefits - Comprehensive medical benefits with employer contribution to premiums and to HSA accounts. - Additional benefits such as gym reimbursement, pet insurance, free access to the Calm app, Rocket Lawyer and more to help you stay healthy: mind, body, and soul. - We are a fully remote company. We provide a monthly tech stipend to support your WFH needs! - Inclusive benefits to support you and your family, including parental leave, fertility support, adoption, and more! - Invest in your future with our 401(k) plan, which includes an employer match to help you build long-term financial security. - Flexible PTO, paid sick time off, company holidays plus winter break (Dec 24th - Jan 1st). - Newsela offers an annual learning and development allowance to employees to attend external training sessions, classes, workshops, conferences, and educational materials to foster professional growth within their current role and career aspirations at Newsela. - No matter your role or department, the work you do each day helps share the future of education and improves the lives of students and teachers. Company Description Newsela is a leading education technology company dedicated to meaningful classroom learning for every student. We deliver integrated, AI-powered solutions designed to unlock student engagement, empower teachers, and drive meaningful learning outcomes. Our suite of products supports knowledge and skill development, writing practice, daily instruction, assessment, and data-informed decision-making across K–12 classrooms. Grounded in learning science research, Newsela’s solutions integrate content, assessment, and analytics to help educators track progress, understand student outcomes, and deliver high-impact instruction that supports every learner.




