• Lead the technical evolution of our data platform for a period of 8 Months Fixed-Term Contract. • Own the design and implementation of our Databricks Lakehouse. • Drive the migration of complex legacy SQL into clean, governed pipelines. • Build the semantic layer that powers self-service analytics in Omni. • Design and implement the Unity Catalog structure. • Lead the migration of complex business logic from legacy systems. • Architect our internal transformation framework using open-source tooling. • Serve as the resident query performance expert. • Govern our Databricks compute footprint through strategic application of various optimization techniques. • Build and maintain CI/CD pipelines to automate testing, validation, and deployment of data models. • Occasionally take on the BI Developer role, building executive-level dashboards.

• Lead the technical evolution of our data platform • Own the design and implementation of our Databricks Lakehouse • Drive the migration of complex legacy SQL into clean, governed pipelines • Build the semantic layer that powers self-service analytics • Design and implement the Unity Catalog structure • Lead the migration of complex business logic • Architect internal transformation framework using open-source tooling • Analyze Spark execution plans and diagnose bottlenecks • Build and maintain CI/CD pipelines to automate testing and deployment • Design data models built for self-service reporting • Partner with cross-functional stakeholders to translate business questions into scalable data solutions

• Develop and maintain data pipelines (ETL/ELT) in an Azure environment, using Databricks for processing and integration. • Implement CI/CD practices to automate deployments and manage code versioning in GitHub. • Design and optimize data models to ensure scalability, performance, and governance. • Support cloud migration projects, ensuring data security, quality, and integrity. • Collaborate with business teams and data science teams to deploy AI models in cloud environments. • Ensure data quality and consistency by applying data profiling techniques and monitoring. • Document processes, architectures, and data engineering best practices.

Job DetailsLevel: ExperiencedJob Location: Remote - Baltimore, MD 21244Education Level: 4 Year DegreeSalary Range: $129,200.00 - $178,500.00 Salary/yearIndex Analytics is seeking a Sr. Data Engineer to support Government clients to design, build, and optimize scalable data pipelines and cloud-based solutions. The Sr. Data Engineer plays a key role in modernizing the organization’s data ecosystem by helping transition legacy solutions to a contemporary infrastructure. As part of a cross-functional team including Data Engineers, health policy researchers, Analysts, the engineer will support efforts to design and implement a robust environment capable of ingesting diverse data sources to support advanced analytics and reporting needs. Core responsibilities include defining structural, interface, and business requirements for data solutions; designing relational and non-relational databases and their associated integration components; and implementing Python based automated data pipelines This role blends advanced data engineering with hands‑on cloud solutions engineering, leveraging AWS, Snowflake, and modern DevOps practices. The ideal candidate has experience delivering high‑quality solutions in an Agile environment. Responsibilities Collaborate closely with stakeholders, cross‑functional and internal technical teams to gather requirements, document business rules and develop thorough understanding of the business context and objectives Collaborate to design secure, scalable, and cost‑optimized data solutions Design, build, and maintain scalable, reliable ETL/ELT data pipelines using AWS and Snowflake and Databricks Develop and optimize data models, both conceptual and physical, to support analytics, reporting, and operational consumption Implement data quality, validation, and monitoring frameworks to ensure accuracy and reliability Ensure data workflows are modular, testable, and properly version‑controlled Operationalize pipelines with monitoring, alerting, and automated recovery mechanisms Conduct advanced data analysis using languages such as Python and SQL. Develop documentation to include data models, data dictionaries, and data usage guides Improve end-to-end performance of data workflows Build and maintain CI/CD pipelines using Jenkins to support automated testing, deployments, and continuous integration Meet schedule deadlines and commitments with a high-level of quality of deliverables. Collaborate with a team of cross-functional resources in an Agile delivery environment to deliver iterative value Qualifications US citizen or lived in the US for 3 of the last 5 years. Must be able to obtain a U.S. Federal government client badge and pass a government background investigation Bachelor’s degree or equivalent with eight (8) or more years of experience as Data Engineer or similar role Hands-on experience in SQL and Python is required Strong proficiency in AWS services, Snowflake, Databricks Strong proficiency in GitHub for source control, branching strategy and reviews Knowledge of data integration patterns, data warehousing, and modern data architecture Strong analytical and communication skills, including the ability to analyze data, create meaningful insights, and present information clearly to stakeholders. Experience with object‑oriented programming and building with software engineering principles DevOps exposure, including CI/CD tools like Jenkins Prior working knowledge of CMS enterprise repositories like IDR. Strong written and verbal communication skills are required, ability to collaborate, present, and report to stakeholders on findings. Knowledge of Agile framework, Scrum methodologies and knowledge of tools used to support them. Prior experience with government agencies is a plus Attention Candidates We're dedicated to ensuring a safe and transparent recruitment process for all candidates and have implemented robust measures to protect your personal information. Please be aware that all employment-related communications will originate from a secure portal (NAME@msg.paycomonline.com) or a corporate email address (NAME@index-analytics.com). If you have any concerns, please don't hesitate to reach out to us at recruiting@index-analytics.com. If you are selected for an interview, please be advised that Index Analytics LLC reserves the right to prohibit the use of artificial intelligence (AI) tools, including but not limited to AI-generated responses, real-time transcription, or automated assistance during the interview process. We value authentic interactions and the opportunity to engage directly with candidates. Any unauthorized use of AI may result in disqualification from consideration. The salary range provided represents the estimated compensation for new hires in this position, applicable across all locations. Actual offers may vary based on factors such as the candidate's skills, qualifications, experience, and market conditions. Index complements its base salary offering with a competitive package that includes health and retirement benefits, discretionary bonuses, and reimbursement for professional development opportunities. Index Analytics provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.