• Develop and maintain data pipelines (ETL/ELT) in an Azure environment, using Databricks for processing and integration. • Implement CI/CD practices to automate deployments and manage code versioning in GitHub. • Design and optimize data models to ensure scalability, performance, and governance. • Support cloud migration projects, ensuring data security, quality, and integrity. • Collaborate with business teams and data science teams to deploy AI models in cloud environments. • Ensure data quality and consistency by applying data profiling techniques and monitoring. • Document processes, architectures, and data engineering best practices.

Job DetailsLevel: ExperiencedJob Location: Remote - Baltimore, MD 21244Education Level: 4 Year DegreeSalary Range: $129,200.00 - $178,500.00 Salary/yearIndex Analytics is seeking a Sr. Data Engineer to support Government clients to design, build, and optimize scalable data pipelines and cloud-based solutions. The Sr. Data Engineer plays a key role in modernizing the organization’s data ecosystem by helping transition legacy solutions to a contemporary infrastructure. As part of a cross-functional team including Data Engineers, health policy researchers, Analysts, the engineer will support efforts to design and implement a robust environment capable of ingesting diverse data sources to support advanced analytics and reporting needs. Core responsibilities include defining structural, interface, and business requirements for data solutions; designing relational and non-relational databases and their associated integration components; and implementing Python based automated data pipelines This role blends advanced data engineering with hands‑on cloud solutions engineering, leveraging AWS, Snowflake, and modern DevOps practices. The ideal candidate has experience delivering high‑quality solutions in an Agile environment. Responsibilities Collaborate closely with stakeholders, cross‑functional and internal technical teams to gather requirements, document business rules and develop thorough understanding of the business context and objectives Collaborate to design secure, scalable, and cost‑optimized data solutions Design, build, and maintain scalable, reliable ETL/ELT data pipelines using AWS and Snowflake and Databricks Develop and optimize data models, both conceptual and physical, to support analytics, reporting, and operational consumption Implement data quality, validation, and monitoring frameworks to ensure accuracy and reliability Ensure data workflows are modular, testable, and properly version‑controlled Operationalize pipelines with monitoring, alerting, and automated recovery mechanisms Conduct advanced data analysis using languages such as Python and SQL. Develop documentation to include data models, data dictionaries, and data usage guides Improve end-to-end performance of data workflows Build and maintain CI/CD pipelines using Jenkins to support automated testing, deployments, and continuous integration Meet schedule deadlines and commitments with a high-level of quality of deliverables. Collaborate with a team of cross-functional resources in an Agile delivery environment to deliver iterative value Qualifications US citizen or lived in the US for 3 of the last 5 years. Must be able to obtain a U.S. Federal government client badge and pass a government background investigation Bachelor’s degree or equivalent with eight (8) or more years of experience as Data Engineer or similar role Hands-on experience in SQL and Python is required Strong proficiency in AWS services, Snowflake, Databricks Strong proficiency in GitHub for source control, branching strategy and reviews Knowledge of data integration patterns, data warehousing, and modern data architecture Strong analytical and communication skills, including the ability to analyze data, create meaningful insights, and present information clearly to stakeholders. Experience with object‑oriented programming and building with software engineering principles DevOps exposure, including CI/CD tools like Jenkins Prior working knowledge of CMS enterprise repositories like IDR. Strong written and verbal communication skills are required, ability to collaborate, present, and report to stakeholders on findings. Knowledge of Agile framework, Scrum methodologies and knowledge of tools used to support them. Prior experience with government agencies is a plus Attention Candidates We're dedicated to ensuring a safe and transparent recruitment process for all candidates and have implemented robust measures to protect your personal information. Please be aware that all employment-related communications will originate from a secure portal (NAME@msg.paycomonline.com) or a corporate email address (NAME@index-analytics.com). If you have any concerns, please don't hesitate to reach out to us at recruiting@index-analytics.com. If you are selected for an interview, please be advised that Index Analytics LLC reserves the right to prohibit the use of artificial intelligence (AI) tools, including but not limited to AI-generated responses, real-time transcription, or automated assistance during the interview process. We value authentic interactions and the opportunity to engage directly with candidates. Any unauthorized use of AI may result in disqualification from consideration. The salary range provided represents the estimated compensation for new hires in this position, applicable across all locations. Actual offers may vary based on factors such as the candidate's skills, qualifications, experience, and market conditions. Index complements its base salary offering with a competitive package that includes health and retirement benefits, discretionary bonuses, and reimbursement for professional development opportunities. Index Analytics provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

• Lead the design and construction of a next-generation data warehouse optimized for improved efficiency, performance, and massive scale. • Build and maintain robust data pipelines for real-time ingestion from large-scale production transactional databases containing hundreds of millions of rows. • Develop real-time data transformation layers to ensure the data warehouse reflects live business activity, enabling "up-to-the-minute" analytics for our ecosystem. • Partner with the Senior Data Product Manager to define, evangelize, and execute a data roadmap that meets both internal and external customer needs. • Research and select appropriate technical solutions, coordinate delivery with dedicated agile teams, and champion engineering best practices. • Rigorously test and validate data integrity, establishing and measuring success metrics for system performance and data reliability. • Work closely with stakeholders to develop technical business cases for new initiatives, ensuring alignment across the development organization.

This is a remote position. Job Title: Data Engineer Location: New York, NY / DC Area Type: Full-Time Sector: Data, AI & Analytics Position Overview BizFirst is supporting our client in identifying a Data Engineer to join a growing consulting team working across industries, clients, and technologies. You've got the skills, the curiosity, and the hunger to grow. This is the platform to go further. Our client is a fast-growing global data and AI consultancy with operations across three continents and 140+ consultants serving 70+ enterprise clients. They've built a consultant-first culture with a proprietary learning academy, paid certifications, and deep partnerships with platforms like Snowflake, Databricks, and Google Cloud. The US office combines the credibility of an established global brand with the energy of a New York startup. Your Career, Accelerated You're not just taking a job, you're investing in your growth. You'll work across industries and client engagements that stretch your thinking. You'll have access to proprietary playbooks and toolkits that fast-track your success on projects. And you'll always have a principal consultant who has your back, not just be thrown into the deep end. What You'll Do You're the builder, making sure data flows cleanly and reliably. • Design and build pipelines to ingest, transform, and load data • Set up data lakes and warehouses for scalable access • Ensure systems are secure, reliable, and cost-effective • Collaborate with analysts, ML engineers, and platform teams Tools You'll Work With • Python, Spark, Airflow • Snowflake, Databricks, BigQuery, Neo4J • dbt, Fivetran, Terraform • Azure, GCP, AWS What We're Looking For We're on the hunt for people who love solving problems, thinking critically, and staying curious. Less about ticking boxes, more about whether you'd thrive in this environment: • Do you get excited about helping clients move forward? • Do you want to learn from people who are really good at what they do? • Are you keen to experiment with the latest tools and ideas? • Can you balance working independently and being a great teammate? Open to people at different experience levels and career stages. Perks & Benefits Your work matters, and so do you. Here's what's waiting: • Proprietary learning academy with 100+ custom modules • Mentoring program with a Senior Support Lead • 360-degree progress reviews with real feedback, not fluff • Guilds, regular training, and peer learning • Paid certifications across all major platforms • Hackathons and innovation days • Kudos and recognition programs • Socials, book clubs, Data & Drinks, and team building days About BizFirst BizFirst is a recruiting firm built for companies that got tired of being account #47. We place talent across AI and data, GovCon, finance and operations, and telecom infrastructure. Every search is led by a senior Delivery Lead managing just 3 to 4 clients total. The result: candidates in days, a single point of contact from kickoff to placement, and a 94% retention rate past 90 days.