Guidehouse, a "next-generation consultancy" and a portfolio company of Veritas Capital, provides management, risk consulting, and technology services to help clients in the commerc
Data Engineer
Location
Virginia
Posted
18 days ago
Salary
$85K - $141K / year
Seniority
Senior
Job Description
Data Engineer
Guidehouse
• Design, develop, and maintain end-to-end data pipelines using Databricks (Spark, PySpark, SQL) to ingest, transform, and curate structured and semi-structured data from authoritative DoD source systems. • Engineer and optimize data models, Delta tables, and curated datasets to support financial reporting, PPBE workflows, auditability, and mission analytics within Advana and downstream Foundry use cases. • Develop, maintain, and deploy Foundry pipelines, transforms, and data products, enabling traceability, lineage, and repeatable analytics workflows for DoD stakeholders. • Implement and manage CI/CD and version-controlled data engineering workflows using Git-based repositories and automated deployment patterns aligned with DoD security and ATO requirements. • Build and deploy cloud-native solutions in secure AWS and Azure environments, supporting IL4/IL5 architectures as applicable, and leveraging containerization where approved. • Partner with functional SMEs, financial analysts, platform engineers, and governance teams to ensure data pipelines conform to DoD financial data standards, business rules, and controls. • Implement robust data quality, reconciliation, validation, and monitoring capabilities to support financial accuracy, audit readiness, and confidence in reported metrics. • Support data integration, modernization, and migration efforts, including onboarding legacy financial systems and transitioning workloads to Databricks and Foundry within Advana. • Troubleshoot and resolve pipeline, performance, and data integrity issues in production environments, ensuring high availability and reliability in mission-critical systems. • Document data flows, engineering designs, and operational procedures to support compliance, knowledge transfer, and platform accreditation. • Stay current on emerging data engineering, analytics platform, and DevSecOps best practices relevant to DoD enterprise data environments.
Job Requirements
- US Citizenship is required.
- Must have an ACTIVE and MAINTAINED "SECRET" Federal or DoD security clearance with the ability to meet all client security and access requirements.
- Bachelor’s degree obtained
- Minimum FIVE (5) years of experience in data engineering, analytics engineering, or software development, preferably in regulated or federal environments.
- Strong proficiency in Python, SQL, PySpark, and Spark-based data processing.
- Demonstrated hands-on experience with Databricks, including Delta Lake, notebook development, performance tuning, and production pipelines; experience supporting or integrating with DoD Advana is highly desirable.
- Experience building or supporting data solutions using Palantir Foundry, including pipelines, transforms, datasets, and data lineage.
- Experience working with relational and analytical data stores (e.g., Databricks, Oracle, Postgres, SQL Server) and applying sound data modeling principles.
- Familiarity with Git-based version control, CI/CD concepts, and Agile delivery methodologies in secure environments.
- Experience handling federal financial data, including budget, execution, and accounting data, with an understanding of data controls and reconciliation needs.
- Ability to operate independently in a fast-paced, mission-focused environment.
- Strong analytical, troubleshooting, and communication skills, including the ability to translate complex technical concepts for both technical and non-technical audiences.
Benefits
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Position may be eligible for a discretionary variable incentive bonus
- Parental Leave and Adoption Assistance
- 401(k) Retirement Plan
- Basic Life & Supplemental Life
- Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Student Loan PayDown
- Tuition Reimbursement, Personal Development & Learning Opportunities
- Skills Development & Certifications
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Emergency Back-Up Childcare Program
- Mobility Stipend
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer – Contractor
myPOSBy combining the latest payment technologies with imagination and expertise, we create a new world of payments.
• Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations • Develop and evolve scalable data architecture to meet business and performance requirements • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics • Implement best practices for data quality, testing, monitoring, lineage, and reliability • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies) • Ensure secure data handling and compliance with relevant data protection standards and internal policies • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
Data Engineer – Contractor
myPOSBy combining the latest payment technologies with imagination and expertise, we create a new world of payments.
• Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations • Develop and evolve scalable data architecture to meet business and performance requirements • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics • Implement best practices for data quality, testing, monitoring, lineage, and reliability • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies) • Ensure secure data handling and compliance with relevant data protection standards and internal policies • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
Senior Data Engineer – Contractor
myPOSBy combining the latest payment technologies with imagination and expertise, we create a new world of payments.
• Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations • Develop and evolve scalable data architecture to meet business and performance requirements • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics • Implement best practices for data quality, testing, monitoring, lineage, and reliability • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies) • Ensure secure data handling and compliance with relevant data protection standards and internal policies • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
Lead Software Engineer – Data Migration
IQ Plus AGIhr Personalverleiher für Informatik-Spezialisten*innen auf Zeit seit über 30 Jahren.
Role Description Für unseren Kunden suchen wir einen erfahrenen Lead Software Engineer im Bereich Data Migration zur Verstärkung des Software-Engineering-Teams. In dieser Funktion übernehmen Sie die Gestaltung, Optimierung und Skalierung von Migrationsstrecken, um neue Kunden an bestehende Steuerlösungen anzubinden. - Analysieren komplexer Datenstrukturen und Abhängigkeiten - Entwickeln von Mapping-Logiken sowie automatisierten Cleansing-Strategien - Sicherstellen der Datenintegrität und -qualität durch automatisierte Tests - Vorbereiten von Migrations- und Testdaten - Überwachen des Verarbeitungsprozesses - Aktives Einbringen von Erkenntnissen aus der Fehleranalyse ins Team - Mitwirken an der kontinuierlichen Weiterentwicklung von Entwicklungsprozessen, Tools und Best Practices - Steuern der Planung sowie Implementierung technischer Anbindungen Qualifications - Mehrjährige praktische Erfahrung in der Erstellung und Optimierung komplexer SQL-Abfragen - Vertiefte Kenntnisse in Datenmodellierung, Datenmanagement und Datenarchitektur - Erfahrung in der Analyse komplexer Datenstrukturen sowie im Erkennen von Anomalien - Gute Kenntnisse in SQL-Datenbanken, insbesondere PostgreSQL und MS SQL Server - Fähigkeit, sich rasch in komplexe Legacy-Datenbanken einzuarbeiten - Analytisches Denkvermögen und Eigeninitiative zur Optimierung von Datenabfragen und Verarbeitungszeiten - Kenntnisse in Python bzw. Erfahrung mit Python-Frameworks von Vorteil - Erfahrung in der Zusammenarbeit mit verschiedenen Teams und Stakeholdern - Starke Kommunikationsfähigkeiten sowie adressatengerechte Vermittlung technischer Themen - Erfahrung in der aktiven Unterstützung und im Coaching von Teammitgliedern - Pragmatische, hands-on Arbeitsweise und hohe Umsetzungsstärke Company Description IQ PLUS ist das spezialisierte Unternehmen für höchst qualifizierte IT-Fachleute auf Zeit. Und das seit über 30 Jahren und in jedem IT-Bereich.
