• Design and build scalable ETL/ELT data pipelines using dbt, PySpark and other modern data transformation tools. • Develop and maintain data ingestion pipelines for generative AI workloads, including document processing, chunking and embedding workflows. • Orchestrate workflows using Airflow, Dagster or cloud-native orchestration tools. • Plan and execute data migration projects, including source analysis, schema mapping, validation and rollback strategies. • Implement Change Data Capture (CDC) solutions using industry-standard tools. • Build and maintain data quality frameworks with automated tests and validations. • Ensure data governance, security and compliance, including proper handling of PII (personally identifiable information) and enforcement of RBAC (role-based access control) policies. • Collaborate with AI Engineers and Full Stack Developers to support RAG pipelines and applications based on generative AI. • Apply event-driven architecture concepts to design scalable and reliable data processing solutions.

Role Description ECS is seeking a Databricks Pipeline Architect to work remotely. This position is contingent upon additional funding. The role will support the design, implementation, and long-term operation of Databricks within a complex Government enterprise environment. Responsibilities include: - Lead data engineering efforts within Databricks, including pipeline development on AWS in an enterprise environment. - Provide unification for organization and enterprise data capabilities to break down operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouse. - Support the integration of Databricks with existing analytics platforms and metadata solutions. - Serve as a technical advisor to stakeholders and help upskill internal teams through guidance/documentation. - Assist and develop customer use case applications of Databricks. Qualifications - Must be a US Citizen. - Ability to successfully maintain a DHS Entry on Duty (EOD)/Public Trust. - Minimum 7 years of hands-on experience architecting, designing, and data engineering with Databricks and AWS in a government setting. - Strong understanding and experience in areas such as Apache Spark, Lakebase, Lakehouse architectures, Delta Lake, Delta Sharing, Medallion Architecture, Data & AI Governance, and use case acceleration. - Demonstrated hands-on experience with AWS Cloud Native data and ETL capabilities (S3, Lambdas, Glue, etc.). - Demonstrated experience leveraging data to provide search, enrichment, correlation, AI/ML Model Training, in alignment with government mission and business use cases. - Experience integrating Databricks with other analytics platforms. - Prior consulting or customer-facing experience in data architecture or modernization initiatives. - Strong Python skills. - Experience in Agile environments and managing cross-functional technical delivery. Requirements - Strong Databricks and AWS experience. - Familiarity with architecting solutions for scale and governance. - Comfortable integrating Databricks with other data platforms. Benefits - Salary Range: $150,000 - $180,000. - General Description of Benefits.

• Responsible for integrating, analyzing raw data, developing, and maintaining datasets. • Improving data quality and efficiency. • Integrating different data sources, transforming data into useful business drivers. • Developing and maintaining scalable data pipelines, integration tools, and building new API integrations. • Building analytical tools to provide actionable insights into key performance metrics. • Designing data integrations, data quality frameworks, and integrating them with monitoring services. • Integrating data from different SOR’s and creating resulting models ready for consumption. • Performing data analysis to troubleshoot issues and assist in resolution. • Identifying, designing, and implementing internal process improvements. • Building solution prototypes as needed and writing algorithms against data. • Implementing processes and systems to monitor data quality. • Collaborating with analytics and business teams to improve data models that feed business intelligence tools.

AWS Data Architect/Engineer Company Overview Random Bit is a system modernization partner that specializes in enterprise architecture, solution architecture, data architecture, cloud transformation, data governance, compliance framework solutions, and organizational change management for both public and private sector clients. Job Summary Random Bit is seeking an AWS Data Architect with experience in Medicaid, Medicare, or Health and Human Services, particularly within claims and financial management data domains. This role provides technical leadership and supports implementation teams by designing high-quality, cloud-native data solutions on AWS. The AWS Data Architect is responsible for defining the data strategy and technical solutions for managing data across transactional, relational, and operational data stores within AWS. This role collaborates with Enterprise Architects and Business Analysts who support enterprise strategy and analysis across Medicaid and healthcare data domains. This position requires proficiency with AWS Cloud technologies and includes hands-on responsibilities such as establishing canonical models, defining interface specifications, and mapping data structures. The AWS Data Architect will be relied upon to: - Design information architecture to support an operational data store for data exchange across the Medicaid enterprise - Design and engineer 100% AWS cloud-native application components - Develop solution prototypes to demonstrate suitability and interoperability of chosen components, and to establish patterns for adoption by implementation team - Review data architectures to determine effectiveness, efficiency, and alignment with enterprise objectives - Develop comprehensive implementation and remediation strategies for data architecture non-compliance - Develop an architectural strategy for metadata management, including tooling and metadata governance - Manage metadata models that support data quality and mastering processes - Develop and maintain Conceptual, Logical, and Physical data models at the enterprise level and for specific data domains within Medicaid (Provider, Member, Claim, Reference) - Review data models with business owners and obtain approval from the data governance committee - Define, and maintain, business rules for data elements in conjunction with business owners and the data governance committee - Research emerging technologies, data modelling methods, and information management systems - Perform data mapping between the canonical models and data formats (both input and output) such as X12 EDI, FHIR, and other structured JSON, XML, or proprietary formats - Support database administrators, network designers and IT personnel on designing and managing the organization's data infrastructure and overall data strategy - Participate in Data Governance Committee meetings, representing the architecture team - Collaborate with internal and external personnel, including solution architects, software developers, database administrators, design analysts and information modelling experts to determine project capabilities, requirements, and timelines Required Experience and Skills: - Bachelor’s degree in information management, data science, statistics, public health, health informatics, or a related field or commensurate work experience - Proficiency with object-oriented design principles and software design patterns - Experience with the following AWS services: - Glue - Lambda - S3 - CloudFormation - CloudWatch and CloudTrail - CodeCommit - EC2. SNS, SQS, KMS, VPC, and IAM - Experience working with data models and relational, transactional, and NoSQL databases - At least five years of experience with healthcare data, particularly in Medicare, Medicaid, Health and Human Services, medical claims, and financial management - Familiarity with federal, state, and organizational policies that safeguard Protected Health Information (PHI) and Personally Identifiable Information (PII) - At least five years of experience with UML 2.0 and Archimate notations - Creative problem-solver with strong communication skills and a collaborative mindset - Experience with data visualization tools - Experience designing data warehouses and domain-specific data models - Experience modeling transactional data stores using relational and document data patterns - Experience modeling data for REST APIs - Experience with data transformation and Domain-Driven Design Desired Certifications: - AWS Solution Architect - Associate This position can be remote and work hours must be based on Eastern Standard Time business hours. This is a W-2 position and we offer a competitive salary and benefits package.