CACI International Inc logo
CACI International Inc

Expertise and Technology for National Security

HCM Data Migration Middleware Developer

Data EngineerData EngineerOtherRemoteSeniorTeam 10,001+Since 1962H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

98 days ago

Salary

$75.2K - $158.1K / year

Seniority

Senior

Bachelor Degree4 yrs expEnglishETLInformaticaOracle DatabaseSQL

Job Description

HCM Data Migration Middleware Developer

CACI International Inc

• Design and develop ETL pipelines using Oracle Integration Cloud (OIC), Informatica, Talend, or equivalent middleware tools to transform extracted legacy HR data into Oracle Fusion HCM HDL and HSDL load file formats • Build data transformation rules that map legacy data values (codes, descriptions, hierarchies) to Oracle Fusion HCM reference data, value sets, and lookup values for each agency migration • Develop data cleansing pipelines that identify and remediate data quality issues including missing required fields, invalid date formats, duplicate records, and referential integrity violations before target system loading • Design and implement batch processing frameworks capable of handling large-volume agency migrations ranging from small to very large agency employee populations with configurable parallelism and restart/recovery capabilities • Build comprehensive error handling and exception management within ETL pipelines including error categorization, automated retry logic, and error reporting dashboards for migration teams • Develop data reconciliation processes that compare source record counts, key data element values, and business rule validations between legacy extracts, transformation outputs, and target system loaded records • Create and maintain data quality dashboards providing real-time visibility into migration pipeline status, error rates, data completeness metrics, and reconciliation results for each agency migration wave • Design reusable transformation templates and parameterized mapping configurations that accelerate successive agency migrations by leveraging patterns from completed migrations • Collaborate with legacy system export developers (PeopleSoft/EBS team) to define extraction file formats, handoff procedures, and data interface specifications • Support iterative mock migration cycles (typically 3-4 per agency) and final cutover data loads, optimizing pipeline performance and resolving data quality issues identified in each cycle • Document ETL design specifications, transformation rules, data flow diagrams, and operational runbooks for each agency migration in accordance with SAFe Agile artifact standards • Apply established methods, standards, and practices to independently resolve functional and technical issues of moderate scope, contributing to team knowledge bases and consulting with senior staff on complex or unfamiliar problems as they arise • Communicate effectively with project team members and direct stakeholders to report progress, explain technical approaches, and support collaborative problem-solving within assigned workstreams and Agile Release Train ceremonies

Job Requirements

  • Bachelor's degree in Computer Science, Information Technology, Software Engineering, or related field
  • Applicable combination of education and experience: T3 - 4+ years of professional experience in ETL development, middleware development, or data integration for enterprise system implementations
  • T4 - 6+ years of professional experience in ETL development, middleware development, or data integration for enterprise system implementations
  • 4+ years of experience in ETL development, middleware development, or data integration for enterprise system implementations
  • 3+ years of hands-on experience with ETL/middleware tools such as Oracle Integration Cloud (OIC), Informatica PowerCenter/Cloud, Talend, or equivalent data integration platforms
  • Strong SQL proficiency with experience writing complex transformation queries, data validation scripts, and reconciliation procedures
  • Experience with batch data processing for large-volume datasets (100,000+ records) including performance optimization, error handling, and restart/recovery design patterns
  • Knowledge of data quality management principles including data profiling, cleansing, standardization, and validation
  • Experience with file-based data integration formats (CSV, XML, JSON) and enterprise data loader specifications
  • Familiarity with Agile/SAFe development methodologies and iterative delivery practices
  • Must be able to obtain and maintain a Public Trust clearance (US Citizenship required)
  • Additional experience may substitute for degree

Benefits

  • healthcare
  • wellness
  • financial
  • retirement
  • family support
  • continuing education
  • time off benefits

Related Categories

Related Job Pages

More Data Engineer Jobs

Jimmy Technologies logo

Senior Data Engineer

Jimmy Technologies

Leveraging the world’s best IT brains to build first-class software and shape your digital products

Data Engineer98 days ago
ContractRemoteTeam 11-50H1B No Sponsor

• Architect Foundry Pipelines: Design, develop, and maintain scalable data pipelines within the Palantir Foundry ecosystem (Data Connection, Code Repos, Pipeline Builder). • Implement ETL processes: Implement ETL and real-time data pipelines for efficient data handling and integration. • Optimize PySpark: Write and tune high-performance Python/Spark code to transform massive insurance datasets into actionable insights. • Build the Ontology: Manage and scale the Foundry Ontology, ensuring data models accurately represent complex real-world insurance entities. • Implement AI/GenAI: Integrate GenAI capabilities (using Palantir AIP or external AI APIs) to automate workflows and enhance data enrichment. • Implement CI/CD: Implement practices using CodePipeline and CodeBuild to streamline development and deployment processes. • Collaboration & Agile Development: Gather requirements, set targets, define interface specifications, and conduct design sessions. Work closely with data consumers to ensure proper integration. Adapt and learn in a fast-paced project environment.

Czechia
€40 - €50 / hour
Job Closed
SS&C Technologies logo

Lead Data Engineer (SS&C Technologies, Inc.; San Francisco, CA): Ref 00087619

SS&C Technologies

Established in 1986, SS&C Technologies is a leading global provider of services and software for the global financial services industry. Committed to helping cl

Data Engineer98 days ago

As a leading financial services and healthcare technology company based on revenue, SS&C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&C for expertise, scale, and technology. Job Description Lead Data Engineer (SS&C Technologies, Inc.; San Francisco, CA): The Lead Data Engineer is based at SS&C’s office in San Francisco, CA with a telecommuting benefit. The incumbent must reside within commuting distance from SS&C’s San Francisco office. The Data Engineer will join a team that creates a leading cloud platform with the latest big data, cloud native and machine learning technologies. Specific responsibilities will include: Build and implement models in a production environment for a revenue-driving product; Create and maintain overall optimal data pipeline architecture; Assemble large, complex data sets that meet functional / non-functional business requirements; Manage data migrations/conversions and troubleshooting data processing issues; Create the pipeline for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources; Build large scale data platform infrastructures to power other products; Lead a squad (feature team) to deliver strategic client features including data movement and data synchronization; and Work with other architect engineers to propose architecture designs that will solve a business problem with bigger impact and reduce technical debts in the long run. Minimum requirements: Master’s degree or foreign equivalent in Computer Science, Data Analytics, Information Technology Management, or related field, plus 3 years of pre- or post-Master’s experience in any occupation in which the required experience is gained. Alternate Education and Experience: Bachelor’s degree or foreign equivalent in Computer Science, Data Analytics, Information Technology Management, or related field, plus 6 years of experience in any occupation in which the required experience is gained. Must have: Master programming skills in Python and SQL. Deep knowledge of big data platforms technologies including Spark, Hive, Airflow, Data Hub, Delta Lake or Iceberg. Strong algorithm & data structure basis. Experience leading a team technically to deliver large business features. Great architecture principles and decision-making skills. Strong problem-solving skills with a can-do attitude. Great software engineering best practices with git and version control systems. Solid communication skills to explain complex data pipelines to both technical and non-technical people. Excellent writing and documenting skills. Salary: $194,834.00 to $210,000.00 per year. Apply online at https://www.ssctech.com/about-us/careers or send resume to: Angela Lamar, Talent Acquisition, SS&C Technologies, Inc., alamar@sscinc.com. Ref: 00087619. An EOE. #LI-DNI Unless explicitly requested or approached by SS&C Technologies, Inc. or any of its affiliated companies, the company will not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. SS&C offers excellent benefits including health, dental, 401k plan, tuition and professional development reimbursement plan.SS&C Technologies is an Equal Employment Opportunity employer and does not discriminate against any applicant for employment or employee on the basis of race, color, religious creed, gender, age, marital status, sexual orientation, national origin, disability, veteran status or any other classification protected by applicable discrimination laws. Salary is determined by various factors including, but not limited to, relevant work experience, job related knowledge, skills, abilities, business needs, and geographic regions. California: Salary range for the position: 194,834 USD to 210,000 USD.

United States
$194K - $210K / year
Job Closed
GE Aerospace logo

Sr. Data Engineer

GE Aerospace

GE Aerospace is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law. GE Aerospace will only employ those who are legally authorized to work in the United States for this opening. Any offer of employment is conditioned upon the successful completion of a drug screen (as applicable).

Data Engineer98 days ago
OtherRemoteTeam 10,001+H1B No Sponsor

Job Description Summary As the Sr. Data Engineer, you will play a critical role in building and architecting automation and observability for the EDAS platform, with a particular focus on the data consumption side in the near term. You will be responsible for emphasizing automating workflows, ensuring platform reliability by developing data-driven observability tools and collaborating with teams to enhance efficiency and performance. The platform to automate & observe includes Redshift, Spotfire and triggers, Dataiku project flows, and Talend. The role focuses on designing and implementing automation solutions to streamline workflows, enhance efficiency, and ensure platform reliability. It involves building observability frameworks for real-time monitoring, logging, and alerting, optimizing data pipelines for scalability, and ensuring compliance with data governance and security standards. Job Description In this role you will: - Build and maintain observability frameworks to monitor the health, performance, and reliability of data and analytic platforms. - Implement tools for real-time monitoring, logging, and alerting to ensure proactive issue detection and resolution. - Analyze system metrics and logs to identify trends, anomalies, and areas for improvement. - Design and implement intelligent automation solutions to streamline data and analytic processing workflows and platform operations. - Develop scripts, tools, and frameworks to automate repetitive tasks and improve system efficiency. - Collaborate with cross-functional teams to identify automation opportunities and implement solutions. - Ensure high availability and fault tolerance of the platform through robust monitoring and automation strategies. Minimum Qualifications: - Bachelor’s degree from accredited university or college with minimum of 2 years of professional experience OR associate's degree with minimum of 5 years of professional experience OR High School Diploma with minimum of 7 years of professional experience - Programming: Python, Bash scripting. - Containerization: Docker. - Cloud Services: AWS (Lambda, CloudTrail, X-Ray, CloudWatch, S3, IAM). - Observability Tools: Prometheus, Grafana, Datadog, FluentBit, ELK stack, OpenSearch. - Data Pipelines: Airflow, Glue, Step Functions. - Standards: OpenTelemetry, E2E lineage strategy, CDC tooling (AWS DMS, Debezium). - Databases: SQL, Elasticsearch/OpenSearch stacks. - Infrastructure: AMI creation, deployment, CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation). - Note: Military experience is equivalent to professional experience Eligibility Requirement: - Legal authorization to work in the U.S. is required. We will not sponsor individuals for employment visas, now or in the future, for this job. Desired Characteristics: - Web application stacks (Node.js, Vue, React). - Security/compliance observability integration. - Custom connectors/APIs for observability tools. - OpenMetadata experience. - Machine learning or AI-driven automation techniques. - Kubernetes for container orchestration. Additional Information: The base pay range for this position is $93,000 - $124,000. The specific pay offered may be influenced by a variety of factors, including the candidate’s experience, education, and skill set. This position is also eligible for an annual discretionary bonus based on a percentage of your base salary/ commission based on the plan. This posting is expected to close on March 31, 2026. Healthcare benefits include medical, dental, vision, and prescription drug coverage; access to a Health Coach, a 24/7 nurse-based resource; and access to the Employee Assistance Program, providing 24/7 confidential assessment, counseling and referral services. Retirement benefits include the GE Retirement Savings Plan, a tax-advantaged 401(k) savings opportunity with company matching contributions and company retirement contributions, as well as access to Fidelity resources and planning consultants. Other benefits include tuition assistance, adoption assistance, paid parental leave, disability insurance, life insurance, and paid time-off for vacation or illness. General Electric Company, Ropcor, Inc., their successors, and in some cases their affiliates, each sponsor certain employee benefit plans or programs (i.e., is a “Sponsor”). Each Sponsor reserves the right to terminate, amend, suspend, replace, or modify its benefit plans and programs at any time and for any reason, in its sole discretion. No individual has a vested right to any benefit under a Sponsor’s welfare benefit plan or program. This document does not create a contract of employment with any individual. This role requires access to U.S. export-controlled information. Therefore, employment will be contingent upon the ability to prove that you meet the status of a U.S. Person as one of the following: U.S. lawful permanent resident, U.S. Citizen, have been granted asylee or refugee status (i.e., a protected individual under the Immigration and Naturalization Act, 8 U.S.C. 1324b(a)(3)). Additional Information GE Aerospace offers a great work environment, professional development, challenging careers, and competitive compensation. GE Aerospace is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, national or ethnic origin, sex, sexual orientation, gender identity or expression, age, disability, protected veteran status or other characteristics protected by law. GE Aerospace will only employ those who are legally authorized to work in the United States for this opening. Any offer of employment is conditioned upon the successful completion of a drug screen (as applicable). Relocation Assistance Provided: No #LI-Remote - This is a remote position

United States + 1 moreAll locations: United States | Trinidad And Tobago
$93K - $124K / year
Job Closed
Supplier.io logo

Senior Data Engineer

Supplier.io

The leading provider of supplier diversity solutions. 1 in 5 Fortune 50 companies relies on supplier.io.

Data Engineer98 days ago
OtherRemoteTeam 51-200H1B No Sponsor

• Execute our cohesive data strategy that aligns with company objectives. • Lead the design, development, and evolution of Supplier.io data architecture, ensuring scalability, reliability, performance and security. • Execute and influence a cohesive data strategy that aligns with company objectives and supports analytics, reporting, and downstream product use cases. • Design, build, and maintain robust, cloud-native data pipelines and data warehouses, with Snowflake as a core component of the platform. • Own complex data modeling initiatives, including dimensional and analytical models that support business intelligence and advance analytics. • Evaluate, introduce, and integrate new tools, technologies, and methodologies, while aligning legacy counterparts for improved data ingestion, transformation, storage, and processing. • Drive continuous improvement by optimizing data pipelines, query performance, reliability, observability, and cost efficiency. • Partner with Infrastructure, Product, Analytics, and Engineering teams to ensure data systems meet best practices, security standards, and business needs. • Provide technical leadership and mentorship to other data engineers, contributing to code reviews, design discussions, and engineering standards. • Create and maintain comprehensive technical documentation, including architecture diagrams, data flow maps, runbooks, security considerations, and operations procedures. • Participate in agile planning and executive, contributing to estimation, prioritization, and delivery of high-impact data initiatives. • Troubleshoot and resolve complex, cross-system data issues and incidents.

United States
Job Closed