Crum & Forster, part of Fairfax Financial Holdings Limited, is an admitted property and casualty insurance company that's been A-rated by A.M. Best. As an emplo
Associate Data Engineer
Location
New Jersey
Posted
5 days ago
Salary
$71.6K - $105K / year
Seniority
Mid Level
Job Description
Associate Data Engineer
Crum & Forster
• Build and maintain batch and streaming ETL/ELT pipelines that feed a cloud data warehouse • Develop, schedule, and monitor cloud data jobs, diagnosing failures and tuning for cost and performance • Write idempotent load logic that handles reprocessing and backfills without creating duplicate data • Integrate external data providers and APIs with authentication, error handling, and retries • Implement data quality checks, validation, and alerting to catch pipeline issues early • Manage and deploy pipelines using infrastructure-as-code and CI/CD • Support data migrations and service updates with minimal downtime • Deliver clean, analytics, model-ready datasets for data scientists and analysts
Job Requirements
- 1-5+ years of professional experience in data engineering or a related software/data role
- Bachelor's degree in Computer Science, Data Engineering, or a related technical field or equivalent experience
- Strong programming skills in Python and SQL
- Familiarity with ETL/ELT concepts and building data pipelines
- Experience with at least one major cloud platform (AWS preferred)
- Familiarity with REST APIs and integrating external data sources
- Strong attention to data quality and reliability
- Ability to communicate clearly with both technical and business audiences
Benefits
- Competitive compensation package
- Generous 401K employer match
- Employee Stock Purchase plan with employer matching
- Generous Paid Time Off
- Excellent benefits that go beyond health, dental & vision. Our programs are focused on your whole family’s wellness, including your physical, mental and financial wellbeing
- A core C&F tenet is supporting your career development, so we provide a wealth of ways for you to keep learning, which may include tuition reimbursement, industry-related certifications and professional training to keep you progressing on your chosen path
- A dynamic, ambitious, fun and exciting work environment
- We believe you do well by doing good and want to encourage a spirit of social and community responsibility, matching donation program, volunteer opportunities, and an employee-driven corporate giving program that lets you participate and support your community
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Being a Senior Data Engineer in this context means being the strategic pillar that connects infrastructure robustness with the company’s continuous telemetry stream. • You don’t just connect point A to point B; you design scalable, secure, and auditable ecosystems, ensuring that behavioral data generated by products arrives with high quality, low latency, and full compliance. • You operate at the intersection of Software Engineering and Data Architecture, transforming complex product requirements into resilient platforms based on Infrastructure as Code (IaC), proactive monitoring, and end-to-end governance.
Senior Data Engineer
SysLogic, Inc.Driving technology solution excellence with people, platforms and partnerships that impact the world.
• Designs and implements secure data integration solutions for operations and analytics, leveraging best practices to design and implement high-performing ETL/ELT solutions • Performs root cause analysis on data sets and processes to answer specific business questions and identify opportunities for improvement • Builds and maintains KPI dashboards to disseminate information to measure/track results and drive business decisions • Integrate reports, audits, and processes from various business systems • Advocates for data quality and increases awareness of data stewardship and data governance concepts among data producers and consumers • Assist with defining and maintaining business rules, policies, and governance for data • Collaborates with Data Architect on project goals and approach • Assist peers and data engineers as needed, to keep the team as productive and efficient as possible • Work with QA and development peers to review and test code changes
Senior Data Migration Specialist
CapcoCapco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries
Senior Data Migration SpecialistAbout the ProjectWe are looking for an experienced Senior Data Migration Specialist to provide expertise on a large-scale transformation programme within the financial services sector. This opportunity is suited to a senior migration specialist who combines strong technical knowledge with experience coordinating complex migration activities across business and technology teams. The engagement focuses on migrating data from a legacy SaaS platform to a new strategic solution. The programme is currently shaping its migration approach and entering a critical phase of planning, reconciliation design, and cutover preparation. Scope of services:As a Senior Data Migration Specialist, you will: - Coordinate the development and delivery of the end-to-end data migration strategy. - Define migration approaches, data quality standards, validation criteria, and reconciliation processes. - Coordinate the design and implementation of qualitative and financial reconciliation tooling. - Collaborate with business stakeholders, solution architects, engineering teams, testing teams, and third-party vendors to ensure successful migration outcomes. - Facilitate migration planning activities, including migration waves, cutover planning, rollback scenarios, and readiness assessments. - Identify migration risks, dependencies, assumptions, and issues throughout the programme lifecycle. - Communicate delivery progress, key risks, and dependencies to programme stakeholders. - Contribute to the continuous improvement of migration methodologies, governance practices, and delivery standards. Required Experience - Proven experience leading enterprise-scale data migration initiatives within financial services or another highly regulated industry. - Strong technical knowledge of: - data migration methodologies, - ETL processes, - data quality management, - reconciliation approaches, - migration tooling and validation techniques. - Experience working with SaaS platforms and complex system migrations. - Ability to deliver migration activities in environments with limited documentation and evolving business knowledge. - Strong stakeholder management and cross-functional collaboration skills. - Excellent analytical, problem-solving, communication, and organisational abilities. - Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline, or equivalent professional experience. Project ChallengesThe programme involves migrating from a legacy SaaS platform with limited internal knowledge and documentation. Success will depend on establishing a robust migration strategy, building effective reconciliation capabilities, and coordinating multiple stakeholders across business, technology, and vendor teams. Initial DeliverablesKey deliverables during the initial phase of the engagement include: - Finalising the overall data migration strategy. - Defining reconciliation processes and supporting the preparation of qualitative and financial reconciliation tooling. - Establishing migration governance, validation, and reporting processes. - Coordinating the preparation of cutover and rollback plans together with business, technology teams, and the solution vendor. - Supporting the programme's readiness for migration rehearsals and the production cutover. We offer a flexible collaboration model based on a B2B contract, with the opportunity to work on diverse projects. RECRUITMENT PROCESS: - HR interview with the recruiter - Technical interview with Capco Engineering team - Client interview - Feedback and offer We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter. #LI-HYBRID
Senior Data Pipeline Engineer – Elastic
SERVISS - HUBZone CertifiedServing our Country, Clients, & Community -- Providing IT & Cyber Professionals the Freedom to Thrive
• Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch • Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility • Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting • Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture • Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic • Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source • Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations • Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders • Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability




