DoiT develops the technology and expertise needed to solve both essential and complex cloud challenges.
Principal Data Engineer
Location
United Kingdom
Posted
3 days ago
Salary
0
Seniority
Lead
Job Description
Principal Data Engineer
DoiT International
• Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies. • Lead system-wide architectural decisions, focusing on data flow, performance, and resilience. Actively contribute to the codebase with high quality code. • Lead major technical initiatives, reduce technical debt and ensure the platform meets the reliability and scalability SLAs. Champion best engineering practices, code quality, testing and maintainability. • Collaborate with product and engineering teams and R&D management to define the technical roadmap, review architecture and mentor junior engineers
Job Requirements
- 8+ years of backend engineering experience, with 3+ years architecting high-load systems or data pipelines in a production environment.
- Deep expertise in distributed systems using modern languages (Go, Java, Rust, or Python).
- Strong, hands-on experience with relational and analytical databases (Postgres, ClickHouse is preferred).
- Proven experience with microservices, containers, and modern DevOps practices (Docker, Kubernetes, GitOps, CI/CD).
- Demonstrated ability to combine hands-on coding with architectural leadership, including strong debugging, benchmarking, and performance optimization skills.
Benefits
- Unlimited PTO
- Flexible Working Options
- Health Insurance
- Parental Leave
- Employee Stock Option Plan
- Home Office Allowance
- Professional Development Stipend
- Peer Recognition Program
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
Logicalis SpainSomos Arquitectos Del Cambio, ayudamos a las organizaciones a tener éxito en un mundo cada vez más digitalizado.
• Desarrollar y mantener procesos de integración de datos utilizando SSIS. • Diseñar y evolucionar dashboards e informes en Power BI orientados a negocio. • Participar en la mejora de las soluciones de datos, incorporando Databricks cuando sea necesario. • Monitorizar pipelines de datos y resolver incidencias para asegurar la continuidad operativa. • Colaborar con equipos internos y cliente para dar soporte a necesidades analíticas.
Data Engineer Location: Orlando United States Job Description: Job#: 3035605 Job Description: Job Description - Data Engineer (Informatica IDMC / SQL) Title: Data Engineer Location: Remote (U.S. based) Contract Length: 6 months (with potential extension) Position Summary We are seeking a highly skilled Data Engineer with strong experience in Informatica IDMC (CDI required, CAI preferred) and advanced SQL capabilities. This role will support the redesign of our ETL processes, the build‑out of a new raw data zone, and the modernization of our data integration framework. The ideal candidate is highly independent, proactive, and able to operate with minimal requirements while collaborating closely with business and technical stakeholders. This is a hands‑on engineering role requiring strong problem‑solving skills, the ability to debug complex data pipelines, and comfort working in a fast‑moving environment with evolving business rules. Key Responsibilities - Develop, maintain, and optimize ETL pipelines using Informatica IDMC (CDI). - Support integrations using IDMC CAI for API‑driven workflows (nice to have). - Work with SQL extensively to debug, validate, and troubleshoot data issues. - Assist in building and maintaining a new raw zone to support data history retention and reprocessing. - Collaborate with the team to abstract and document business rules for improved visibility and governance. - Analyze data to identify gaps, inconsistencies, or rule failures. - Work independently to gather missing requirements, ask the right questions, and drive tasks to completion. - Partner with business analysts and stakeholders to understand data needs and ensure accuracy. - Participate in the evolution of ETL frameworks, including Python‑based components that interact with IDMC APIs. - Support potential future work involving JAMS scheduling or .NET‑related tasks (nice to have). Required Skills & Experience - Strong Informatica IDMC experience (CDI required). - Advanced SQL skills with the ability to debug and analyze complex datasets. - Experience building or maintaining ETL pipelines in enterprise environments. - Ability to work independently with minimal direction. - Strong communication skills and comfort asking clarifying questions. - Experience working in environments with evolving business rules and limited documentation. Nice‑to‑Have Skills - IDMC CAI (Application Integration) for API/JSON workflows. - Experience working with JSON, APIs, and related data structures. - Familiarity with Python (junior level acceptable) for reading or understanding framework integrations. - Exposure to AI‑assisted coding tools (Claude, GitHub Copilot, etc.). - Experience with JAMS or other scheduling/orchestration tools. - Background in .NET / C# (helpful for future cross‑team needs). Soft Skills & Work Style - Highly independent and self‑directed. - Comfortable operating without fully defined requirements. - Strong analytical and problem‑solving mindset. - Able to collaborate effectively with both technical and business teams. - Not afraid to push back constructively when needed. Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Everforth Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Everforth Apex team member can provide. Everforth Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems. Employee Type: Contract Remote: Yes Location: Orlando, FL, US Job Type: Pay Range: $65 - $75 per hour
Principal Data Engineer
DoiTDoiT is a global technology company that works with cloud-driven organizations to leverage the cloud to drive business growth and innovation. We combine data, technology, and human expertise to ensure our customers operate in a well-architected and scalable state - from planning to production. Delivering DoiT Cloud Intelligence, the only solution that integrates advanced technology with human intelligence, we help our customers solve complex multicloud problems and drive efficiency. With decades of multicloud experience, we have specializations in Kubernetes, GenAI, CloudOps, and more. An award-winning strategic partner of AWS, Google Cloud, and Microsoft Azure, we work alongside more than 4,000 customers worldwide.
Role Description Our Principal Data Engineer will be an integral part of our Engineering teams in EMEA. This role is based remotely as a full-time employee in the UK, Ireland, Estonia, the Netherlands, Sweden, and Israel. We are also open to contractors in East Europe and Portugal. As a Principal Data Engineer, you will be both a hands-on contributor and a key architectural leader. You will design and build large-scale backend services and high-throughput data pipelines while also shaping the long-term technical direction of PerfectScale’s platform. This role combines deep technical ownership with active contribution to critical code, infrastructure, and performance-sensitive workloads. Responsibilities - System Ownership: Design, build, and deploy large-scale distributed systems and high-throughput data pipelines using Go and cloud-native technologies. - Architecture & Code: Lead system-wide architectural decisions, focusing on data flow, performance, and resilience. Actively contribute to the codebase with high quality code. - Technical Leadership: Lead major technical initiatives, reduce technical debt and ensure the platform meets the reliability and scalability SLAs. Champion best engineering practices, code quality, testing and maintainability. - Collaboration: Collaborate with product and engineering teams and R&D management to define the technical roadmap, review architecture and mentor junior engineers. Qualifications - 8+ years of backend engineering experience, with 3+ years architecting high-load systems or data pipelines in a production environment. - Deep expertise in distributed systems using modern languages (Go, Java, Rust, or Python). - Strong, hands-on experience with relational and analytical databases (Postgres, ClickHouse is preferred). - Proven experience with microservices, containers, and modern DevOps practices (Docker, Kubernetes, GitOps, CI/CD). - Demonstrated ability to combine hands-on coding with architectural leadership, including strong debugging, benchmarking, and performance optimization skills. Bonus Points - Deep Golang expertise - Deep Kubernetes Knowledge - Experience with modern data engineering technologies: Spark, Trino, Iceberg, Parquet, ClickHouse, DBT - DBA background (relational, OLAP, columnar) - Expertise in telemetry and time series - Cloud expertise (AWS, GCP, Azure) Benefits - Unlimited PTO - Flexible Working Options - Health Insurance - Parental Leave - Employee Stock Option Plan - Home Office Allowance - Professional Development Stipend - Peer Recognition Program Company Description DoiT is a global technology company that works with cloud-driven organizations to leverage the cloud to drive business growth and innovation. We combine data, technology, and human expertise to ensure our customers operate in a well-architected and scalable state - from planning to production. Delivering DoiT Cloud Intelligence, the only solution that integrates advanced technology with human intelligence, we help our customers solve complex multicloud problems and drive efficiency. With decades of multicloud experience, we have specializations in Kubernetes, GenAI, CloudOps, and more. An award-winning strategic partner of AWS, Google Cloud, and Microsoft Azure, we work alongside more than 4,000 customers worldwide.
Generative AI Data Engineer
NEORISNEORIS is a Digital Accelerator that helps companies step into the future.
Role Description Estamos en búsqueda de: Ingeniero/a de Datos IA Generativa (RAG) - Diseñar, implementar y mantener soluciones basadas en RAG con grandes volúmenes de documentos - Desarrollar y optimizar pipelines de ingestión y procesamiento de datos (ETLs) - Definir y gestionar bases de datos vectoriales y su ciclo de vida - Optimizar estrategias de chunking, prompting y recuperación de información - Garantizar el tratamiento seguro de información sensible - Implementar técnicas de reranking y mejora de relevancia en sistemas de búsqueda Qualifications - Experiencia mínima de 3 años en roles similares - Experiencia real en tratamiento y procesamiento de grandes volúmenes de documentos - Experiencia en definición, implementación y mantenimiento de bases de datos vectoriales (RAG) - Conocimientos sólidos en tratamiento de información sensible - Experiencia en desarrollo de procesos ETL - Experiencia en optimización de chunking y prompting - Conocimiento de técnicas de reranker Requirements - Conocimiento de estrategias de caché y optimización de recursos - Experiencia con frameworks de IA modernos - Conocimiento en fine-tuning de LLMs o SLMs - Experiencia con bases de datos de grafos (GraphRAG o KAG) - Experiencia en Spark o PySpark Benefits - Contrato indefinido con salario competitivo - Modalidad flexible y posibilidad de trabajo remoto - Plan de carrera personalizado y formación continua - Participación en proyectos estables con alto componente técnico - Flexibilidad horaria y enfoque en la conciliación - Beneficios sociales adaptados a tus necesidades



