Arbor Education logo
Arbor Education

Arbor MIS helps schools and MATs work more easily and collaboratively. Join a free webinar: http://bit.ly/Arbor-webinars

Staff Engineer (Data)

Data EngineerData EngineerFull TimeRemoteLeadTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United Kingdom

Posted

8 days ago

Salary

£100K - £120K / year

Seniority

Lead

Job Description

Staff Engineer (Data)

Arbor Education

Role Description As a Staff Engineer you will help drive architecture and technical strategy for our Data domain, spanning the entire journey from transactional source to analytical insight. You will evolve how data is leveraged across Arbor, delivering value that ensures our OLAP and AI capabilities provide a competitive edge and our OLTP foundations are built for scale. It’s a wide impacting and exciting role, crucial for Arbor's next stage of growth. We’re looking for candidates who are highly collaborative, energised by complex problems, and have a proactive approach. You will work collaboratively with multiple teams, Technical Leads, Product Directors, and Engineering Leadership to deliver strategic business objectives, all while reimagining ways of working to ensure we stay at the forefront of the industry’s AI evolution. Core Responsibilities - Define and evangelise target architectures that bridge our transactional, analytical, and AI systems, ensuring our data remains a competitive advantage. - Be a leader for our end-to-end data lifecycle, from OLTP schema design and migrations to OLAP governance, platform and analytics. - Partner with Technical Leads to provide hands-on guidance supporting feature delivery, tech debt paydown, and architecture improvements. - Collaborate with Product Directors to understand product vision and translate this into deliverables, aligning commercial and engineering goals. - Lead our shift to an AI-First way of working, architecting the data foundations to enable AI in our products and championing the latest approaches to help drive productivity gains. - Architect the future infrastructure required for LLM orchestration, Retrieval-Augmented Generation (RAG), and real-time model inference at scale. - Mentor and coach Technical Leads/Senior Engineers on architectural and engineering excellence, continually raising our bar and supporting career growth. - Act as a role model for technical leadership — work with pace, be pragmatic, and stay laser focused on outcomes not output. - Head up architectural reviews for your domain and ensure all designs meet Arbor’s quality, reliability, security and compliance standards. - Collaborate with Staff Engineers and Principal Engineers to shape Arbor’s broader technology strategy, working outside your domain as needed. - Partner with Engineering Management to help grow teams, identify and resolve systemic bottlenecks, ensuring the success of our strategic goals. Qualifications - Extensive experience overseeing data architecture and a track record of delivering iterative outcomes across one or more OLAP domains. - Strong understanding of data modelling techniques (Star, Medallion, etc.) and distributed data systems within cloud-native environments (Snowflake, etc.). - Experience in building and leveraging unstructured data across disparate systems to enable product development. - Examples of communication and influencing across technical and non-technical audiences to achieve positive outcomes. - An ability to support the growth of engineers and technical leads whilst still delivering value across distributed, cross-functional teams. - Demonstrable experience working in an ownership culture where quality, performance, observability, and security are core responsibilities for every engineer. - An understanding and opinion on how AI-first engineering will change the data ecosystem and ways of working, ideally with worked examples. - Examples of contributing to or leading technical communities of practice (e.g. chapters, guilds, architecture councils). - Practical knowledge of DataOps principles, including CI/CD for data and the orchestration of complex pipelines (e.g., AWS, Debezium, Git, Infra as Code). - Good commercial knowledge of data security standards, encryption at rest/transit, and relevant compliance laws. - Platform financial acumen - demonstrable experience of optimising SaaS platform spend, and the use of forecasting models. Bonus Skills - AI/ML Engineering & MLOps, including model deployment/serving and monitoring. - Experience with federated learning and/or privacy-enhancing technologies (PETs). - Direct experience with LLM Ops, including prompt engineering at scale, and token cost optimisation. Benefits - A dedicated wellbeing team who champion initiatives such as mindfulness, lunch n learns, manager training, mental health first aid training and much more! - 32 days holiday (plus Bank Holidays). This is made up of 25 days annual leave plus 7 extra company wide days given over Easter, Summer & Christmas. - Life Assurance paid out at 3x annual salary. - Comprehensive wellness benefit provided by AIG Smart Health, which provides a 24/7 virtual GP service, Mental health support, Counselling, and personalised Health Checks. - Private Dental Insurance with Bupa. - Salary sacrifice Pension provided by Scottish Widows. - Enhanced maternity and adoption leave (20 weeks full pay) and paternity (6 weeks full pay) pay. - 5 free return to work maternity coaching sessions, helping you adapt to this new exciting time of life! - Access to services such as Calm and Bippit (financial wellbeing coaching). - All of our roles champion flexible working and we are happy to discuss what this means to you. - Social committees that plan team, office and company wide events to bring people together and celebrate success. - Dedicated professional development training budget (CPD courses, upskilling resources, professional memberships etc). - Volunteer with a charity of your choice for a day each year. - Dog friendly offices! Interview Process - Phone screen - 1st stage - 2nd stage

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description We are currently looking for multiple Data Architects for one of the leading tech companies in Germany. The position is 100% remote and long-term. - Freelancing/Contracting - Start: ASAP - 100% remote - Duration: long-term 12+ months - Capacity: full-time, part-time also possible - Language: English (no German needed!!) - German business hours Requirements - Experience in data architecture, including designing scalable data platforms and data models. - Knowledge of Azure-based data platforms, including Azure Data Factory, ADLS, Synapse, Azure SQL, and Event Hubs. - Experience with Databricks, Apache Spark, and Delta Lake for modern data processing architectures. - Understanding of data modeling approaches, including dimensional, relational, and NoSQL models. - Familiarity with data governance, security, and platform reliability in enterprise environments. - Knowledge of Python, SQL, and DevOps practices such as CI/CD, Terraform, Docker, Kubernetes, or AKS. Qualifications - Please include a self-assessment (0-10, 10 = expert level) in the following areas: - Data Architecture (in general) - Azure-based data platforms - Databricks - Apache Spark - Delta Lake - Data Modeling (dimensional, relational, and NoSQL) - Data Governance & Security - Azure Data Factory - ADLS - Synapse - Azure SQL - Event Hubs - Python - SQL - DevOps - CI/CD - Terraform - Docker - Kubernetes - AKS

CET (UTC+1)

Role Description We are looking for a highly skilled and experienced L2 Data Engineer to join our growing Data & Analytics team. In this role, you will lead the design, development, optimization, and maintenance of scalable enterprise data platforms and cloud-native data solutions. You will work closely with architects, analysts, and business stakeholders to build high-performance data pipelines and modern lakehouse solutions that support advanced analytics, reporting, and data-driven decision-making. This opportunity is ideal for a senior data professional with strong hands-on expertise in Databricks and the Microsoft Azure ecosystem, who is passionate about building reliable, scalable, and optimized data platforms in enterprise environments. Qualifications - 5+ years of professional experience in Data Engineering or related roles. - Strong expertise in Python for enterprise data processing, transformation, and automation. - Advanced hands-on experience with Pandas, PySpark, and Spark SQL for large-scale distributed processing. - Strong experience with Databricks, including cluster management, notebook development, workflow orchestration, Delta Lake, and performance optimization. - Extensive experience building and managing enterprise data pipelines using Azure Data Factory. - Strong working knowledge of Azure Synapse Analytics, particularly Spark pool integration and enterprise data warehousing concepts. - Advanced SQL skills including query optimization, performance tuning, indexing strategies, and troubleshooting. - Strong understanding of data lake architecture, Delta Lake, incremental processing, partitioning, and lakehouse concepts. - Experience implementing data governance, security, access controls, and monitoring within cloud data platforms. - Experience handling production support, troubleshooting, and optimization of enterprise data platforms. Requirements - Design, develop, and optimize enterprise-scale data pipelines and ETL/ELT workflows using Azure and Databricks technologies. - Architect and implement scalable data ingestion, transformation, and orchestration processes using Azure Data Factory, Databricks, and Azure Synapse Analytics. - Develop high-performance data transformation frameworks using PySpark, Python, and Spark SQL for large-scale distributed data processing. - Optimize SQL queries, Spark jobs, and data workflows to improve performance, scalability, and cost efficiency. - Lead data migration initiatives, including SQL Server migrations and modernization of legacy data platforms. - Implement and maintain Delta Lake architecture, incremental data loading strategies, and enterprise data lake best practices. - Collaborate with architects and cross-functional teams to design robust and scalable data models aligned with business and governance standards. - Monitor and troubleshoot production pipelines, perform root-cause analysis, and implement preventive measures for recurring issues. - Support CI/CD implementation and infrastructure automation for data engineering workflows. - Mentor junior engineers and contribute to engineering standards, reusable frameworks, and technical best practices. - Create and maintain technical documentation including architecture diagrams, pipeline documentation, and operational runbooks. - Evaluate and recommend modern data engineering tools, frameworks, and optimization strategies. Benefits - Experience with Terraform for Azure infrastructure provisioning and Infrastructure-as-Code (IaC). - Experience implementing CI/CD pipelines for data engineering deployments. - Exposure to Lakehouse Federation, Delta Sharing, and modern data sharing architectures. - Experience with streaming and near real-time data processing solutions. - Knowledge of DevOps practices and cloud cost optimization strategies. Certification Requirement Candidates are expected to hold or be actively working toward the Databricks Certified Data Engineer Professional certification. This certification validates advanced expertise across the following domains: - Advanced ETL and ELT development using Spark SQL and PySpark - Enterprise-grade pipeline orchestration and optimization - Data modeling and scalable lakehouse architecture - Performance tuning and distributed data processing optimization - Advanced data governance and security implementation - Production-grade data engineering practices within the Databricks ecosystem

Worldwide
NEORIS logo

Generative AI Engineer - Document Processing of Sensitive Data

NEORIS

NEORIS is a Digital Accelerator that helps companies step into the future.

Data Engineer8 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

Role Description En EPAM NEORIS, creemos que el verdadero cambio nace del talento. Hoy, como parte de EPAM Systems, ampliamos nuestro alcance global y nuestras capacidades, manteniendo lo más importante: una cultura donde cada persona puede crecer, aportar y ser protagonista. No buscamos solo cubrir posiciones. Buscamos talento que quiera superarse, aprender constantemente y dejar huella en proyectos de alto impacto. Estamos en búsqueda de perfiles especializados en IA Generativa y procesamiento documental para incorporarse a un proyecto estratégico e innovador dentro del sector financiero. Principales responsabilidades: - Diseño e implementación de soluciones basadas en IA Generativa y arquitecturas RAG. - Procesamiento masivo y estructuración de documentos complejos. - Definición, mantenimiento y optimización de bases de datos vectoriales. - Desarrollo y optimización de pipelines ETL para tratamiento de información. - Implementación de estrategias de chunking, prompting y reranking. - Participación en la evolución técnica y mejora continua de soluciones IA en producción. - Colaboración con equipos multidisciplinares en entornos ágiles. Qualifications - Excluyentes: - Experiencia real en tratamiento y procesamiento de grandes volúmenes de documentos. - Experiencia en definición, implementación y ciclo de vida/mantenimiento de bases de datos vectoriales (RAG). - Conocimientos en tratamiento de información sensible. - Experiencia en procesos ETL. - Experiencia en optimización de chunking y prompting. - Conocimiento de técnicas de reranker. - Deseables: - Conocimiento de estrategias de caché y optimización de recursos. - Conocimiento de los principales frameworks de IA. - Experiencia en fine tuning de LLMs o SLMs. - Conocimiento de bases de datos basadas en grafos (GraphRAG, KAG, etc.). - Experiencia con Spark. Benefits - Contrato indefinido con salario competitivo. - Modalidad 100% remota. - Plan de carrera personalizado y formación continua. - Participación en proyectos estables con alto componente técnico e innovador. - Flexibilidad horaria y enfoque en la conciliación. - Beneficios sociales adaptados a tus necesidades.

Spain
Job Closed

Title: SAP Data Migration Engineer (LTMC / SLT / LVM) Location: Remote Job Description: Full Time Experienced Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. As we continue to grow, we’re looking for a skilled SAP Data Migration Engineer (LTMC / SLT / LVM) to join our dynamic team and contribute to our mission of transforming business processes through technology. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. Job Title: SAP Data Migration Engineer (LTMC / SLT / LVM) Location: 100% Remote (Continental United States) Position Type: In-house Bright Vision Technologies SOW engagement (no third-party client or vendor) Salary: $100K - $150K Experience: 5+ years Sponsorship: No new H1B sponsorship available. H1B transfers welcomed for qualified candidates. Employment Type: Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party) Engagement: Long-term, multi-year, aligned to the Bright Vision SOW delivery roadmap Compensation: Competitive base salary commensurate with experience, plus benefits Employment Terms & Visa Policy This is a 100% remote, full-time, direct W2 position with Bright Vision Technologies. This role is part of Bright Vision Technologies’ in-house Statement of Work (SOW) engagement. The client, end customer, and employer for this position is Bright Vision Technologies — there is no third-party client, vendor, or implementation partner involved. We do not engage in C2C, 1099, or third-party arrangements for this role. BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE. Candidates must be willing to work directly as a full-time W2 employee of Bright Vision Technologies and contribute to our in-house SOW deliverables. No new H1B sponsorship is available for this role. However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply. We will support H1B transfers for qualified candidates. For every role, a technical coding assessment is mandatory. Please apply only if you are confident in your technical abilities and hands-on experience. Job Summary We are seeking an experienced SAP Data Migration Engineer to design, execute, and support large-scale data migration initiatives within SAP S/4HANA environments. This role focuses on the full data migration lifecycle — extraction, transformation, validation, reconciliation, and cutover — to ensure accurate, complete, and compliant migration of enterprise data from legacy systems into SAP. The ideal candidate will combine strong hands-on experience with SAP LTMC, SLT, LVM, and S/4HANA migration tools with deep understanding of SAP data structures, business processes, and data governance, and will partner closely with functional teams, business owners, and infrastructure stakeholders during all phases of migration. Key Responsibilities - Design and execute SAP data migration strategies for S/4HANA implementations, including conversion and greenfield scenarios. - Perform data extraction from legacy systems using SAP-provided and custom tools and prepare data for ingestion into SAP. - Configure and utilize SAP LTMC (Legacy Transfer Migration Cockpit), including custom migration objects where required. - Implement real-time replication scenarios using SAP SLT (System Landscape Transformation), including transformation rules and filter conditions. - Manage logical system setups and replication configurations for hybrid SAP environments. - Support system refreshes and landscape virtualization activities using SAP LVM (Landscape Virtualization Management). - Design and execute data transformation, cleansing, and enrichment processes prior to migration. - Develop comprehensive validation and reconciliation reports to ensure data accuracy and completeness. - Identify and resolve data inconsistencies, duplicates, and orphan records prior to go-live. - Support mock migrations, dress rehearsals, and the final cutover, including detailed runbook execution and rollback planning. - Optimize performance for large-volume data loads, including parallelization, package sizing, and database tuning. - Collaborate with functional teams to validate master and transactional data against business expectations. - Ensure compliance with enterprise data governance, audit, and privacy standards. - Maintain comprehensive, current technical documentation — including architecture diagrams, design decisions, configuration references, runbooks, and operational procedures — so that the system remains supportable, auditable, and easy to onboard new engineers onto over time. Required Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of SAP data migration experience. - Strong hands-on experience with SAP LTMC and S/4HANA migration tools. - Experience with SAP SLT replication scenarios. - Working knowledge of SAP LVM for system refresh and landscape management. - Strong understanding of SAP master and transactional data structures. - Experience performing data validation and reconciliation processes. - Strong SQL and data analysis skills. - Experience working in enterprise SAP landscapes during major implementations. - Strong troubleshooting and documentation skills. Preferred Qualifications - Experience participating in S/4HANA greenfield or brownfield implementations. - Exposure to SAP Data Services or other ETL platforms. - Experience with high-volume, multi-source data migrations. - Working knowledge of SAP HANA database structures. - SAP S/4HANA certification. How to Apply Would you like to know more about this opportunity? Learn more about Bright Vision Technologies at www.bvteck.com. We recognize that our people are our strength, and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans. Position offered by “No Fee Agency.” Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Worldwide
$100K - $150K / year