Kraken Digital Asset Exchange logo
Kraken Digital Asset Exchange

We put the power in your hands to buy, sell, and trade digital currency 🌏

Senior Data Engineer – Agents Systems

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1,001-5,000Since 2011H1B No SponsorCompany SiteLinkedIn

Location

United Kingdom

Posted

2 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishApacheKafkaPythonScalaSQL

Job Description

Senior Data Engineer – Agents Systems

Kraken Digital Asset Exchange

• Own and evolve streaming data pipelines that power live inference and real-time model serving across Kraken's AI infrastructure • Design and build feature stores that serve low-latency, high-reliability features to production ML models • Implement and maintain streaming systems using RisingWave, Apache Flink, or Kafka Streams, selecting the right tool for the workload • Partner with ML engineers and AI infra teams to define data contracts, feature schemas, and pipeline SLAs • Drive pipelines toward real-time where batch exists today reducing latency from hours to seconds • Ensure data quality, observability, and auditability across all streaming and feature engineering systems • Contribute to inference pipeline tooling where data engineering and model serving intersect • Evaluate emerging streaming and feature store technologies and shape the team's technical roadmap

Job Requirements

  • 5+ years in data engineering with at least 2 years focused on streaming systems in production
  • Hands-on experience with RisingWave, Apache Flink, Kafka Streams, or comparable stream processing frameworks
  • Strong understanding of feature store design — online/offline consistency, point-in-time correctness, low-latency serving
  • Experience building data pipelines that feed production ML models or inference systems
  • Proficiency in Python and/or Scala; SQL fluency required
  • Familiarity with data quality frameworks, pipeline observability, and SLA ownership
  • Comfortable operating in a fast-moving, ambiguous environment embedded within an AI-focused team

Benefits

  • Our commitment to diversity and inclusion
  • Opportunity for professional development
  • Remote work options

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description We are looking for a Senior Data Engineer - Surveillance & Interoperability to join our team and support the design, development, and implementation of large-scale data integration and interoperability solutions. The role focuses on integrating data from multiple heterogeneous systems, designing scalable data architectures, implementing interoperability frameworks, and developing reliable data pipelines that enable seamless information exchange, surveillance, monitoring, and analytics. You will collaborate closely with technical and business stakeholders to deliver secure, scalable, and high-performing data solutions in complex environments. Key Responsibilities - Design and implement data integration and interoperability solutions across multiple systems and platforms - Design and maintain scalable data architectures and integration frameworks - Develop and maintain ETL/ELT pipelines for data ingestion, transformation, validation, and harmonisation - Design and implement interoperability middleware and API-based integration services - Develop and maintain data exchange mechanisms between heterogeneous systems - Design and implement canonical data models and metadata harmonisation processes - Support the implementation of surveillance, monitoring, and reporting data solutions - Develop and maintain cloud-based and hybrid data integration platforms - Ensure data quality, consistency, reliability, and performance across data ecosystems - Contribute to technical architecture decisions and interoperability standards implementation - Produce technical documentation, architecture artefacts, and implementation guidelines Qualifications - Bachelor's degree in Computer Science, Data Engineering, Software Engineering, Information Systems, or a related field - Minimum 8 years of relevant professional experience in Data Engineering, Data Integration, or Information Systems - Minimum 4 years of experience working on complex data integration or interoperability projects - Strong experience designing and implementing enterprise data architectures - Strong experience with Python development - Strong experience with SQL and relational databases - Experience designing and implementing ETL/ELT pipelines - Experience developing and integrating REST APIs and data exchange services - Experience with interoperability frameworks, middleware solutions, and integration architectures - Experience working with heterogeneous data sources and distributed systems - Experience with cloud platforms such as Azure, AWS, or GCP - Experience with data modelling, metadata management, and data governance practices - Understanding of data security, access control, audit logging, and privacy principles - Strong analytical and problem-solving skills - Experience producing technical documentation and solution designs - Excellent written and verbal communication skills in English Nice to Have - Experience with surveillance, monitoring, or large-scale reporting systems - Experience with health information systems and interoperability initiatives - Experience with HL7 FHIR or other interoperability standards - Experience with DHIS2, SORMAS, Go.Data, OpenMRS, OpenELIS, or similar platforms - Experience with terminology standards such as ICD, LOINC, or SNOMED CT - Experience with AI-assisted data processing and data harmonisation approaches - Advanced degree in Data Engineering, Data Science, Health Informatics, or a related field - Knowledge of French Why join inventYOU - Work on large-scale data integration and interoperability initiatives - Contribute to modern data architecture and analytics solutions - Collaborate with experienced international teams and stakeholders - Gain exposure to advanced data, cloud, and integration technologies - Be part of impactful projects that support data-driven decision-making and innovation

Greece

Role Description As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure. You will work closely with data analysts, data scientists, software engineers, and business stakeholders to ensure reliable, accessible, and high-quality data across the organization. This is an excellent opportunity for professionals who enjoy solving complex data challenges and building systems that support business intelligence, analytics, and machine learning initiatives. - Design, develop, and maintain scalable ETL and ELT pipelines. - Build and optimize data architectures, databases, and data warehouses. - Integrate data from multiple sources, APIs, and third-party platforms. - Ensure data quality, consistency, reliability, and security. - Monitor and troubleshoot data pipelines and workflows. - Collaborate with analytics, engineering, and business teams to understand data requirements. - Implement data governance and best practices for data management. - Optimize data storage, processing performance, and query efficiency. - Support reporting, business intelligence, and analytics initiatives. - Document data models, workflows, and technical processes. Qualifications - 3+ years of experience in data engineering, data warehousing, or related roles. - Strong proficiency in SQL and database management. - Experience with Python, Java, Scala, or similar programming languages. - Hands-on experience with ETL/ELT tools and data pipeline development. - Knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform. - Experience with modern data warehouses such as Snowflake, Redshift, BigQuery, or Databricks. - Familiarity with orchestration tools such as Airflow or Prefect. - Understanding of data modeling, data governance, and data quality principles. - Experience working with large datasets and distributed systems is preferred. - Strong analytical, problem-solving, and communication skills. - Ability to work independently in a remote, collaborative environment. Benefits - 💰 Competitive salary: Based on experience, technical expertise, and location. - 🌎 Fully remote role: Work from anywhere with flexible working arrangements. - 🚀 Career growth opportunities: Join innovative companies and work on impactful projects. - 📈 Long-term opportunities: Build your career with growing global organizations. - 🧠 Continuous learning: Exposure to modern data technologies, cloud platforms, and large-scale data systems. - 🤝 Collaborative culture: Work alongside talented engineers, analysts, and business leaders. - ⚙️ Cutting-edge technology: Gain experience with modern data stacks and cloud-native solutions.

Worldwide
Full TimeRemoteTeam 10,001+Since 1961H1B Sponsor

Title: Lead Data Engineer - Modernization & Reliability Location: United States Job Description: Remote Job: Yes widget:Full time Category:Technology and Digital Analytics Humana Job ID:R-410243 Become a part of our caring community The Lead Data Engineer is responsible for leading the modernization, optimization, and stabilization of the Wisconsin Medicaid Market's data platform ecosystem across two independent health plan technology stacks. This role owns the market's Data Warehouse and ODS, drives ETL/data movement strategy (including SSIS modernization), and improves the reliability, observability, and security posture of data pipelines supporting critical Medicaid operations. The Lead Data Engineer partners closely with the Market BI team as their IT counterpart to improve data access and flow, including establishing and managing Databricks pipeline patterns and platform enablement as the BI environment evolves. The Lead Data Engineer owns and evolves the Wisconsin Medicaid Market's data stores and data movement ecosystem, including the Data Warehouse and ODS, and the ETL processes that connect vendor and internal systems. This role is accountable for modernizing and optimizing the market's data platform to improve reliability, reduce technical debt, strengthen observability/fault tolerance, and increase engineering efficiency in a complex dual-stack environment. The Lead Data Engineer is also the Market BI team's primary IT partner for data platform enablement — improving data access patterns, strengthening pipeline governance, and helping establish a maintainable approach to Databricks pipelines and workflows as the market matures its analytics capabilities. This is a Lead-level individual contributor role where work requires higher autonomy and complexity and includes directing the work of a small number of contract resources while remaining hands-on in delivery. Team Culture & Expectations On the Wisconsin Medicaid Market IT team, how you show up is as important as what you accomplish. We value a positive attitude, curiosity, ownership, and a desire to learn and make a meaningful difference. This role requires collaboration, high accountability, and comfort operating in ambiguity while continuously improving data reliability, security, and outcomes for associates, members, providers, and other stakeholders. Use your skills to make an impact Skills & Capabilities The ideal candidate blends deep data engineering fundamentals with the ability to lead through influence — setting direction, improving reliability, and guiding others' work (including contract resources) while staying hands-on. Required Skills - SQL, ETL/ELT & Data Platform Depth - Proven production experience with SQL Server data engineering, including warehousing patterns, operational support, performance tuning, and ETL/ELT design. Strong experience with SSIS/SSRS and Azure Data Factory (or similar orchestration) in real operating environments. - Integration & Interoperability Tooling (WI Market Reality) - Experience working across integration engines and healthcare data movement patterns, including tools such as Rhapsody / CorePoint - Modernization, Optimization & Stabilization Mindset - Demonstrated ability to modernize and optimize fragile pipelines and legacy patterns, reduce technical debt, and improve reliability, observability, and fault tolerance. - Databricks / UDAP Growth Path (directional, not gatekeeping) - Experience with Databricks and/or enterprise data platforms (e.g., UDAP), or strong aptitude and desire to grow into these platforms as part of market modernization and enterprise alignment. - Execution Leadership - Highly organized, self-directed, and able to drive work to outcomes in an ambiguous, rapidly changing environment including planning, sequencing, and communicating progress/risk. Experience creating detailed technical documentation to gain buy-in and drive decisions. Team operates in SAFe Agile practices. - Vendor / Contract Resource Direction - Ability to direct and review contract resource work (clarify requirements, establish standards, review deliverables, ensure maintainability). Preferred Skills - Own the market's data stores (Data Warehouse + ODS) and ensure stability, security, and performance - AI Integration - Lead modernization and optimization of the ETL ecosystem, including SSIS modernization and improved reliability/observability - Drive reduction of legacy report patterns and support transition aligned to enterprise SSRS footprint reduction efforts - Partner with Market BI as their IT counterpart to improve data access and establish/manage Databricks pipeline patterns - Define and enforce data engineering standards aligned with enterprise direction. - Reduce technical debt and streamline workflows to lower operational burden on engineers and increase delivery capacity Additional Information Work-At-Home Requirements - WAH requirements: Must have the ability to provide a high speed DSL or cable modem for a home office. Associates or contractors who live and work from home in the state of California will be provided payment for their internet expense. - A minimum standard speed for optimal performance of 25x10 (25mpbs download x 10mpbs upload) is required. - Satellite and Wireless Internet service is NOT allowed for this role. - A dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required. Scheduled Weekly Hours 40 Pay Range The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc. $142,300 - $195,700 per year This job is eligible for a bonus incentive plan. This incentive opportunity is based upon company and/or individual performance. Description of Benefits Humana, Inc. and its affiliated subsidiaries (collectively, “Humana”) offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities. About us About Inclusa: Inclusa manages the provision of a person-centered and community-focused approach to long-term care services and support to Family Care members across the state of Wisconsin. As a values-based organization devoted to building vibrant and inclusive communities, Inclusa deploys a unique approach to managed care with a trademarked model of support named Commonunity® which focuses on the belief in everyone, and from that belief, the common good for all is achieved. In 2022, Inclusa was acquired by Humana. This partnership will allow us to create a model of care that provides industry-leading support for members across the health care continuum. About Humana: Humana Inc. (NYSE: HUM) is a leading U.S. healthcare company. Through our Humana insurance services and our CenterWell healthcare services, we make it easier for the millions of people we serve to achieve their best health – delivering the care and service they need, when they need it. These efforts are leading to a better quality of life for people with Medicare and Medicaid, families, individuals, military service personnel, and communities at large. Learn more about what we offer at Humana.com and at CenterWell.com. ​ Equal Opportunity Employer It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Request an Accommodation If you are an individual with a disability and require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying Employment Fraud Notice Humana will never ask a candidate for money for work equipment and network access or request access to personal accounts during the application process. Learn more about identifying and preventing employment fraud or report a suspected employment fraud case. Applicant Privacy Policy Review how we collect and use applicant information in our Applicant Privacy Policy. Labor Notices Review our federal, state, and local labor notices on our Legal Information page.

Kentucky + 5 moreAll locations: Kentucky | Georgia | Massachusetts | Texas | Illinois | Tennessee
$142.3K - $195.7K / year
ServiceNow logo

Staff Data Platform Software Engineer, Graph - Veza

ServiceNow

ServiceNow provides cloud-based services that automate enterprise information technology operations. As an employer, ServiceNow offers a challenging, collaborat

Data Engineer2 days ago
Full TimeRemoteTeam 29,000Since 2004

Company Description Veza is the pioneer in identity security, purpose-built to answer the fundamental question enterprises face: who can and should take what action on what data. Veza's Access Graph platform maps an organization's entire identity ecosystem across users, groups, roles, policies, permissions, and resources providing deep visibility and control over human, non-human, and agentic identities across SaaS, cloud, on-prem, and custom applications. With over 30 billion access permissions under management, global enterprises including Blackstone, Expedia, and Wynn Resorts trust Veza to manage privileged access monitoring, non-human identity security, access entitlement management, and next-generation identity governance. Founded in 2020 and headquartered in Redwood City, California, Veza is now part of the ServiceNow family, with the acquisition closing in March 2026. The combination brings together Veza's AI-native Access Graph with ServiceNow's AI Control Tower and agentic workflows, enabling organizations to enforce end-to-end identity security rooted in the principle of least privilege across applications, data, cloud environments, and AI agents. For engineers joining Veza today, this means the scale and resources of an enterprise platform company, with the product velocity and mission-driven focus of a security innovator at a pivotal moment in the industry. Job Description We are looking for a passionate Staff Data Platform Software Engineer to join Veza's Graph team. You will play a key role in designing, improving, and maintaining the robust and scalable code behind the Veza Access Graph, collaborating closely with cross-functional teams to shape the future of our products and deliver exceptional identity and access management experiences to our customers. This is an exciting opportunity to contribute to the growth and success of a high-impact startup while working on cutting-edge technologies! What you will do - Develop, maintain and scale Graph features to directly and indirectly support actionable customer intelligence across various products. - Drive the performance, scalability, and reliability of the backend services and APIs for our platform. - Collaborate with product managers, other software engineers, and security experts to build product features that meet business objectives and security standards. - Continuously optimize and improve your work through code and design reviews, testing, and refactoring. - Implement logging, monitoring, and auditing capabilities to ensure visibility and compliance with regulatory requirements and operational health metrics. - Stay current with industry trends and emerging technologies across different fields and leverage them to drive innovation and improve our platform. Qualifications Experience: - Proven experience (minimum 8+ years) in professional backend software development with a focus on data modeling, data management, identity, security, or related areas. - A history with the development of databases, storage layers, query engines or adjacent tooling. - Experience with complex relational data models in OLAP systems and/or graph database systems such as Neo4j. - Deep knowledge of relational algebra and graph algorithms. - A familiarity with caching mechanisms and distributed systems. - A proven ability to develop and test code in one or more modern backend programming languages such as Golang or Kotlin. - Experience designing and implementing RESTful APIs in microservice architectures. - Experience with cloud platforms, such as AWS, Azure, or Google Cloud Platform, and containerization and orchestration technologies, such as Docker and Kubernetes, is a plus. You Are: - An excellent problem-solver with high attention to detail. - Someone who can work both independently and collaboratively in a fast-paced environment. - A strong communicator with the ability to relate technical concepts to both technical and non-technical stakeholders. - A mentor who helps others become the best versions of themselves. - A pleasure to work with! For positions in this location, we offer a base pay of $176,100 - $308,200, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location. Additional Information Work Personas We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here . To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service. Equal Opportunity Employer ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. Accommodations We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact globaltalentss@servicenow.com for assistance. Export Control Regulations For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. ©2025 Fortune Media IP Limited. All rights reserved. Used under license.

California
$176.1K - $308.2K / year