Douro Labs logo
Douro Labs

Douro Labs is the company behind Pyth Pro, real-time market data infrastructure that distributes institutional-grade price feeds from primary sources directly to exchanges, market makers, and trading firms. Pyth Pro currently provides the market data behind many major cryptocurrency exchanges and prediction markets, with a growing base of institutional users relying on it daily.

Staff Engineer, Market Data

Data EngineerData EngineerFull TimeRemoteLeadTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

Europe

Posted

1 day ago

Salary

0

Seniority

Lead

Bachelor DegreeEnglishRustWeb3

Job Description

Staff Engineer, Market Data

Douro Labs

• Build and maintain core market data infrastructure in Rust • Work through the practical problems specific to real-time market data: cross-exchange pricing differences, data quality, latency • Bring real market data or trading systems knowledge into engineering decisions • Communicate clearly with the rest of the team as the group grows • Take on leadership of a small team over time, not immediately

Job Requirements

  • Senior or staff-level engineering experience with strong, hands-on Rust
  • Experience with real-time streaming systems
  • Experience with high-scale data storage and processing, specifically in a market data context
  • Real market data or trading systems experience, ideally from a market data provider, trading firm, or bank
  • Background in traditional finance, rather than web3 or crypto-native companies
  • Comfort using AI tools like Claude to move quickly, balanced with the ability to solve hard problems independently
  • Strong communication skills, given the path toward managing people this role carries
  • Based in Europe, where most of the team sits, or the US

Benefits

  • English (Fluent)

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description Talend developer with experience designing and delivering complex, large-volume data warehouse applications. - Senior Level Talend ETL development (4+ years of hard-core Talend experience) - Teradata experience, including Multiload, Fastload, T-Pump and preferably TPT - Experience in Big Data and Snowflake is preferred - Preferably has exposure in Map Reduce components in Talend - Strong experience in advanced SQL programming - Minimum data modeling experience - High volume data warehouse design experience taking Teradata unique nuances into account such as skewing considerations - Solid and professional communications skills, both verbal and written - Unix familiarity and shell scripting experience - Strong knowledge of Software Development Lifecycle (SDLC) - Job scheduling experience using Maestro is required - Strong experience in Data Quality, Source Systems Analysis, Business Rules Validation, Source Target Mapping Design, Performance Tuning and High Volume Data Loads - Strong written and oral communication skills are essential - Strong analytical skills and ability to resolve problems are desired - Some knowledge of the mortgage industry required - Ability to work independently and multi-task to meet critical deadlines in a rapidly changing environment - Working knowledge of source-code control using any tool available in the market is preferred - High energy, self-motivation, attention to detail, creativity, flexibility, and ability to work under pressure - Flexibility to work additional hours on an as-needed basis to meet deadlines and with offshore team Requirements - Total IT experience of 6+ years Roles & Responsibilities - Analyze, design, implement and maintain high volume, multi-terabyte 24/7 data warehouse robust and fast ETL applications - Advanced ETL development using Talend Big Data platform - Be a senior technical player on complex ETL development projects with multiple team members - Develop relevant functional and technical documentation - Lead, design and develop data warehouse solutions using different architecture, design and modeling techniques

United States
$57 / hour

Big Data/ Hadoop admin

Ruri Software Technologies LLC

MAGIC serves as the centralized ERP system for over 120 State agencies, supporting: Financial Management Procurement Grants Management Reporting These modules have been in production since 2015. The State is also currently implementing SAP SuccessFactors for: Human Capital Management (HCM) Payroll Processing

Data Engineer1 day ago

Role Description We are seeking a highly experienced Senior Big Data / AWS Administrator with 10+ years of hands-on experience in managing large-scale distributed systems. The ideal candidate will have deep expertise in AWS cloud infrastructure, AWS MSK, Hadoop ecosystem, and Kafka administration, ensuring high availability, scalability, and performance of enterprise data platforms. W2 POSITION Key Responsibilities - Cloud & Infrastructure (AWS) - Design, deploy, and manage scalable, secure, and highly available infrastructure on AWS MSK. - Administer core AWS services: EC2, S3, EMR, EKS, IAM, VPC, CloudWatch, Lambda. - Implement automated infrastructure provisioning using Infrastructure as Code (Terraform/CloudFormation). - Optimize cost, performance, and reliability of cloud environments. - Develop disaster recovery and backup strategies. - Big Data Platform Administration (Hadoop) - Install, configure, tune, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark). - Monitor cluster health, performance, and capacity planning. - Troubleshoot cluster issues and ensure high availability using HA configurations (NameNode HA, etc.). - Manage data ingestion and processing workflows. - Streaming Platform Administration (Kafka) - Install, configure, and manage Apache Kafka clusters. - Ensure high throughput, low latency, and fault-tolerant streaming systems. - Manage topics, partitions, brokers, and retention policies. - Perform Kafka cluster scaling, upgrades, and performance tuning. - Implement monitoring using tools like Prometheus, Grafana, or Confluent Control Center. - System Operations & Monitoring - Implement monitoring, logging, and alerting for all systems. - Conduct root cause analysis and performance tuning. - Ensure system security, access controls, and compliance standards. - Maintain detailed documentation and operational runbooks. - Automation & DevOps - Build CI/CD pipelines for infrastructure and platform deployments. - Automate routine administrative tasks using scripting (Python, Shell, etc.). - Collaborate with DevOps and engineering teams for platform improvements. Qualifications - Minimum 10+ years of experience in system administration, with at least 5+ years in big data and cloud environments. - Proven experience managing large-scale Hadoop clusters and Kafka environments. - Strong hands-on experience with AWS cloud platform. - Agentic AI experience. Technical Skills - AWS services: AWS MSK, AWS Administration, EC2, S3, EMR, IAM, VPC, CloudWatch, Lambda. - Big Data: Administration, Hadoop, HDFS, Hive, Spark, Kafka Administration.

United States
Full TimeRemoteTeam 1,001-5,000

Role Description You will be responsible for designing and implementing scalable data pipelines and data infrastructure that support various business domains (customer, product, merchandising, and other data domains). - Design and implement data transformations, cleaning, and validation logic to produce trusted, well-documented data models for analytics use cases. - Build reusable frameworks, templates, and self-service tooling so both engineering and business teams can move faster. - Own source code management, documentation (technical and end-user), and release planning for data engineering products; lean into DataOps, DevOps, and CI/CD to deliver reliable, tested, and scalable functionality through automation. - Own end-to-end delivery and day-to-day production support of data products, actively monitoring pipeline health and troubleshooting failures to guarantee uptime and meet data delivery SLAs. - Document data definitions, transformations, and lineage for datasets you own. - Partner with the Snowflake Admin/Architect to evaluate new platform capabilities, design patterns, and storage/compute optimizations that accelerate delivery timelines. - Evaluate and adopt new tools and technologies to improve platform capability and speed of analytics delivery. - Partner with Analytics, Security, and Cloud Infra teams to ensure best practices are defined and implemented. - Partner directly with business stakeholders to translate business questions into data models and self-service datasets. - Set standards and patterns for how domain-specific data products are built on the platform; mentor engineers working across platform and analytics. This is a fully remote position, with responsibilities that require strong communication skills and the ability to thrive in a virtual work environment. Candidates located on or near the West Coast are preferred. Qualifications - 10+ years of data engineering experience maintaining data platform technologies and supporting analytical teams. - 5+ years of hands-on experience with cloud data warehouse platforms (Snowflake). - Retail experience preferred. - Expert knowledge of SQL and Python. - Hands-on experience with pipeline orchestration tools (Airflow) and data transformation tooling (dbt). - Working knowledge of Git, CI/CD practices (GitHub Actions/Jenkins), and Infrastructure as Code (Terraform). - Hands-on experience with Kimball data warehouse modeling methodologies, alongside strong data modeling, data quality, and documentation practices. - Experience in API design; real-time streaming experience is a plus. - Experience providing production support, monitoring pipeline health, and triaging platform alerts to guarantee data delivery SLAs. - Experience performing root cause analysis for production issues and identifying opportunities for data platform improvement. - Passionate about writing clean, documented, and well-formed code, and performing regular code reviews. - Experience setting technical standards, mentoring engineers, and balancing platform scalability with domain-specific delivery needs. - Track record of partnering with business stakeholders in customer, product, or merchandising domains to translate requirements into robust data models. - Ability to work cross-functionally with Enterprise Architect, Security, and Cloud Infra teams, as well as collaborating with offshore teams. - Excellent written and verbal communication skills, with a proven ability to break down complex technical topics for non-technical audiences. Requirements - CA Pay Range is $155,000 - $175,000 annually. - Full time and Part time associates are eligible to participate in the Company’s 401(k) retirement savings plan after three (3) months of service. - Benefits for full-time employment on the first of the month following 30 days of continuous employment include offerings for programs including Medical, Dental, Vision, Prescription Drug, Life Insurance, Flexible Spending, Commuter Benefits and Employee Assistance. Benefits - Benefits that support health, financial security, and personal life needs. - Paid vacation and paid sick time. - 401(k) plan with Roth option and company match. - Employee Assistance Program and wellness resources. - Sample Sales and up to 30% shopping discount. - Work life balance and work from home flexibility. - Working with a team who thinks the world of you.

United States
$155K - $175K / year
Full TimeRemoteTeam 10,001+Since 1978H1B No Sponsor

• Diseñar, construir y mantener pipelines de datos y procesos ETL utilizando Databricks y Apache Spark • Optimizar flujos de trabajo de datos para rendimiento, escalabilidad y eficiencia de costos • Implementar arquitectura de Lakehouse de datos y gestionar la ingestión de datos desde múltiples fuentes • Colaborar con científicos de datos y analistas para habilitar análisis avanzados y cargas de trabajo de aprendizaje automático • Asegurar la calidad, gobernanza y seguridad de todos los activos de datos • Monitorizar y solucionar problemas de clústeres, trabajos y flujos de trabajo de Databricks • Integrar Databricks con servicios en la nube (AWS, Azure o GCP) y otros sistemas empresariales • Documentar procesos, estándares y mejores prácticas para la ingeniería de datos

Mexico