Job Closed

This listing is no longer active.

Data Engineer

Data EngineerData EngineerOtherRemoteTeam 51-200Since 2020H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

143 days ago

Salary

0

Job Description

Data Engineer

Spear AI

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We’re seeking a skilled Data Engineer to build the next-generation data management and artificial intelligence platform for maritime domain awareness. What you’ll do: - Implement real-time data pipelines with MQTT and Redpanda for stream processing. - Implement offline data pipelines using Dagster for batch processing. - Parse and process binary message formats from various data sources. - Build data warehouses using Postgres, Apache Iceberg, Parquet, and S3. - Design data models that allow for high-performance queries. - Validate and normalize data sources. - Improve local development and CI/CD using modern tooling and GitHub Actions. Qualifications - Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) - Proficiency in Python and Rust for data engineering workflows. - Experience with binary message parsing. - Experience with row-based & columnar-based data formats. - Experience with OLTP & OLAP databases. - Knowledge of distributed systems, streaming architectures, and batch processing patterns. - Hands-on experience with a batch orchestrator such as Dagster/Airflow. - Hands-on experience with a streaming platform such as Redpanda/Kafka. - Hands-on experience with binary message formats such as Protobuf. Requirements - Experience with IoT devices and sensors (nice to have). - Digital signal processing experience (nice to have). - Geospatial analysis and GIS experience (nice to have). - Familiar with working in monorepos (nice to have). Benefits - Unlimited PTO — Take the time you need to recharge and maintain work-life balance. - Dedicated Sick Time — Your health and well-being come first. - Comprehensive Health & Benefits – Medical, dental, and vision coverage to keep you and your family protected. - 11 Paid Holidays — Enjoy time off throughout the year to celebrate and spend time with loved ones. - Professional Development — Educational opportunities and resources to help you grow your skills and advance your career. - Collaborative Environment — Work directly with leadership in our flat organizational structure, where your ideas and contributions matter. - Mission-Driven Work — Contribute to projects that directly support national security and make a real-world impact. - Growth Opportunities — Join us during an exciting expansion phase where you can help shape our future. - 401(k) with company match. - Onsite / Remote / Flexible work arrangements or hybrid options (position dependent). - Relocation assistance (position dependent). - Referral bonuses. - Performance bonuses. - Life insurance and disability coverage. - Technology home office setup stipend. - Professional certification reimbursement (position dependent).

Job Requirements

  • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.)
  • Proficiency in Python and Rust for data engineering workflows.
  • Experience with binary message parsing.
  • Experience with row-based & columnar-based data formats.
  • Experience with OLTP & OLAP databases.
  • Knowledge of distributed systems, streaming architectures, and batch processing patterns.
  • Hands-on experience with a batch orchestrator such as Dagster/Airflow.
  • Hands-on experience with a streaming platform such as Redpanda/Kafka.
  • Hands-on experience with binary message formats such as Protobuf.
  • Experience with IoT devices and sensors (nice to have).
  • Digital signal processing experience (nice to have).
  • Geospatial analysis and GIS experience (nice to have).
  • Familiar with working in monorepos (nice to have).

Benefits

  • Unlimited PTO — Take the time you need to recharge and maintain work-life balance.
  • Dedicated Sick Time — Your health and well-being come first.
  • Comprehensive Health & Benefits – Medical, dental, and vision coverage to keep you and your family protected.
  • 11 Paid Holidays — Enjoy time off throughout the year to celebrate and spend time with loved ones.
  • Professional Development — Educational opportunities and resources to help you grow your skills and advance your career.
  • Collaborative Environment — Work directly with leadership in our flat organizational structure, where your ideas and contributions matter.
  • Mission-Driven Work — Contribute to projects that directly support national security and make a real-world impact.
  • Growth Opportunities — Join us during an exciting expansion phase where you can help shape our future.
  • 401(k) with company match.
  • Onsite / Remote / Flexible work arrangements or hybrid options (position dependent).
  • Relocation assistance (position dependent).
  • Referral bonuses.
  • Performance bonuses.
  • Life insurance and disability coverage.
  • Technology home office setup stipend.
  • Professional certification reimbursement (position dependent).

Related Categories

Related Job Pages

More Data Engineer Jobs

Quanata logo

Senior Data Engineer

Quanata

Quanata is on a mission to help ensure a better world through context-based insurance solutions. We are an exceptional, customer-centered team with a passion for creating innovative technologies, digital products, and brands. We blend some of the best Silicon Valley talent and cutting-edge thinking with the long-term backing of leading insurer, State Farm. Quanata, LLC is an insurance technology innovation company that engineers advanced risk prediction and prevention solutions. We develop risk-focused acquisition capabilities and build/support a full-stack, flexible, digital & increasingly AI-native insurance platform. Quanata, LLC is wholly owned and funded by State Farm. We prioritize an inclusive and positive culture, believing that the core of our success is in hiring talented people across disciplines.

Data Engineer143 days ago
OtherRemoteTeam 201-500H1B No Sponsor

• Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence • Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making • Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries • Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference • Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets • Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments • Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems • Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists • Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value

United States
$215K - $300K / year
Full TimeRemoteTeam 51-200Since 2018H1B Sponsor

• Design, build, and maintain efficient ETL/ELT processes and reliable data pipelines in dbt and BigQuery, integrating data from a variety of sources (MongoDB, SQL, Google Sheets, Google Analytics, APIs, etc.); • Build and maintain dashboards and visualizations in Looker Studio and other BI tools; • Ensure data quality, consistency, and accessibility across the organization, implement data quality controls; • Proactively collaborate with different stakeholders across operations, sales, finance and tech to clarify requirements and answer data-related questions.

Indonesia
S$1.5K - S$2.3K / month

Senior Data Engineer

Tekmetric

Tekmetric is an auto repair technology company offering a comprehensive shop management solution designed to enhance the operational efficiency of shops across the United States. W

Data Engineer143 days ago

• Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake. • Collaborate and influence the long term technology strategy and innovations roadmaps across data engineering areas. • Provide technical leadership, mentorship and growth to junior team members as we scale • Collaborate closely with engineering and product to elevate data generation approaches • Manage the end-to-end life cycle on the development of new features and pipelines • Ideate and contribute to shared data engineering tooling and standards. • Define and promote data engineering best practices across the company.

United States
Job Closed
IDT BY INDET GROUP logo

Data Engineer

IDT BY INDET GROUP

LABEL MAKERS & GLOBAL SERVICES

Data Engineer144 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

• Design, implement, and validate ETL/ELT data pipelines–for batch processing, streaming integrations, and data warehousing, while maintaining comprehensive documentation and testing to ensure reliability and accuracy. • Maintain end-to-end Snowflake data warehouse deployments and develop Denodo data virtualization solutions. • Recommend process improvements to increase efficiency and reliability in ELT/ETL development. • Stay current on emerging data technologies and support pilot projects, ensuring the platform scales seamlessly with growing data volumes. • Architect, implement and maintain scalable data pipelines that ingest, transform, and deliver data into real-time data warehouse platforms, ensuring data integrity and pipeline reliability. • Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions. • Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines. • Should be willing to stay informed and learn emerging methodologies in data engineering, and open source technologies.

Brazil