Job Closed

This listing is no longer active.

Sayari logo
Sayari

Science for decision making.

Principal Data Engineer

Data EngineerData EngineerOtherRemoteLeadTeam 1-10H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

145 days ago

Salary

$200K - $220K / year

Seniority

Lead

Job Description

Principal Data Engineer

Sayari

• Design and implement complex Spark data logic, focusing on performance optimization, data volume tuning, and robust execution. • Own the architectural design of graph build pipelines, ensuring they are scalable, automated, and highly resilient. • Plan and oversee the strategic re-architecture of data pipelines to meet evolving business needs and scale. • Optimize infrastructure-as-code and schema designs to reduce cloud costs and improve pipeline latency. • Act as a technical consultant for the team, fostering a collaborative and engineer-led approach to design decisions. • Support the development of the engineering team through code reviews, design docs, and architectural best practices. • Ensure the accuracy of mission-critical data outputs.

Job Requirements

  • 8+ years of experience in the big data space, with a proven track record of implementing large-scale features and leading process redesigns.
  • Expert-level mastery of Apache Spark for large-scale data processing.
  • Strong experience with orchestration tools (Airflow) and cloud computing environments.
  • Hands-on experience architecting and managing data flows into databases such as Elasticsearch, Memgraph, and Cassandra.
  • Demonstrated ability in system architecture, including Infrastructure as Code (IaC) and schema design.
  • A "builder" mindset with experience evolving and improving existing architectures to meet new scale requirements.

Benefits

  • 100% fully paid medical, vision, and dental for employees and their dependents
  • Generous time off; we observe all US federal holidays, close our office for a winter break (12/24-12/31), in addition to granting 18 PTO days and 10 sick days
  • Outstanding compensation package; competitive commissions for revenue roles and quarterly bonuses for non-revenue positions
  • A strong commitment to diversity, equity, and inclusion
  • Eligibility to participate in additional benefits such as 401k match up to 5%, 100% paid life insurance (up to $100,000 coverage),, and parental leave
  • A collaborative and positive culture - your team will be as smart and driven as you
  • Limitless growth and learning opportunities

Related Categories

Related Job Pages

More Data Engineer Jobs

OtherRemoteTeam 51-200Since 2020H1B No Sponsor

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We’re seeking a skilled Data Engineer to build the next-generation data management and artificial intelligence platform for maritime domain awareness. What you’ll do: - Implement real-time data pipelines with MQTT and Redpanda for stream processing. - Implement offline data pipelines using Dagster for batch processing. - Parse and process binary message formats from various data sources. - Build data warehouses using Postgres, Apache Iceberg, Parquet, and S3. - Design data models that allow for high-performance queries. - Validate and normalize data sources. - Improve local development and CI/CD using modern tooling and GitHub Actions. Qualifications - Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) - Proficiency in Python and Rust for data engineering workflows. - Experience with binary message parsing. - Experience with row-based & columnar-based data formats. - Experience with OLTP & OLAP databases. - Knowledge of distributed systems, streaming architectures, and batch processing patterns. - Hands-on experience with a batch orchestrator such as Dagster/Airflow. - Hands-on experience with a streaming platform such as Redpanda/Kafka. - Hands-on experience with binary message formats such as Protobuf. Requirements - Experience with IoT devices and sensors (nice to have). - Digital signal processing experience (nice to have). - Geospatial analysis and GIS experience (nice to have). - Familiar with working in monorepos (nice to have). Benefits - Unlimited PTO — Take the time you need to recharge and maintain work-life balance. - Dedicated Sick Time — Your health and well-being come first. - Comprehensive Health & Benefits – Medical, dental, and vision coverage to keep you and your family protected. - 11 Paid Holidays — Enjoy time off throughout the year to celebrate and spend time with loved ones. - Professional Development — Educational opportunities and resources to help you grow your skills and advance your career. - Collaborative Environment — Work directly with leadership in our flat organizational structure, where your ideas and contributions matter. - Mission-Driven Work — Contribute to projects that directly support national security and make a real-world impact. - Growth Opportunities — Join us during an exciting expansion phase where you can help shape our future. - 401(k) with company match. - Onsite / Remote / Flexible work arrangements or hybrid options (position dependent). - Relocation assistance (position dependent). - Referral bonuses. - Performance bonuses. - Life insurance and disability coverage. - Technology home office setup stipend. - Professional certification reimbursement (position dependent).

United States
Job Closed
Quanata logo

Senior Data Engineer

Quanata

Quanata is on a mission to help ensure a better world through context-based insurance solutions. We are an exceptional, customer-centered team with a passion for creating innovative technologies, digital products, and brands. We blend some of the best Silicon Valley talent and cutting-edge thinking with the long-term backing of leading insurer, State Farm. Quanata, LLC is an insurance technology innovation company that engineers advanced risk prediction and prevention solutions. We develop risk-focused acquisition capabilities and build/support a full-stack, flexible, digital & increasingly AI-native insurance platform. Quanata, LLC is wholly owned and funded by State Farm. We prioritize an inclusive and positive culture, believing that the core of our success is in hiring talented people across disciplines.

Data Engineer145 days ago
OtherRemoteTeam 201-500H1B No Sponsor

• Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence • Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making • Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries • Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference • Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets • Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments • Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems • Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists • Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value

United States
$215K - $300K / year
Full TimeRemoteTeam 51-200Since 2018H1B Sponsor

• Design, build, and maintain efficient ETL/ELT processes and reliable data pipelines in dbt and BigQuery, integrating data from a variety of sources (MongoDB, SQL, Google Sheets, Google Analytics, APIs, etc.); • Build and maintain dashboards and visualizations in Looker Studio and other BI tools; • Ensure data quality, consistency, and accessibility across the organization, implement data quality controls; • Proactively collaborate with different stakeholders across operations, sales, finance and tech to clarify requirements and answer data-related questions.

Indonesia
S$1.5K - S$2.3K / month

Senior Data Engineer

Tekmetric

Tekmetric is an auto repair technology company offering a comprehensive shop management solution designed to enhance the operational efficiency of shops across the United States. W

Data Engineer145 days ago

• Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake. • Collaborate and influence the long term technology strategy and innovations roadmaps across data engineering areas. • Provide technical leadership, mentorship and growth to junior team members as we scale • Collaborate closely with engineering and product to elevate data generation approaches • Manage the end-to-end life cycle on the development of new features and pipelines • Ideate and contribute to shared data engineering tooling and standards. • Define and promote data engineering best practices across the company.

United States
Job Closed