Quanata logo
Quanata

Quanata is on a mission to help ensure a better world through context-based insurance solutions. We are an exceptional, customer-centered team with a passion for creating innovative technologies, digital products, and brands. We blend some of the best Silicon Valley talent and cutting-edge thinking with the long-term backing of leading insurer, State Farm. Quanata, LLC is an insurance technology innovation company that engineers advanced risk prediction and prevention solutions. We develop risk-focused acquisition capabilities and build/support a full-stack, flexible, digital & increasingly AI-native insurance platform. Quanata, LLC is wholly owned and funded by State Farm. We prioritize an inclusive and positive culture, believing that the core of our success is in hiring talented people across disciplines.

Senior Data Engineer

Data EngineerData EngineerOtherRemoteSeniorTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

143 days ago

Salary

$215K - $300K / year

Seniority

Senior

Bachelor Degree6 yrs expEnglishAirflowAWSApache KafkaPythonSQLTerraform

Job Description

Senior Data Engineer

Quanata

• Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence • Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making • Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries • Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference • Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets • Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments • Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems • Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists • Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value

Job Requirements

  • Bachelor's degree or equivalent relevant experience
  • 6-8 years of industry experience in data engineering or software engineering with a focus on data systems
  • Strong proficiency in Python and SQL for data pipeline development and analysis
  • Experience with AWS data platforms (Glue, S3, Athena, Lambda, Step Functions)
  • Familiarity with Snowflake or similar cloud data platforms
  • Familiarity with streaming technologies such as Kafka or Kinesis
  • Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
  • Proficiency in infrastructure-as-code tools like Terraform
  • Understanding of data modeling principles
  • Excellent written and verbal communication with a strong collaborative focus
  • Experience with CI/CD tailored for machine learning systems (e.g., automating model training, validation, and deployment)

Benefits

  • We provide a wide variety of health, wellness and other benefits.These include medical, dental, vision, life insurance and supplemental income plans for you and your dependents
  • A Headspace app subscription
  • Monthly wellness allowance
  • A 401(k) Plan with a company match
  • Given our virtual environment—a one-time payment of $2K will be provided to cover the purchase of in-home office equipment and furniture
  • All employees accrue four weeks of PTO in their first year of employment
  • New parents receive twelve weeks of fully paid parental leave
  • We’re committed to investing in and helping our people grow personally and professionally
  • All employees receive up to $5000 each year for professional learning, continuing education and career development
  • All team members also receive LinkedIn Learning subscriptions and access to multiple different coaching opportunities through BetterUp

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 51-200Since 2018H1B Sponsor

• Design, build, and maintain efficient ETL/ELT processes and reliable data pipelines in dbt and BigQuery, integrating data from a variety of sources (MongoDB, SQL, Google Sheets, Google Analytics, APIs, etc.); • Build and maintain dashboards and visualizations in Looker Studio and other BI tools; • Ensure data quality, consistency, and accessibility across the organization, implement data quality controls; • Proactively collaborate with different stakeholders across operations, sales, finance and tech to clarify requirements and answer data-related questions.

Indonesia
S$1.5K - S$2.3K / month

Senior Data Engineer

Tekmetric

Tekmetric is an auto repair technology company offering a comprehensive shop management solution designed to enhance the operational efficiency of shops across the United States. W

Data Engineer143 days ago

• Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake. • Collaborate and influence the long term technology strategy and innovations roadmaps across data engineering areas. • Provide technical leadership, mentorship and growth to junior team members as we scale • Collaborate closely with engineering and product to elevate data generation approaches • Manage the end-to-end life cycle on the development of new features and pipelines • Ideate and contribute to shared data engineering tooling and standards. • Define and promote data engineering best practices across the company.

United States
Job Closed
IDT BY INDET GROUP logo

Data Engineer

IDT BY INDET GROUP

LABEL MAKERS & GLOBAL SERVICES

Data Engineer143 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

• Design, implement, and validate ETL/ELT data pipelines–for batch processing, streaming integrations, and data warehousing, while maintaining comprehensive documentation and testing to ensure reliability and accuracy. • Maintain end-to-end Snowflake data warehouse deployments and develop Denodo data virtualization solutions. • Recommend process improvements to increase efficiency and reliability in ELT/ETL development. • Stay current on emerging data technologies and support pilot projects, ensuring the platform scales seamlessly with growing data volumes. • Architect, implement and maintain scalable data pipelines that ingest, transform, and deliver data into real-time data warehouse platforms, ensuring data integrity and pipeline reliability. • Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions. • Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines. • Should be willing to stay informed and learn emerging methodologies in data engineering, and open source technologies.

Brazil
Leega logo

Data Engineer – Azure, Databricks, Mid-level

Leega

Inteligência, Inovação e Tecnologia.

Data Engineer143 days ago
Full TimeRemoteTeam 201-500Since 2010H1B No Sponsor

• Perform data modeling by analyzing and structuring datasets to ensure proper relationships and adherence to industry best practices. • Handle special data by creating and managing equivalence tables, including specific cases such as “verticals”, aiming for greater standardization and efficiency. • Build pipelines that ensure full traceability from client file delivery through to loading into the Gold layer in Azure Databricks. • Identify opportunities for source-side automation to reduce reliance on manual files and increase efficiency. • Propose and implement efficient migration strategies, such as incremental loads, to avoid high costs from daily full loads. • Familiarity with code documentation. • Experience with agile methodologies. • Familiarity with developing process monitoring and alerts. • Ability to communicate technical solutions in a simple, pragmatic manner. • Proactive in supporting the team.

Brazil
Job Closed