Job Closed

This listing is no longer active.

PerformLine logo
PerformLine

The omni-channel compliance solution to mitigate risk across your marketing and sales channels

Senior Data Engineer

Data EngineerData EngineerOtherRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

139 days ago

Salary

$95K - $170K / year

Seniority

Senior

Bachelor DegreeEnglishAirflowAWSETLPythonSQLTerraform

Job Description

Senior Data Engineer

PerformLine

• Lead the rebuild of our data stack with a modern Snowflake data lakehouse, architected for scale and performance on AWS • Design and implement best-in-class AWS data infrastructure using Terraform for provisioning, configuration, and automation • Influence data architecture, tooling choices, and long-term strategy, ensuring alignment with business and technology needs and growth plans • Build and optimize scalable ETL/ELT pipelines with AWS services, Python, and Airflow • Establish and enforce rigorous standards for data quality, observability, and governance, including access control, lineage, and compliance requirements • Prepare and evolve the data platform to support advanced analytics, AI, and machine learning use cases • Collaborate closely with Product, Engineering, and Customer Success to deliver reliable, trusted data for analytics and reporting

Job Requirements

  • Hands-on Snowflake experience in production environments
  • Proven experience designing and maintaining large-scale data pipelines
  • Strong SQL and Python skills for data transformation and orchestration
  • Experience with ETL/ELT tools like Airflow, dbt, or similar
  • Familiarity with AWS cloud infrastructure
  • Deep understanding of data modeling, performance optimization, and query tuning
  • Experience designing data workflows, ensuring data quality, reliability, and performance.

Benefits

  • To view our benefits package, visit the PerformLine Careers page!

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer139 days ago
Full TimeRemoteTeam 201-500Since 1997H1B No Sponsor

• Levantamento, construção de processos de integração de dados, data pipelines e dashboards; • Integração de dados com as soluções dos parceiros, através de coleta e armazenamento das informações dos clientes, transformação e carga nos data stores das soluções; • Implantação, gerenciamento e monitoramento dos fluxos de integração de dados; • Desenvolvimento de relatórios operacionais, dashboards e indicadores de desempenho;

Brazil
Runway logo

Member of Technical Staff, Research Tooling & Data Platform

Runway

Business financials got stuck in the 15th century so we're showing them today’s computers 🖥

Data Engineer139 days ago
OtherRemoteTeam 11-50Since 2018H1B Sponsor

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We're looking for an engineer to own Runway's internal exploratory data analysis (EDA) and evaluation platform used daily by our ML research, design, product, and creative teams. This is a high-impact role where you'll directly accelerate research velocity and enable better decision-making across the company. This platform helps researchers query large-scale datasets, run evaluations on model outputs, and analyze results - all through an intuitive interface. As the owner, you'll be responsible for the full product experience: - Database query optimization and infrastructure management - Building user-facing features that make complex ML workflows accessible to non-engineers A peek at our technical stack: - API endpoints for real-time collaboration and media asset management written in TypeScript, running in ECS containers on AWS Fargate - Leveraging multiple AWS-native components, such as S3, CloudFront, Lambda, Kinesis, and SQS - Inference backend written in Python (PyTorch, TorchScript), deployed across multiple clusters/cloud providers - Using Kubernetes for container orchestration, and k8s-native components such as Flyte, Kueue, and Kyverno for efficient job orchestration - Investing in Prometheus and Grafana for monitoring, and Terraform to manage infrastructure Qualifications - 4+ years of industry experience in a backend focused software engineering role - Strong experience in at least 2 of 3 areas (platform/infrastructure, ML domain knowledge, frontend/product engineering) with eagerness to learn the third: - Platform/infrastructure: experience with vector databases, cloud primitives (i.e. SQS, ECR, Kinesis) and container orchestration (Kubernetes, ECS) - ML domain knowledge: Understanding of ML workflows, model training, evaluation, testing, dataset management, feature engineering, or research tooling - Product engineering: Ability to build clean, intuitive user experiences with product thinking and user empathy (TypeScript/React experience is a plus) - Comfortable setting up and maintaining production infrastructure and services - Self-starter who can navigate ambiguity and make pragmatic technical decisions - Humility and open-mindedness; at Runway we love to learn from one another Requirements - Ability to build tools people love to use Benefits - Salary range: $240,000 - $290,000 - Commitment to creating a space where employees can bring their full selves to work and have equal opportunity to succeed Company Description Runway strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on competitive market rates for our size, stage, and industry, and salary is just one part of the overall compensation package we provide. There are many factors that go into salary determinations, including relevant experience, skill level and qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more or less experienced than outlined in the job description. Lastly, the provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range, which again, will be communicated to candidates. We're excited to be recognized as a best place to work: - Crain's - InHerSight - BuiltIn NYC - INC

United States + 171 moreAll locations: United States | Canada | Brazil | Colombia | Argentina | Chile | Venezuela | Bolivia | Ecuador | French Guiana | Guyana | Paraguay | Peru | Suriname | Uruguay | Mexico | Costa Rica | El Salvador | Guatemala | Honduras | Nicaragua | Panama | Dominican Republic | Puerto Rico | Bahamas | Guadeloupe | Haiti | Jamaica | Martinique | Montserrat | United Kingdom | Germany | France | Estonia | Portugal | Hungary | Poland | Ukraine | Romania | Bulgaria | Czechia | Slovakia | Belarus | Moldova | Sweden | Greece | Belgium | Italy | Ireland | Switzerland | Netherlands | Finland | Malta | Denmark | Lithuania | Croatia | Spain | Austria | Bosnia And Herzegovina | Iceland | Luxembourg | North Macedonia | Montenegro | Norway | Serbia | Slovenia | Albania | Cyprus | Latvia | Monaco | South Africa | Egypt | Algeria | Angola | Benin | Botswana | Burkina Faso | Burundi | Cameroon | Cabo Verde | Central African Republic | Chad | Congo | Côte D'ivoire | Democratic Republic of the Congo | Equatorial Guinea | Eritrea | Ethiopia | Gabon | Gambia | Ghana | Guinea | Guinea-bissau | Kenya | Lesotho | Liberia | Libya | Madagascar | Malawi | Mali | Mauritania | Mauritius | Mayotte | Morocco | Mozambique | Namibia | Niger | Nigeria | Réunion | Rwanda | Senegal | Seychelles | Sierra Leone | Somalia | Sudan | Eswatini | Tanzania | Togo | Tunisia | Uganda | Zambia | Zimbabwe | Georgia | Turkey | Israel | United Arab Emirates | Armenia | Azerbaijan | Bahrain | Iraq | Jordan | Kuwait | Lebanon | Oman | Qatar | Saudi Arabia | Palestine | Yemen | India | Japan | Philippines | Pakistan | Thailand | Singapore | Vietnam | Taiwan | Indonesia | Cambodia | Laos | Malaysia | Myanmar | South Korea | China | Afghanistan | Bangladesh | Bhutan | Kazakhstan | Kyrgyzstan | Maldives | Mongolia | Nepal | Sri Lanka | Tajikistan | Turkmenistan | Uzbekistan | Australia | Papua New Guinea | Kiribati | Palau | French Polynesia | Tuvalu | New Zealand
$240K - $290K / year
Job Closed
Innovaccer logo

Data Engineer, II

Innovaccer

Two years in a row: Innovaccer Awarded Best in KLAS Data & Analytics Platforms Category.

Data Engineer139 days ago
OtherRemoteTeam 1,001-5,000Since 2014H1B Sponsor

• Design, develop, and maintain scalable ETL/ELT pipelines using Python and SQL. • Ensure high data quality, integrity, and availability for downstream analytics and pharmacy workflows. • Collaborate with data scientists, analysts, and pharmacy domain experts to understand requirements. • Troubleshoot and optimize data models and pipelines for performance and reliability. • Work in a cloud environment to support modern, scalable pharmacy technology infrastructure. • Play a critical role in enabling pharmacy data flows and ensuring end-to-end software reliability.

United States
Job Closed
Runway logo

Member of Technical Staff, Data Infrastructure

Runway

Business financials got stuck in the 15th century so we're showing them today’s computers 🖥

Data Engineer139 days ago
OtherRemoteTeam 11-50Since 2018H1B Sponsor

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We're looking for a Data Engineer to build and scale the data infrastructure that powers Runway's AI research and business intelligence. You'll own critical data pipelines spanning production databases, analytics warehouses, and large-scale ML training datasets. This role sits at the intersection of data engineering, ML infrastructure, and analytics—you'll enable both world-class research and data-driven business decisions. You'll work on challenging problems at scale: - Managing billions of rows of multimodal training data - Building CDC streams from production systems - Optimizing vector databases for ML workflows - Creating the foundational data layer that the entire company relies on A peek at our technical stack: - LanceDB for vector storage and dataset versioning with multimodal training data - ClickHouse as our analytics warehouse receiving CDC streams from production Postgres via AWS Kinesis - BigQuery for training run logs and evaluation results - Ray for large-scale distributed data processing on managed Kubernetes clusters - dbt for standardized transformations - Prometheus and Grafana for monitoring - Terraform for infrastructure management This is an opportunity to bring best practices and technical leadership as we mature our data infrastructure to support rapidly growing ML training and research needs. Qualifications - 4+ years of industry experience in data engineering - Strong knowledge of Python - Experience with data quality, deduplication, and cleaning at scale - Comfortable working with cloud storage (S3) and managing large datasets - Experience building and maintaining ETL/CDC pipelines at scale - Strong SQL skills and experience with multiple database systems (Postgres, columnar databases like ClickHouse/Redshift) - Humility and open mindedness; at Runway we love to learn from one another Requirements - Experience with one or more frameworks for large-scale data processing (e.g. Spark, Ray, etc) - Knowledge of cloud platforms (AWS, GCP, or Azure) and their data service offerings - Knowledge of data privacy and data security best practices - Experience with business intelligence and visualization tools (e.g., Looker, Tableau, PowerBI, Metabase, or similar) - Experience in a high-growth startup environment or similar fast-paced setting Benefits - Salary range: $240,000 - $290,000 - Commitment to creating a space where employees can bring their full selves to work - Equal opportunity to succeed regardless of race, gender identity or expression, sexual orientation, religion, origin, ability, age, veteran status

United States + 171 moreAll locations: United States | Canada | Brazil | Colombia | Argentina | Chile | Venezuela | Bolivia | Ecuador | French Guiana | Guyana | Paraguay | Peru | Suriname | Uruguay | Mexico | Costa Rica | El Salvador | Guatemala | Honduras | Nicaragua | Panama | Dominican Republic | Puerto Rico | Bahamas | Guadeloupe | Haiti | Jamaica | Martinique | Montserrat | United Kingdom | Germany | France | Estonia | Portugal | Hungary | Poland | Ukraine | Romania | Bulgaria | Czechia | Slovakia | Belarus | Moldova | Sweden | Greece | Belgium | Italy | Ireland | Switzerland | Netherlands | Finland | Malta | Denmark | Lithuania | Croatia | Spain | Austria | Bosnia And Herzegovina | Iceland | Luxembourg | North Macedonia | Montenegro | Norway | Serbia | Slovenia | Albania | Cyprus | Latvia | Monaco | South Africa | Egypt | Algeria | Angola | Benin | Botswana | Burkina Faso | Burundi | Cameroon | Cabo Verde | Central African Republic | Chad | Congo | Côte D'ivoire | Democratic Republic of the Congo | Equatorial Guinea | Eritrea | Ethiopia | Gabon | Gambia | Ghana | Guinea | Guinea-bissau | Kenya | Lesotho | Liberia | Libya | Madagascar | Malawi | Mali | Mauritania | Mauritius | Mayotte | Morocco | Mozambique | Namibia | Niger | Nigeria | Réunion | Rwanda | Senegal | Seychelles | Sierra Leone | Somalia | Sudan | Eswatini | Tanzania | Togo | Tunisia | Uganda | Zambia | Zimbabwe | Georgia | Turkey | Israel | United Arab Emirates | Armenia | Azerbaijan | Bahrain | Iraq | Jordan | Kuwait | Lebanon | Oman | Qatar | Saudi Arabia | Palestine | Yemen | India | Japan | Philippines | Pakistan | Thailand | Singapore | Vietnam | Taiwan | Indonesia | Cambodia | Laos | Malaysia | Myanmar | South Korea | China | Afghanistan | Bangladesh | Bhutan | Kazakhstan | Kyrgyzstan | Maldives | Mongolia | Nepal | Sri Lanka | Tajikistan | Turkmenistan | Uzbekistan | Australia | Papua New Guinea | Kiribati | Palau | French Polynesia | Tuvalu | New Zealand
$240K - $290K / year
Job Closed