Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

Canada

Posted

5 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Globalli

Role Description We are looking for a Senior Data Engineer to build and evolve the data platform powering our global workforce management ecosystem. You will design, implement, and maintain scalable data pipelines that consolidate data from multiple operational systems, transform it into trusted analytical datasets, and make it available for reporting, product analytics, and business intelligence. You should be comfortable working with modern cloud-native data architectures on AWS, building reliable ETL/ELT pipelines, and designing data models optimized for analytical workloads. This role requires a strong engineering mindset, balancing performance, scalability, data quality, and operational excellence while collaborating closely with software engineers, product teams, analysts, and data scientists. What You Will Own - Design, build, and maintain scalable batch and streaming data pipelines using AWS-native services and distributed processing frameworks - Develop ETL/ELT workflows to ingest, consolidate, sanitize, enrich, and transform data from multiple internal and external systems - Build and optimize AWS Data Lake solutions using Amazon S3, AWS Glue, Amazon Redshift, and Amazon Kinesis Firehose - Design and implement distributed data processing jobs using Apache Spark, AWS Glue, Databricks, or equivalent technologies - Develop orchestration workflows using Apache Airflow (MWAA), AWS Step Functions, or similar workflow orchestration platforms - Design analytical data models including star schemas, snowflake schemas, dimensional models, and optimized reporting datasets - Optimize Redshift performance through distribution strategies, sort keys, partitioning, workload tuning, and query optimization - Build resilient pipelines supporting retries, idempotency, checkpointing, incremental processing, and partial failure recovery - Implement automated data quality validation, schema evolution, lineage tracking, and governance controls - Develop infrastructure and deployment automation using Infrastructure as Code and CI/CD pipelines - Monitor, troubleshoot, and continuously improve the reliability, scalability, and performance of the data platform - Collaborate with analysts, software engineers, data scientists, and product managers to translate business requirements into scalable data solutions - Participate in architecture discussions and contribute technical documentation, standards, and best practices Qualifications - 5+ years of professional experience building production data pipelines and cloud-based data platforms - Strong experience with AWS data services including Amazon Redshift, AWS Glue, Amazon S3, and Amazon Kinesis Firehose - Strong Python programming skills for ETL development, automation, event processing, and scripting - Advanced SQL expertise including query optimization, window functions, analytical queries, versioned migrations, rollback strategies, and warehouse tuning - Experience designing scalable ETL/ELT pipelines for both batch and streaming workloads - Experience with distributed compute and storage using Apache Spark, AWS Glue, Databricks, or similar distributed processing frameworks - Strong understanding of data warehousing concepts including dimensional modeling, star schemas, snowflake schemas, partitioning strategies, and analytical data structures - Experience designing end-to-end data architectures including ingestion, transformation, orchestration, and consumption layers - Experience implementing workflow orchestration using Apache Airflow (MWAA), AWS Step Functions, or equivalent orchestration tools - Understanding of data governance, metadata management, security best practices, IAM, encryption, and regulatory compliance considerations - Experience with Git-based collaborative development workflows, CI/CD pipelines, Infrastructure as Code, deployment approvals, versioned migrations, and safe rollback strategies - Experience monitoring and maintaining production data infrastructure, ensuring high availability, observability, data quality, and operational reliability - Strong communication skills with the ability to explain technical concepts to business stakeholders and collaborate effectively across engineering, analytics, and product teams Nice to Have - Experience with Apache Iceberg, Delta Lake, Apache Hudi, or modern open table formats - Experience with dbt or SQL-based transformation frameworks - Familiarity with Kafka, Amazon MSK, or other streaming platforms - Experience with Lakehouse architectures and modern analytical data platforms - Knowledge of Terraform or AWS CloudFormation - Experience with containerized data workloads using Docker and ECS/EKS - Experience implementing DataOps practices and automated testing for data pipelines - Familiarity with BI platforms such as Tableau, Power BI, Looker, or QuickSight - Experience implementing data catalogs, lineage, and governance solutions - Exposure to machine learning feature pipelines or data science infrastructure Tech Stack - Programming: Python, SQL, PySpark - Data Processing: Apache Spark, AWS Glue, Databricks - Data Storage: Amazon S3, Amazon Redshift, Parquet - Streaming: Amazon Kinesis Firehose, EventBridge - Orchestration: Apache Airflow (MWAA), AWS Step Functions - Data Modeling: Star Schema, Snowflake Schema, Dimensional Modeling - Infrastructure: AWS, IAM, CloudWatch - IaC/CI: Git, GitHub Actions, Terraform, CloudFormation - Observability: CloudWatch, Datadog (or equivalent observability platforms) - Governance: Data Catalog, Metadata Management, Data Lineage

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 1,001-5,000

Role Description Design, develop, and maintain scalable ELT pipelines and modern data architectures. - Build and optimize data transformation workflows using dbt and SQL. - Collaborate closely with software engineers and product teams to support data-driven applications. - Develop infrastructure as code using Terraform. - Support web application integrations involving Node.js, TypeScript, GraphQL, and React. - Improve data reliability, monitoring, and operational excellence across the platform. - Participate in production support through an on-call rotation (1 week every 4 weeks) and serve as backup on-call engineer for an additional week every 4 weeks. - Collaborate with US-based engineering teams to troubleshoot production issues and continuously improve platform performance. - Contribute to best practices around data engineering, automation, and cloud architecture. Qualifications - Strong experience building ELT pipelines and modern data engineering solutions. - Advanced experience with dbt and SQL. - Hands-on experience with Terraform. - Experience working with web application technologies, including: Node.js, TypeScript, GraphQL, React. - Strong analytical and problem-solving skills. - Experience working in Agile environments. - Excellent communication skills and ability to collaborate with distributed international teams. - English proficiency sufficient to work daily with US-based engineers. Requirements - Nice to have: Snowflake. - AWS. - Apache Airflow. - Looker. - Python. - GitHub. - Experience supporting production environments and participating in on-call rotations. - Experience designing modern cloud-native data platforms. - English level: Upper-Intermediate. Benefits - International projects. - In-office, hybrid, or remote flexibility. - Medical healthcare. - Recognition program. - Ongoing learning & reimbursement. - Well-being program. - Team events & local benefits. - Sports compensation. - Referral bonuses. - Top-tier equipment provision.

Worldwide
Tech9 logo

Data Engineer

Tech9

World-class software solutions built by embedded experts, delivered seamlessly with clarity, trust, and consistency.

Data Engineer5 days ago
ContractRemoteTeam 51-200Since 2015H1B No Sponsor

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Python. • Build, test, and support integrations between Databricks, Oracle, and downstream systems. • Develop and maintain high-quality data extracts for internal and external stakeholders. • Own and document inbound and outbound data feeds. • Monitor data pipelines for performance, reliability, and quality; identify and resolve issues. • Design and optimize data models supporting operational, analytical, and financial reporting. • Contribute to continuous improvement of the data platform using industry best practices. • Partner with technical and business stakeholders to gather requirements and deliver solutions. • Support internal applications and ensure business continuity. • Collaborate effectively across engineering and cross-functional teams.

Utah
MediaRadar, Inc. logo

Senior Data Engineer

MediaRadar, Inc.

Sales enablement platforms customized for media, and ad tech companies that help you close more deals.

Data Engineer5 days ago
Full TimeRemoteTeam 201-500Since 2007H1B No Sponsor

Role Description We are looking for a highly technical, hands-on Senior Data Engineer to drive the evolution of our data delivery platform while leading a team of data engineers. This is a player-coach role: - Architect our next-generation data stack. - Build proofs-of-concept (POCs) and prove out new technologies before committing to them at scale. - Manage and grow a team of engineers who report directly to you. - Partner closely with engineering leadership to shape the technical direction of our pipelines while staying hands-on in the systems. We are deliberately moving away from a locked-in, vendor-heavy stack toward a flexible, largely open-source architecture that keeps our options open. We expect our engineers to work in a modern, AI-assisted way: - Use AI coding tools and prompt-based workflows to move faster without compromising quality. - Evaluate tools, build POCs, and make pragmatic, evidence-based decisions about what we adopt next. This is a build-and-prove role: - Write code, design schemas, profile queries, and understand the "how" and "why" behind every pipeline. - Mentor your team to do the same. - Team Leadership & People Management: Lead, manage, and grow a distributed team of data engineers (across North America and India). - AI-Assisted Development: Champion the use of AI coding assistants and prompt-based development. - Hands-On POCs & Prototyping: Build proofs-of-concept to validate new tools and patterns. - Tech Stack Strategy & Architecture: Help shape the technical vision for our ETL and data platform. - Platform Modernization: Drive the migration away from Azure Databricks toward a more open, flexible stack. - Build & Own Pipelines: Design, build, and optimize robust ETL pipelines. - Deep System Integration: Master all systems upstream and downstream to ensure seamless data delivery. - Operational Excellence: Establish testing frameworks, QA plans, observability, and CI/CD practices. - Technical Leadership Through Influence: Set technical standards and raise the bar across a distributed team. - Domain Mastery: Rapidly learn the nuances of the Advertising and Market Research domain. Qualifications - 8+ years in data engineering / ETL, with a strong track record as a hands-on engineer. - Hands-on experience using AI coding tools and strong prompt-based development skills. - Expert-level SQL and RDBMS skills with deep experience in SQL Server and Postgres. - Hands-on experience with technologies such as ClickHouse, dbt, and open-source data pipeline tools. - Strong, hands-on AWS experience. - Demonstrated ability to independently prototype, benchmark, and evaluate new technologies. - Strong proficiency in Python (or similar) for building and automating data pipelines. - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Requirements - Previous experience in Advertising, Media, or Market Research (Bonus Points). - Familiarity with containerization (Docker, Kubernetes) and infrastructure-as-code (Bonus Points). - Experience with streaming/real-time data technologies (e.g., Kafka) (Bonus Points). Benefits - Medical, Dental & Vision Insurance - 401k with Company Match - Flexible PTO - Commuter Benefits - Gym Discounts - Summer Fridays

United States
Samsara logo

Senior Data Ops Engineer

Samsara

Samsara Inc. is on a mission to increase the sustainability of the operations that power the global economy. The company pioneers the Connected Operations Cloud

Data Engineer5 days ago

• Serve as a primary responder for production data incidents, quickly diagnosing root causes, implementing fixes, and ensuring data integrity. • Design, implement, and maintain monitoring, logging, and alerting systems for all production data pipelines and infrastructure. • Manage, deploy, and maintain data and integrations pipelines and APIs. • Continuously identify and implement optimizations to improve the speed, scalability, and efficiency of data processing jobs and API performance. • Develop and enforce data validation and quality checks within the pipelines to minimize errors and inconsistencies in production data. • Collaborate with DevOps teams on managing the underlying infrastructure (AWS components) that hosts the data platform. • Maintain comprehensive and up-to-date documentation for all operational procedures, pipeline architectures, and troubleshooting runbooks. • Communicate incident status and SLA reports to management. • Develop & deploy data pipelines, backend ingestion or integration jobs to support minor enhancements and bug fixes. • Work with data from a variety of sources including but not limited to: CRM data, Product data, Marketing data, Order flow data, Support ticket volume data, Finance data etc. • Champion, role model, and embed Samsara’s cultural principles (Focus on Customer Success, Build for the Long Term, Adopt a Growth Mindset, Be Inclusive, Win as a Team) as we scale globally and across new offices.

Canada
$112.6K - $145.8K / year