Lime logo
Lime

Building a future where transportation is shared, affordable and carbon-free. Join us! www.li.me/careers

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 501-1,000Since 2017H1B SponsorCompany SiteLinkedIn

Location

Canada

Posted

2 days ago

Salary

CA$136K - CA$187K / year

Seniority

Senior

Job Description

Senior Data Engineer

Lime

• Own the end-to-end design, delivery, and operation of major data products, including high-throughput ETL/ELT pipelines, transformation workflows, and storage solutions. • Partner with engineering, product, and business stakeholders to clarify requirements, challenge assumptions, define pragmatic solutions, and drive projects from design through production launch. • Solve difficult data engineering problems by developing performance-tuned transformations and services using Python, high-performance SQL, and tools such as dbt. • Make sound technical trade-offs at the product level, balancing scalability, reliability, delivery speed, maintainability, and cost. • Author and drive technical designs and RFCs that clearly communicate architecture, alternatives, risks, and operational considerations. • Influence the technical direction of the data products you own and contribute to the team’s broader technical strategy and roadmap. • Set a high quality bar through thoughtful design and code reviews, automated testing, version-controlled schemas, and CI/CD practices for data pipelines. • Lead projects that improve the team’s engineering and operational excellence, including data observability, lineage, incident response, deployment safety, and developer productivity. • Design and operate scalable batch and real-time data solutions using technologies such as Spark, Flink, and Kafka. • Partner with the ML Platform team to deliver clean, reliable, and feature-rich datasets for model training and inference. • Advance data stewardship through strong documentation, discoverability, privacy controls, access management, and governance practices. • Lead postmortems for data incidents, identify systemic improvements, and drive corrective actions to completion. • Break complex projects into clear, deliverable work and help coordinate execution across engineers on the team. • Mentor other engineers, provide actionable technical feedback, and participate in interviewing and hiring. • Participate in the team's on-call rotation, responding to incidents, troubleshooting issues, and contributing to root cause analysis and service reliability improvements. • Respond to and troubleshoot production issues, outages, and critical alerts during assigned on-call shifts. • Escalate incidents as needed and collaborate with team members to restore service. • Document issues and contribute to improvements that reduce recurring incidents. • Be available to provide occasional after-hours, weekend, and holiday support while on call.

Job Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related technical field, or equivalent practical experience.
  • 5+ years of relevant industry experience in data engineering, distributed systems, or a related field.
  • A track record of independently delivering and operating significant production data products end to end.
  • Experience using AI-assisted development tools to support coding, debugging, testing, documentation, technical exploration, and analysis.
  • Ability to validate AI-assisted outputs, identifying risks and failure modes, protecting sensitive information, and knowing when deeper manual review is required.
  • Deep experience building and scaling cloud-based data platforms, preferably using AWS and Snowflake.
  • Expertise in developing, optimizing, and debugging complex data transformations using Python and high-performance SQL.
  • Strong understanding of data modeling, ETL/ELT architecture, schema design, and transformation frameworks such as dbt.
  • Experience designing reliable workflows using orchestration tools such as Airflow.
  • Hands-on experience with distributed processing or streaming technologies such as Spark, Flink, or Kafka.
  • Strong technical judgment and experience making trade-offs among performance, reliability, scalability, maintainability, and cost.
  • Experience establishing or improving data quality, testing, observability, lineage, and operational practices.
  • Familiarity with modern data governance practices, including cataloging, data classification, PII masking, privacy controls, and access management.
  • Experience writing technical design documents and communicating complex decisions to technical and non-technical stakeholders.
  • Experience with technologies such as Iceberg, Debezium, or infrastructure-as-code tools such as Terraform is a plus.
  • Ability to participate in a shared on-call rotation supporting production systems, including occasional after-hours, weekend, and holiday coverage, with responsibility for responding to critical alerts, coordinating escalations to restore service, and documenting issues to help prevent recurrence.

Benefits

  • Offers Equity
  • Offers Bonus

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer

Reality Defender

Reality Defender is a pioneering company focused on protecting organizations from the growing threat of deepfake technology. Its platform secures critical commu

Data Engineer2 days ago

• Design, build, and operate large-scale data processing pipelines handling multi-terabyte and streaming datasets, including audio/video transcoding, feature extraction, and preprocessing workflows. • Deploy, scale, and troubleshoot containerized workloads on Kubernetes and AWS in production environments. • Build and maintain distributed data processing jobs using frameworks such as Spark and Ray. • Design and operate workflow orchestration systems (e.g., Airflow) with dependency management, retries, monitoring, and alerting for production pipelines. • Administer and tune enterprise databases, including performance tuning, backup/recovery, access control, and scaling strategies. • Partner with ML engineers and researchers to support training pipelines, model retraining triggers, feature stores, and other MLOps workflows.

New York
$140K - $180K / year
First Citizens Bank logo

Senior Data Engineer

First Citizens Bank

First Citizens Bank offers a full line of financial services and focuses on individuals, as well as small to medium-sized businesses. As an employer, the compan

Data Engineer2 days ago

Role Description This is a remote role that may only be hired in the following location(s): North Carolina, Arizona, Florida, and Texas. We are seeking an experienced Senior Data Engineer to join our Data Platform Engineering Organization and help build scalable cloud-based data solutions that enable analytics and data-driven decision-making across the organization. The ideal candidate is a hands-on data engineer with expertise in cloud-based data platforms, data warehousing, ETL/ELT development, and modern data engineering practices. - Build and optimize scalable data pipelines, integrations, and data products utilizing AWS Services, Snowflake, dbt, Python, SQL, and related technologies. - Collaborate with a talented team of engineers, product partners, and business stakeholders to deliver cloud-based data solutions that support critical business initiatives. - Work with modern technologies, solve complex data challenges, and contribute to enterprise-scale data platforms that enable data-driven decision-making across the bank. Qualifications - Bachelor's Degree and 4 years of experience in Data Engineering, Data Warehousing, Cloud Data Platforms, or related technology disciplines. - OR High School Diploma or GED and 8 years of experience in Data Engineering, Data Warehousing, Cloud Data Platforms, or related technology disciplines. - Advanced experience with cloud platforms such as AWS, Azure, or GCP. - Advanced experience with modern data warehousing and large-scale data processing technologies such as Snowflake, Spark, or equivalent platforms. - Advanced proficiency in Python and SQL. - Advanced experience developing and supporting ETL/ELT processes, data pipelines, and data integration solutions utilizing tools such as dbt, Apache Airflow, Astronomer or equivalent cloud-native data engineering technologies. - Experience with data modeling, data warehousing, and data engineering best practices. - Experience designing, developing, and supporting scalable and reliable data engineering solutions in enterprise environments. - Experience collaborating with business and technology stakeholders to deliver data-driven solutions. - Strong analytical, problem-solving, and communication skills. Requirements - Intermediate experience with enterprise ETL/ELT tools such as DataStage, SAP BODS, SSIS, Informatica, or equivalent technologies. - Intermediate experience developing and supporting Operational Data Stores (ODS), analytics platforms, and data products. - Intermediate experience with Change Data Capture (CDC), streaming, and real-time data ingestion technologies such as Kafka, Amazon Kinesis, Apache Flink, Qlik Replicate, Snow pipe Streaming, or equivalent platforms. - Intermediate experience integrating data across cloud and on-premises environments. - Experience with Data Vault modeling and modern data warehousing methodologies. - Intermediate understanding of data governance, security, compliance, and data quality management practices. - Experience working within Financial Services, Banking, or other highly regulated industries. - Familiarity with Tableau, Power BI, or other analytics and visualization platforms. - Experience using AI-powered development and productivity tools to improve engineering efficiency and delivery outcomes. - AWS Certified Data Engineer – Associate, AWS Certified Developer – Associate, SnowPro Core Certification, SnowPro Advanced Data Engineer Certification, or equivalent cloud and data platform certifications. Benefits Benefits are an integral part of total rewards and First Citizens Bank is committed to providing a competitive, thoughtfully designed and quality benefits program to meet the needs of our associates. More information can be found at https://jobs.firstcitizens.com/benefits .

United States

Role Description Owns the OBIWAN Oracle database and data-integration layer supporting timely and accurate FAA financial reporting. The position administers Oracle Database 19c and associated platforms, operates and enhances Oracle Data Integrator (ODI) workflows, maintains GoldenGate replication, executes daily DELPHI and PRISM data loads and reconciliation, performs backup and recovery, tunes performance, resolves failures, and preserves data integrity across development, test, staging, and production environments. The candidate must have the ability to operate effectively under pressure adhering to the ProSol Core Values of: - Agility: rapid adaptation to the changing requirements and environment of our clients; - Excellence: Service quality that exceeds the expectations of our clients; - Integrity: Accountability and honesty−always doing the right thing; - Long-Term Commitment: Unquestioned loyalty and dedication to our clients, partners and employees. Qualifications - Advanced Oracle Database administration and troubleshooting skills in high-availability production environments. - Strong Oracle Data Integrator experience, including complex load plans, scheduling, mappings, job dependencies, automation, restartability, exception handling, and performance optimization. - Hands-on experience with Oracle GoldenGate replication, RMAN backup/recovery, Oracle Enterprise Manager, AWR, SQL/PLSQL, and database performance tuning. - Ability to operate time-sensitive financial data pipelines, validate source-to-target completeness, reconcile balances and records, and resolve discrepancies under strict daily deadlines. - Experience with flat-file transfer, FTP/SFTP, secure shell tools, file parsing, job scheduling, logging, alerting, and automated controls. - Ability to diagnose failures spanning source systems, network transfer, ETL, databases, replication, reports, and downstream dependencies. - Strong documentation and communication skills, including clear incident status, root-cause analysis, recovery procedures, and technical recommendations. Requirements - Bachelor’s degree in computer science, information systems, data engineering, software engineering, or a related technical field; directly relevant experience may substitute for a portion of formal education. - At least seven years of experience supporting enterprise Oracle database, data warehouse, ETL, data-integration, or financial-reporting environments. - At least five years of hands-on experience with Oracle Database administration and/or Oracle Data Integrator in production operations. - Demonstrated experience with backup and recovery, performance tuning, patching, upgrades, replication, production batch operations, data validation, and root-cause analysis. - Demonstrated ability to support early-morning Eastern Time production deadlines and respond calmly to high-impact data or database incidents. Preferred Qualifications - Oracle Certified Professional (OCP), Oracle Database Administration, ODI, GoldenGate, Exadata, or comparable Oracle credentials. - Experience with FAA systems, OBIWAN, DELPHI / Oracle Federal Financials, PRISM, or other federal financial and procurement data sources. - Experience with Exadata X9, Oracle Enterprise Manager, VxRail, Red Hat Linux, and hybrid application/database operations. - Experience creating automated reconciliation controls, anomaly detection, dashboards, and preventive monitoring for daily data pipelines. - Experience supporting ATO sustainment, NIST controls, vulnerability remediation, security scans, and audit evidence in federal environments. Core Competencies - Oracle database administration - ODI and ETL operations - Daily data reconciliation - GoldenGate replication - Backup and recovery - Performance tuning and capacity - Root-cause analysis and automation - Time-critical production support Supervisory Responsibilities This position has no routine direct reports. The employee may lead database and integration work, coordinate incident response, conduct peer reviews, and provide technical direction to team members or vendor support personnel. Work Environment and Physical Requirements Work is primarily performed remotely or at a Contractor facility. The role requires sustained computer use, early-morning availability aligned to Eastern Time, careful review of logs and financial data, and occasional after-hours work during maintenance, releases, outages, or recovery events. The employee must be able to respond promptly through telephone, messaging, and virtual collaboration tools. Performance Expectations - Daily integrations and reconciliation complete within required contract timelines with accurate status and escalation when deadlines are at risk. - Database services, replication, backup, and recovery remain reliable, secure, performant, and fully documented. - Data discrepancies and integration failures are resolved quickly, with root cause and preventive controls documented. - Patches, upgrades, migrations, and configuration changes are tested, controlled, reversible, and supported by complete evidence. - Database and data-integration documentation remains current enough for backup personnel to execute routine operations and recovery. Position Description Disclaimer This description summarizes the position’s primary duties and may be revised for related business or contract needs. It does not create an employment contract. Reasonable accommodations may be provided in accordance with applicable law and company policy. Additional Information ProSol is an equal opportunity employer, all interested qualified applicants are encouraged to apply, EEO/D/M/V/F. ProSol welcomes and encourages diversity in the workforce. All your information will be kept confidential according to EEO guidelines.

EST (UTC-5)

Role Description We are looking for a Senior Data Engineer to design, build, and optimize scalable data platforms that support analytics, ecommerce, logistics, and marketing initiatives. This role will be responsible for developing robust data pipelines, improving the data infrastructure, and ensuring high-quality, reliable data solutions in an AWS environment. The ideal candidate has strong expertise in Python, SQL, Spark, Airflow, and cloud-based data architectures, along with excellent communication skills and a collaborative mindset. - Design, build, and maintain scalable data pipelines for analytics, ecommerce, logistics, and marketing. - Improve and maintain the company's data infrastructure and tooling, including Redshift/Snowflake, Airflow, and Fivetran. - Architect data processing systems capable of handling complex data flows and large-scale datasets. - Develop reliable, efficient, and cost-effective data solutions in an AWS environment. - Ensure high standards of data quality through automation and best engineering practices. - Optimize platform performance, resiliency, scalability, and operational costs. - Collaborate closely with software engineers, analysts, and business stakeholders. - Mentor engineers and analysts on data engineering best practices. - Participate in architecture discussions and technical decision-making. Qualifications - 4+ years of experience as a Data Engineer working with modern data technologies. - Strong proficiency in Python and SQL. - Experience processing large-scale datasets. - Hands-on experience with Apache Spark and Apache Airflow. - Experience designing and architecting data processing systems in AWS. - Experience with Redshift and/or Snowflake. - Knowledge of Fivetran or similar data ingestion tools. - Strong understanding of data quality, automation, and data engineering best practices. - Excellent communication and interpersonal skills. Requirements - Experience with streaming technologies such as Kafka or AWS Kinesis Firehose. - Knowledge of Docker and/or Kubernetes. - Familiarity with Ruby or R. - Experience building or migrating a Data Warehouse. - Experience leading projects or mentoring technical teams. Benefits - A stable, long-term contract with opportunities for career growth. - Private health insurance. - A remote-friendly culture that promotes work-life balance. - Continuous training, mentorship, and learning programs to keep you at the forefront of the industry. - Free access to AI training resources and state-of-the-art AI tools to elevate your daily work. - A flexible Paid Time Off (PTO) policy as well as paid holiday days. - Challenging, world-class software projects for clients in the US and LatAm. - Collaboration with some of the most talented software engineers in Latin America and the US, in a diverse work environment.

Northern America + 1 moreAll locations: Northern America | Latin America (LATAM)