We unlock leaps in innovation with strategy, design and technology.
Data Engineering Lead
Location
Canada
Posted
80 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineering Lead
Future Works
• Data Ingestion & Structuring: Lead the extraction, ingestion, and harmonization of historical freight, order, inventory, and complex carrier rate card data from diverse legacy sources. • Schema Design: Define "Minimum Viable Attributes" and architect a unified, canonical data schema that normalizes client data for downstream consumption. • Pipeline Development: Build robust, reusable ETL/ELT pipelines to facilitate rapid and structured analysis in a highly regulated environment. • Quality Assurance for Modelling: Ensure data quality, completeness, and readiness are sufficient to train predictive machine learning models and run optimization simulations. • Infrastructure Collaboration: Work alongside the Solutions Architect to stand up and operate within a secure, single-tenant sandbox environment ensuring strict data isolation. • Hypothesis Validation: Support the Operations Strategy team by providing the necessary data structures to decompose current allocation logic, enabling the identification of wrong-node, mode-mix, and escalation drivers.
Job Requirements
- 5+ years of senior-level data engineering experience with a proven track record of designing data architecture, data lakes/warehouses, and complex ETL/ELT pipelines.
- Technical Mastery: Deep proficiency in Python, advanced SQL, and modern data processing libraries
- Cloud Expertise: Hands-on experience working within cloud environments to deploy secure, high-performance data infrastructure (e.g., PostgreSQL).
- Domain Knowledge: Previous experience working with supply chain, logistics, or ERP data (shipment histories, inventory levels, freight billing) is highly preferred.
- Agile Execution: Ability to thrive in rapid, hypothesis-driven sprint cycles (12-week models) where the focus is on validation experiments rather than traditional, slow IT delivery.
- AI-Native Workflow: Comfort utilizing LLM code assistants (e.g., Cursor, Copilot) and agentic engineering to multiply your productivity and enhance code quality.
Benefits
- Work from anywhere, forever - We are a fully remote and global team. We trust you to manage your time and energy to deliver exceptional results.
- Connect deeply - We gather for immersive, all-expenses-paid company retreats in unique locations to connect, learn, and grow together.
- Share in the upside - A competitive compensation package including equity, bonuses, substantial participation in company profits with a clear growth path to C-Level leadership based on performance.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Work Location: Cherry Hill, New Jersey, United States of America Hours: 40 Pay Details: $91,000 - $145,600 USD TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs. As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role. Line of Business: Data & AnalyticsJob Description: The Business Information Management Specialist provides business technical leadership across a broad range of information management functions to support the various areas of data and analytics. Works independently as a senior lead and may manage and direct activities related to analysis, design and support of business data management solutions on various projects ranging up to larger projects. Depth & Scope: - Highly seasoned professional role requiring substantial knowledge / expertise in a complex field and knowledge of broader related areas - Requires master level conceptual expertise and knowledge for own area of specialty / domain and knowledge of broader related areas - Primary subject matter expert in multiple areas and consults with clients/or project teams with respect to all aspects of business information management processes and procedures - Expert level analytical and problem solving skills and fluent in multiple programming language - Works autonomously as a senior/lead on a diverse range of tasks and is relied upon to coach/ educate others - Manages and directs activities related to analysis, design and support of business information management solutions - In-depth expertise or experience with big data solutions and familiarity with big data technologies - Keeps abreast of rapid business and technology innovation within business information management field - Familiar with visualization tools - Analyzes, designs, develops data repositories, warehouses and marts, data movement, data wrangling, data mapping and transformation (ETL) processes - Supports solutions, applications, platforms, and/or tools that are leveraged across all functional groups (e.g., Data Scientists, Business Insights & Analytics, etc.) - May also be responsible for developing sophisticated data preparation frameworks and architecture to create or modify data features for consumption by Data Scientists - Supports data modeling capabilities in order to structure business data to be consumed / translated into a variety of novel capacities - Supports business teams in the use and understanding of the data and reporting solutions - Develops data road map/information management strategies and corresponding technical solutions on integrating, transforming, and/or managing data - Drives data-centric solution development focusing on complex data integration - Adopts the Enterprise Data model in alignment with direction from the OCDO and other data & analytics functional groups - Solicits, analyzes, and understands data requirements (i.e., using market research, requirements gathering, feature planning, user experience / design considerations, etc.) to enable development of information management solutions Education & Experience: - Undergraduate degree or Technical Certificate - 7+ years of relevant experience from a business administration, statistical, mathematical, scientific or financial background - Advanced knowledge of various data sources, tools and technologies used in preparing summaries and reports - Analytical and problem solving skills are required to interpret data and draw conclusions - Knowledge of current and emerging competitor and market trends - Skill in using analytical software tools, data analysis methods and reporting techniques - Skill in mentoring/coaching others - Skill in using computer applications including MS Office - Ability to communicate effectively in both oral and written form - Ability to work collaboratively and build relationships - Ability to work successfully as a member of a team and independently - Ability to exercise sound judgement in making decisions - Ability to analyze, organize and prioritize work while meeting multiple deadlines - Ability to handle confidential information with discretion - Ability to contribute to strategic direction of the function and provide advice to senior leadership Preferred Qualifications: - Experience in SQL and Python - Experience in Alteryx and Data Bricks Customer Accountabilities: - Analyzes and understand business and data requirements to develop complete business solutions, including data models (entity relationship diagrams, dimensional data models) and business rules, data life-cycle management, governance, lineage, metadata and reporting elements. - Applies automation and innovation on data platforms and on-going on any new development projects / initiatives aligned to business or organizational strategies - Designs and implements complex business data information management frameworks to provide a solution that meets business requirements - Collaborates with technology and business partners to resolve issues and ensure requirements and established SLAs - Works closely with various technology/project teams to understand business data and provide analysis and requirements to ensure the data design / development initiatives are in line with the planned design and standards Shareholder Accountabilities: - Works with other various partners/ stakeholders to ensure project success - Develops business requirements by researching / analyzing and documenting business data requirements - Provides expert guidance within projects and other various change initiatives to support data impact assessments and data risk mitigation - Implements processes aligned to data information management standards and ensure data quality (e.g., rules / thresholds / assessments, etc.) and requirements are developed - Develops and maintains knowledge of data available from upstream sources and data within various platforms - Identifies critical data / critical data elements to support Business Segment data governance and/or data management frameworks / programs - May be responsible to understand and utilize business information management data deliverables - Ensures business data and information is retained and disposed in compliance with enterprise data standards, policies and guidelines - Performs data profiling using TD tooling and ad hoc system query languages to validate data analysis - Provides support throughout data lifecycle to resolve data issues and support user community by helping users interpret the data - Leads the investigation of root causes for data issues and ensure data issues are resolved - Identifies and/or defines knowledge transfer and data expertise activities to support business teams using the information management solutions. - Adheres to enterprise frameworks or methodologies that relate to data activities for business area - Ensures business operations follow applicable internal and external requirements (e.g. financial controls, segregation of duties, transaction approvals and physical control of assets) - Participates in cross-functional / enterprise / initiatives as a subject matter expert helping to identify risk / provide guidance for complex situations - Conducts meaningful analysis at the functional or enterprise level using results to draw conclusions, make recommendations, assess the effectiveness of programs/ policies/ practices - Keeps abreast of emerging issues, trends, and evolving regulatory requirements and assess potential impacts - Maintains a culture of risk management and control, supported by effective processes in alignment with risk appetite Employee/Team Accountabilities: - Participates fully as a member of the team, support a positive work environment that promotes service to the business, quality, innovation and teamwork and ensure timely communication of issues/ points of interest - Provides industry knowledge for own area of expertise and participate in knowledge transfer within the team, and business unit, and/or cross-functional groups or committees (e.g., Data Councils) - Keeps current on emerging trends/ developments and grow knowledge of the business, related tools and techniques - Participates in personal performance management and development activities, including cross training within own team - Keeps others informed and up-to-date about the status / progress of projects and / or all relevant or useful information related to day-to-day activities - Contributes to team development of skills and capabilities through mentorship of others, by sharing knowledge and experiences and leveraging best practices. - Leads, motivates and develops relationships with internal and external business partners / stakeholders to develop productive working relationships. - Contributes to a fair, positive and equitable environment that supports a diverse workforce - Acts as a brand ambassador for your business area/function and the bank, both internally and/or externally Physical Requirements: Never: 0%; Occasional: 1-33%; Frequent: 34-66%; Continuous: 67-100% - Domestic Travel – Occasional - International Travel – Never - Performing sedentary work – Continuous - Performing multiple tasks – Continuous - Operating standard office equipment - Continuous - Responding quickly to sounds – Occasional - Sitting – Continuous - Standing – Occasional - Walking – Occasional - Moving safely in confined spaces – Occasional - Lifting/Carrying (under 25 lbs.) – Occasional - Lifting/Carrying (over 25 lbs.) – Never - Squatting – Occasional - Bending – Occasional - Kneeling – Never - Crawling – Never - Climbing – Never - Reaching overhead – Never - Reaching forward – Occasional - Pushing – Never - Pulling – Never - Twisting – Never - Concentrating for long periods of time – Continuous - Applying common sense to deal with problems involving standardized situations – Continuous - Reading, writing and comprehending instructions – Continuous - Adding, subtracting, multiplying and dividing – Continuous The above statements are intended to describe the general nature and level of work being performed by people assigned to this job. They are not intended to be an exhaustive list of all responsibilities, duties and skills required. The listed or specified responsibilities & duties are considered essential functions for ADA purposes. Who We Are: TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we strive to make every interaction, product, and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to foster deeper relationships, ensure disciplined execution, and build a simpler, faster banking experience. TD is deeply committed to being a leader in client experience, that is why we believe that all colleagues, no matter where they work, are client facing. Together, we are reimagining what banking can be for our clients, colleagues and communities. Our Total Rewards Package Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical and mental well-being goals. Total Rewards at TD includes base salary and variable compensation/incentive awards (e.g., eligibility for cash and/or equity incentive awards, generally through participation in an incentive plan) and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off (including Vacation PTO, Flex PTO, and Holiday PTO), banking benefits and discounts, career development, and reward and recognition. Learn more Additional Information: We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home. Colleague Development If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. If you’re passionate about helping clients and building deep, lasting relationships, TD offers diverse career paths where you can grow your expertise and make a meaningful impact. We're committed to your success and foster a respectful workplace where diverse perspectives are valued, everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best. Training & Onboarding We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role. Interview Process We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call. Accommodation TD Bank is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, status as a protected veteran or any other characteristic protected under applicable federal, state, or local law. If you are an applicant with a disability and need accommodations to complete the application process, please email TD Bank US Workplace Accommodations Program at USWAPTDO@td.com. Include your full name, best way to reach you and the accommodation needed to assist you with the applicant process.
• Design, develop, and optimize data pipelines using Azure Databricks, Spark, and related Azure services • Lead and support migration activities from the existing data warehouse/ETL stack into Databricks and modern data lakehouse architectures • Collaborate with architects, data engineers, and analysts to define migration approaches, integration patterns, and technical standards • Build and maintain data ingestion, transformation, and orchestration workflows aligned with best practices for Databricks and Delta Lake • Improve performance, scalability, and reliability of Spark workloads through tuning, optimization, and efficient resource management • Implement data quality, monitoring, and observability components for migrated pipelines • Contribute to platform governance, reusable components, and engineering standards to enable consistent delivery across teams • Document migration procedures, architectural decisions, data models, and operating guidelines • Participate in Agile ceremonies to ensure predictable and transparent delivery during the migration program
WHAT WE DO Founded in 2007, Growth Acceleration Partners (GAP) is a consulting and technology services company. We consult, design, build and modernize revenue-generating software and data engineering solutions for clients. With modernization services and AI tools, we help businesses achieve a competitive advantage through technology. GAP’s remote, integrated engineering teams use end-to-end solutions to innovate and align with your business goals. We have 600+ English-speaking engineers based in Latin America and approximately 20 U.S.-based engineers. With some of the highest customer satisfaction scores in the industry, GAP’s focus is customer and employee success. GAP is a woman-owned company headquartered in Austin Texas. We are a values-based company focused on growing our people by investing in education, onsite English classes and training in the latest technologies, including AI, data analytics and machine learning. Our goal is to provide solutions for our customers that help them achieve critical business outcomes, while enabling our GAPSters and our communities to attain long-term success. Summary We are looking for a Senior Data Quality Engineer with strong expertise in validating data pipelines, ETL processes, and enterprise Data Warehouse environments. In this role, you will be responsible for ensuring the integrity, reliability, and consistency of the data powering analytics and reporting platforms. The primary focus of this position is validating the quality of data as it moves across pipelines, transformations, and warehouse layers. You will work closely with Data Engineers and Data Analysts to analyze datasets, review ETL pipelines, validate transformations, and detect anomalies within analytical data environments. This role requires a strong analytical mindset and a deep understanding of how data flows across systems and integrations. This is not a traditional QA role focused on application testing or BI dashboards. Instead, it is a data-focused role centered on validating the quality, completeness, and accuracy of analytical datasets before they are consumed by reporting or analytics systems. Education - Bachelor’s Degree in Computer Science, Software Engineering, Information Systems, Data Engineering, or a related technical field. Professional Experience - 5+ years of experience working with data validation, data quality, or data pipeline reliability - Proven experience working with Data Warehouses and analytical data models - Strong experience validating ETL pipelines and data integrations feeding a Data Warehouse - Experience analyzing large datasets to identify data quality issues, inconsistencies, or anomalies - Experience supporting data validation processes prior to analytics or reporting consumption - Experience integrating data validation checks into CI/CD workflows Key Responsibilities Data Quality & Data Warehouse Validation - Ensure the accuracy, completeness, and consistency of data entering the Data Warehouse - Validate analytical datasets and data models across warehouse environments - Analyze datasets to detect data quality issues, inconsistencies, and anomalies - Perform reconciliation and cross-validation between source systems and warehouse outputs - Apply data quality standards including completeness, accuracy, consistency, and reliability ETL & Data Pipeline Validation - Review and validate ETL pipelines and data integrations feeding the Data Warehouse - Analyze ingestion workflows and transformation logic across data pipelines - Validate transformations across staging, processing, and warehouse layers - Perform source-to-target data validation across environments - Ensure pipelines deliver high-quality datasets to downstream analytics systems Data Investigation & Validation - Write advanced SQL queries to validate datasets and transformations - Investigate discrepancies across multiple data sources - Identify anomalies, unexpected patterns, or data inconsistencies - Perform root cause analysis on data quality issues across systems Automation & Data Validation Frameworks - Develop automated data validation processes using Python - Implement repeatable validation checks across data pipelines - Build monitoring checks for data completeness and integrity - Integrate validation processes into CI/CD pipelines Cross-Functional Collaboration - Partner with Data Engineers and Data Analysts to maintain reliable analytical datasets - Support validation activities before data is consumed by analytics platforms or reporting tools - Collaborate with governance teams to maintain data quality standards - Document validation rules, processes, and methodologies Required Technical Skills - Strong SQL expertise for data validation and troubleshooting - Experience working with Data Warehouses and analytical data models - Hands-on experience validating ETL pipelines and data integrations - Experience in Data Quality validation across analytical datasets - Strong Python skills for data processing and validation - Deep understanding of data flows across systems and integrations - Strong analytical mindset with Data Engineer / Data Analyst perspective - Experience identifying anomalies and inconsistencies in large datasets - Experience integrating data validation into CI/CD pipelines Nice to Have - Experience working with Microsoft Fabric - Familiarity with Databricks - Experience with Azure Data Factory or similar orchestration tools - Familiarity with Power BI to understand downstream data consumption Soft Skills - Advanced English proficiency (spoken and written) - Strong analytical and investigative mindset - Excellent documentation and communication skills - Ability to identify risks and proactively address data quality issues - Collaborative mindset when working with data and engineering teams - Strong attention to detail and problem-solving abilities At Growth Acceleration Partners, we're an equal opportunity employer committed to building a diverse and inclusive team. We value everyone's unique background, and we provide equal opportunities regardless of race, color, creed, religion, sexual orientation, gender identity, age, national origin, disability, marital status, veteran status or any other personal right protected by law. We foster a culture of belonging and strive to provide a welcoming environment where everyone feels safe to contribute and grow.
Senior Data Engineer, Alteryx/Tableau
FUJIFILMFUJIFILM is a publicly traded, multinational photography and imaging company with global headquarters in Tokyo, Japan and regional headquarters in Valhalla, New York. Established i
Position Overview Join FUJIFILM Biotechnologies to power analytics at scale. We’re seeking a Senior Data Engineer with deep expertise in Alteryx and Tableau to design, build, and operate scalable data pipelines and modern analytics platforms. You’ll shape engineering standards, elevate platform reliability and performance, and deliver secure, audit‑ready solutions that accelerate decision‑making across a regulated enterprise. Company Overview The work we do at FUJIFILM Biotechnologies has never been more important—and we are looking for talented candidates to join us. We are growing our locations, our capabilities, and our teams, and looking for passionate, mission-driven people like you who want to make a real difference in people’s lives. Join FUJIFILM Biotechnologies and help make the next vaccine, cure, or gene therapy in partnership with some of the most innovative biopharma companies across the globe. We are proud to cultivate a culture that will fuel your passion, energy, and drive - what we call Genki. Fujifilm is globally headquartered in Tokyo with over 70,000 employees across four key business segments of healthcare, electronics, business innovation, and imaging. We are guided and united by our Group Purpose of “giving our world more smiles.” Visit: https://www.fujifilm.com/us/en/about/region/careers Job Description What you’ll do - Engineer pipelines that deliver impact: Design, build, and maintain high‑performance batch/streaming pipelines (SQL, dbt and/or Alteryx) for data products, analytics, and AI. - Own Alteryx at scale: Configure, administer, and optimize Alteryx Server/Cloud (environments, schedules, credentials, governance, packaging/promotions, upgrades). - Elevate Tableau performance: Engineer/administer Tableau Server/Cloud (sites/projects, permissions, extracts, schedules, LCM, performance tuning, version upgrades). - Run platforms like a pro: Implement monitoring/alerting, SLOs, capacity planning; troubleshoot incidents; drive root‑cause elimination and reliability improvements. - Raise data quality: Implement quality checks, lineage, and observability; define standards for naming, modeling, documentation; contribute to catalog/metadata. - Build security/compliance in: Align with Cybersecurity, data privacy, and where applicable GxP/21 CFR Part 11; execute changes under ITIL/PMO governance. - Partner to deliver: Translate business needs into technical designs; balance delivery velocity with platform health and best practices. - Be the escalation point: Provide L2/L3 support, guide service desk, maintain runbooks/knowledge articles, participate in on‑call rotations as needed. - Optimize for performance and cost: Tune queries/extracts; right‑size compute/storage; drive license hygiene and cost efficiency. - Standardize and improve: Establish engineering standards, SOPs/WIs, templates, peer reviews; evaluate and introduce targeted innovations. Minimum requirements - Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field; or an equivalent combination of education and experience. - 8+ years of related experience with a Bachelor’s; or 6+ years with a Master’s; or PhD with 3+ years; or equivalent experience. - Within the above, 5+ years in data engineering and/or analytics platform engineering, including 3+ years hands‑on administering and operating Alteryx and Tableau in enterprise settings. - Strong SQL and dimensional/relational data modeling; experience with data transformation/integration tools (e.g., Alteryx, dbt, Azure Data Factory/Talend). Preferred requirements - Certifications: Alteryx Designer (Core/Advanced) and/or Server Admin; Tableau Desktop Specialist/Certified Professional, Tableau Server/Cloud Admin; ITIL Foundation v3/v4; cloud certifications (Azure/AWS/GCP) are a plus. - Hands‑on with Snowflake (highly considered); Python for automation; CI/CD (Git, DevOps pipelines); infrastructure‑as‑code basics. - Experience in biotech/life sciences or other regulated industries; familiarity with data privacy and, where applicable, GxP/CSV/CSA and 21 CFR Part 11. What’s in it for you - Impact at enterprise scale: Your engineering will power analytics and AI across functions. - Technical leadership: Set standards, mentor peers, and influence platform roadmaps. - Modern stack + growth: Advance your skills across Alteryx/Tableau, dbt/SQL, cloud data services, and automation. EEO Information Fujifilm is committed to providing equal opportunities in hiring, promotion and advancement, compensation, benefits, and training regardless of nationality, age, gender, sexual orientation or gender identity, race, ethnicity, religion, political creed, ideology, national, or social origin, disability, veteran status, etc. ADA Information If you require reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to our HR Department (fdbglobaltalent@fujifilm.com).




