Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. Over 30 years of delivering extraordinary impact with clients. Helping clients solve complex business problems with technology as the differentiator.
Lead Data Engineer
Location
Canada
Posted
54 days ago
Salary
C$150K - C$241K / year
Seniority
Lead
Job Description
Lead Data Engineer
Thoughtworks
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities - You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. - You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality. - You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. - You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. - You will collaborate with data scientists to design scalable implementations of their models. - You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines. - You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available. - You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack. - You will be responsible for data governance, data security and data privacy to support business and compliance requirements. - You will define the strategy for and incorporate data quality into your day-to-day work. Job qualifications Technical Skills - You have experience in leading the system design and implementation of technical solutions. - Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. - You have a deep understanding of data modeling and experience with modern data engineering tools and platforms. - You have experience in writing clean, high-quality code using the preferred programming language. - You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting. - You have experience with data visualization techniques and can communicate the insights as per the audience. - You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems. - You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills - You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way. - You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives. - You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them. - You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work. - You enjoy influencing others and always advocate for technical excellence while being open to change when needed. - You are a proven leader with a track record of encouraging teammates in their professional development and relationships. - Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business. Policy on the Use of Artificial Intelligence in the Selection Process We use recruitment tools that include some AI-powered features to support our teams with repetitive tasks such as sending communications, scheduling, and generating interview notes. These tools do not rank candidates or make hiring decisions. Every application is reviewed by our recruitment team, and all selection and hiring decisions are made by humans. We are committed to fairness, and our third-party vendors must meet high standards for testing, monitoring, and mitigating bias. For more details, please see our full Thoughtworks AI Policy for Recruitment. Transparency regarding our job openings and our Projects' dynamics As a technology consultancy, the projects we undertake are subject to change based on client needs and agreements. While we strive for consistency, please be aware that project scope or availability may shift, or projects may even be cancelled, during the recruitment and selection process, which is often outside of our direct control. Should the project related to this vacancy be significantly altered or cancelled, all impacted candidates will be promptly and duly informed of the change. Other things to know Learning & Development There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys. About Thoughtworks Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary. #LI-Remote Salary Benefits: https://www.thoughtworks.com/en-ca/careers/benefits Salary $150,000—$241,000 CAD See here our AI policy.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Develop and maintain Looker data models, including LookML, models, and explores • Build and optimize scalable, consumable data models to support business intelligence and strategic decision-making • Utilize Looker API 4.0 to enable programmatic access to dashboards, looks, and explores • Automate report generation and delivery using Looker API endpoints • Write and optimize complex SQL queries to improve performance and efficiency • Work with Snowflake, dbt, and Python to support data transformation and pipeline development • Collaborate with stakeholders to translate data requirements into scalable BI solutions • Ensure data accuracy, consistency, and performance across reporting layers
Job Posting: Since 1953, Ferguson has been a source of quality supplies for a variety of industries. Together We Build Better infrastructure, better homes and better businesses. We exist to make our customers’ complex projects simple, successful, and sustainable. We proactively solve problems, adapt and grow to continuously serve our customers, communities and each other. Ferguson, a Fortune 500 company, is proud to provide best-in-class products, service and capabilities across the following industries: Commercial/Mechanical, Facilities Supply, Fire and Fabrication, HVAC, Industrial, Residential Trade, Residential Building and Remodel, Waterworks and Residential Digital Commerce. Ferguson has approximately 36,000 associates across 1,700 locations. Ferguson is a community of proud associates who operate with the shared purpose of building something meaningful. You will build a career that you are proud of, at a company you can believe in. We are looking for a focused Enterprise Data Operator for the Onboarding team to continuously add new products and maintain existing products in the Ferguson ERP. The Enterprise Data Operator will need to communicate with employees within the company with professionalism. The Enterprise Data Operator will translate and manipulate data provided in a timely and accurate manner. They will identify and correct errors to meet Ferguson's high standard of quality. All Operators will need to maintain a professional and contributing attitude. This role is approved to be fully remote and can be based anywhere in the United States. Schedule: Monday-Friday 8am-5pm EST. Responsibilities - Manage multiple data tasks within set deadlines, utilize Excel, and internal to Ferguson programs. - Take on data tasks including new product adds, product maintenance, and overhauls. - Communicate well with others within and outside job area providing positive customer service. - Respond to feedback in a professional manner. - Thoroughly read all forms of communication that pertain to the department and take any necessary action. - Organize and keep all programs/software up to date. - Effectively multitask and organize one's day in accordance with the required tasks at hand. Qualifications: - Experience with Microsoft Excel is required. - Problem solving, identification, and analysis skills, including the capability to routinely Self QA work. - Attention to detail: Knowledge of grammar, punctuation, and basic math skills - Ability to work within provided instruction and time constraints without direct supervision - Willingness to learn new processes - Effectively communicate issues and status of tasks; occasionally escalate issues and recommend solutions to higher level associates or team lead - Capacity to learn; retain information; use critical thinking; knowing, understanding, and improving available resources - Comfortable communicating with individuals via video, chat, email, or phone - Demonstrates efficient organization and time management skills - Must be able to work in a fast-paced environment with demonstrated ability to manage and prioritize multiple competing tasks and demands - Education/Training/Experience - High school diploma or GED required; one or more years of relative experience or intermediate competencies with Office 365, Excel, an ERP or master data management system. At Ferguson, we care for each other. We value our well-being just as much as our hard work. We are committed to a holistic approach towards benefits plans and programs that support the mental, physical and financial well-being of our associates. Our competitive offering not only includes benefits like health, dental, vision, paid time off, life insurance and a 401(k) with a company match, but our associates also enjoy additional meaningful and inclusive enhancements that are adaptable to their diverse situations and needs, including mental health coverage, gender affirming and family building benefits, paid parental leave, associate discounts, community involvement opportunities and more! #Li-Remote - Pay Range: - Actual pay rate may vary depending upon location. The estimated pay range for this position is below. The specific rate will depend on a candidate’s qualifications and prior experience. - $18.11 - $28.91- Estimated Ranges displayed are Monthly for Salaried roles OR Hourly for all other roles. - This role is Bonus or Incentive Plan eligible. - Ferguson complies with all wage regulations. The starting wage may be higher in certain locations based on local or state wage requirements. - The Company is an equal opportunity employer as well as a government contractor that shall abide by the requirements of 41 CFR 60-300.5(a), which prohibits discrimination against qualified protected Veterans and the requirements of 41 CFR 60-741.5(A), which prohibits discrimination against qualified individuals on the basis of disability. Ferguson Enterprises, LLC. is an equal employment employer F/M/Disability/Vet/Sexual Orientation/Gender Identity. Equal Employment Opportunity and Reasonable Accommodation Information
Senior Manager, Data Engineering
OneMagnifyCreating optimal customer experiences through digital transformation.
• Lead Data Platform Architecture and Delivery • Own the technical direction and delivery of cloud-native data platforms built on Databricks and AWS • Lead the design and implementation of Lakehouse architecture — Delta Lake, Unity Catalog, Spark-based processing — across client engagements • Ensure scalability, performance, security, and cost optimization are built into solutions from the start, not addressed after delivery • Build and Optimize Data Pipelines • Oversee ingestion, transformation, and orchestration pipelines across both batch and streaming workloads • Apply AWS-native services (Glue, Step Functions, Lambda, Redshift, S3) alongside Databricks to build reliable, production-grade pipelines • Establish reusable pipeline patterns and delivery accelerators that raise consistency across the team • Enable AI, ML, and GenAI Use Cases • Ensure data is accessible, trusted, and production-ready to support model development and deployment across AI and GenAI initiatives • Collaborate closely with data science and analytics teams to align platform capabilities with active and planned AI programs • Contribute to client AI roadmap conversations by translating platform decisions into clear enablement strategies • Engage Clients on Technical Strategy • Participate in client-facing architecture reviews and technical strategy sessions, communicating complex platform concepts as practical business outcomes • Support senior leadership in executive briefings and help clients make confident decisions about platform direction and investment • Partner with strategy and delivery teams to scope and structure data platform engagements • Develop the Data Platform Team • Lead, mentor, and grow a team of data engineers, architects, and platform specialists • Set technical standards and create an environment where craft and continuous improvement are expected • Identify skill gaps and help build the team's capabilities alongside the growth of OneMagnify's data practice
OneMagnify is an AI native, platform-enabled B2B digital agency operating at the intersection of data, technology, and creativity. We help complex organizations drive measurable business outcomes by building smarter customer experiences and delivering highly integrated solutions across digital, media, and technology. By combining deep industry expertise with advanced analytics and artificial intelligence, we enable our clients to make better decisions, move faster, and compete more effectively in dynamic markets. Role Summary As a Data Engineer at OneMagnify, you'll build and maintain the data pipelines and integrations that power enterprise analytics and client-facing solutions. This is a craft-focused role where the quality of your work has a direct line to the insights clients rely on — and to the AI and analytics products built on top of that data. You'll work alongside data scientists, analysts, and architects to make sure data moves reliably, cleanly, and at scale. The Impact You'll Have Good data engineering is invisible when it works and painfully obvious when it doesn't. In this role, you're the reason it works. The pipelines you build connect source systems — ERPs, CRMs, data warehouses — to the analytics and AI layers where client decisions get made. When that infrastructure is solid, the models are more accurate, the reporting is trustworthy, and the business cases hold up. You'll work on engagements with large B2B clients in sectors like automotive, industrial, and enterprise technology — organizations managing complex, high-volume data environments where reliability and data quality aren't optional. Your work directly affects how well those clients can act on their data, whether that's optimizing a supply chain, personalizing a customer experience, or tracking campaign performance across channels. You'll collaborate closely with data scientists, analysts, and data architects — not just handing off pipelines, but actively contributing to how data domains are structured and how quality standards get defined and upheld across the platform. What You'll Do Build and Maintain Data Pipelines - Develop integrations between data sources and target systems including ERPs, CRMs, and data warehouses using Databricks and AWS-native services (Glue, Step Functions, Lambda) - Configure, customize, and deploy data engineering applications that support multiple data domains reliably and at scale - Leverage the Databricks Lakehouse platform — Delta Lake, Unity Catalog, and Spark-based processing — to optimize pipeline performance and maintainability Establish and Uphold Data Quality - Develop and enforce data cleansing and standardization guidelines that keep data consistent and trustworthy across systems - Use strong SQL skills to validate, troubleshoot, and resolve data issues before they surface downstream - Partner with data architects to set quality standards that the broader team can operate against Connect Systems Through Integration - Build integrations using APIs and modern pipeline approaches to connect systems that weren't designed to work together - Align pipeline design with enterprise data flows in close collaboration with data scientists and analysts - Ensure integrations are built for durability, not just initial delivery Support Data Platform Users - Work directly with business users and data stewards to diagnose and resolve data issues within the platform - Translate technical pipeline behavior into clear explanations for non-engineering stakeholders - Contribute to documentation and processes that make the data platform easier to use and maintain over time What You'll Need - Bachelor's degree in Computer Science, Information Systems, or a related field — or equivalent professional experience - 5+ years of hands-on experience in data engineering development or implementation - Strong SQL skills across data analysis, validation, and troubleshooting - Hands-on experience with Databricks (Delta Lake, Unity Catalog, Spark) and AWS data services (Glue, Redshift, S3, Lambda, or Step Functions) - Familiarity with APIs and integration methods for connecting systems across an enterprise Future-Ready Skills (Nice to Have) - Experience with Databricks MLflow or Feature Store supporting AI/ML pipeline workflows - Familiarity with marketing data ecosystems: CRM platforms, CDP architectures, or Martech/Adtech data flows - Exposure to data observability or governance tooling (lineage tracking, data cataloging, pipeline monitoring) - Experience in a digital agency, marketing services, or consulting environment with multiple concurrent client data environments - Working knowledge of streaming data pipelines or event-driven architectures (e.g., Kafka, Kinesis) Benefits We believe great work happens when people have the support and flexibility they need to thrive. Our benefits include medical, dental, and vision coverage, a 401(k) retirement plan, paid holidays, and Flexible Time Off (FTO) so you can take time away to recharge when you need it. We also offer additional programs focused on wellness, financial security, and professional growth. We are an equal opportunity employer We believe that Innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance. We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform job functions, and to receive benefits and privileges of employment. Please contact us to request accommodation.


