Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001

Location

United States + 1 moreAll locations: United States | Canada

Posted

47 days ago

Salary

$108.2K - $158.7K / year

Seniority

Senior

Job Description

Senior Data Engineer

Praxair

Role Description The Senior Data Engineer will join the Americas IT software and architecture team. This business-centric IT team enables business-focused development of cutting-edge solutions and integrates global/regional IT initiatives into the business. In this senior role, we are seeking an experienced Data Engineer with deep hands-on expertise in Apache Spark, Microsoft Fabric, and cloud-scale data architecture. You will lead the design of robust data pipelines, optimize large-scale data architectures, and drive data-driven decision-making across the organization. The Senior Data Engineer is expected to work independently, collaborate with business and IT leaders, guide junior engineers, and architect solutions from the ground up based on complex business requirements. Key Responsibilities - Design and Develop Enterprise Data Pipelines: Architect, build, and maintain scalable, distributed data pipelines leveraging Apache Spark and Microsoft Fabric to process large structured and unstructured datasets. - Data Integration Leadership: Integrate data from diverse internal and external systems, ensuring reliability, lineage, and consistency across the enterprise. - Performance Optimization: Lead optimization of ETL/ELT workloads for large-scale analytics, improving cost efficiency, throughput, and reliability. - Data Quality & Governance: Define and implement standards for data quality, metadata management, cataloging, lineage, and governance compliance. - Cross-Functional Collaboration: Partner with data scientists, analysts, architects, and IT teams to define requirements, deliver insights, and integrate analytical models. - Documentation: Develop and maintain in-depth documentation for pipeline architectures, workflows, schemas, and operational processes. - Continuous Innovation: Evaluate emerging technologies and introduce modern data engineering practices such as lakehouse patterns, delta formats, automation, and real-time processing. - Troubleshooting & Reliability: Lead resolution of complex data pipeline failures, ensuring platform stability and enterprise-grade reliability. - Security & Compliance: Enforce enterprise data security, privacy, and access governance policies. Qualifications - Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field. - 7+ years of professional experience in data engineering, data architecture, or large-scale data platform development. - Expertise in Apache Spark for large-scale batch and streaming workloads. - Deep hands-on experience with Microsoft Fabric, including Data Engineering, Data Factory, Data Pipelines, and Lakehouse implementations. - Advanced proficiency in SQL, Python, and/or Scala. - Hands-on expertise with Microsoft Azure (preferred), AWS, or GCP cloud data services. - Strong understanding of distributed systems, lakehouse patterns, and data modeling. - Proven experience designing and optimizing complex ETL/ELT workflows. - Strong communication skills, leadership capability, and technical mentorship experience. Preferred Qualifications - Professional certifications in Azure Data Engineering, Apache Spark, or Microsoft Fabric. - Experience with real-time streaming technologies such as Kafka or Azure Event Hubs. - Knowledge of DevOps practices including CI/CD, Infrastructure as Code, and automated testing. - Experience with visualization tools such as Power BI or Tableau. Benefits - Competitive compensation and an outstanding benefits package. - Access to health, dental, disability, and life insurance. - Paid holidays and vacation. - 401(k) matching and pension benefits. - Employee discount program. - Opportunities for educational and professional growth. Salary Pay commensurate with experience. Open to salary range $108,225 - $158,730.

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description As a Data Engineer, you will be a key part of the team, enabling and facilitating a data-driven culture for internal and external clients and using advanced data pipelines to generate insights on where to go. - Collaborate with a talented international team of engineers, architects, and cloud experts to design and implement data-driven solutions from concept to deployment. - Translate business needs, user stories, and technical requirements into scalable and efficient data warehouse solutions. - Communicate your technical decisions to team members and stakeholders using clear, accessible language. - Proactively suggest and implement improvements to existing processes, engage in technical discussions, and lead code reviews, providing constructive feedback and innovative solutions. - Be involved in the entire development lifecycle of data pipelines and warehouse architectures, applying critical thinking and leveraging advanced tools and methodologies to ensure impactful results. - Embrace a bold and resilient mindset, experimenting with new approaches and learning from challenges to achieve success more often. Qualifications - At least 2 years of experience in similar positions - Hands-on experience with Databricks - Solid understanding of cloud environment and their integration with Data Warehouse solutions - Strong Data Warehouse experience with diverse data models - Experience with Python - Experience with SQL - Fluent in English and strong communication skills Requirements - Resilience and the ability to navigate change and adapt - Experience working in a fast-paced start-up environment - Experience developing solutions using Generative AI, LLMs, or agentic architectures - Experience leveraging AI-powered SDLC workflows for both product and engineering tasks Benefits - Agile Company Culture and the Best Team - Global Projects & Opportunities - Social Events & Team Building - Continuous Development - Training & Development - Growth Opportunities - Flexible Working - Remote Friendly Culture - Great Equipment & Tools - Flexible Benefits - Extra Days Off - Health Insurance

Worldwide
DLG (Digital Luxury Group) logo

Senior Data Engineer

DLG (Digital Luxury Group)

Luxury is in our DNA. We are the leading strategic partner for luxury & lifestyle brands.

Data Engineer47 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Set the technical direction for pipeline architecture and data quality standards • Take end-to-end ownership of mission-critical pipelines — from raw ingestion through to clean, documented delivery in BigQuery • Be the go-to technical authority on data behaviour across the platform • Design and develop data processing, cleansing, transformation, and QA scripts using Python and SQL • Own the operation, maintenance, and enhancement of existing mission-critical data pipelines and ETLs • Monitor pipeline reliability and data quality standards; identify and close coverage gaps systematically • Optimise ETL performance and migrate legacy pipelines into a more scalable architecture • Define and enforce data quality standards across the full pipeline • Contribute to architectural decisions on ingestion, transformation, and delivery layer design • Own the full data lifecycle documentation: every transformation rule, edge case, and business logic decision must be spec'd • Fetch datasets from external data sources: REST APIs, JSON, CSV • Perform data migrations and batch data updates • Conduct exploratory analysis to support new business requirements and data source onboarding • Develop proof-of-concept pipelines for new data initiatives

Poland
Job Closed
Carrier logo

DPM Lead Data H/F

Carrier

Carrier Global Corporation, global leader in intelligent climate and energy solutions, is committed to creating innovations that bring comfort, safety and sustainability to life. Through cutting-edge advancements in climate solutions such as temperature control, air quality and transportation, we improve lives, empower critical industries and ensure the safe transport of food, life-saving medicines and more. Since inventing modern air conditioning in 1902, we lead with purpose: enhancing the lives we live and the world we share. We continue to lead because of our world-class, inclusive workforce that puts the customer at the center of everything we do.

Data Engineer47 days ago
Full TimeRemoteTeam 10,001+Since 1915H1B Sponsor

Poste: DPM Lead Data Contrat: Permanent Build your career with confidence. By joining Carrier, you become part of the global leader in providing healthy, safe, sustainable, and intelligent solutions to the building and cold chain industries. We create solutions that matter for our planet – and our employees are at the heart of our vision. We are a company of innovators, united by our vision, values, and culture: the "Carrier Way." As an employer of choice, we aspire to provide an attractive workplace, develop and retain the best talents, promote engagement, foster teamwork, and use innovation to serve our customers. In short, Carrier's strengths lie in the expertise, creativity, and passion of our employees, and we look forward to having you join our team. The role The DPM Lead Data leads the definition, governance, and functional delivery of CSE‑C analytics projects by translating business needs (Sales, SIOP, Finance, ERCD, Customer Care, Factory) into scalable, compliant, and reusable analytics solutions, while working closely with the CSE Analytics team to integrate CSE‑C application data into the global CSE Analytics platform. Key Responsibilities - Define and drive the CSE‑C Analytics roadmap, ensuring alignment between business priorities, KPIs, and delivery capacity. - Own KPI definitions and business semantics, ensuring consistency, reusability, and cross‑functional alignment across domains and regions. - Translate business requirements into scalable analytics solutions and semantic data models, acting as functional lead for ERP‑based analytics. - Lead analytics delivery execution, coordinating delivery teams, tracking progress, and validating outputs through UAT and business sign‑off. - Ensure data governance, security, and GDPR compliance, including access models, data masking, and collaboration with Legal and Privacy teams. - Coordinate stakeholders and analytics adoption, leading workshops, steering forums, and enabling effective use of analytics solutions. Profile - Strong functional understanding of Sales, SIOP, Finance, Supply Chain, Customer Care, and Factory data and processes, with a performance‑driven mindset. - Proven experience in KPI frameworks and performance management, from definition to cross‑business alignment and operational usage. - Deep functional expertise in SAP ERP data models, with experience using modern analytics platforms (Snowflake, Power BI, Databricks). - Solid capability in data modeling and semantic layer design, ensuring scalable, consistent, and reusable analytics solutions. - Strong data governance and GDPR exposure, combined with excellent stakeholder communication skills and the ability to operate in complex, multi‑country, matrix organizations. - Ability to operate in complex, multi‑country, matrix organizations. Our commitment Our greatest assets are the expertise, creativity and passion of our employees. We strive to provide a great place to work that attracts, develops and retains the best talent, promotes employee engagement, fosters teamwork and ultimately drives innovation for the benefit of our customers. We strive to create an environment where you feel that you belong, with diversity and inclusion as the engine to growth and innovation. We develop and deploy best-in-class programs and practices, providing enriching career opportunities, listening to employee feedback and always challenging ourselves to do better. This is The Carrier Way. Join us and make a difference. Apply Now! Carrier is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class. Job Applicant's Privacy Notice: Click on this link to read the Job Applicant's Privacy Notice Carrier est engagé dans l’égalité des chances et l’inclusion. Toutes les candidatures qualifiées seront examinées dans le respect de la réglementation et un accompagnement spécifique sera fourni à la prise de poste. Notice de confidentialité du candidat au poste : Cliquez sur ce lien pour lire la Notice de confidentialité du candidat au poste

France
DocPlanner logo

Freelance Portuguese Data Annotation Specialist (100% Remote within Europe)

DocPlanner

At Docplanner Group, we’re on a mission to help people live longer, healthier lives. As the world’s largest healthcare platform, each month, we connect 24 million patients with 280k doctors across 13 countries. Our marketplaces, SaaS and AI tools simplify daily tasks and help doctors, clinics and hospitals work more efficiently. Real impact – We help doctors help patients. Your work truly makes a difference. At scale, yet agile – 3,000+ employees, but still fast, flexible, and hands-on. Shape the future, sustain growth – Make a difference now and build for long-term success.

Data Engineer47 days ago
Full TimeRemoteTeam 1,001-5,000Since 2012H1B No Sponsor

Company Description Welcome to the good side of tech! You might have heard about us, but with a different name: DocPlanner, Doctoralia, Znanylekarz... It all started 10 years ago when we asked ourselves: is anyone in healthcare thinking about patients? We jumped in and we empowered patients by giving them access to leave and read reviews about their visit. We then provided doctors with the technology to manage bookings easily and save time, so they could devote themselves to what they always wanted: treating patients. And today is the day in which we ask you: wanna join us in the next step of the company's history: Making people longer & healthier lives? We're coupling the latest advances in AI & LLMs to the power of the network effects of our Marketplace to transform how people approach healthcare. Docplanner at scale We are leaders in 13 countries so far, and more than 90 million patients trust us every month. 210,000 specialists believe in us and our product, and so do leading venture capital funds such as Point Nine Capital, Goldman Sachs Asset Management, and One Peak Partners. And yet, employing over 3.500 people all over the globe, we managed to keep the startup mindset we started with over 10 years ago. And why should you join us? Because it feels good to tell your family and your friends how you made the world a little bit better. You go to bed knowing that what you do matters, and that your talents align with your beliefs. We want to make people live longer & healthier lives, and that starts with you being you. We believe that taking the diversity of human experience into account makes a better healthcare experience for all. We’re not just different: we embrace diversity. We will encourage you to come to work your whole self, and that includes not coming to the office at all if you prefer not to, as we're 100% remote-friendly. Job Description As a Freelance Data Annotation Specialist at Docplanner, your main focus will be preparing and curating linguistically and medically oriented datasets in Portuguese to power our machine learning and natural language processing (NLP) initiatives. You will work independently while maintaining clear communication with our NLP experts, ensuring the accuracy and relevance of our data for the market, and contributing directly to the quality and reliability of our AI-driven products in the medical domain. This role is ideal for candidates with a strong linguistic background in Portuguese who are passionate about working in the healthcare and technology space. The ideal freelancer has experience in data annotation, transcription, and text analysis, combined with a basic understanding of medical terminology and concepts. This is not a full time job, it's for FREELANCERS ONLY. You must be able to invoice in EUR. Key Responsibilities: - Prepare and maintain medically oriented datasets for machine learning purposes, ensuring high-quality data annotation and consistency. - Follow and provide feedback on annotation and labeling conventions, as well as perform audio transcriptions in Italian (aligning audio with text and correcting text based on audio). - Implement text patterns to detect and extract named entities in Portuguese, such as names, addresses, organization names, ID numbers, and medical terms. - Contribute to dictionaries and taxonomies in Portuguese for use in NLP systems. - Evaluate the correctness and accuracy of words, sentences, and text structures, ensuring linguistic quality and consistency. - Deliver high-quality work within established deadlines and communicate proactively about project progress and challenges. Qualifications - Languages: Native Portuguese speaker and Full Professional Level of English - Linguistic Expertise: A degree or strong background in linguistics, computational linguistics, or a related field. - Medical Knowledge: Familiarity with medical terminology or prior experience in the healthcare domain. - Data Annotation: Hands-on experience with data annotation, transcription, and labeling tools. - Text Analysis: Proficiency in working with text patterns and dictionaries for NLP purposes. - Attention to Detail: Exceptional ability to assess and improve data quality. - Self-Management: Strong ability to work independently, manage time effectively, and consistently meet deadlines. Which skills are 'bonus points'? - Previous experience in AI, machine learning, or data preparation projects. - Knowledge of multiple languages or dialects. - Exposure to medical coding systems (e.g., ICD, CPT) or electronic health records (EHR). - Experience working as a freelancer on similar annotation or linguistic projects. Additional Information Remuneration: 15 euros / h

Spain
€15 / year