Job Closed
This listing is no longer active.
We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay
Lead Data Engineer_Databricks
Location
United States
Posted
75 days ago
Salary
0
Seniority
Lead
Job Description
Lead Data Engineer_Databricks
EXL
Senior Data Engineers lead the development and optimization of complex data systems and pipelines. Responsibilities include managing data projects, ensuring data quality, and mentoring junior engineers. You will work with stakeholders to align data solutions with business goals and drive improvements. Extensive experience in data engineering and leadership skills are required.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
About evermore evermoreis a technology company that administers Smart Benefits to connect people to products and services they need, when they need them, so they can live healthier lives. We partner with payers and retailers to deliver expansive benefits for things like healthy foods, OTC medications, or transportation. evermore is reinventing benefits administration so that everyone benefits with more value for each and better outcomes for all. evermore is a Series B stage company, backed by leading investors including General Catalyst, Define Ventures, Lightspeed Venture Partners, Pinegrove Capital Partners, and Qiming Venture Partners. The Job at a Glance Benefit plan sponsors are our customers, and the data which will be your responsibility is the most visible aspect of our service to them. You will evolve our current offering into a self-service reporting platform while simultaneously expanding our data footprint. At evermore, every role contributes to creating a more accessible and dignified experience for millions of individuals navigating essential public benefits. What You Will Do Working within an organization created at the intersection of health care, retail and financial technology, no two days will look the same. Typical responsibilities of the role include: - Define and work within our data governance practices, including a catalog/dictionary and management of data quality, so that users understand and can trust what they are reporting about - Manage lights-out data operations of our ETL/ELT pipelines ranging from streaming inputs to batch file loads, to support customer reporting, development, and operations - Untangle, normalize, synthesize as needed to permit joining and comparisons from disparate sources, and further analysis including ML processing - Wrangle internal and external data into and through the reporting pipeline and schema - Design and run the security aspects of reporting – we manage healthcare and payments data; a safety mindset is at the foundation of everything we do - Handle reporting requests from stakeholders within and external to the business; over time, move from adhoc to systematic - Support data analysts and other internal consumers of the data - Support and enable ML/AI workloads About You While every candidate brings a unique resume and prospective, an ideal candidate will include: - A legacy of happy customers, rather than amount of data processed or the size of data footprint - A work history at startups; you collaborate deeply, are self-sufficient and you get a lot done - A history of applying software engineering best practices to data wrangling and pipeline creation - Cloud proficiency, ideally on GCP, especially as applied to compute/data architecture and security - Amazing SQL and Python skills, to be applied in ETL, front-end reporting - Experience with building and maturing an MLOps pipeline - Experience with, but not blind reliance on, workflow tools like Airflow and transformation tools like dbt - An ability, and a strategy, to manage data quality - Bachelor’s degree or similar experience strongly preferred Other Requirements - Travel may be required from time to time as part of the role, for company events and business needs - evermore is a remote-first, distributed workforce. Candidates should be comfortable with, and equipped to work within, a distributed remote team, including having reliable internet access and basic home office equipment. evermore will provide a work laptop, and mouse/keyboard upon request - Legal authorization to work in the US is required. At this time, evermore will not consider candidates who need sponsorship, now or in the future - All offers for employment are contingent upon successful completion of a background check What We Offer - Competitive base salary ranging from $219,625 to $235,675, discretionary bonus, and equity; depending on experience/qualifications - Benefits - Medical, Dental, and Vision insurance with 90% paid employer premium contributions for all tiers - 100% Employer Paid Short-Term & Long-Term Disability - 100% Employer Paid Basic Life Insurance Policy - Employee Assistance Program (EAP) - 401(k) Program - Discretionary PTO - Paid holidays - Parental Leave - Flexible work schedule within core hours - Work anywhere in the USA as we are a fully distributed team from coast to coast evermore is an equal opportunity employer, Minority/Female/Disability/Veteran/LGBTQIA+ – proudly embracing diversity in all its manifestations. Applicants requiring reasonable accommodation for the application and/or interview process should notify a representative of the People Operations Team via Careers@sodahealth.com. evermore participates in E-Verify, the federal program for electronic verification of employment eligibility. To all recruitment agencies: evermore does not accept agency resumes, please do not forward them to any evermore employees.
• The Data Engineer will be responsible for architecting, designing, and implementing advanced analytics capabilities. • The right candidate will have broad skills in database design, be comfortable dealing with large and complex data sets, have experience building self-service dashboards, be comfortable using visualization tools, and be able to apply your skills to generate insights that help solve business challenges. • We are looking for someone who can bring their vision to the table and implement positive change in taking the company's data analytics to the next level.
Senior Data Engineer
tapoutsBy 2025, tapouts will prepare one million children to take on our future challenges by transforming stress into success.
Senior Data Engineer Location: Remote Type: Full-Time **We will only consider candidates who are located in Latin America About Us At tapouts, we believe in the boundless potential of every child. Our mission goes beyond teaching skills; we are dedicated to nurturing the emotional and psychological well-being of the next generation. Imagine being part of a team that transforms the lives of a million children and their families. By joining tapouts, you are not just taking on a job but using your talents for a deeply rewarding cause. About the Role We are looking for a Senior Data Engineer to join our growing data team. In this role, you will be responsible for designing, building, and maintaining scalable data infrastructure that powers our analytics, AI initiatives, and business operations. This is a hands-on role for someone who thrives in fast-paced environments, thinks like a platform architect, and is passionate about building data systems that matter. Key Responsibilities - Design, build, and maintain robust, scalable data pipelines (batch and real-time/streaming). - Design and develop dashboards that surface key business metrics and enable strategic, data-informed decision-making. - Develop and optimize complex SQL queries, stored procedures, and data models - Write clean, production-grade Python code for data ingestion, transformation, and automation - Build and manage cloud-native data infrastructure on AWS, GCP, or Azure - Implement and maintain data lakehouse architectures (e.g., Delta Lake, Apache Iceberg) - Support ML workflows including feature engineering, model training pipelines, and MLOps integration - Ensure data quality, governance, and lineage tracking across all data assets - Collaborate with data scientists and analysts to deliver trusted, well-documented datasets - Monitor pipeline performance, troubleshoot issues, and optimize for cost and efficiency - Contribute to the development of internal data platform tools and frameworks - Apply data governance best practices and ensure compliance with data privacy regulations (GDPR, LGPD) What We're Looking For - A platform-first mindset — you think beyond individual pipelines and consider ownership, reliability, and long-term maintainability - A data-driven approach — you use metrics to measure pipeline health and continuously improve - Strong communication skills — you can collaborate with technical and non-technical stakeholders - Comfort working in ambiguous, fast-moving environments and bringing structure to chaos - A passion for continuous learning — you stay current with the latest tools and trends in data engineering
Forward Deployed Engineer - Data Migration & Data Consolidation Platforms
Rackspace TechnologyWhere enterprise AI runs and outcomes scale
About the Role: Location: Remote (US) + Travel to client sites up to 40% | Department: Private Cloud, Data & AI | Reports To: VP, Data & AI | As a Forward Deployed Engineer (FDE) for Data Migration & Data Consolidation Platforms, you will serve as the hands-on technical lead driving enterprise-scale data transformation engagements. You will own the end-to-end execution of complex data migrations, multi-system consolidations, and platform modernization initiatives for Global Enterprises and Industry Leaders navigating critical technology inflection points. Operating at the convergence of cloud architecture, data engineering, and direct client partnership, you will translate the capabilities embedded in our migration acceleration platform into production-grade, client-specific solutions. This role demands deep proficiency across legacy enterprise systems such as SAP ECC, Oracle on-premise, modern cloud data platforms, and AI-driven transformation tooling. You will function as both solution architect and hands-on implementer - owning migration strategy design, building automated data pipelines, and deploying ontology-driven integration frameworks that unify fragmented application landscapes into cohesive, consolidated business data models. Key Responsibilities: - - Migration Execution & Cloud Architecture: Lead end-to-end delivery of enterprise data migrations from corporate systems (SAP, Oracle, Epic ERP) to target cloud data platforms, including the design of cloud landing zones, data governance frameworks, and system rationalization strategies. Establish migration compliance controls, automated rollback procedures, and operational readiness gates while owning full technical accountability for 12–18+ month migration roadmaps. - Data Pipeline Engineering & Transformation: Build production-grade data connectors to SAP (RFC, IDoc, BAPI, OData), Oracle (AQ, GoldenGate, APIs), and SQL/non-relational sources. Develop ETL/ELT pipelines with LLM-enabled transformation logic, multi-layer validation and reconciliation frameworks, and optimized throughput for datasets scaling from tens of millions to billions of records with built-in CDC and incremental loading. - Ontology Layer Development & Schema Automation: Construct semantic ontology layers translating raw ERP structures into business-consumable objects (Customer, Order, Invoice, Product, Vendor, Asset). Deploy automated schema mapping agents for source-to-target analysis and transformation logic generation. Build unified master data models with row/column-level security, cross-system lineage tracking, and AI-ready semantic structures. - Application & Workflow Delivery: Build operational dashboards, migration control centers, and agent-driven workflows for automated validation, exception handling, and anomaly detection using low-code platform tools. Generate TypeScript/Python SDKs for custom integrations and deliver real-time monitoring and self-service interfaces for migration progress, data quality KPIs, and compliance tracking. - Multi-System Consolidation & Master Data Management: Lead consolidation of 5–15+ fragmented ERP instances into standardized master data models. Resolve complex entity resolution challenges including customer matching, product harmonization, and chart of accounts unification. Establish golden record frameworks, data quality scorecards, survivorship rules, and data stewardship workflows for post-migration governance. - Client Engagement, Discovery & Modernization Advisory: Serve as primary technical advisor to C-suite and enterprise architecture stakeholders across all engagement phases. Deploy discovery agents to analyze legacy data estates, conduct assessment workshops, facilitate solution design sessions, and deliver executive briefings, go/no-go readiness assessments, and prioritized modernization roadmaps. - Knowledge Transfer, Enablement & IP Development: Build reusable migration accelerators, playbooks, and reference architectures that scale across engagements. Lead knowledge transfer to upskill client teams for post-migration ownership and collaborate with internal product and sales engineering teams to feed field insights back into platform development and delivery methodology. - Leadership & Executive Engagement: Operate autonomously in ambiguous, high-stakes client environments, driving outcomes with minimal oversight; translate deeply technical concepts into clear, business-level narratives for C-suite audiences through executive briefings and stakeholder communications; navigate organizational complexity, competing stakeholder priorities, and enterprise change management dynamics to maintain momentum across multi-workstream engagements; mentor junior engineers, cultivate technical capability within delivery teams, and foster a culture of knowledge sharing and continuous improvement. Required Qualifications: - - 7-10+ years of progressive experience in enterprise data engineering, data migration, or large-scale system integration roles within complex, multi-platform environments - 3-5+ years directly leading end-to-end data migration or multi-system consolidation programs for Global Enterprises and Industry Leaders, with full ownership of technical delivery and client outcomes - Demonstrated client-facing experience serving as a trusted technical advisor to C-level executives, enterprise architecture teams, and cross-functional business stakeholders - Proven industry depth in at least two of the following verticals: Healthcare, Financial Services, Manufacturing, Retail, Energy & Utilities, or Public Sector - Hands-on migration complexity: successfully delivered programs involving at least 3+ heterogeneous source systems, 100M+ records, complex master data harmonization, and multi-phase cutover execution - Advanced proficiency in Python and SQL with working experience in PySpark and TypeScript/JavaScript - Hands-on expertise with modern ETL/ELT and data integration platforms (Informatica, Talend, Matillion, Fivetran, AWS Glue, Azure Data Factory) - Proven ability to build scalable, version-controlled data pipelines with error handling, incremental loading, and Change Data Capture (CDC) - Strong working knowledge of at least one major cloud provider (AWS, Azure, or GCP), including core infrastructure, managed data services, and security configurations - Experience with enterprise data warehouse and lakehouse platforms (Snowflake, Databricks, BigQuery, Redshift, Synapse Analytics, Delta Lake) - Familiarity with knowledge graph construction, semantic modeling, ontology frameworks (RDF, OWL), or platforms such as Neo4j, AI Foundry, or Stardog - Practical experience integrating LLMs or AI-driven tooling into data transformation, schema inference, or mapping workflows (OpenAI, Anthropic, AWS Bedrock) - Experience with low-code/no-code application platforms for rapid solution delivery (AI Foundry, Mendix, OutSystems, PowerApps) Preferred Qualifications: - - Certifications: AI Foundry (Data Engineer, Ontologist, or Application Developer), SAP Certified Technology Associate/Professional, cloud architecture or data engineering credentials (AWS Solutions Architect, Azure Data Engineer, GCP Professional Data Engineer), or data governance/MDM certifications (CDMP, DAMA) - Advanced Technical Skills: Deep, production-level knowledge of real-time event streaming platforms (Kafka, Kinesis, Event Hubs, Pub/Sub); demonstrated expertise with enterprise MDM platforms (Informatica MDM, SAP MDG, Profisee, Reltio); hands-on proficiency in API development, microservices architecture, and service mesh patterns; strong command of CI/CD pipelines and infrastructure-as-code tooling (Jenkins, GitLab CI, Azure DevOps, Terraform, ArgoCD); comprehensive understanding of data security, privacy, and regulatory compliance frameworks (GDPR, HIPAA, SOC 2, CCPA, FedRAMP) - Domain Knowledge: Working understanding of financial close processes, supply chain operations, revenue cycle management, or procurement workflows; experience with industry-specific data standards (EDI, HL7, FHIR, SWIFT, XBRL); familiarity with process mining tools (Celonis, UiPath Process Mining, Signavio) and data observability, cataloging, and lineage platforms (Monte Carlo, Collibra, Alation, Apache Atlas) #LI-Remote #LI-AS Our compensation reflects the cost of labor across several geographic markets. The base pay for this position ranges from $164,851.50/year in our lowest geographic market up to 274,752.50 USD/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. The compensation package may also include incentive compensation opportunities in the form of annual bonus or incentives, equity awards and an Employee Stock Purchase Plan (ESPP). Learn more about benefits at Rackspace. About Rackspace Technology We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future. More on Rackspace Technology Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.



