Job Closed

This listing is no longer active.

CNX logo
CNX

We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future.

Senior Databricks Architect

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001

Location

United States

Posted

81 days ago

Salary

$106.1K - $151.6K / year

Seniority

Senior

Job Description

Senior Databricks Architect

CNX

Role Description We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. We integrate world-class digital engineering, creativity, and a deep understanding of human behavior to find and unlock value through tech-powered and intelligence-fueled experiences. You will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience. Within our professional services team, you will deliver strategic consulting, design, advisory services, market research, and contact center analytics that deliver insights to improve outcomes and value for our clients. Our gamechangers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year. Join us and be part of this journey towards greater opportunities and brighter futures. Qualifications - Excellent communication and presentation skills, with the ability to influence technical and non-technical audiences. - Demonstrated ability to gather requirements, and translate business needs into technical designs and phased roadmaps. - Proven experience driving architecture and design in data or analytics projects in a consulting, professional services, or similar environment. - Extensive hands-on experience designing and delivering data platforms and pipelines on Databricks, including Delta Lake, Jobs/Workflows, and Databricks SQL. - Strong programming skills in at least two of: Python, PySpark, and SQL, with demonstrated ability to build performant batch and streaming solutions. - Solid understanding of cloud services (Azure, AWS, or GCP) relevant to Databricks deployments, such as storage, networking, identity, and DevOps tooling. - Experience implementing data governance, security, and access control in Lakehouse or data platform environments using Unity Catalog or similar tools. Requirements - Presales, client facing and solutioning. - Partner with lead consultants to identify, design and develop high value Databricks use cases. - Design and deploy best in class architectures for data, analytics, and AI platforms built on Databricks and cloud services (Azure, AWS, or GCP). - Identify opportunities to create IP and packageable solutions based on observed patterns and customer whitespaces. - Drive architectural discussions with Client SME’s and technical resources during design phase of engagements. - Address technical objections and build confidence with client architects and executives during the sales and delivery cycle. - Lead the design and development of secure, scalable Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and integration with upstream and downstream systems. - Oversee and participate in the build of batch and streaming data pipelines, notebooks, and Databricks SQL assets using Spark, Python, and SQL, following medallion and other best practice patterns. - Help define and enforce engineering standards, including code quality, testing, CI/CD, observability, and operational readiness for Databricks workloads. - Collaborate with project managers and client stakeholders to plan releases, manage dependencies, mitigate risks, and ensure on-time, on-budget delivery. - Provide hands-on technical leadership to data engineers and analysts, review designs and code, and unblock complex technical issues. - Implement data governance and security practices using Unity Catalog and related tools, including access control, lineage, and compliance aligned policies. - Optimize performance, reliability, and cost of Databricks workloads through cluster tuning, storage strategies, and monitoring. - Drive change management and enablement by creating documentation, runbooks, and training materials, and facilitating knowledge transfer to client teams. - Support production, go-live stabilization, ensuring robust handover to client operations or managed services teams. Benefits - Medical, dental, and vision insurance. - Comprehensive employee assistance program. - 401(k) retirement plan. - Paid time off and holidays. - Paid learning days.

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description Na Vertigo, somos movidos por pessoas inquietas, que buscam resultado e têm coragem para atuar onde tecnologia e negócio se encontram. Somos uma consultoria de tecnologia com mais de 20 anos de inteligência digital, atuando em parceria com nossos clientes para transformar gaps tecnológicos em vantagens competitivas para gerar impacto real, acelerando negócios e melhorando vidas. Procuramos por um(a) Engenheiro de Dados Júnior que queira se desenvolver com a Vertigo! #GoVertigo 🚀 Responsabilidades e atribuições: - Apoiar o desenvolvimento e a manutenção de pipelines de dados (ETL/ELT) sob a supervisão de engenheiros mais experientes; - Auxiliar na estruturação e preparação de dados em ambientes analíticos (Data Lake e Lakehouse); - Ajudar na criação e manutenção de bases de dados, tabelas e views, familiarizando-se com modelos de dados (star schema, snowflake); - Contribuir nas rotinas de ingestão, transformação e limpeza de dados; - Colaborar com os demais membros da equipe de dados e áreas de negócio para facilitar o acesso e a disponibilidade das informações; - Seguir as diretrizes e boas práticas de segurança, privacidade e compliance (incluindo LGPD) definidas pela área; - Apoiar a documentação de processos, pipelines e dicionários de dados; - Utilizar versionamento de código (Git) em suas entregas diárias; - Participar ativamente das cerimônias ágeis (Scrum), colaborando nas entregas da sprint com dedicação e no prazo. Qualifications - Superior completo ou cursando o último ano em Tecnologia da Informação, Ciência da Computação, Engenharia, Estatística ou áreas correlatas; - Bons conhecimentos em SQL para consultas, manipulação e transformação de dados; - Conhecimento em programação aplicada a dados (Python é essencial; Scala ou R são diferenciais); - Familiaridade com conceitos de modelagem de dados; - Noções teóricas ou vivência acadêmica/estágio na construção de pipelines de dados; - Noções sobre plataformas de dados em nuvem e ambientes de processamento distribuído; - Conhecimento básico em controle de versão (Git). Requirements - Conhecimento básico ou cursos extracurriculares em plataformas como Databricks, MS Fabric ou Azure; - Familiaridade com ferramentas de orquestração (como Azure Data Factory ou Airflow); - Noções de arquitetura de dados moderna (Data Lakehouse, Delta Lake); - Conhecimento básico em ferramentas de visualização (como Power BI) para validação de dados; - Noções de automação de deploy (CI/CD). Benefits - Você quer fazer parte do nosso time? Se inscreva, e embarque nessa jornada com a gente!

Brazil
Job Closed
Omnicell logo

Engineer IV, Data Engineering

Omnicell

A leader in transforming the pharmacy care delivery model

Data Engineer81 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

Responsibilities: - Translate business needs and architectural guidance into detailed designs, data contracts, and implementation plans that break down large initiatives into actionable engineering tasks with reliable estimates - Create detailed pipeline designs covering schemas, transformations, partitioning, DLT configurations, orchestration, error handling, and observability that align with the platform architecture through close collaboration with the Data Architect - Lead implementation and guide junior engineers on design, coding standards, and best practices - Develop metadata-driven and configuration-driven pipeline patterns that reduce custom code and improve consistency - Make technical decisions that ensure reliability, performance, maintainability, and scalability. Ensure production readiness with monitoring, lineage, alerting, observability, CI/CD and documentation - Define and enforce engineering design patterns, coding standards, testing practices, and operational best practices - Evaluate and incorporate new technologies and Databricks capabilities that improve reliability, performance, or developer productivity - Validate new technologies with the Data Architect and operationalize them through documentation, examples, and enablement - Implement automated data quality checks, rule enforcement, and exception handling - Production support of both an existing and new platform including optimization of jobs, incident tracking and other analysis required for production - Lead resolution of complex production issues and deliver durable root cause fixes - Maintain SLAs for reliability, recovery, idempotency, performance, and cost efficiency - Mentor Level 2–3 engineers through pairing, design guidance, code reviews, and technical coaching Basic Skills: • Bachelor’s degree preferred; equivalent experience accepted • 10+ years in data engineering (12+ without a degree) • 4+ years building production-grade batch/streaming pipelines using PySpark, Spark Structured Streaming, Python, and SQL • Proven experience with data governance, schema evolution, data lineage, and secure access patterns • Proven 2 years’ experience with maintaining and sustaining data pipelines Preferred Skills: • 3+ years hands-on with Databricks (Delta Lake, DLT, Unity Catalog, workflow jobs) within the last 6 years • Experience building metadata-driven or configuration-driven pipelines • Experience with data quality frameworks (DQX, Great Expectations, or equivalent) • Experience with observability, metrics and query performance analysis • Strong Spark optimization Work Conditions: • Team collaborative hours between 8am to 4pm EST • Corporate office/lab environment • Ability to travel 10% of the time

United States
Job Closed
Torc Robotics logo

Senior Software Engineer – Data Pipeline

Torc Robotics

Leading autonomous vehicle technology since 2007, Torc develops automated Level 4, Class 8 trucks with Daimler.

Data Engineer81 days ago
Full TimeRemoteTeam 501-1,000Since 2007H1B Sponsor

• Design and develop high‑performance data converters for multi‑sensor autonomous‑driving data (camera, lidar, radar), ensuring accurate time alignment and robust handling of raw sensor logs. • Design, build, and optimize large‑scale ingestion and transformation pipelines (ETL/ELT) capable of processing petabyte‑scale autonomous‑driving sensor data, and automate them for reliable, production‑grade deployment. • Work with data formats such as ROS bags, MCAP, and custom binary encodings; establish standards for schema evolution and metadata integrity. • Implement automated data validation, quality checks, and lineage tracking to ensure reliability of production datasets. • Collaborate closely with ML, annotation, simulation, and perception teams to ensure cross‑team ownership of data products and deliver datasets that are consistent, semantically correct, and ready for downstream consumption. • Proactively assess current capabilities to identify areas for improvement proposing solutions that align with core strategy and operation.

Michigan
$160.8K - $193K / year
Job Closed
Kpler logo

Senior Data Engineer

Kpler

Facilitating efficient and sustainable trade.

Data Engineer81 days ago
Full TimeRemoteTeam 201-500Since 2014H1B Sponsor

• Design, develop, and maintain scalable real-time data pipelines to support analytics and operational use cases. • Own and operate cloud-based infrastructure, following a 'you build it, you run it' model to ensure reliability, performance, and scalability. • Develop and manage data products, collaborating with a diverse set of stakeholders including product managers, analysts, and engineering teams. • Mentor and support other engineers, contributing to a collaborative and high-performing engineering culture. • Build a deep understanding of a complex business domain and work effectively across teams with multiple dependencies. • Own features end-to-end, from design and implementation through deployment, monitoring, and ongoing improvement.

Hungary
Job Closed