Job Closed
This listing is no longer active.
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.
Databricks Practice Architect II
Location
United States
Posted
10 days ago
Salary
$148.2K - $222.4K / year
Seniority
Mid Level
Job Description
Databricks Practice Architect II
TEKsystems
Role Description Join our Data Modernization and Gen AI practice and take the lead across designing, building, and maintaining data pipelines and analytics solutions on the Databricks cloud platform. Collaborate with data analysts and customer stakeholders to ensure the availability, scalability, and reliability of data. We are seeking a highly skilled and motivated Databricks Data and AI Practice Architect with at least 7 years of hands-on experience in data engineering and at least 3 years in AI/ML engineering. The Individual: - Consultative and personable data and AI engineering leader, who will provide advice and leading expertise on Databricks and have a deep understanding of cloud data services to become a key contributor to various large scale data projects. - Works on specific projects critical to our needs with opportunities to switch teams and projects as our fast-paced business grows and evolves. - Is versatile, displays leadership qualities and is enthusiastic to take on new challenges across the data stack. Qualifications - Bachelor’s or higher degree in Computer Science, Information Technology, or a related field. - 10+ years industry experience building and supporting large-scale cloud systems. - Ability to speak and write in English fluently. - Excellent verbal and written communication skills. - Professional Certification in one or more areas: Cloud Architect, Solution Architect, Data Engineer, ML Engineer, Gen AI Engineer, Claude Code Architect. - Databricks certified candidates will be preferred. Requirements - Hands-on experience with Databricks, Spark and working knowledge of DBT for data processing and transformation. - Working understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design. - Hands-on experience building data pipelines using technology such as Azure Data Factory, AWS Glue, GCP Dataflow and Apache Spark (preferably in Databricks). - Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, GCP Cloud Build, and Jenkins. - Skilled in scripting languages including Python, SQL, PySpark, Jupyter Notebooks, R, Scala, Bash, and PowerShell. - Expert Level proficiency in: - Databricks, PySpark - MLflow for model tracking and deployment - ML pipelines and associated MLOps tools - Experience in deploying ML models securely in cloud-native architectures. - Experience in Generative AI Large Language Models (LLMs), Retrieval Augmented Generation (RAG), and Agentic AI techniques. - Experience applying or fine-tuning foundational models or large language models (LLM). - Demonstrated experience in designing and integrating diverse data sources to support Agentic AI systems, including structured, unstructured, and real-time data pipelines in production environments. - Proficiency with Retrieval-Augmented Generation (RAG) frameworks, including implementation of vector databases, embedding models, and retrieval mechanisms to enhance contextual relevance and model performance. - Experience in conducting exploratory data analysis (EDA), data cleaning, and validation. - Experience in engineering feature pipelines and automate feature stores within Databricks. - Experience in building end-to-end ML pipelines with MLflow for training, evaluation, and model lifecycle management. - Experience in providing guidance on implementing AI agent frameworks such as LlamaIndex, crewAI, LangGraph, and Azure AI Foundry. - Experience in designing, implementing, and optimizing AI solutions leveraging both Large Language Models (LLMs) and Small Language Models (SLMs), ensuring scalability, efficiency, and alignment with business objectives. - Experience in developing and deploying scalable Machine Learning models using Databricks and Lakehouse architecture. - Experience in utilizing development containers, unit testing/code quality review - standard best practices. - Strong expertise in version control systems. - Familiarity with logging and monitoring solutions. - Familiarity with containerization and orchestration technologies. - Strong problem-solving, troubleshooting, communication and collaboration skills. Responsibilities - Design & Architecture: Design and implement data and AI solutions for the Databricks platform and APIs. Work with data engineering and data science teams, customers, and other customer-facing teams. Actively participate in whole AI/ML pipeline design, development, and implementation lifecycle. - Technical leadership: Provide technical guidance to customers on big data projects, including architectural design, data engineering, and model deployment. - Customer collaboration: Work with customers to understand their requirements, and help them define solutions and a roadmap to meet their goals. - Solution design: Create and review architecture and solution design artifacts. - Technical expertise: Demonstrate expertise in Databricks Lakehouse architecture, delta lake medallion architecture, data pipelines, CI/CD pipelines etc. - Communication: Communicate complex technical concepts to non-technical stakeholders, such as business leaders and C-level executives. - Documentation: Develop and maintain documentation for the Databricks platform, such as deployment guides, operational procedures, and architecture diagrams. - Risk management: Identify, communicate, and mitigate risks, assumptions, issues, and decisions. Job Type & Location This is a Permanent position based out of Beaverton, OR. Pay and Benefits The pay range for this position is $148200.00 - $222400.00/yr. We reserve the right to pay above or below the posted wage based on factors unrelated to sex, race, or any other protected classification. Additional earnings may be available through incentive programs like annual bonuses, profit sharing, etc. - Medical, Dental, and Vision - Critical Illness, Accident, and Hospital - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available - Life Insurance (Voluntary Life and AD&D for employee and dependents) - Short and Long-Term Disability - Health Spending Account (HSA) - Transportation Benefits - Employee Assistance Program - Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a fully remote position. Application Deadline This position is anticipated to close on Jun 23, 2026.
Related Guides
Related Categories
Related Job Pages
More Architect Jobs
Senior Director – Head of Architecture
G-PFind, hire and manage teams in days instead of months with the #1 Global Growth Platform.™
• Define and strongly influence the execution of a target-state, AI-native architecture that supports both core software services and advanced AI Agentic behaviors. • Establish global standards for architecture consistency, ensuring all platform components maximize reuse and align with the long-term technology roadmap. • Oversee the architectural design of complex AI systems, AI enablement strategies, data engineering, and governance controls. • Everything we do is to serve our customers. Understanding the customers and the business is the only way to build strategies for its success. • Lead, scale, and mentor a multidisciplinary team of architects, fostering a culture of engineering excellence and continuous learning. • Define and create standards and governance mechanisms for software platform and infrastructure security to mitigate data breaches and ensure regulatory compliance. • Act as a coach and decision maker with technical teams and business stakeholders, translating complex technical trade-offs when creating business impact. • Serve as the ultimate "sounding board" for introducing new technologies, 3rd-party integrations, and open-source solutions to keep the platform at the forefront of the industry. • Ensure system and infrastructure architecture results in high reliability, low latency, and minimal outages as a primary measure of organizational success. • Help create a strong culture of innovation and technical excellence across the organization.
• Support the design and implementation of solution architectures based on Artificial Intelligence and Generative AI. • Gather and translate business requirements into technical solutions using AI, automation and data analysis. • Develop and implement solutions using LLMs, RAG (Retrieval-Augmented Generation), AI agents and integrations with enterprise systems. • Build and expose AI models and services via APIs and microservices. • Implement solutions on cloud AI platforms, ensuring performance, security and governance. • Participate in the definition and implementation of data architectures for AI applications, including Data Lakes, Data Warehouses and vector databases. • Support proofs of concept (PoCs), technical testing and evaluation of new technologies. • Apply best practices in development, governance, security and responsible use of Artificial Intelligence. • Collaborate with multidisciplinary data, development and business teams to ensure proper integration of solutions. • Support monitoring, maintenance and continuous evolution of deployed solutions using MLOps practices. • Produce technical documentation, architecture diagrams and functional and technical specifications. • Participate in technical meetings with clients and stakeholders to understand requirements and present solutions.
Principal Search Consulting Architect
ElasticSelf-described as the leading platform for search-powered solutions, Elastic helps organizations, their customers, and their employees find what they need faster while protecting a
Role Description As a Principal Search Architect, you will serve as the elite technical authority and visionary leader helping our largest enterprise customers unlock the full potential of Elasticsearch. Acting as a strategic, trusted advisor to CTOs and Enterprise Architecture teams, you will design, govern, and scale massive, complex Elasticsearch cluster topologies that transform application search performance, data retrieval infrastructure, and AI-powered semantic search capabilities. You will bridge the gap between business strategy and cutting-edge distributed systems engineering, collaborating directly with Elastic’s global Professional Services leadership, Core Engineering, Product Management, and Sales executives. In this high-impact role, you will shape the future of enterprise deployments by driving regional architectural standards, leading critical cluster migrations, and mentoring both Fortune 500 engineering teams and internal Elastic technical staff. What You Will Be Doing - Elasticsearch Core Architecture: Translate highly complex business requirements into resilient, next-generation enterprise retrieval architectures built natively on distributed Elasticsearch environments. - Cluster Governance & Design: Lead the overarching technical strategy and design authority for high-stakes customer engagements—from initial node blueprinting and capacity planning to custom mappings, shard strategy, Index Lifecycle Management (ILM), and cross-cluster replication (CCR/CCS). - Advanced Vector Search & AI Engineering: Design and operationalize cutting-edge semantic search architectures utilizing Elasticsearch’s native vector database capabilities, including kNN, Approximate Nearest Neighbor (ANN), ELSER (Elastic Learned Sparse Encoder), hybrid retrieval, and Retrieval-Augmented Generation (RAG) pipelines. - Performance Tuning & Optimization: Profile, benchmark, and tune distributed search and indexing performance for ultra-high-QPS environments with aggressive sub-second SLAs, optimizing Apache Lucene segment merging, caching layers, and heap/garbage collection configurations. - High-Throughput Indexing: Architect robust distributed ingestion strategies handling petabyte-scale throughput, optimizing cluster state performance, thread pools, and bulk indexing requests for maximum efficiency. - Cross-Functional Influence: Collaborate cross-functionally with Elastic Product Management and Core Engineering to influence the Elasticsearch codebase roadmap, surface edge-case bugs, and drive feature enhancement requests based on enterprise field realities. - Community & IP Development: Capture, formalize, and publish global best practices, reference architectures, and reusable solution patterns across the broader Elasticsearch and open-source engineering communities. - Culture of Excellence: Drive internal enablement initiatives, mentor senior engineers, and cultivate a culture of continuous technical excellence and deep mastery of Elasticsearch internals. Qualifications - 8+ years as a Principal Architect, Lead Engineer, or Senior Systems Consultant with recognized, deep technical expertise specifically focused on Elasticsearch at a massive scale. - Elasticsearch Internals Mastery: Comprehensive understanding of distributed systems theory as it applies to Elasticsearch, including consensus protocols, internal node roles (master, data, ingest, machine learning), Apache Lucene indexing mechanics, and cluster state management. - AI-Powered Search Expertise: Proven track record of deploying production-grade semantic search solutions using Elasticsearch’s native ML nodes, dense/sparse vector fields, and integrations with modern NLP frameworks and LLM orchestration tools. - Cloud-Native Infrastructure: Advanced knowledge of orchestrating massive Elasticsearch workloads across cloud platforms (AWS, Azure, GCP) using cloud-native patterns, Docker, and Terraform. - Polyglot Coding: Strong proficiency in multiple programming languages (e.g., Java, Python, Go) with extensive experience utilizing official Elasticsearch client libraries and building custom plugins. - Elite Communication: Exceptional presentation and storytelling skills, with verified experience commanding a room of executive stakeholders to align technical Elasticsearch roadmaps with core business strategy. - Education: Bachelor’s, Master’s, or PhD in Computer Science, Engineering, or a related quantitative field, or equivalent deep industry experience. - Global Mindset: Comfortable working effectively across highly distributed, global teams and traveling to client sites as required for strategic architectural engagements. Compensation - The typical starting salary range for this role is: $159,800 — $252,800 USD. - The typical starting salary range for this role in select locations (including Seattle WA, Los Angeles CA, the San Francisco Bay Area CA, and the New York City Metro Area) is: $191,900 — $303,500 USD. Benefits - Competitive pay based on the work you do here and not your previous salary. - Health coverage for you and your family in many locations. - Ability to craft your calendar with flexible locations and schedules for many roles. - Generous number of vacation days each year. - Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service. - Up to 40 hours each year to use toward volunteer projects you love. - Embracing parenthood with a minimum of 16 weeks of parental leave.
• Cloud architecture with a primary focus on Microsoft Azure and complementary knowledge of Oracle Cloud Infrastructure (OCI) • Responsible for designing, assessing, implementing and optimizing critical corporate cloud environments • Must have experience in infrastructure projects • Architecture, engineering and support of cloud environments, with the ability to define best practices, technical standards and recommendations for performance, availability, security, connectivity, governance and operational continuity
