We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other protected characteristic.
Databricks Architect
Location
India
Posted
12 days ago
Salary
0
Seniority
Mid Level
Job Description
Databricks Architect
Cogniify
Role Description We're seeking a Databricks Architect (Senior/Specialist level) to serve as a senior technical authority for data architecture and analytics engineering on the Databricks Lakehouse platform across Cognify Analytics and our client engagements. In this role, you will design and own Databricks-based data platform architecture, lead complex data engineering initiatives, and ensure our data capabilities are enterprise-grade, governed, and future-ready. You will bridge data engineering, analytics, and AI/ML — combining deep hands-on expertise in Databricks, Python, and SQL with strong architectural judgment and stakeholder communication. Qualifications - Bachelor's, Master's, or equivalent professional experience in Computer Science, Data Science, Statistics, or a related field. - 6–9 years of professional experience in data engineering, analytics engineering, or data architecture, with demonstrated technical leadership on at least a few large-scale engagements. - Mandatory, hands-on expertise in Databricks, Python, and SQL in production environments. - Strong working knowledge of the modern data stack: dbt, Airflow/Dagster, Fivetran/Airbyte, Spark, Kafka, and cloud-native data services. - Solid grasp of data modeling methodologies (Kimball, Data Vault, Activity Schema, OBT) and the judgment to apply them across contexts. - Experience with cloud data infrastructure on AWS, Azure, or GCP (any combination is acceptable, alongside Databricks). - Proven ability to influence technical direction and align technical and business stakeholders on complex architecture topics. - Strong understanding of data governance, data quality, cataloging, lineage, and regulatory compliance frameworks. - Experience mentoring engineers and contributing to a high-performing data team. - Strong understanding of how data platforms serve AI/ML workloads, including feature engineering, vector data, and model input/output pipelines. Requirements - Own the architecture and design of Databricks-based data platforms, including lakehouse design (Delta Lake), medallion architecture, and unified analytics layers. - Serve as the senior technical authority on Databricks platform design, providing guidance on architecture, tooling, modeling, and engineering standards across teams and projects. - Design and build ingestion, transformation, and orchestration pipelines using Python, SQL, PySpark, and Databricks Workflows. - Architect data mesh and data product strategies, defining domain ownership, data contracts, and self-service consumption patterns on Databricks. - Establish and evangelize best practices across the data lifecycle: ingestion, transformation, modeling, quality, observability, governance, and consumption. - Drive the integration of Databricks with AI/ML capabilities, including feature engineering pipelines, vector data infrastructure for RAG, and MLflow-based model workflows. - Lead complex data migration, platform modernization, and consolidation initiatives for enterprise clients across industries. - Evaluate emerging data technologies (Apache Iceberg, Unity Catalog, Delta Live Tables, Mosaic AI) to inform architectural decisions. - Solve complex, ambiguous, high-impact data architecture problems that span multiple teams, platforms, or organizational boundaries. - Drive cross-functional alignment between data engineering, analytics, AI/ML, platform engineering, security, and product teams. - Mentor senior data engineers and analysts, fostering a culture of technical excellence. - Represent Cognify Analytics in discussions with client stakeholders and leadership on data capabilities, strategy, and technical roadmaps. - Define and enforce data governance, compliance (GDPR, HIPAA, SOC2), and responsible data management standards across all Databricks environments. - Drive FinOps maturity for the Databricks platform, including compute optimization, cluster policies, storage lifecycle management, and cost forecasting. Benefits - Unlimited PTO - Generous parental leave, above industry standards - Open communication with management and company leadership - Small, dynamic teams = massive impact - Medical, Dental, and Vision coverage - Access to Disability & Life insurance - Mental health and wellbeing support - Annual bonus program - Employer Stock Purchase Program (ESPP) - Yearly team building experiences - Mentorship and sponsorship opportunities - Manager resources and support
Related Guides
Related Categories
Related Job Pages
More Architect Jobs
• Identify high-value AI use cases across CVS Health and shape them into products • Design and architect each AI system end-to-end • Write product requirements, design documents, and architecture decision records • Build production implementations using AI coding agents • Partner with platform and system owners to integrate AI applications cleanly • Apply seasoned engineering judgment to review AI-generated code • Coach other architects and senior engineers on applied-AI coding techniques • Publish architecture decision records and reference implementations
• Lead project designs, direct other architects and designers to complete architectural designs in accordance with accepted practices and company standards. • Assist with and lead the development of contract documents, including Revit models, drawings, details, specifications, and installation scopes of work. • Lead the development and maintenance of Revit standards, templates, and libraries. • Work with the Department Manager for team improvements, technology needs, sales strategies, proposal development, and production efficiency. • Mentor other architects and designers to facilitate a learning experience for subordinate personnel. • Manage discipline project budgets utilizing Work Breakdown Structures Report (WBS), segregating tasks and associated costs in accordance with the scope of work outlined in project proposals. • Supervise and direct assigned project personnel and control projects, including productivity, resource hours used, project changes, and adherence to predefined scope of services. • Maintain and submit accurate budget and schedule forecasts to the Project Manager, Department Manager, and Client for evaluation of productivity and schedule variance. • Maintain project correspondence file to include project-related memos, letters, scope change documentation, and associated documents. • Maintain positive client relations and develop potential work opportunities. • Works in a safe manner at all times. Adheres to both Matrix and client-established safety standards when appropriate.
Senior Agent Architect
ParloaAmplify your customer service experience with an AI agent management platform.
• Act as a solution architect for enterprise AI Agent deployments • Design end-to-end system architectures connecting Parloa's platform to complex environments • Solve multi-system integration challenges • Shape conversational experience layer using prompt engineering • Build and configure integrations using integration platforms and APIs • Collaborate with engineers on complex integration scenarios • Validate architecture, integration reliability, and AI agent performance • Identify and resolve blockers with internal departments and customers • Scope AI Agent deployments • Document best practices, how-to guides, and product capabilities
• Design and architect scalable, high-performance back-end software solutions that integrate multiple systems. • Collaborate with stakeholders to gather requirements and translate them into technical specifications and architectural designs for complex integrations. • Evaluate and recommend tools, technologies, and processes to improve integration efficiency and software quality, with a focus on .NET technologies. • Ensure solutions align with the overall enterprise architecture and comply with best practices and standards for system reliability and security. • Lead the preparation of architectural documentation, including system diagrams, integration strategies, and design patterns for service-oriented architecture (SOA). • Work closely with development teams to ensure successful implementation of architectural designs, particularly for SOAP and RESTful APIs. • Conduct architectural reviews and provide feedback to ensure quality and performance throughout the development lifecycle. • Stay current with emerging technologies and trends in system integration, assessing their potential impact on the organization and projects.
