Job Closed
This listing is no longer active.
We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
Senior Databricks Engineer
Location
India
Posted
75 days ago
Salary
₹1,500K - ₹3,000K / year
Seniority
Senior
Job Description
Senior Databricks Engineer
Weekday (YC W21)
• Design and oversee the development of scalable generative AI systems and enterprise-grade AI platforms. Establish robust architectures that support model training, inference, monitoring, and lifecycle management in production environments. • Direct the selection, customization, and enhancement of state-of-the-art generative AI and large language models. • Develop and execute APIs, microservices, and integration frameworks to incorporate AI capabilities into enterprise applications. • Ensure that AI platforms meet stringent standards for performance, reliability, security, and scalability, while also adhering to data governance and privacy regulations. • Collaborate closely with product, engineering, and business teams to outline technical requirements and approaches to AI architecture. • Architect end-to-end pipelines for deploying and monitoring AI models, ensuring seamless integration with existing systems. • Guide architectural decisions for LLM applications, AI workflows, and distributed AI infrastructure. Institute best practices for ethical AI development, including strategies to mitigate risks like model hallucinations, bias, and reliability challenges. • Provide technical mentorship and guidance to engineering teams, while contributing to the formulation of long-term technology strategies and the advancement of AI platforms.
Job Requirements
- 4+ years of experience in software engineering or architecture roles with strong exposure to AI/ML systems.
- Strong knowledge of modern neural network architectures such as Transformers, CNNs, and RNNs.
- Experience designing scalable and distributed architectures for AI-powered applications.
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with containerization and orchestration technologies including Docker and Kubernetes.
- Strong understanding of microservices architecture, RESTful APIs, and distributed system design.
- Experience working with MLOps / LLMOps pipelines including model training, deployment, monitoring, and lifecycle management.
- Familiarity with large-scale data systems and modern database technologies.
- Experience translating business requirements into scalable AI solution architectures.
- Strong documentation skills for architecture designs, workflows, and technical decision-making.
- Comfortable working in a startup or fast-paced environment with strong ownership and leadership mindset.
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Engineer III, Applications Development
AvantorAvantor is a privately-held chemicals company offering integrated solutions to clients in the life sciences and advanced technology industries that help fuel scientific innovation
• Implements tactical and operational goals focused on software build, release, deployment, and configuration management, ensuring seamless application delivery. • Contributes to the implementation of new automation frameworks, CI/CD pipelines, testing methodologies, and deployment standards. • Manages software deployment projects and operational processes, coordinating release schedules, dependency tracking, and integration workflows. • Works on diverse, multifaceted challenges where analysis requires evaluating software performance, system compatibility, and implementation risks. • Derives solutions based on limited precedent, applying best practices in release engineering, infrastructure automation, and software quality assurance to maintain stability and efficiency. • Communicates regularly with internal stakeholders, including development, QA, IT operations, and product teams, as well as external vendors and cloud service providers to ensure timely implementation and support. • Act as a subject matter expert for Tulip and HighByte within the organization. • Design and implement end-to-end data flows – to and from shop floor to ERP’s and Digital Manufacturing Platforms (Tulip) • Troubleshoot and resolve integration issues, including Industrial Data Ops platform (Highbyte) • Ensure compliance with security and data governance standards • Provide training, documentation, and ongoing support to operations and engineering teams. • Partner with manufacturing teams to identify opportunities for digital process improvements. • Stay current with Industry 4.0 trends, low-code MES platforms, and edge integration technologies. • Support the deployment and configuration of the Tulip platform across manufacturing sites. • Configure and manage Tulip connectors for system integrations (ERP, PLM, QMS, etc.). • Support process engineers in charge of the development of the Tulip apps, dashboards, and workflows to support operations, quality, and maintenance. • Support end users in leveraging Tulip for day-to-day activities. • Configure and manage data models, pipelines, and contextualization in HighByte. • Set up and maintain connectors for OT and IT systems (PLC, SCADA, historians, ERP, MES). • Ensure secure, reliable, and scalable data flows between the Tulip platform and the enterprise applications and the UNS layer. • Collaborate with operations and engineering teams to identify new integration use cases.
System Modeling Engineer
LG Energy Solution Vertech, Inc.Exceptional customer experience and reliable, long-lasting energy storage systems.
• Model Li-ion battery-based energy storage subsystems, including state machines, closed-loop controls, and related building blocks. • Collaborate with systems and controls engineering teams to develop physics-based models, simulate system performance, and validate lab and field data. • Support DevOps in packaging and deploying system models for customer-facing applications. • Analyze large volumes of time-series data to identify patterns, validate assumptions, and derive actionable insights. • Participate in Agile software development practices, contributing to design reviews, sprint planning, and iterative releases. • Produce high-quality documentation and communicate effectively across technical and non-technical teams.
Lead IAM Engineer
Centene CorporationTransforming the health of the communities we serve, one person at a time.
• design, implementation, and support of SailPoint IdentityIQ (IIQ) solutions • lead complex integration and automation initiatives across enterprise environments • troubleshoot production issues effectively • collaborate with internal teams to ensure successful implementation of solutions • ensure compliance with all policies and standards
Automotive Engineering & Python Expert - Freelance AI Trainer
MindriftApply → Pass qualification(s) → Join a project → Complete tasks → Get paid. Project time expectations: Tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements; This is an estimate, not a guaranteed workload, and applies only while the project is active. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves While each project involves unique tasks, contributors may: - Design graduate- and industry-level automotive engineering problems grounded in real practice; - Evaluate AI-generated solutions for correctness, assumptions, and engineering logic; - Validate analytical or numerical results using Python (NumPy, SciPy, Pandas); - Improve AI reasoning to align with first principles and accepted engineering standards; - Apply structured scoring criteria to assess multi-step problem solving. What we look for This opportunity is a good fit for automotive engineers with an experience in python open to part-time, non-permanent projects. Ideally, contributors will have: - Degree in Automotive Engineering or related fields, e.g. Mechatronics, Manufacturing Engineering, Mechanical Engineering, Aerospace Engineering, etc. - 3+ years of professional automotive engineering experience - Strong written English (C1/C2) - Strong Python proficiency for numerical validation - Stable internet connection Professional certifications (e.g., PE, CEng, PMP) and experience in international or applied projects are an advantage. How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid Project time expectations For this project, tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Compensation On this project, contributors can earn up to $55 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.



