Job Closed
This listing is no longer active.
We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
Senior Databricks Engineer
Location
India
Posted
74 days ago
Salary
₹1,500K - ₹3,000K / year
Seniority
Senior
Job Description
Senior Databricks Engineer
Weekday (YC W21)
• Design and lead the development of scalable, cloud-native data platforms • Create high-performance pipelines using Python and SQL • Collaborate with ML teams on LLM/BERT-based data workflows • Architect and implement high-performance data engineering solutions • Build robust ETL/ELT pipelines • Lead projects related to data architecture, feature engineering, and AI-driven data workflows
Job Requirements
- Minimum 5 years
- Degree in CS/IT preferred
- Databricks
- Apache Airflow
- Spark
- Delta Lake
- Data Architecture
- ETL/ELT
- Python
- SQL
- Azure
- LLMs/NLP
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Senior Documentation Engineer
HazelcastHazelcast modernizes applications with a unified real-time data platform.
• Own Documentation Strategy & Architecture • Define and execute a documentation strategy that aligns with Hazelcast’s product roadmap and developer experience goals • Restructure information architecture to improve discoverability, reduce redundancy, and support self-service learning paths • Establish quality standards, style guidelines, and content governance across all user-facing documentation • Build AI-Augmented Documentation Workflows • Design and implement AI-assisted authoring pipelines that accelerate content creation, review, and maintenance • Evaluate and integrate AI tools for draft generation, content auditing, terminology consistency, and translation readiness • Develop prompts, templates, and automation that enable engineers to contribute higher-quality documentation with less friction • Measure the impact of AI tooling on documentation velocity, quality, and coverage—and iterate based on results • Write, Edit, and Ship Great Documentation • Author and maintain documentation for Hazelcast products, including conceptual guides, API references, tutorials, and troubleshooting content • Edit and improve developer-contributed drafts, turning rough technical notes into polished, user-centered content • Overhaul legacy documentation to meet current standards and fill coverage gaps • Modernize Tooling & Infrastructure • Evaluate the current docs-as-code stack and recommend improvements to the toolchain, publishing pipeline, and content management approach • Implement CI/CD-style workflows for documentation that support automated testing, link checking, and quality gates • Optimize the docs site for search, navigation, and developer experience • Champion Documentation Culture • Be the internal voice of the user—advocating for documentation quality in product planning and release processes • Build lightweight contribution frameworks that make it easy for engineers and PMs to participate in docs • Track documentation health metrics (coverage, freshness, feedback scores) and report on progress
Benefits: - Company parties - Competitive salary - Paid time off - Parental leave - Training & development Qualifying Master Plumber Primarily Remote 1-800-Plumber +Air is a growing plumbing and HVAC franchise brand seeking a licensed Qualifying Master Plumber to support one of our franchise locations in a compliance, advisory, and oversight capacity. This role is ideal for a licensed Master Plumber who wants to leverage their experience in a flexible, primarily remote position while helping support a professional residential and commercial plumbing operation. The Qualifying Master Plumber plays an important role in supporting licensing compliance, permit registration, code guidance, and technical oversight as needed. Responsibilities - Serve as the Qualifying Master Plumber for the business in accordance with state and local requirements - Support permit registration in Carmel and surrounding cities as required - Provide guidance related to plumbing code, regulations, and compliance - Offer technical support to journeyman plumbers and field technicians on an as-needed basis - Provide plumbing-related support and consultation to ownership as needed - Help ensure plumbing work is performed in alignment with applicable codes and professional standards Qualifications - Active Master Plumber license required - Must be properly registered and in good standing where required - Strong knowledge of current plumbing codes, regulations, and permitting processes - Experience with residential and commercial plumbing systems - Strong communication skills and a professional, responsive approach - Ability to provide oversight, guidance, and support in a primarily remote role Compensation This position is typically compensated through a monthly license-holder fee, reflecting the value of serving as the Qualifying Master Plumber for the business. Compensation will be based on local requirements, scope of involvement, and overall expectations of the role. About the Role This is a primarily remote position designed for a licensed Master Plumber who is looking for a flexible opportunity to provide professional oversight and support to a growing plumbing business. While the role is not intended to function as a full-time field position, occasional involvement related to permits, compliance, or operational support may be needed based on local requirements. This is a remote position.
Senior Databricks Engineer
Weekday (YC W21)We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
• Design and oversee the development of scalable generative AI systems and enterprise-grade AI platforms. Establish robust architectures that support model training, inference, monitoring, and lifecycle management in production environments. • Direct the selection, customization, and enhancement of state-of-the-art generative AI and large language models. • Develop and execute APIs, microservices, and integration frameworks to incorporate AI capabilities into enterprise applications. • Ensure that AI platforms meet stringent standards for performance, reliability, security, and scalability, while also adhering to data governance and privacy regulations. • Collaborate closely with product, engineering, and business teams to outline technical requirements and approaches to AI architecture. • Architect end-to-end pipelines for deploying and monitoring AI models, ensuring seamless integration with existing systems. • Guide architectural decisions for LLM applications, AI workflows, and distributed AI infrastructure. Institute best practices for ethical AI development, including strategies to mitigate risks like model hallucinations, bias, and reliability challenges. • Provide technical mentorship and guidance to engineering teams, while contributing to the formulation of long-term technology strategies and the advancement of AI platforms.
Engineer III, Applications Development
AvantorAvantor is a privately-held chemicals company offering integrated solutions to clients in the life sciences and advanced technology industries that help fuel scientific innovation
• Implements tactical and operational goals focused on software build, release, deployment, and configuration management, ensuring seamless application delivery. • Contributes to the implementation of new automation frameworks, CI/CD pipelines, testing methodologies, and deployment standards. • Manages software deployment projects and operational processes, coordinating release schedules, dependency tracking, and integration workflows. • Works on diverse, multifaceted challenges where analysis requires evaluating software performance, system compatibility, and implementation risks. • Derives solutions based on limited precedent, applying best practices in release engineering, infrastructure automation, and software quality assurance to maintain stability and efficiency. • Communicates regularly with internal stakeholders, including development, QA, IT operations, and product teams, as well as external vendors and cloud service providers to ensure timely implementation and support. • Act as a subject matter expert for Tulip and HighByte within the organization. • Design and implement end-to-end data flows – to and from shop floor to ERP’s and Digital Manufacturing Platforms (Tulip) • Troubleshoot and resolve integration issues, including Industrial Data Ops platform (Highbyte) • Ensure compliance with security and data governance standards • Provide training, documentation, and ongoing support to operations and engineering teams. • Partner with manufacturing teams to identify opportunities for digital process improvements. • Stay current with Industry 4.0 trends, low-code MES platforms, and edge integration technologies. • Support the deployment and configuration of the Tulip platform across manufacturing sites. • Configure and manage Tulip connectors for system integrations (ERP, PLM, QMS, etc.). • Support process engineers in charge of the development of the Tulip apps, dashboards, and workflows to support operations, quality, and maintenance. • Support end users in leveraging Tulip for day-to-day activities. • Configure and manage data models, pipelines, and contextualization in HighByte. • Set up and maintain connectors for OT and IT systems (PLC, SCADA, historians, ERP, MES). • Ensure secure, reliable, and scalable data flows between the Tulip platform and the enterprise applications and the UNS layer. • Collaborate with operations and engineering teams to identify new integration use cases.


