Job Closed
This listing is no longer active.
Pioneering AI-first solutions, solving complex business challenges through expertise, cloud, data engineering, and AI.
Senior Technical Architect – Databricks
Location
India
Posted
69 days ago
Salary
0
Seniority
Senior
Job Description
Senior Technical Architect – Databricks
Quantiphi
• Building cloud-native, hybrid, or multi-cloud solutions • Developing data pipelines using PySpark with Databricks • Collaborating with teams to deliver technical workloads • Creating roadmaps and architecture for migration workloads on AWS • Mentoring and managing data engineering teams
Job Requirements
- 15+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions
- Experience with Databricks implementations - developing data pipelines using PySpark
- Experience in Databricks Workspaces, Notebooks, Delta Lake, APIs
- Expertise in production grade solutions using: AWS (Redshift, S3, Glue, Lambda, Airflow), Pyspark, Python, Data pipelines using Glue/Airflow/Sagemaker.
- Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases
- Experience with migration of databases to AWS.
- Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.
- Exposure to ETL tools and Data warehouse.
- Experience in SQL and Query optimisation.
- Proficient in SQL-based technologies (MySQL, Oracle DB, SQL Server etc.)
- Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.
- Experience building and supporting large-scale systems in a production environment.
- Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads.
- Experience using Github/codecommit for developmental activities
Benefits
- Ample opportunities to learn
- Grow and interact with colleagues from varied experience and backgrounds around the globe
Related Guides
Related Job Pages
More Backend Engineer Jobs
Fullstack Developer, Python/React
Grupo BoticárioCriamos oportunidades para a beleza transformar a vida das pessoas, e assim transformar o mundo ao nosso redor.
• Create and develop APIs, services, and microservices (Python with Flask/FastAPI) to orchestrate and serve data in a performant, secure, and observable manner. • Ensure our cloud products (GCP) are scalable and flexible, staying ahead of the technological demands of GB. • Evolve the interface of our internal products (React), ensuring the user journey is intuitive and high-performance. • Implement and maintain automated workflows using Airflow (Composer) for automation and monitoring of data processes. • Work cross-functionally, promoting component reuse and developing patterns that facilitate engineering teams’ activities. • Ensure data integrity and security, basing all decisions on reliable metrics and development best practices. • Act with an owner mindset, proactively suggesting continuous improvements, adapting quickly to scope changes, and delivering real value to our users.
Analyste Programmeur – .NET, C#, Angular
Solution SFTConnecting Top Talent with Leading Industries | Solution SFT 🚀 | Specializing in IT and Engineering Consulting.
• Réaliser l'analyse fonctionnelle • Rédiger ou réviser les dossiers fonctionnels • Rédiger ou réviser le manuel d'exploitation • Effectuer la programmation et les essais unitaires • Effectuer les essais fonctionnels et intégrés • Mettre le système en production • Rédiger le guide d'utilisation • Dossier d'analyse • Dossiers fonctionnels • Manuel d'exploitation • Devis et données d'essais • Rapport de l'essai intégré • Plan de mise en production • Manuel destiné aux utilisateurs • Registre d'anomalies • Carnet de produit • Procédures opérationnelles et guide d'utilisation • Scripts, services web, métadonnées, catalogue • Documents de suivi • Présentations
• Provide technical leadership for a squad and manage the team • Design, develop, and test new features for the platform • Maintain and improve the codebase, fix bugs, and refactor • Promote standards and best practices to raise overall quality • Conduct regular 1:1s and support team well-being • Structure team rituals and ensure cadence and predictability • Co-define the technical roadmap with Product • Coordinate reliability initiatives and lead maintenance for high-risk changes • Define and communicate team metrics • Lead incident response and prioritize follow-up actions • Participate in recruiting and selection processes
• Desenvolvimento e evolução de aplicações full stack • Atuação em arquitetura baseada em microsserviços • Construção e integração de APIs RESTful • Modernização e sustentação de sistemas legados • Desenvolvimento e manutenção de interfaces utilizando Angular e React • Participação em análises técnicas e resolução de problemas complexos • Investigação de causa raiz e apoio em tomadas de decisão técnicas • Colaboração com times técnicos, infraestrutura e áreas parceiras • Participação em melhorias contínuas, qualidade de código e boas práticas de desenvolvimento




