Data Engineering Tech Lead – Azure
Location
India
Posted
179 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineering Tech Lead – Azure
Lingaro
• Efficient and effective project delivery is the primary responsibility of the tech lead. • Provide leadership and guidance to the data engineering team, including mentoring, coaching, and fostering a collaborative work environment. Set clear goals, assign tasks, and manage resources to ensure successful project delivery. Work closely with developers to support them and improve data engineering processes. • Support team members with troubleshooting and resolving complex technical issues and challenges. • Utilize and promote Generative AI tools to accelerate project delivery. • Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies. Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards. • Collaborate with stakeholders to understand project requirements, define scope, and create project plans. • Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards. Monitor progress, identify risks, and implement mitigation strategies. • Act as a trusted advisor for the customer. • Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders. Ensure data solutions are scalable, efficient, and aligned with business requirements. Provide guidance in areas such as data modeling, database design, and data integration. • Align coding standards, conduct code reviews to ensure proper code quality level. • Identify and introduce quality assurance processes for data pipelines and workflows. • Optimize data processing and storage for performance, efficiency and cost savings. • Evaluate and implement new technologies to improve data engineering processes on various aspects (CICD, Quality Assurance, Coding standards). • Act as main point of contact to other teams/contributors engaged in the project. • Maintain technical documentation of the project, control validity and perform regular reviews of it. • Ensure compliance with security standards and regulations.
Job Requirements
- A bachelor's or master’s degree in computer science, Information Systems, or a related field is typically required. Additional certifications in data integration tools or platforms are advantageous.
- Minimum of 8-10 years of experience in data engineering or a related field.
- Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, R or Scala.
- Practical experience with Microsoft Azure cloud and Databricks platform. Familiarity with other cloud platforms, such as GCP or AWS, is beneficial.
- Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions.
- Proven experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support.
- In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration.
- Hands-on experience using GenAI tools in daily programming is highly beneficial. A willingness to learn, utilize and promote such tools is expected.
- Strong project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines.
- Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues.
- Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management.
- Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies.
Benefits
- Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
- 100% remote.
- Flexibility regarding working hours.
- Full-time position
- Comprehensive online onboarding program with a “Buddy” from day 1.
- Cooperation with top-tier engineers and experts.
- Unlimited access to the Udemy learning platform from day 1.
- Certificate training programs. Lingarians earn 500+ technology certificates yearly.
- Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
- Grow as we grow as a company. 76% of our managers are internal promotions.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
- Create our community together. Refer your friends to receive bonuses.
- Activities to support your well-being and health.
- Plenty of opportunities to donate to charities and support the environment.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Architect
nDeavour ConsultingWe are a staffing and IT recruitment company based in Sofia, Bulgaria.
• Define the enterprise data architecture roadmap aligned with strategic business objectives. • Champion best practices for data modelling, integration, governance, and metadata management across domains. • Design canonical data models, entity relationships, and standards for schema evolution and semantic layers. • Architect modern lakehouse platforms using Databricks, Delta Lake, and Unity Catalog. • Define ingestion and transformation patterns, including orchestration using tools such as Airflow. • Implement bronze / silver / gold layering strategies for structured, trusted, and scalable data pipelines. • Establish data lineage, quality frameworks, cataloguing, and compliance processes. • Partner with engineering teams to integrate data into microservices and operational systems. • Contribute to real-time and batch pipeline designs that support analytics and ML/AI use cases. • Define and maintain data governance principles, security standards, and access controls. • Lead adoption of Unity Catalog for centralized metadata and policy enforcement. • Mentor senior engineers and act as a thought leader, influencing architecture and best practices across teams.
• Collaborate with cross-functional teams to define data requirements, perform data collection, and ensure data quality and integrity. • Curate data sets including through hands on analyses and automated tools including web scraping, ETL pipelines and SQL queries. • Conduct in-depth research and analysis to identify new data sources and complement existing data sources. • Design and maintain intuitive BI dashboards, reports, and visualizations to effectively communicate complex data and insights. • Identify actionable business insights through analysis of data trends, patterns, and correlations. • Own documentation of data processes, schemas, and data sets • Build using best practices in security, design, and data quality.
Fullstack Data Engineer
Codvo.aiBuilding Advance AI & Cloud Native Software Using The "Virtual Silicon Valley" Model. Let’s Talk AI, Cloud and Outcomes.
• Design and develop ETL/ELT pipelines on platforms like Databricks (PySpark, Delta Lake, SQL), Informatica, Teradata, Snowflake • Architect data models (batch and streaming) for analytics, ML, and reporting • Optimize performance of large-scale distributed data processing jobs • Implement CI/CD pipelines for Databricks workflows using GitHub Actions, Azure DevOps, or similar • Build and maintain APIs, dashboards, or applications that consume processed data (full-stack aspect) • Collaborate with data scientists, analysts, and business stakeholders to deliver solutions • Ensure data quality, lineage, governance, and security compliance • Deploy solutions across cloud environments (Azure, AWS, or GCP)
• Translate business requirements to data engineering solutions to support an enterprise scale AWS and/or Databricks based data environments. • Support designing, maintaining, automating and optimizing ETL operations ensuring data quality and efficient data management. • Design, build, and optimize scalable data solutions using a Medallion Architecture. • Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously. • Integrate data from various structured and unstructured sources to enable high-quality business insights. • Implement effective data management strategies to ensure data integrity, availability, and accessibility. • Identify opportunities for cost optimization in data storage, processing, and analytics operations. • Monitor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management. • Collaborate with the team to enable advanced AI-driven analytics and data science workflows.




