Job Closed
This listing is no longer active.
Building a #BetterWorkingWorld by providing trust through assurance and helping organizations grow, transform & operate.
Azure Data Architect – Manager
Location
India
Posted
53 days ago
Salary
0
Seniority
Lead
Job Description
Azure Data Architect – Manager
EY
• Develop standardized practices for delivering new products and capabilities using Big Data & cloud technologies, including data acquisition, transformation, analysis, Modelling, Governance & Data management skills • Interact with senior client technology leaders, understand their business goals, create, propose solution, estimate effort, build architectures, develop and deliver technology solutions • Define and develop client specific best practices around data management within a cloud environment • Recommend design alternatives for data ingestion, processing and provisioning layers • Design and develop data ingestion programs to process large data sets in Batch mode using ADB, ADF, PySpark, Python, Snypase • Develop data ingestion programs to ingest real-time data from LIVE sources using Apache Kafka, Spark Streaming and related technologies • Have managed team and have experience in end to end delivery • Have experience of building technical capability and teams to deliver
Job Requirements
- Minimum 7 years hands-on experience in one or more of the above areas
- Minimum 10 years industry experience
- Strong understanding & familiarity with all Cloud Ecosystem components
- Strong understanding of underlying Cloud Architectural concepts and distributed computing paradigms
- Experience in the development of large scale data processing.
- Hands-on programming experience in ADB, ADF, Synapse, Python, PySpark, SQL
- Hands-on expertise in cloud services like AWS, and/or Microsoft Azure eco system
- Solid understanding of ETL methodologies in a multi-tiered stack with Data Modelling & Data Governance
- Experience with BI, and data analytics databases
- Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
- Experience in Enterprise grade solution implementations.
- Experience in performance benchmarking enterprise applications
- Strong stakeholder, client, team, process & delivery management skills
- Design and propose Azure-based data and AI solutions that align with customer objectives and solve business challenges.
- Develop and present demonstrations, prototypes, and PoCs to showcase the value and capabilities of the proposed solutions.
Benefits
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that’s right for you
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Product Growth Specialist – Data Engineering
SnowflakeSnowflake delivers the AI Data Cloud to help organizations share data, build apps and power their business with AI.
• The Product Growth Specialist (PGS) will drive the theater-wide activation of Product Go-to-Market (GTM) initiatives, specifically focused on Data Engineering. • The PGS will act as a critical cross-functional interlock, designed to plug product-strategy gaps and accelerate GTM program execution. • They will ensure faster execution of GTM programs and sales plays. • Build a tight interlock between product teams and field execution, acting as the "Voice of the Field". • Continuously scan customer, market, and pipeline trends to propose new programmatic initiatives for Product Strategy teams. • Provide critical support for high-value deals by ensuring optimal cross-functional orchestration.
Lead Data Engineer
ThoughtworksThoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. Over 30 years of delivering extraordinary impact with clients. Helping clients solve complex business problems with technology as the differentiator.
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities - You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. - You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality. - You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. - You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. - You will collaborate with data scientists to design scalable implementations of their models. - You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines. - You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available. - You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack. - You will be responsible for data governance, data security and data privacy to support business and compliance requirements. - You will define the strategy for and incorporate data quality into your day-to-day work. Job qualifications Technical Skills - You have experience in leading the system design and implementation of technical solutions. - Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. - You have a deep understanding of data modeling and experience with modern data engineering tools and platforms. - You have experience in writing clean, high-quality code using the preferred programming language. - You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting. - You have experience with data visualization techniques and can communicate the insights as per the audience. - You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems. - You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills - You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way. - You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives. - You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them. - You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work. - You enjoy influencing others and always advocate for technical excellence while being open to change when needed. - You are a proven leader with a track record of encouraging teammates in their professional development and relationships. - Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business. Other things to know Learning & Development There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys. About Thoughtworks Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary. #LI-Remote Salary Benefits: https://www.thoughtworks.com/en-us/careers/benefits The annual salary range posted is subject to many factors and may vary depending on experience, geographic location, job responsibilities, performance, skills and/or training. Salary $158—$253 USD See here our AI policy.
Lead Data Engineer - Refer
Referrals OnlyThoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary.
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities - You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. - You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality. - You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. - You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. - You will collaborate with data scientists to design scalable implementations of their models. - You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines. - You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available. - You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack. - You will be responsible for data governance, data security and data privacy to support business and compliance requirements. - You will define the strategy for and incorporate data quality into your day-to-day work. Job qualifications Technical Skills - You have experience in leading the system design and implementation of technical solutions. - Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. - You have a deep understanding of data modeling and experience with modern data engineering tools and platforms. - You have experience in writing clean, high-quality code using the preferred programming language. - You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting. - You have experience with data visualization techniques and can communicate the insights as per the audience. - You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems. - You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills - You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way. - You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives. - You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them. - You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work. - You enjoy influencing others and always advocate for technical excellence while being open to change when needed. - You are a proven leader with a track record of encouraging teammates in their professional development and relationships. - Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business. Other things to know Learning & Development There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys. About Thoughtworks Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary. #LI-Remote Salary Benefits: https://www.thoughtworks.com/en-us/careers/benefits The annual salary range posted is subject to many factors and may vary depending on experience, geographic location, job responsibilities, performance, skills and/or training. Salary $158—$253 USD See here our AI policy.
Lead Data Engineer
ThoughtworksThoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. Over 30 years of delivering extraordinary impact with clients. Helping clients solve complex business problems with technology as the differentiator.
Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities - You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. - You will collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality. - You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. - You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. - You will collaborate with data scientists to design scalable implementations of their models. - You write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines. - You will lead and advise clients on how to use different distributed storage and computing technologies from the plethora of options available. - You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack. - You will be responsible for data governance, data security and data privacy to support business and compliance requirements. - You will define the strategy for and incorporate data quality into your day-to-day work. Job qualifications Technical Skills - You have experience in leading the system design and implementation of technical solutions. - Working with data excites you; You have created Big Data architecture, can build and operate data pipelines, and maintain data storage, all within distributed systems. - You have a deep understanding of data modeling and experience with modern data engineering tools and platforms. - You have experience in writing clean, high-quality code using the preferred programming language. - You have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting. - You have experience with data visualization techniques and can communicate the insights as per the audience. - You have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems. - You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills - You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way. - You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives. - You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them. - You coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work. - You enjoy influencing others and always advocate for technical excellence while being open to change when needed. - You are a proven leader with a track record of encouraging teammates in their professional development and relationships. - Cultivating strong partnerships comes naturally to you; You understand the importance of relationship building and how it can bring new opportunities to our business. Policy on the Use of Artificial Intelligence in the Selection Process We use recruitment tools that include some AI-powered features to support our teams with repetitive tasks such as sending communications, scheduling, and generating interview notes. These tools do not rank candidates or make hiring decisions. Every application is reviewed by our recruitment team, and all selection and hiring decisions are made by humans. We are committed to fairness, and our third-party vendors must meet high standards for testing, monitoring, and mitigating bias. For more details, please see our full Thoughtworks AI Policy for Recruitment. Transparency regarding our job openings and our Projects' dynamics As a technology consultancy, the projects we undertake are subject to change based on client needs and agreements. While we strive for consistency, please be aware that project scope or availability may shift, or projects may even be cancelled, during the recruitment and selection process, which is often outside of our direct control. Should the project related to this vacancy be significantly altered or cancelled, all impacted candidates will be promptly and duly informed of the change. Other things to know Learning & Development There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys. About Thoughtworks Thoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we’re pushing boundaries through our purposeful and impactful work. For 30+ years, we’ve delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let’s be extraordinary. #LI-Remote Salary Benefits: https://www.thoughtworks.com/en-ca/careers/benefits Salary $150,000—$241,000 CAD See here our AI policy.

