Job Closed
This listing is no longer active.
We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
Senior Azure Fabric Data Engineer
Location
India
Posted
92 days ago
Salary
0
Seniority
Senior
Job Description
Senior Azure Fabric Data Engineer
Weekday (YC W21)
• Design and lead scalable, cloud-native data platforms • Build high-performance pipelines using Python and SQL • Collaborate with machine learning teams • Emphasize architecture, governance, and best practices • Create robust ETL/ELT pipelines • Lead projects focusing on data architecture and AI-driven data workflows
Job Requirements
- 7+ years of experience in supporting ETL and ELT development
- Experience with Azure Fabric, Databricks, Azure OneLake, Spark, Delta Lake
- Skills in data architecture, Azure Data Bricks, Azure Synapse, PySpark, SQL
- Knowledge of Delta Lake concepts, Power BI, Azure Data Factory (ADF)
- Proficiency in Python, SQL ETL/ELT strategy, and orchestration
- Preferred degree in Computer Science/Information Technology
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Serve as the Snowflake subject matter expert within the Data Platform Operations team, providing specialized expertise for platform architecture, administration, and optimization. • Monitor, triage, and resolve production ETL/ELT pipeline incidents and alerts, with emphasis on Snowflake-related issues including query performance, warehouse contention, and data loading failures. • Manage Snowflake access controls, role-based security, and data governance policies to ensure compliance with security and privacy requirements. • Optimize Snowflake platform performance and costs through proactive monitoring, query optimization, warehouse sizing, resource management, and storage efficiency improvements. • Collaborate with data engineers and operations team members to troubleshoot data pipeline failures, performance bottlenecks, and data quality issues. • Implement and maintain operational standards, monitoring solutions, and runbooks for Snowflake platform management and ETL support. • Design and enforce Snowflake best practices including data modeling patterns, security configurations, and cost management strategies. • Support the operations team in evaluating, implementing, and maintaining data integration tools, orchestration platforms (Airflow, dbt), and CI/CD processes. • Implement data governance frameworks including data quality standards, metadata management, and lineage tracking within Snowflake. • Partner with DevOps, security, and data engineering teams to ensure seamless platform operations and continuous improvement.
App Dev & Support Engineer III
ConduentThrough our dedicated associates, Conduent delivers mission-critical services and solutions on behalf of Fortune 100 companies and over 500 governments - creating exceptional outcomes for our clients and the millions of people who count on them. You have an opportunity to personally thrive, make a difference and be part of a culture where individuality is noticed and valued every day. Conduent is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, creed, religion, ancestry, national origin, age, gender identity, gender expression, sex/gender, marital status, sexual orientation, physical or mental disability, medical condition, use of a guide dog or service animal, military/veteran status, citizenship status, basis of genetic information, or any other group protected by law. For US applicants: People with disabilities who need a reasonable accommodation to apply for or compete for employment with Conduent may request such accommodation(s) by submitting their request through this form that must be downloaded: click here to access or download the form. Complete the form and then email it as an attachment to FTADAAA@conduent.com. You may also click here to access Conduent's ADAAA Accommodation Policy.
Through our dedicated associates, Conduent delivers mission-critical services and solutions on behalf of Fortune 100 companies and over 500 governments - creating exceptional outcomes for our clients and the millions of people who count on them. You have an opportunity to personally thrive, make a difference and be part of a culture where individuality is noticed and valued every day. Data Warehouse ETL Developer Job Summary: We are seeking a skilled Data Warehouse / ETL Developer with expertise in Informatica PowerCenter to design, develop, and maintain enterprise-level ETL solutions. The ideal candidate will have hands-on experience in data warehousing concepts, ETL processes, and strong problem-solving skills to ensure high-quality, timely, and accurate data integration. Key Responsibilities: - Design, develop, and deploy ETL mappings, workflows, and sessions using Informatica PowerCenter. - Extract data from heterogeneous source systems (Oracle, SQL Server, flat files, SAP) and load into target data warehouse environments. - Collaborate with business analysts and data architects to understand data requirements and translate them into efficient ETL solutions. - Optimize ETL processes for performance, scalability, and maintainability. - Conduct data validation, reconciliation, and troubleshooting to ensure data quality and integrity. - Maintain ETL documentation, including data flow diagrams, technical specifications, and process design documents. - Participate in code reviews, unit testing, and UAT support. - Monitor ETL jobs and workflows, identify bottlenecks, and implement improvements. - Provide production support and resolve data-related issues in a timely manner. Required Skills and Qualifications: - Bachelor’s degree in computer science, Information Technology, or a related field. - 7 years of experience in ETL development using Informatica PowerCenter. - Strong understanding of data warehousing concepts, dimensional modeling, and star/snowflake schemas. - Experience with SQL, PL/SQL, and performance tuning of database queries. - Knowledge of data quality, data governance, and best practices in ETL development. - Strong analytical, problem-solving, and communication skills. - Experience with version control systems and ETL deployment processes. Preferred Qualifications: - Exposure to real-time ETL and data streaming technologies. - Knowledge of scheduling tools such as Informatica Workflow Manager and IBM Workload Automation Flexible Working At Conduent, we value individuality and flexible working arrangements. In this role, you can expect: - Remote Work: Enjoy the flexibility of working from home while optimizing your work-life balance. Working for You We offer perks and rewards designed to support you: - Health & Welfare Benefits: Comprehensive plans tailored to your needs, effective from day one. - Retirement Savings: Robust programs to help you secure your financial future. - Employee Discounts: Access to a wide range of discounts on merchandise, services, travel, and more. - Career Growth Opportunities: Paths for advancement within a global organization. - Paid Training: Learn while you earn with award-winning learning platforms. - Paid Time Off: Competitive PTO packages to help you recharge. - Great Work Environment: Join an award-winning culture that values diversity and inclusion. Join Us: At Conduent, we are united by a shared mission. We understand that our success is driven by the success of our associates. When you join us, you’ll find opportunities to: - Bring your authentic self to work every day. - Grow and thrive both personally and professionally. - Make a meaningful impact with our clients, in our communities, and for the millions of people we serve. With over 50,000 associates in 24 countries, you’ll be part of a global team that’s shaping the future — for the company and for yourself. Pay Transparency Laws in some locations require disclosure of compensation and/or benefits-related information. For this position, actual salaries will vary and may be above or below the range based on various factors including but not limited to location, experience, and performance. In addition to base pay, this position, based on business needs, may be eligible for a bonus or incentive. In addition, Conduent provides a variety of benefits to employees including health insurance coverage, voluntary dental and vision programs, life and disability insurance, a retirement savings plan, paid holidays, and paid time off (PTO) or vacation and/or sick time. The estimated salary range for this role is ($110,688 - $143750) Conduent is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, creed, religion, ancestry, national origin, age, gender identity, gender expression, sex/gender, marital status, sexual orientation, physical or mental disability, medical condition, use of a guide dog or service animal, military/veteran status, citizenship status, basis of genetic information, or any other group protected by law. For US applicants: People with disabilities who need a reasonable accommodation to apply for or compete for employment with Conduent may request such accommodation(s) by submitting their request through this form that must be downloaded: click here to access or download the form. Complete the form and then email it as an attachment to FTADAAA@conduent.com. You may also click here to access Conduent's ADAAA Accommodation Policy.
App Dev & Support Engineer III
ConduentThrough our dedicated associates, Conduent delivers mission-critical services and solutions on behalf of Fortune 100 companies and over 500 governments - creating exceptional outcomes for our clients and the millions of people who count on them. You have an opportunity to personally thrive, make a difference and be part of a culture where individuality is noticed and valued every day. Conduent is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, creed, religion, ancestry, national origin, age, gender identity, gender expression, sex/gender, marital status, sexual orientation, physical or mental disability, medical condition, use of a guide dog or service animal, military/veteran status, citizenship status, basis of genetic information, or any other group protected by law. For US applicants: People with disabilities who need a reasonable accommodation to apply for or compete for employment with Conduent may request such accommodation(s) by submitting their request through this form that must be downloaded: click here to access or download the form. Complete the form and then email it as an attachment to FTADAAA@conduent.com. You may also click here to access Conduent's ADAAA Accommodation Policy.
Through our dedicated associates, Conduent delivers mission-critical services and solutions on behalf of Fortune 100 companies and over 500 governments - creating exceptional outcomes for our clients and the millions of people who count on them. You have an opportunity to personally thrive, make a difference and be part of a culture where individuality is noticed and valued every day. Data Warehouse ETL Developer Job Summary: We are seeking a skilled Data Warehouse / ETL Developer with expertise in Informatica PowerCenter to design, develop, and maintain enterprise-level ETL solutions. The ideal candidate will have hands-on experience in data warehousing concepts, ETL processes, and strong problem-solving skills to ensure high-quality, timely, and accurate data integration. Key Responsibilities: - Design, develop, and deploy ETL mappings, workflows, and sessions using Informatica PowerCenter. - Extract data from heterogeneous source systems (Oracle, SQL Server, flat files, SAP) and load into target data warehouse environments. - Collaborate with business analysts and data architects to understand data requirements and translate them into efficient ETL solutions. - Optimize ETL processes for performance, scalability, and maintainability. - Conduct data validation, reconciliation, and troubleshooting to ensure data quality and integrity. - Maintain ETL documentation, including data flow diagrams, technical specifications, and process design documents. - Participate in code reviews, unit testing, and UAT support. - Monitor ETL jobs and workflows, identify bottlenecks, and implement improvements. - Provide production support and resolve data-related issues in a timely manner. Required Skills and Qualifications: - Bachelor’s degree in computer science, Information Technology, or a related field. - 7 years of experience in ETL development using Informatica PowerCenter. - Strong understanding of data warehousing concepts, dimensional modeling, and star/snowflake schemas. - Experience with SQL, PL/SQL, and performance tuning of database queries. - Knowledge of data quality, data governance, and best practices in ETL development. - Strong analytical, problem-solving, and communication skills. - Experience with version control systems and ETL deployment processes. Preferred Qualifications: - Exposure to real-time ETL and data streaming technologies. - Knowledge of scheduling tools such as Informatica Workflow Manager and IBM Workload Automation Flexible Working At Conduent, we value individuality and flexible working arrangements. In this role, you can expect: - Remote Work: Enjoy the flexibility of working from home while optimizing your work-life balance. Working for You We offer perks and rewards designed to support you: - Health & Welfare Benefits: Comprehensive plans tailored to your needs, effective from day one. - Retirement Savings: Robust programs to help you secure your financial future. - Employee Discounts: Access to a wide range of discounts on merchandise, services, travel, and more. - Career Growth Opportunities: Paths for advancement within a global organization. - Paid Training: Learn while you earn with award-winning learning platforms. - Paid Time Off: Competitive PTO packages to help you recharge. - Great Work Environment: Join an award-winning culture that values diversity and inclusion. Join Us: At Conduent, we are united by a shared mission. We understand that our success is driven by the success of our associates. When you join us, you’ll find opportunities to: - Bring your authentic self to work every day. - Grow and thrive both personally and professionally. - Make a meaningful impact with our clients, in our communities, and for the millions of people we serve. With over 50,000 associates in 24 countries, you’ll be part of a global team that’s shaping the future — for the company and for yourself. Pay Transparency Laws in some locations require disclosure of compensation and/or benefits-related information. For this position, actual salaries will vary and may be above or below the range based on various factors including but not limited to location, experience, and performance. In addition to base pay, this position, based on business needs, may be eligible for a bonus or incentive. In addition, Conduent provides a variety of benefits to employees including health insurance coverage, voluntary dental and vision programs, life and disability insurance, a retirement savings plan, paid holidays, and paid time off (PTO) or vacation and/or sick time. The estimated salary range for this role is ($110,688 - $143,750) Conduent is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, creed, religion, ancestry, national origin, age, gender identity, gender expression, sex/gender, marital status, sexual orientation, physical or mental disability, medical condition, use of a guide dog or service animal, military/veteran status, citizenship status, basis of genetic information, or any other group protected by law. For US applicants: People with disabilities who need a reasonable accommodation to apply for or compete for employment with Conduent may request such accommodation(s) by submitting their request through this form that must be downloaded: click here to access or download the form. Complete the form and then email it as an attachment to FTADAAA@conduent.com. You may also click here to access Conduent's ADAAA Accommodation Policy.
Freelance Web Scraping Engineer (Vibe Coding)
MindriftApply → Pass qualification(s) → Join a project → Complete tasks → Get paid. Project time expectations: Tasks are estimated to require around 10–20 hours per week during active phases, based on project requirements; This is an estimate, not a guaranteed workload, and applies only while the project is active. Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Vibe Code specialist, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities - Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. - Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. - Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior. - Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. - Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent, depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine-tuning AI outputs, you’ll play a key role in advancing AI capabilities and real-world applications.


