Meazure Learning logo
Meazure Learning

Offering full-service assessment development, delivery, and proctoring solutions across the world

Principal Data Engineer

Data EngineerData EngineerFull TimeRemoteLeadTeam 1,001-5,000Since 2008H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

62 days ago

Salary

0

Seniority

Lead

Postgraduate Degree8 yrs expEnglishAirflowApacheAzureCloudETLKafkaPySparkTerraformVault

Job Description

Principal Data Engineer

Meazure Learning

• Define and lead enterprise data architecture strategy with strong focus on Azure-based modern data platforms and Lakehouse architecture. • Architect, design, and optimize scalable Data Warehouse and analytics solutions using Azure Synapse, Azure Data Lake Storage Gen2, Databricks, Delta Lake, and Microsoft Fabric. • Build and orchestrate robust ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, PySpark, and modern orchestration frameworks. • Implement Medallion Architecture (Bronze/Silver/Gold) and scalable data ingestion frameworks supporting batch, streaming, and CDC workloads. • Develop enterprise semantic models and optimize datasets for Power BI Premium, Fabric, and self-service analytics. • Establish enterprise standards for data modeling, governance, security, observability, and performance optimization. • Lead Data Warehouse modernization initiatives and implement scalable Star Schema, Snowflake, and Data Vault 2.0 models. • Drive platform scalability, MPP query tuning, workload optimization, and cloud cost optimization initiatives. • Implement CI/CD, DataOps, and Infrastructure-as-Code practices using Azure DevOps, GitHub Actions, Terraform, or Bicep. • Promote AI-assisted engineering practices leveraging GitHub Copilot, Cursor AI, and Azure OpenAI for development productivity and automation. • Mentor engineering teams and drive engineering excellence, automation, and reusable framework adoption.

Job Requirements

  • Experience of 8 yrs to 10 yrs with dbt, Apache Airflow, Kafka/Event Hubs, or real-time analytics platforms.
  • Experience of 4 yrs to 6 Yrs in AI/ML data platforms, Azure OpenAI, or intelligent automation frameworks.
  • Experience of 4 yrs to 6 Yrs using AI-assisted coding tools such as GitHub Copilot or Cursor AI.
  • Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect are preferred.

Benefits

  • Competitive Pay
  • Healthy Work Culture
  • Career Growth Opportunities
  • Learning and Development Opportunities
  • Company Sponsored Health Insurance
  • Referral Award Program
  • Company Provided IT Equipment (for remote team members)
  • Transportation Program (on-site team members)
  • Company Provided Meals (on-site team members)
  • 14 Company Provided Holidays
  • Generous Leave Program

Related Categories

Related Job Pages

More Data Engineer Jobs

Cypher Consulting Europe logo

Data & AI Engineer

Cypher Consulting Europe

Cypher Consulting Europe takes pride in its ability to deliver expert consultants across a wide spectrum of technologies and industry sectors.

Data Engineer62 days ago

Role Description We are seeking talented Data & AI Engineers to support the development of an enterprise-grade AI Assistant. This is a high-impact initiative at the intersection of modern data engineering and applied AI. The role focuses on building the data pipeline that transforms unstructured corporate documents into a searchable, intelligent knowledge base powering a Large Language Model (LLM) as well as automating actions such as ticket creation and workflow integrations. - Data Engineering: Build and maintain scalable data pipelines using Databricks and Azure Data Lake Storage Gen2 (ADLS Gen2), ensuring reliability and performance across all pipeline stages. - Data Transformation: Implement the Medallion Architecture (Raw → Silver → Gold layers) to clean, normalise, and structure technical documentation for downstream AI consumption. - AI Orchestration: Design and develop the Reasoning Layer using frameworks such as LangChain or LlamaIndex to manage LLM logic, prompt routing, and tool orchestration. - Search Optimisation: Manage and tune Vector Databases (e.g. Pinecone, Weaviate, or Azure AI Search) to enable fast and accurate semantic retrieval across the corporate knowledge base. - Integration & Automation: Develop Azure Apps and Azure Functions to connect the AI system to external enterprise platforms such as Salesforce and SharePoint, enabling end-to-end automation. Qualifications - 3–4 years in Data Engineering or Software Development with a strong focus on cloud-based data processing. - Strong proficiency in Databricks and Python; comfortable working across the full data engineering lifecycle. - Hands-on experience with LLM orchestration frameworks: LangChain, LlamaIndex, or similar. - Solid understanding of the Azure ecosystem — Storage (ADLS Gen2), Identity (AAD), and Serverless (Azure Functions). - Familiarity with modern AI coding assistants (GitHub Copilot, Cursor, OpenAI Codex) to accelerate development velocity. Company Description Cypher Consulting Europe takes pride in its ability to deliver expert consultants across a wide spectrum of technologies and industry sectors.

Czechia
Job Closed
Higginbotham logo

Senior Data Architect

Higginbotham

Lead with values and value leads.

Data Engineer63 days ago
Full TimeRemoteTeam 1,001-5,000Since 1948H1B No Sponsor

• Lead the design and evolution of our enterprise data architecture • Define and lead enterprise data architecture strategy across Azure data platforms, Snowflake, Azure Data Lake, analytics, and integration services • Design scalable, secure, and high-performance data models, pipelines, and platform architectures aligned to business and technical requirements • Establish architecture standards, governance frameworks, and best practices for data quality, lineage, security, and lifecycle management • Oversee solution design reviews, architecture documentation, and implementation guidance for critical data initiatives • Provide technical leadership and mentorship to data engineers, architects, and business intelligence professionals

Texas
Job Closed
Higginbotham logo

Data Engineer

Higginbotham

Lead with values and value leads.

Data Engineer63 days ago
Full TimeRemoteTeam 1,001-5,000Since 1948H1B No Sponsor

• The Data Engineer designs, builds, and maintains scalable data pipelines and analytics solutions across our Azure cloud environment • This role transforms raw data from multiple source systems into reliable, business-ready information that powers reporting, analytics, and operational decision-making • The Data Engineer works closely with analysts, application developers, and business stakeholders to deliver high-quality data solutions on Snowflake, Azure Data Lake, and Microsoft Power BI • Design, develop, and maintain ETL/ELT pipelines in Azure to ingest, transform, and integrate data from multiple source systems • Build and optimize Snowflake-based data solutions for scalable storage, transformation, and analytics workloads • Manage and support Azure Data Lake structures for both structured and unstructured data • Develop interactive dashboards and reports in Microsoft Power BI to support business intelligence and operational reporting • Implement integration solutions that connect Azure services, Snowflake, and downstream reporting platforms • Monitor pipeline performance, troubleshoot failures, and implement enhancements to improve efficiency and reliability • Ensure data quality, integrity, security, and consistency across all cloud data platforms • Partner with analysts, developers, and business stakeholders to gather and refine data and reporting requirements

Texas
Job Closed
Banner Health logo

Senior Lead Data Engineer

Banner Health

Making health care easier, so life can be better.

Data Engineer63 days ago
Full TimeRemoteTeam 10,001+Since 1999H1B Sponsor

• Partner with business to gather requirements and implement solutions • Collaborate with IT teams and prioritize projects • Lead cross-functional teams and manage multiple projects • Establish system documentation standards and quality assurance methodologies

Arizona
$37 - $61 / hour
Job Closed