Job Closed
This listing is no longer active.
IT services that put people at the center of your business
Data Engineer
Location
India
Posted
91 days ago
Salary
0
Seniority
Lead
Job Description
Data Engineer
Astreya
• Build and maintain ETL/ELT pipelines to move data from source to storage • Implement automated data quality testing and observability alerts • Optimize data storage formats (e.g., Parquet, Delta Lake) for high-speed querying • Manage CI/CD pipelines for data code deployment • Create interactive visualizations with actionable insights by persona
Job Requirements
- 8 to 10 years of experience
- Focus: Reliability, Automation, and Data Quality
- Preferred USA B1 Business Visa with a minimum validity of 2 years
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
The Cloud Data Engineer establishes and sustains the university’s modern data infrastructure within Microsoft Fabric, enabling reliable, scalable, and integrated data operations across institutional systems. This role focuses on designing and maintaining data lakehouses, pipelines, and warehouses that unify data from platforms such as RIO, Domo, Canvas, HubSpot, and SurveyMonkey. The engineer supports efforts to develop and curate reusable datasets, ensuring that information flows securely and efficiently between systems to support analytics, compliance, and institutional decision-making. By implementing repeatable frameworks and optimizing data processes, this position plays a critical role in advancing the university’s data maturity and empowering evidence-based insight across all departments. Team & Reporting Team: Information Technology Reports to: Director of Information Technology Location: Remote Status: Full-time Role Composition (Estimated %) Leadership: [10%] Strategy: [30%] Coaching: [0%] Player/Execution: [60%] Note: This is an estimate of how the role is currently balanced, and may evolve over time. Preferred Qualifications: - Experience implementing or managing Microsoft Fabric environments, including lakehouses, pipelines, and warehouses. - Working knowledge of Azure Data Services (Data Factory, Synapse, Data Lake Storage, Purview). - Proficiency in Python, SQL, Powershell, and BI solution, with experience automating data ingestion and transformation workflows. - Understanding of data governance and security frameworks (FERPA, GLBA, or similar). - Experience in higher education or workforce analytics, particularly integrating data from SIS, LMS, CRM, or survey systems. - Knowledge of API integrations (e.g., RIO, Canvas, HubSpot, SurveyMonkey) for data ingestion and synchronization. - Certification or demonstrated training in Microsoft Azure or Fabric data engineering tools preferred. Key Areas of Focus This role is focused on outcomes and contribution, not an exhaustive list of tasks. 1. Data Infrastructure and Architecture - Design, deploy, and maintain the university’s modern data infrastructure in Microsoft Fabric, including lakehouses, warehouses, pipelines, and dataflows. - Develop standardized ingestion and transformation frameworks that connect data from systems such as RIO, Canvas, HubSpot, and SurveyMonkey. - Implement medallion (bronze–silver–gold) architecture and optimize data storage, schema design, and query performance for scalable analytics. - Evaluate emerging Fabric capabilities and data-engineering practices to enhance scalability, governance, and automation. 2. Data Pipeline Development and Management - Build and orchestrate automated data pipelines for ingestion, transformation, and curation using Fabric Dataflows Gen2, and Data Factory, among others. - Monitor and troubleshoot pipeline execution, ensuring reliability, timeliness, and consistency across environments. - Collaborate with data stewards and analysts to align curated datasets with institutional reporting and governance requirements. 3. Framework Development and Continuous Improvement - Implement version-controlled, repeatable processes for dataset deployment including pipeline creation, dataset publication, and documentation to accelerate institutional data projects. - Continuously assess and optimize transformation logic, orchestration performance, and overall data-engineering practices to reduce overhead and improve time-to-insight. - Contribute to the evolution of the university’s data architecture roadmap and play a key role in scaling the Fabric environment. - Share expertise and mentor colleagues on data engineering standards, fostering a culture of data literacy and collaboration. Collaboration & Communication - Works closely with: Institutional Research and some cross-departmental collaboration. - May support or guide: Director of Information Technology and the university. Expectations for Growth As the university’s data ecosystem expands, the Cloud Data Engineer will take on increasing responsibility for designing and scaling the institutional data framework. Growth in data volume, source systems, and analytical complexity will require deeper technical expertise in Microsoft Fabric, pipeline orchestration, and dataset curation. The individual in this role is expected to evolve alongside emerging data technologies and the university’s strategic priorities. Ongoing development may include advanced certifications in Microsoft Fabric and Azure Data Engineering, deeper specialization in data modeling and orchestration, and active participation in professional data engineering and higher education analytics communities. Expectations for Growth As the university’s enterprise systems mature, the Enterprise Systems Project Manager will take on broader responsibility for leading complex, cross-functional technology initiatives beyond the initial stabilization and transition period. The role is expected to evolve from recovery-focused project leadership into increased involvement with enterprise planning, system enhancements, and future-state evaluation of CRM, SIS, and related platforms. Ongoing growth in this role requires deeper institutional knowledge, stronger change-management skills, and continued development in project and program leadership practices. Professional development may include advanced project management training, expanded exposure to enterprise systems and integrations, and participation in higher education technology or project management communities, with opportunities to help shape institutional standards for enterprise project delivery. Reach University is an accredited, nonprofit institution reshaping higher education - one where a job leads to a degree, not the other way around. Through the Apprenticeship Degree, Reach transforms workplaces into university learning spaces, allowing working adults to earn credit for the work they do on the job and leverage deep learning through inquiry, dialogue, collaboration, and on-the-job practice in their everyday experience. At Reach, we envision a world where everyone, everywhere can access fully job-embedded higher education - where effort and skill, not wealth or connections, determine who gets ahead. Reach is building pathways for professionals to grow their impact, advance their careers, and stay rooted in the communities they serve.We’re building a world where higher education is both higher and within reach. Learn more at reach.edu Benefits: - Health Insurance: We provide medical, vision, and dental insurance plans to ensure you and your family are well-covered. Plus additional wellness programs. - Flexible Time Off: We offer a flexible "Flexible Time Off" policy, empowering you to take the time you need when you need it, without the constraints of a traditional vacation policy. - Flexible Remote-Only Workplace: Enjoy the freedom to work from anywhere with our flexible remote-only work environment, fostering a balance of workload and rest - Professional Development Support: We are committed to your growth and development, offering support for professional development opportunities to help you advance in your career. Salary The salary range for this role is between $100-115k. Equal Opportunity Employer Reach University is committed to creating a diverse work environment and is proud to be an equal opportunity employer. Reach University does not discriminate on the basis of race, color, national origin, sex, gender identity, religion, sexual orientation, age, disability, parental status, veteran status, or any other protected status under applicable laws. We encourage individuals of all backgrounds to apply. If you are a qualified candidate with a disability, please e-mail us at PeopleOps@reach.edu if you require a reasonable accommodation to complete this application.
Join Zepz: Breaking Down Borders, Together Our Meaningful MissionAt Zepz, we're all about breaking down barriers for our customers and our teammates. Our purpose is deeply personal, we provide a lifeline and deliver opportunities to cross-border communities that need it most through cutting edge finance and tech. Zepz is the power behind WorldRemit and Sendwave, driven by the mission to celebrate the incredible impact migrants have, both at home and abroad. We're not just moving money; we're building a world that truly recognizes and supports global connections.Who You'll Be JoiningWe look for mission-driven builders who thrive in a fast-paced environment connected to a true purpose. We’re an always developing team of experts that enjoy problem solving and bring clarity to tough challenges. At Zepz, we are Relentless Learners, always seeking feedback, and Responsible Owners, treating company resources like your own. We depend on Transparent Communicators who keep the team aligned through open, honest talk.Our Core Commitments — What We Live ByOur vibrant and truly diverse culture is built on three core commitments, that guide how we work and interact: - Integrity: We always do the right thing. It’s simple, but it’s the foundation of everything we build for our customers and each other. - Outcomes: We work for our customers. Their success and prosperity are the results we focus on delivering. - Velocity: We are fast! We maintain high energy levels and make smart decisions quickly, keeping us nimble and ahead of the curve. Perks of Joining Our TeamWe believe in empowering colleagues because we genuinely trust our team. Our culture is founded on this high trust, which naturally encourages the high ownership that drives us to meet our shared high expectations and deliver high performance. Our remote-first culture means you have the flexibility to work in your employing country wherever you feel the most focused and productive. This freedom comes with wonderful tailored, location-specific perks designed to support your whole life, not just your work. Think unlimited annual leave , great healthcare benefits, and employee discounts. We want you to thrive and focus entirely on making your biggest impact! In turn, we expect you to bring high ownership and commitment to your work. This is a place where we value trust and high performance, and we'll provide the environment and support needed for you to excel. About the Role We are looking for a Senior Data Analytics Engineer to help us optimize our business strategy using the latest data techniques. This role is key to setting the roadmap for a highly efficient and scalable data function that will grow with the ambitious plans for the business. Reporting to Product, you will collaborate with Product, Engineering, Data Science, and the wider organization. You will build and maintain new data models, optimize existing ones, and work with a wide variety of technologies and datasets to drive real insight and recommendations. You'll be a driving force in identifying trends, quantifying opportunities, and setting the requirements to develop data-driven solutions that have a direct impact on the business. Our current Data Platform tech stack includes: - Data Lakehouse: Databricks - Cloud & Infrastructure: AWS (S3, Lambda), Kubernetes - Data Processing: Python is our primary language - Orchestration & Transformation: dbt, Fivetran, and Airflow - Visualization: Mode and similar BI tools - Data monitoring and alerting: Metaplane What You'll Do - Data Modeling & Pipelines: Build and maintain scalable and reliable data models to expose high-quality data for analysis and reporting. Where needed, deliver dashboards to drive more self service on data among teams. - Stakeholder Collaboration: Work closely with analysts and business stakeholders to understand commercial requirements, translating them into technical solutions that enable reliable self-serve data for decision-making. - Strategic Analysis: Work in a collaborative, cross-functional way to identify and quantify opportunities, enabling data-driven business decisions and identifying opportunities for improvement through analysis, A/B testing, and tracking, with a strong emphasis on extracting actionable, in-depth business insights. - Data Governance & Quality: Ensure all data and output is of high quality — tested, automated, scalable, and well-documented. You will develop standards and best practices for data consumption and educate data consumers. - Champion Data Culture: Champion the use of data to optimize business performance and bring fresh analytical ideas to the table. - Communication & Presentation: Present results and complex concepts back to the business in a structured, data-driven manner, simplifying them for non-technical audiences. - Process Improvement: Identify opportunities to reduce complexity and increase efficiency across our data models and data warehouse infrastructure. - Data Cleansing & Transformation: Develop and implement robust data cleansing, validation, and transformation processes to ensure the accuracy, consistency, and reliability of data across all sources. - Insight Storytelling: Translate complex analytical findings into clear, compelling narratives and visualizations for both technical and non-technical audiences, influencing strategic decision-making. What We’re Looking For From You - You are highly proficient with daily use of SQL and have hands-on experience in a modern cloud data warehouse/ lakehouse environment (e.g., Databricks, BigQuery, Redshift, Snowflake). - You’re comfortable automating processes and developing production-standard Python scripts to extract data, perform analysis, and build pipelines. - You have the ability to work confidently with the tools of modern software engineering, such as the command line, version control (Git), testing, and performing code reviews. - You have a problem-solving approach that gets to the underlying business questions, using a variety of data sources and information to find the answer. - You see yourself as a strategic partner who wants to understand the business problem and can clearly communicate the commercial impact of your technical solutions. - You are an advocate for data-driven decision-making who strives to improve processes, establish best practices, and define standards. - You are passionate about learning, able to quickly adopt new business concepts and technologies, and are an independent, curious person who likes to take initiative. - You have an open mind with respect to diversity and inclusivity. Our team (and customers) come from all over the world. Bonus Points - You have familiarity with dbt to design and implement data models. - Experience with data orchestration tools - AML Transaction Monitoring definition, calibration, testing and documentation. Experience with regulatory testing regimes such as DFS rule 504 a plus. - Customer risk rating definition, calibration, testing and documentation. If you want to join us in our journey to help break barriers in financial access and improve lives globally, there's no better place or time to join. Our global team of 800+ people is spread across six continents. We aspire to hire the best mix of people from former Olympians to YouTube influencers and we speak over twenty languages. This incredible diversity isn't a bonus; it's the engine that lets us serve the world. Ready to Apply? Let’s Go.
Join Zepz: Breaking Down Borders, Together Our Meaningful Mission At Zepz, we're all about breaking down barriers for our customers and our teammates. Our purpose is deeply personal, we provide a lifeline and deliver opportunities to cross-border communities that need it most through cutting edge finance and tech. Zepz is the power behind WorldRemit and Sendwave, driven by the mission to celebrate the incredible impact migrants have, both at home and abroad. We're not just moving money; we're building a world that truly recognizes and supports global connections.Who You'll Be Joining We look for mission-driven builders who thrive in a fast-paced environment connected to a true purpose. We’re an always developing team of experts that enjoy problem solving and bring clarity to tough challenges. At Zepz, we are Relentless Learners, always seeking feedback, and Responsible Owners, treating company resources like your own. We depend on Transparent Communicators who keep the team aligned through open, honest talk.Our Core Commitments — What We Live By Our vibrant and truly diverse culture is built on three core commitments, that guide how we work and interact: - Integrity: We always do the right thing. It’s simple, but it’s the foundation of everything we build for our customers and each other. - Outcomes: We work for our customers. Their success and prosperity are the results we focus on delivering. - Velocity: We are fast! We maintain high energy levels and make smart decisions quickly, keeping us nimble and ahead of the curve. About the Role We are seeking a highly skilled and experienced Staff Analytics Engineer to join our dynamic team. This pivotal role will focus on supporting critical data needs and developing foundational data models that are essential for driving our cross-border remittances business forward. You will leverage your expertise in data warehousing, transformation, and modeling to build robust and scalable data solutions. Responsibilities - Data Modeling: Design, implement, and evolve data models to support the organization's core datasets. This includes creating new models and enhancing existing ones to meet emerging business needs. - Tooling & Data Ownership: Lead the adoption of data transformation tools (e.g., dbt) to empower teams in their data-driven decision-making processes. - Data Processing Framework: Develop and implement a robust framework that establishes high-quality data processing standards. This includes ensuring comprehensive testing, automation, scalability (for both data volume and federated governance), and adoption through thorough documentation and training. - Business Partnership: Collaborate with data scientists, analysts, and business stakeholders to translate commercial objectives into well-defined technical projects, ensuring reliable self-serve data for strategic decision-making. - Organizational Data Value: Foster cross-organizational relationships to understand data usage patterns and identify opportunities for efficient value extraction. - Data Consumption Standards: Establish and promote best practices for data consumption, educating users on data quality, availability, and interpretation. - Data Pipeline Optimization: Optimize data pipelines to reduce data warehouse complexity and costs through efficient transformations. Qualifications - Experience: 5+ years of experience in data engineering, analytics engineering, or a similar role. - Data Warehousing: In-depth knowledge and hands-on experience with data warehousing concepts and technologies. - Data Transformation: Proven expertise in designing and implementing ETL/ELT processes. - Data Modeling: Strong understanding and experience with various data modeling techniques (e.g., Kimball, Inmon). - Data Formats: Experience with modern data lake formats such as Delta Lake and Iceberg. - Technical Skills: Proficiency in SQL and at least one programming language (e.g., Python, Scala). - Problem-Solving: Excellent analytical and problem-solving skills with a strong attention to detail. - Communication: Strong communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders. Preferred Qualifications - Experience in the financial services or FinTech industry, particularly with cross-border payments. - Familiarity with cloud data platforms (e.g., AWS, GCP, Azure). - Experience with data warehouse/lakehouse technologies (e.g. Databricks). - Experience with workflow orchestration tools (e.g., Astronomer, Apache Airflow). - Proficiency in data modeling tools (e.g. dbt) - Familiarity with data observability tools (e.g. Metaplane, Datadog). Perks of Joining Our Team We believe in empowering colleagues because we genuinely trust our team. Our culture is founded on this high trust, which naturally encourages the high ownership that drives us to meet our shared high expectations and deliver high performance. Our remote-first culture means you have the flexibility to work in your employing country wherever you feel the most focused and productive. This freedom comes with wonderful tailored, location-specific perks designed to support your whole life, not just your work. Think unlimited annual leave , great healthcare benefits, and employee discounts. We want you to thrive and focus entirely on making your biggest impact! In turn, we expect you to bring high ownership and commitment to your work. This is a place where we value trust and high performance, and we'll provide the environment and support needed for you to excel. If you want to join us in our journey to help break barriers in financial access and improve lives globally, there's no better place or time to join. Our global team of 800+ people is spread across six continents. We aspire to hire the best mix of people from former Olympians to YouTube influencers and we speak over twenty languages. This incredible diversity isn't a bonus; it's the engine that lets us serve the world. Ready to Apply? Let’s Go.
Senior Data Engineer
Centene CorporationTransforming the health of the communities we serve, one person at a time.
• Develops and operationalizes data pipelines to make data available for consumption • Engages with the DevSecOps Engineer during continuous integration and continuous deployment • Provides guidance to data engineers in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures • Designs, develops, and maintains real-time processing applications and real-time data pipelines • Ensure quality of technical solutions as data moves across Centene’s environments • Drives ways to improve data reliability, efficiency, and quality and deploys a solution


