Job Closed
This listing is no longer active.
ETL Developer / Data Engineer
Location
India
Posted
58 days ago
Salary
0
Seniority
Mid Level
Job Description
ETL Developer / Data Engineer
Software Engineering Firm
Role Description - Design, develop, and maintain ETL pipelines using DBT and other data integration tools. - Collaborate with data engineers, analysts, and business teams to define requirements and deliver data solutions. - Build and optimize data models (star/snowflake schemas, fact/dimension tables) to support reporting and analytics. - Write, test, and document DBT models and macros for data transformation. - Implement data quality checks, testing, and validation frameworks within DBT. - Optimize query performance and troubleshoot pipeline bottlenecks. - Manage version control (Git), deployment, and CI/CD pipelines for DBT projects. - Ensure compliance with data governance, security, and privacy standards. - Stay updated with the latest modern data stack technologies (Snowflake, BigQuery, Redshift, Airflow, Fivetran, etc.). Qualifications - Proven experience as an ETL Developer / Data Engineer with hands-on DBT expertise. - Strong knowledge of SQL and relational databases (Snowflake, Redshift, BigQuery, PostgreSQL, etc.). - Experience in cloud data warehouses and modern ELT/ETL frameworks. - Proficiency in data modeling (Kimball/Inmon methodologies). - Familiarity with version control (Git), CI/CD pipelines, and collaborative workflows. - Understanding of data governance, security, and quality best practices. - Strong problem-solving skills with the ability to optimize and debug pipelines.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design end-to-end data architectures (batch/streaming ingestion, processing, storage in Lakehouse/Warehouse and consumption via BI/APIs/ML) • Build and maintain the Data Map (inventory of sources, pipelines and consumers) and perform domain-oriented conceptual/logical modeling • Define taxonomies, classify sensitive data, and support privacy and compliance requirements • Produce technical artifacts (HLD, LLD, ADRs, C4/DFD diagrams) and present/defend solutions in architecture committees • Maintain continuous collaboration with Data Engineering, Security, Platform teams and Business areas.
Senior Data Engineer
Kaufland e-commerceElevate e-commerce - and yourself - on a daily basis. Develop the e-commerce of the future with us.
Role Description Your tasks – this is what awaits you in detail: - You design, develop and maintain our streaming and CDC backbone (Apache Kafka, Debezium, Schema Registry, BigQuery Sinks) and our self-built workflow management platform Navarch, running on Kubernetes. - You drive architectural initiatives across the platform end-to-end — from idea to production — spanning streaming, orchestration, the warehouse and the observability layer that sits across them. - You operate and evolve our BigQuery multi-project setup, shaping access management, partitioning, slot strategy and cost-aware design patterns. - You shape how the platform supports domain analysts who ship their own pipelines — clear ownership boundaries, quality safeguards, and less hand-off friction between producers and the platform team. - You build and maintain observability across the data platform (Datadog, Slack-native alerting, cost dashboards) and you take care of our CI/CD pipelines on our self-hosted GitLab instance. - You shape how we manage BigQuery and Kafka cost at platform scale — FinOps is a live practice on this team, not a one-off. - You bring a senior perspective into architectural decisions across the platform — design reviews, merge-request reviews, and the multi-quarter initiatives the team runs. Qualifications - You have several years of senior-level data-engineering experience, demonstrated by independent ownership of production systems — running on-call, shipping cross-component changes, and influencing architecture without process scaffolding around you. - You have strong problem-solving skills with a demonstrated ability to troubleshoot complex, cross-component issues (schema evolution, broker lag, query performance, cost anomalies). - You have professional experience in software engineering using Python and you have a working command of SQL on top of cloud data warehouses — partitioning, clustering, query cost, idempotency. - Strong experience with object-oriented programming and software design patterns, applied to data engineering applications. - You have hands-on experience with at least four of the following technologies: - Message brokers, ideally Apache Kafka (broker operations, schema registry, KRaft). - Change data capture, ideally Debezium. - Orchestration tools (in-house, Airflow, Dagster or similar). - Public Cloud Providers, ideally Google Cloud Platform. - Container orchestration, ideally Kubernetes (Helm, operators, KEDA/VPA). - Infrastructure as Code, ideally Terraform and/or Ansible. - Data modeling and transformation, ideally dbt or comparable. - You can articulate trade-offs in your past decisions — batch vs. stream, build vs. buy, latency vs. cost, isolation vs. coupling — with concrete numbers from your own work. - You thrive in a Kanban-style, low-process environment where seniors organise their own work and rotate triage weekly. - You are fluent in English (C1) and enjoy working in a dynamic, international environment. Benefits - Create your own work-life balance: You have the flexibility to choose between working remotely (within Germany) or from one of our locations in Cologne, Darmstadt, Düsseldorf, or in Berlin! - Do you want to move to Germany? No problem – we offer you an attractive relocation package to give you a smooth start. - Urban Sports Club and RSG Group Fitness Studios: Get top deals for fitness, swimming, yoga and more. - Mental Well-Being: We support you on your well-being journey with special offerings such as Instahelp, the digital platform for online psychological counseling. - Vacation & Sabbatical: Enjoy 30 days of vacation per year and the opportunity to take a sabbatical once you have been part of the team for a certain period! - Option for Pluxee restaurant vouchers: Buy Pluxee vouchers through us and benefit from tax-advantaged meal allowances! - ‘Deutschlandticket’: We subsidize your train season ticket for more mobility. - Employee Discount: You will receive a monthly coupon for Kaufland.de. - Free choice of operating system: MacOS or Ubuntu Linux, it's up to you. - Boost your growth: Benefit from our online language learning programs, diverse in-house training, and our automated 360-degree feedback. We cover the costs for relevant conferences, training opportunities, and approved team workshops to strengthen personal interactions.
• Diseñar e implementar soluciones analíticas y de datos en Microsoft Azure • Desarrollar pipelines y notebooks (PySpark, Spark SQL, SparkR, Python, T-SQL) para la integración, transformación y explotación de datos • Valoración de experiencia en Fabric y con gobernanza y catalogación de datos con Microsoft Purview
• Senior Data Architect serves as an experienced individual contributor within a team, with the expectation that you will further develop your leadership, guidance, and mentoring skills • With minimal oversight from leadership, you will be responsible for supporting the goal of meeting scope, schedule, and delivery requirements • A Senior Data Architect impacts the long-term goals of the program, while contributing to the development of the program's data architecture strategy • You may serve as the discipline's primary lead when working with stakeholders and utilize strong influential skills to drive improvements in data architecture processes and practices • Lead complex legacy data migrations end-to-end, including schema mapping, data profiling, phased migration sequencing, parallel-run validation, and cutover with automated rollback procedures • Design and maintain cloud-native data pipelines using event-driven infrastructure (SNS/SQS, Lambda/Step Functions) to support BI and analytics workflows • Architect data analytics repositories that are production-ready, monitored, and fully documented so agency staff and external tools can operate without contractor dependency • Manage digital artifact and content management lifecycles including upload, storage, review, and archiving across AWS and Azure/M365 environments • Drive data governance across programs, including lineage documentation, dictionary standardization, and glossary development • Align data architecture and standardize access patterns to make data available to BI tools, apps, and web platforms • Translate business and agency requirements into functional BI portals and dashboards • Present architectural decisions clearly to mixed audiences, from engineers to product owners to federal agency stakeholders • Mentor junior analysts and engineers and participate in technical interviews and candidate evaluations • May lead small, less critical, or temporary structures and projects



