Job Closed
This listing is no longer active.
Five Years Out
Data Engineer
Location
India
Posted
29 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
Arrow Electronics
• Build and operate scalable, reliable data pipelines on Azure • Develop batch and streaming ingestion, transform data using Databricks (PySpark/SQL), ADF • Design, build, and maintain ETL/ELT pipelines in Azure Data Factory and Databricks across Bronze → Silver → Gold layers/Medallion Architecture • Implement Delta Lake best practices (ACID, schema evolution, MERGE/upsert, time travel, Z-ORDER) • Write performant PySpark and SQL; tune jobs (partitioning, caching, join strategies) • Create reusable components; manage code in Git; contribute to CI/CD pipelines (Azure DevOps/GitHub Actions/Jenkins) • Apply data quality checks (Great Expectations or custom validations), monitoring, drift detection, and alerting • Model data for analytics (star/dimensional); publish to Synapse/Snowflake/SQL Server • Uphold governance and security (Purview/Unity Catalog lineage, RBAC, tagging, encryption, PII handling) • Author documentation/runbooks; support production incidents and root-cause analysis; suggest cost/performance improvements
Job Requirements
- 4–6 years of professional experience in data engineering (or equivalent project depth)
- Bachelor’s/Master’s in CS/IT/Engineering or related field (or equivalent practical experience)
- Hands-on experience building production pipelines with Azure Data Factory and Databricks (PySpark/SQL)
- Working knowledge of Medallion Architecture and Delta Lake (schema evolution, ACID)
- Strong Python (pandas/PySpark) and SQL
- Practical Git workflow; experience integrating pipelines into CI/CD (Azure DevOps/GitHub Actions/Jenkins)
- Familiarity with packaging reusable code (e.g., Python wheels) and configuration-driven jobs
- Solid grasp of dimensional modeling/star schemas; experience with Synapse, Snowflake, or SQL Server
- Implemented validation checks and alerts; exposure to drift detection and pipeline observability
- Experience with metadata/lineage (Purview/Unity Catalog), RBAC, secrets management, and secure data sharing
- Understanding of PII/PHI handling and encryption at rest/in transit
- Clear communication, documentation discipline, Agile ways of working, and code reviews
Benefits
- Health insurance
- Paid time off
- Professional development
- Flexible work arrangements
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design and implement batch and real-time ingestion pipelines from internal and external sources • Implement automated data quality checks, observability, and SLA monitoring • Support master data management, metadata, lineage, and access controls • Optimise datasets and pipelines for analytics, ML training, and API consumption • Work closely with Data Scientists and ML Engineers to support feature and model needs • Contribute to long term platform roadmap and AI readiness
Principal Data Engineer
Serv Recruitment AgencyBoutique Recruitment Agency sourcing Leaders for growth businesses.
• Own the design and delivery of the company’s data platform • Define and own the foundational data architecture including data models and relationships • Establish data contracts and guide the evolution to analytical and AI-ready systems • Design and build end-to-end data pipelines from ingestion through serving layers • Implement scalable ingestion from relational databases, object storage, event streams, and SaaS APIs • Establish data quality, observability, schema management, and pipeline reliability standards • Design multi-tenant data models, storage layouts, and access patterns • Implement tenant-aware security including row-level and column-level controls • Define data lifecycle management including retention, archival, and deletion strategies • Establish data governance standards including classification, lineage, and auditability • Partner with security and compliance teams to ensure privacy and regulatory alignment • Design serving layers for analytics, reporting, and internal business use • Prepare data systems to support AI-enabled capabilities including embeddings and advanced data structures • Evaluate and implement graph-based data models where appropriate • Mentor engineers and provide architectural oversight • Drive data literacy and data-informed decision making across the organization
• Work on a global project, supporting the construction and maintenance of data pipelines and processing in a cloud environment. • Develop and tune data flows. • Collaborate with international teams.
Senior Specialist - Data Engineering
LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that aims to empower businesses through cutting-edge solutions that accelerate digit
Role Description Analista de Polticas de Cobrana Snior Modalidade 100% Remoto | Tipo Efetivo CLT O que você vai fazer: - Analisar o comportamento de clientes em atraso curto, médio e longo prazo para encontrar oportunidades de melhoria. - Criar e ajustar políticas de cobrança baseadas em dados para reduzir o risco e aumentar a recuperação. - Usar SQL e Python para extrair insights e gerar relatórios estratégicos. - Explicar para as áreas de negócio e vendas por que as estratégias analíticas funcionam e provar o valor das soluções. - Trabalhar em conjunto com os times de Ciência de Dados e Operações. Qualifications - Experiência: Já ter trabalhado com análise de dados voltada para cobrança ou risco de crédito. - Técnica: Domínio de SQL, BigQuery e Python. - Visão Prática: Conseguir transformar números em ações que resolvam os problemas dos clientes. - Comunicação: Saber explicar resultados complexos de um jeito simples para diferentes times. - Formação: Ensino superior completo em Exatas, Engenharias, Economia ou áreas correlatas. Diferenciais - Conhecimento em políticas de desconto, acesso de carteira e precificação. - Inglês.



