Job Closed

This listing is no longer active.

Arrow Electronics logo
Arrow Electronics

Five Years Out

Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 10,001+Since 1935H1B SponsorCompany SiteLinkedIn

Location

India

Posted

29 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishAzureETLJenkinsPandasPySparkPythonSQLUnity

Job Description

Data Engineer

Arrow Electronics

• Build and operate scalable, reliable data pipelines on Azure • Develop batch and streaming ingestion, transform data using Databricks (PySpark/SQL), ADF • Design, build, and maintain ETL/ELT pipelines in Azure Data Factory and Databricks across Bronze → Silver → Gold layers/Medallion Architecture • Implement Delta Lake best practices (ACID, schema evolution, MERGE/upsert, time travel, Z-ORDER) • Write performant PySpark and SQL; tune jobs (partitioning, caching, join strategies) • Create reusable components; manage code in Git; contribute to CI/CD pipelines (Azure DevOps/GitHub Actions/Jenkins) • Apply data quality checks (Great Expectations or custom validations), monitoring, drift detection, and alerting • Model data for analytics (star/dimensional); publish to Synapse/Snowflake/SQL Server • Uphold governance and security (Purview/Unity Catalog lineage, RBAC, tagging, encryption, PII handling) • Author documentation/runbooks; support production incidents and root-cause analysis; suggest cost/performance improvements

Job Requirements

  • 4–6 years of professional experience in data engineering (or equivalent project depth)
  • Bachelor’s/Master’s in CS/IT/Engineering or related field (or equivalent practical experience)
  • Hands-on experience building production pipelines with Azure Data Factory and Databricks (PySpark/SQL)
  • Working knowledge of Medallion Architecture and Delta Lake (schema evolution, ACID)
  • Strong Python (pandas/PySpark) and SQL
  • Practical Git workflow; experience integrating pipelines into CI/CD (Azure DevOps/GitHub Actions/Jenkins)
  • Familiarity with packaging reusable code (e.g., Python wheels) and configuration-driven jobs
  • Solid grasp of dimensional modeling/star schemas; experience with Synapse, Snowflake, or SQL Server
  • Implemented validation checks and alerts; exposure to drift detection and pipeline observability
  • Experience with metadata/lineage (Purview/Unity Catalog), RBAC, secrets management, and secure data sharing
  • Understanding of PII/PHI handling and encryption at rest/in transit
  • Clear communication, documentation discipline, Agile ways of working, and code reviews

Benefits

  • Health insurance
  • Paid time off
  • Professional development
  • Flexible work arrangements

Related Categories

Related Job Pages

More Data Engineer Jobs

Software Mind logo

Data Engineer

Software Mind

Software House focused on results since 1999

Data Engineer29 days ago
Full TimeRemoteTeam 1,001-5,000Since 1999H1B No Sponsor

• Design and implement batch and real-time ingestion pipelines from internal and external sources • Implement automated data quality checks, observability, and SLA monitoring • Support master data management, metadata, lineage, and access controls • Optimise datasets and pipelines for analytics, ML training, and API consumption • Work closely with Data Scientists and ML Engineers to support feature and model needs • Contribute to long term platform roadmap and AI readiness

Poland
Serv Recruitment Agency logo

Principal Data Engineer

Serv Recruitment Agency

Boutique Recruitment Agency sourcing Leaders for growth businesses.

Data Engineer29 days ago
Full TimeRemoteTeam 1-10Since 2018H1B No Sponsor

• Own the design and delivery of the company’s data platform • Define and own the foundational data architecture including data models and relationships • Establish data contracts and guide the evolution to analytical and AI-ready systems • Design and build end-to-end data pipelines from ingestion through serving layers • Implement scalable ingestion from relational databases, object storage, event streams, and SaaS APIs • Establish data quality, observability, schema management, and pipeline reliability standards • Design multi-tenant data models, storage layouts, and access patterns • Implement tenant-aware security including row-level and column-level controls • Define data lifecycle management including retention, archival, and deletion strategies • Establish data governance standards including classification, lineage, and auditability • Partner with security and compliance teams to ensure privacy and regulatory alignment • Design serving layers for analytics, reporting, and internal business use • Prepare data systems to support AI-enabled capabilities including embeddings and advanced data structures • Evaluate and implement graph-based data models where appropriate • Mentor engineers and provide architectural oversight • Drive data literacy and data-informed decision making across the organization

United States
Job Closed
EVT logo

Data Engineer – Databricks

EVT

We Connect People with Technology

Data Engineer29 days ago
ContractRemoteTeam 501-1,000Since 1999H1B No Sponsor

• Work on a global project, supporting the construction and maintenance of data pipelines and processing in a cloud environment. • Develop and tune data flows. • Collaborate with international teams.

Brazil
Job Closed

Senior Specialist - Data Engineering

LTIMindtree

LTIMindtree is a global technology consulting and digital solutions company that aims to empower businesses through cutting-edge solutions that accelerate digit

Data Engineer29 days ago

Role Description Analista de Polticas de Cobrana Snior Modalidade 100% Remoto | Tipo Efetivo CLT O que você vai fazer: - Analisar o comportamento de clientes em atraso curto, médio e longo prazo para encontrar oportunidades de melhoria. - Criar e ajustar políticas de cobrança baseadas em dados para reduzir o risco e aumentar a recuperação. - Usar SQL e Python para extrair insights e gerar relatórios estratégicos. - Explicar para as áreas de negócio e vendas por que as estratégias analíticas funcionam e provar o valor das soluções. - Trabalhar em conjunto com os times de Ciência de Dados e Operações. Qualifications - Experiência: Já ter trabalhado com análise de dados voltada para cobrança ou risco de crédito. - Técnica: Domínio de SQL, BigQuery e Python. - Visão Prática: Conseguir transformar números em ações que resolvam os problemas dos clientes. - Comunicação: Saber explicar resultados complexos de um jeito simples para diferentes times. - Formação: Ensino superior completo em Exatas, Engenharias, Economia ou áreas correlatas. Diferenciais - Conhecimento em políticas de desconto, acesso de carteira e precificação. - Inglês.

Brazil