Job Closed
This listing is no longer active.
Data-Driven Networking
Lead Data Engineer
Location
India
Posted
80 days ago
Salary
0
Seniority
Senior
Job Description
Lead Data Engineer
Arista Networks
• Collaborate with stakeholders and source data system teams to understand data requirements • Architect and implement scalable workspace, data lake, dimensional models, data pipelines, data warehouses and other ETL/ELT processes using Fabric. • Work with Fabric assets, Power BI, and other services to build end-to-end data solutions • Ensure data quality, security, and compliance with regulations by implementing data validation, logging, monitoring, and role-based access controls. • Perform root cause analysis on internal/external data and processes to answer specific business questions and identify opportunities for improvement. • Manage platform cost optimization, data quality/governance, and performance tuning • Follow software quality process and methodology standards, including those for design, data quality, code, version control, defect/change request tracking, documentation, work product review, unit testing and environment management. • Review requirements / user stories and provide feedback to the team. Includes participation/input to the requirements process • Integrate AI/ML models and GenAI capabilities into data products and workflows • Help the QA and functional team to identify and define testing strategies for existing and new features • Ability to ensure that solutions developed by development teams fit the business needs • Able to work under pressure and meet deadlines • Comfortable working in evening hours (2pm to 11pm IST)
Job Requirements
- 8+ years of experience in data engineering roles, preferably in a global enterprise environment
- Strong hands-on experience with Microsoft Fabric, Data Lake, Data Warehouse, Data pipelines and related broader Microsoft ecosystem.
- Expertise in Power BI semantic models and datasets for building dashboards and reports
- Strong DAX and Power Query skills
- Expert proficiency in SQL, Python, PySpark for data processing
- Must have implemented ETL solutions to integrate data from various sources into Azure Data Lake and Data Warehouse
- Good knowledge of EDW
- Strong understanding of data management processes, such as data normalisation and modelling, as well as data security principles, data access control and confidentiality.
- Good to have experience in Copilot or any AI/ML solutions with at least basic exposure to GenAI (LLMs, prompt engineering, AI API integration)
- Familiar with software quality assurance best practices & methodologies, and tools like Jira, GIT, etc.
- Experience with other SaaS/Cloud ERP, CRM systems like NetSuite or Salesforce or SAP S4/Hana is a plus
- Excellent problem-solving, communication, and collaboration skill
Benefits
- Professional development opportunities
- Remote work options
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer / Data Architect, Consultant
IANSIANS was originally established in 2001 as the Institute for Applied Network Security. Today, this company provides security insights and decision support throu
• Design and build a scalable, org-wide data architecture that serves as the backbone for all current and future products. • Design, build, and maintain data pipelines and ETL/ELT processes across Azure SQL Server, PostgreSQL, Elasticsearch, and third-party sources (Salesforce, APIs). • Evaluate and support a potential migration from MSSQL to PostgreSQL, including feasibility analysis, schema translation, deadlock remediation, performance benchmarking, and migration planning. • Build and maintain a centralized data warehouse or data platform to support analytics, reporting, AI/ML workflows, and our broader data-as-a-service. • Architect metadata models, taxonomies, and tagging systems that enable content enrichment across products (e.g., tagging content with vendors, team size, revenue, industry). • Collaborate with engineering, product, and AI teams to define data models and ensure clean, consistent data flows across systems. • Implement data quality checks, monitoring, and alerting to maintain data integrity across all data products. • Document data architecture, lineage, and dictionary standards for the engineering team. • Support and improve existing Azure SQL databases, Redis caching layers, and Elasticsearch clusters. • Identify and resolve data bottlenecks, query performance issues, and infrastructure gaps.
• Design and maintain scalable data pipelines. • Structure, transform, and optimize data in Snowflake. • Implement multi-source ETL/ELT flows (ERP, APIs, files). • Leverage the AWS environment, including S3, IAM, and various data services. • Prepare data for Data Science teams and integrate AI/ML models into production. • Ensure data quality, security, and governance. • Provide input on data architecture.
Senior Data Engineer
Flock SafetyWe are the first public safety operating system empowering over 2500 cities to eliminate crime.
• The Nova team is building a “single pane of glass” for investigators. The purpose is to connect the investigator to the many disparate sources of data they already have access to in order to make it easier to “connect the dots” and build a picture around their case work. • The technical challenges to enable these tools are diverse and sophisticated. • The team needs a strong engineer to build integrations to the many data sources as well as build stronger bindings to the overall Flock Software Platform. • Our engineers work directly with our customers and are able to react with high value and often real life impacting results. • Flock believes that many facets of our work are “Better Together” and that infuses how we think about the various products we offer as well as how we work together individually and collectively. This provides a vast opportunity to work across multiple teams and skillsets and not only elevate the company but our engineers as well.
• Define the enterprise data architecture vision aligned with business strategy and digital transformation goals. • Design conceptual, logical, and physical data models for domain-driven systems. • Establish target-state architectures for data platforms (cloud, hybrid, on-prem). • Evaluate and select core technologies, taking into consideration specific customer needs, priorities and current architecture • Architect scalable data pipelines (ETL/ELT). • Define integration standards (APIs, CDC, event-driven architectures). • Optimize data lake, lakehouse, and warehouse architectures. • Design high availability, disaster recovery, and backup strategies. • Enforce security controls: encryption, IAM, row-level security, masking. • Evaluate emerging paradigms (data mesh, lakehouse, streaming-first architectures). • Assess tools for orchestration and transformation (e.g., Apache Airflow, dbt). • Prototype proof-of-concept architectures. • Ensure architectural flexibility for AI, advanced analytics, and real-time insights.



