Gugu Robotics logo
Gugu Robotics

The Future is Now; Beyond Boundaries, Beyond Imagination

Data Engineer

Data EngineerData EngineerFull TimeRemoteLeadTeam 51-200Since 2016H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

2 days ago

Salary

0

Seniority

Lead

Bachelor Degree7 yrs expEnglishCloudKafkaPythonScalaSQL

Job Description

Data Engineer

Gugu Robotics

• We’re looking for a Staff Data Engineer to join a multi-disciplinary engineering team building modern, enterprise-grade data platforms. • In this role, you will design scalable data lakes, warehouses, and pipelines, define governance and quality standards, and drive data platform modernization across real, in-flight work where performance, reliability, and security are critical. • You’ll mentor more junior engineers, partner with leadership on data strategy, and bring an AI-forward mindset. • Define data architecture and platform strategy, leading design across pipelines, warehouses, and data lakes. • Build and optimize scalable data pipelines supporting batch and real-time processing. • Define and enforce data governance, quality standards, and compliance frameworks across the platform. • Build monitoring, logging, and alerting for data pipelines and services, and contribute to CI/CD workflows for data deployment and automation. • Drive data platform modernization, optimizing for performance, cost, and scalability. • Design and implement data contracts and event flows in collaboration with backend, platform, and engineering teams. • Lead the design and implementation of data pipelines for production AI/ML systems, including embeddings, vector stores, RAG data preparation, feature stores, and training/inference data flows. • Integrate data services with APIs, middleware, and third-party systems to support end-to-end data consumption.

Job Requirements

  • 7+ years of professional data engineering experience, with experience leading complex data platform initiatives
  • Strong system architecture background with expertise in distributed data systems
  • Expert proficiency in Python, Scala, and SQL
  • Deep expertise with cloud-native data platforms and enterprise data warehousing
  • Strong expertise in data pipeline orchestration and processing
  • Strong experience with streaming platforms and real-time data processing (e.g., Kafka, Kinesis, Pub/Sub)
  • Strong data modeling expertise and experience with data transformation
  • Strong experience with data quality, governance, and compliance frameworks
  • Strong experience with container orchestration and CI/CD for data systems
  • Strong experience building data pipelines for production AI/ML systems, including embeddings, vector stores, RAG data preparation, feature stores, and training/inference data flows
  • Demonstrated leadership and technical mentoring experience across a team or organization
  • Strong stakeholder communication skills, with the ability to translate technical depth across audiences
  • Demonstrable, day-to-day usage and expert knowledge of AI-forward coding tools such as Claude and Cursor
  • Excellent problem-solving skills and the ability to navigate highly ambiguous technical and business challenges with sound judgment
  • Experience with data mesh or data fabric concepts, lakehouse architectures, or governance framework implementation is a plus.

Benefits

  • Health insurance
  • 401(k) matching
  • Flexible work hours
  • Paid time off

Related Categories

Related Job Pages

More Data Engineer Jobs

Mid-Level Data Engineer / Analyst

Cogniify

We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other protected characteristic.

Data Engineer2 days ago

Role Description We’re seeking a Mid-Level Data Engineer/Analyst to independently design, build, and optimize data pipelines and analytics solutions that power business intelligence and AI/ML initiatives. In this role, you will own key data workstreams end to end, build production-grade transformation layers using dbt and Spark, manage data infrastructure on Snowflake and Databricks, and collaborate with analysts, data scientists, and product teams to deliver reliable, well-governed, and high-quality data products. You will also contribute to the maturity of our DataOps and data observability practices. - Design, build, and maintain production-grade ETL/ELT pipelines using dbt, Apache Spark (PySpark), Airflow, Dagster, or Prefect. - Develop and optimize data models on Snowflake, Databricks, BigQuery, or Redshift following dimensional modeling, data vault, or One Big Table patterns. - Implement and manage data ingestion from diverse sources including databases, REST/GraphQL APIs, event streams (Kafka, Kinesis), SaaS platforms, and flat files using Fivetran, Airbyte, or custom connectors. - Build and maintain semantic/metrics layers and curated data products for analytics, reporting, and self-service consumption. - Implement data quality, testing, and observability frameworks using dbt tests, Great Expectations, Soda, Monte Carlo, or Datafold. - Create advanced dashboards, reports, and analytical visualizations using Tableau, Looker, Power BI, or Sigma Computing. - Optimize query performance, pipeline efficiency, and cloud data platform costs across Snowflake, Databricks, or BigQuery. - Collaborate with data scientists and ML engineers to prepare and serve feature datasets for machine learning models. - Implement DataOps practices including CI/CD for data pipelines, version-controlled transformations, and automated testing. - Write production-quality Python and SQL code with proper testing, documentation, and error handling. - Support data governance initiatives including cataloging, lineage tracking, access controls, and PII management using tools like Alation, Atlan, DataHub, or Unity Catalog. Qualifications - Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field. - 3–5 years of professional experience in data engineering, analytics engineering, or a closely related role with production delivery. - Strong proficiency in SQL and experience writing complex transformations, window functions, CTEs, and performance-tuned queries. - Hands-on experience with at least one modern data platform: Snowflake (strongly preferred), Databricks, BigQuery, or Redshift. - Experience with dbt (data build tool) for data transformation, testing, and documentation in production environments. - Working knowledge of Python (Pandas, PySpark, or Polars) for data processing and pipeline development. - Experience with workflow orchestration tools: Airflow, Dagster, Prefect, or cloud-native equivalents (AWS Step Functions, Azure Data Factory). - Familiarity with data ingestion tools and patterns: Fivetran, Airbyte, CDC (Debezium), or streaming ingestion (Kafka, Kinesis). - Experience with data visualization and BI tools: Tableau, Looker, Power BI, or Sigma. - Understanding of data modeling methodologies (Kimball, Data Vault, OBT) and data warehousing best practices. - Familiarity with version control (Git), CI/CD for data, and Agile development workflows. Preferred Qualifications - Snowflake SnowPro Core, Databricks Data Engineer Associate, or AWS Data Analytics Specialty certification. - Experience with Apache Spark and Databricks for large-scale data processing and lakehouse architectures. - Familiarity with data cataloging and governance tools: Alation, Atlan, DataHub, Collibra, or Databricks Unity Catalog. - Experience with data observability platforms: Monte Carlo, Datafold, Soda, or Elementary. - Exposure to streaming data pipelines using Kafka, Spark Structured Streaming, Flink, or Kinesis. - Experience with metrics/semantic layers: dbt Semantic Layer, Cube, or Looker Modeling Language (LookML). - Knowledge of cloud data infrastructure: AWS (S3, Glue, Athena, Redshift, Lake Formation), Azure (ADLS, Synapse, Data Factory), or GCP (GCS, Dataflow, BigQuery). Benefits - Unlimited PTO. - Very generous parental leave, much above industry standards. - Entrepreneurial culture where pushing limits and taking risks is everyday business. - Open communication with management and company leadership. - Small, dynamic teams = massive impact. - Medical, Dental and Vision coverage for employees. - Access to Disability & Life insurance. - Mental health and wellbeing support. - Annual bonus program. - Employer Stock Purchase Program (ESPP). - Yearly Team building experiences. - Mentorship and sponsorship opportunities. - Manager resources and support.

United States
$91.9K - $144.1K / year
TEKsystems logo

Lead Azure Fabric Data Engineer

TEKsystems

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.

Data Engineer2 days ago
Full TimeRemoteTeam 10,001H1B No Sponsor

Role Description We are seeking a highly skilled Lead Data Engineer with strong expertise in Microsoft Fabric and Azure analytics ecosystem to design and deliver modern, scalable data platforms. The ideal candidate should be a good team player with 8 or more years of experience in data engineering with Microsoft technologies, deep hands-on expertise in Microsoft Azure Fabric platform (OneLake, Lakehouse, Data Factory pipelines, Synapse Data Engineering, Power BI), and preferably some experience with Azure AI/ML services. This role requires expertise in designing, developing, and deploying secure, scalable, and high-performance cloud-native analytics solutions, mentoring engineering teams, and close collaboration with architects, AI Engineers, Data Scientists, and business stakeholders to deliver impactful, data-driven solutions. This position will require up to 50% travel to customer sites as per project need. Essential Functions - Actively involved in requirement gathering workshops from customers, translating the functional requirements into technical solutions, and translating complex technical concepts into actionable insights for stakeholders. - Actively participates in architectural discussions independently or under guidance/supervision from Practice Architect to design and develop effective, efficient, reliable, secure, scalable, and cost-optimized data engineering solutions as per the overall data management strategy. - Design and implement modern data platform architectures using Microsoft Fabric, including: - OneLake-based data Lakehouse architectures - Data Factory pipelines within Fabric - Synapse Data Engineering and Data Warehousing experiences - Develop scalable data ingestion, transformation, and orchestration pipelines using Fabric-native tools and Azure services. - Design high-performance Lakehouse and Warehouse models following best practices (medallion architecture, dimensional modeling). - Integrate Azure services such as Azure Data Factory, ADLS Gen2, Azure SQL, Databricks (optional). - Build interactive and scalable Power BI semantic models and reports integrated with Fabric. - Implement CI/CD pipelines (Azure DevOps/GitHub) for data and analytics workloads. - Ensure adherence to data governance, security, and compliance standards. - Mentor and guide junior engineers, drive best practices, and lead POD delivery. - Contribute to solution accelerators, reusable frameworks, and pre-sales activities. - Create prototypes and evaluate emerging tools and methodologies to drive innovation within the team. - Occasional support to Sales and Pre-Sales partners to convert opportunity to revenue through thought leadership in the designated area of expertise. Qualifications - Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. - 8 or more years of experience in Data Engineering, with at least 3 or more years in Azure ecosystem. - Strong hands-on expertise in Microsoft Fabric, including: - OneLake & Lakehouse architecture - Data Factory in Fabric - Synapse Data Engineering / Data Warehousing - Power BI integration with Fabric - Proficiency in Python, PySpark, SQL, and Spark-based processing. - Strong experience building data pipelines (batch and streaming). - Expertise in data modeling (star/snowflake schemas, medallion architecture). - Experience with Azure data services: - Azure Data Factory / Synapse Pipelines - ADLS Gen2 - Azure SQL / SQL MI - Experience in CI/CD, version control, and DevOps practices. - Strong understanding of data governance, security, and access control (RBAC, IAM, encryption). - Experience working with structured, semi-structured, and unstructured data sources. - Strong problem-solving, communication, and stakeholder management skills. - Excellent verbal and written communication skills. - Ability to work cross-functionally with product managers, business stakeholders, and engineering teams. - Passion for staying updated with the latest cloud and AI/ML technologies and ability to evaluate and adopt emerging tools and methodologies. Preferred Qualifications - Microsoft certifications such as: - Fabric Analytics Engineer Associate - Fabric Data Engineer Associate - Azure AI Engineer Associate - Azure Solutions Architect Expert - Experience with Databricks or Synapse Spark pools. - Familiarity with real-time analytics and streaming architecture. - Exposure to data governance tools (Purview or equivalent). - Experience in building enterprise-scale data platforms. Supervisory/Leadership Responsibilities - Lead POD/team delivery and ensure high-quality, timely execution. - Mentor junior engineers and conduct knowledge-sharing sessions. - Participate in Agile ceremonies (planning, retrospectives, backlog grooming). - Function as a technical point of contact for stakeholders and clients. Job Type & Location This is a Permanent position based out of Atlanta, GA. Pay and Benefits The pay range for this position is $127100.00 - $190700.00/yr. We reserve the right to pay above or below the posted wage based on factors unrelated to sex, race, or any other protected classification. - Medical, Dental, and Vision - Critical Illness, Accident, and Hospital - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available - Life Insurance (Voluntary Life and AD&D for employee and dependents) - Short and Long-Term Disability - Health Spending Account (HSA) - Transportation Benefits - Employee Assistance Program - Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a fully remote position. Application Deadline This position is anticipated to close on Jul 27, 2026.

United States
$127.1K - $190.7K / year
TEKsystems logo

Lead Data Engineer

TEKsystems

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.

Data Engineer2 days ago
ContractRemoteTeam 10,001H1B No Sponsor

Role Description Our client is a nationally recognized organization seeking a Lead Data Engineer to join a growing data and engineering team. This role will focus on building scalable data platforms, supporting analytics initiatives, and driving data engineering best practices within a modern Azure-based environment. This is a hands-on technical leadership opportunity focused on building and supporting modern data platforms. The role will be responsible for: - Designing, developing, and maintaining production-grade data pipelines, data models, governance frameworks, and data services. - Helping establish engineering standards and best practices. The ideal candidate will bring strong Azure data engineering experience, technical leadership capabilities, and a passion for delivering reliable, scalable, and business-focused data solutions. Qualifications - 7+ years of experience in Data Engineering, Analytics Engineering, or related data platform roles. - Strong Python and SQL development skills. - Experience building and supporting enterprise ETL/ELT pipelines. - Strong understanding of data modeling and data warehousing concepts. - Hands-on experience with modern Azure data technologies, including Databricks, Azure Data Factory, Synapse, ADLS, and Azure SQL or PostgreSQL. - Experience with data quality, governance, lineage, and monitoring frameworks. - Experience with Git, CI/CD pipelines, and modern software development practices. - Ability to gather business requirements and translate them into technical solutions. - Experience mentoring team members and contributing to technical leadership initiatives. Requirements - Experience integrating enterprise business systems and operational data sources. - Experience supporting analytics, reporting, or customer-focused applications. - Experience with search technologies, APIs, or data services. - Experience using AI-enabled tools to improve data engineering workflows. - Experience with cloud-native data platforms and modern data architecture patterns. Benefits - Medical, dental & vision - Critical Illness, Accident, and Hospital - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available - Life Insurance (Voluntary Life & AD&D for the employee and dependents) - Short and long-term disability - Health Spending Account (HSA) - Transportation benefits - Employee Assistance Program - Time Off/Leave (PTO, Vacation or Sick Leave) Company Description This is a fully remote position. The pay range for this position is $70.00 - $90.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms.

United States
$70 - $90 / hour
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Work in a fast-paced agile/scrum environment • Develop basic to highly advanced code and designs to maintain new and existing technology systems following company standards • Accountable to develop and deliver technical documentation • Undergo peer code and design reviews to ensure stable and high-quality production-ready code • Build and maintain data solutions that meet or exceed industry regulatory requirements • Leading and authoring of technical specifications and detailed designs • Foster and maintain high collaboration with team members, other technical colleagues, and business partners from across the organization • Active involvement and engineering leadership in multiple complex projects • Provide engineering leadership and mentorship to all level of engineering staff • Review code for complex maintainability, coding standards, and security issues • Conceptualize, plan, design, and build software to solve complex problems • Effectively collaborate with Architects to develop and review intended solutions • Demonstrate expert-level knowledge of coding standards and apply them • Engages in driving organization technical strategy and innovation efforts • Demonstrates subject matter expertise in their domain and takes on higher-level responsibilities • Ensure compliance with established SDLC frameworks • Ensure compliance with all the audit and security requirements of the company • Lead a team with meeting project commitments • Ability to travel as needed to perform position responsibilities • Availability to be on-call as needed • Perform other duties as assigned

United States
$110.1K - $143.1K / year