Job Closed

This listing is no longer active.

Smartsheet logo
Smartsheet

Founded in 2005, Smartsheet offers collaborative work management and process automation to empower greater enterprise productivity. A leading cloud-based platfo

Principal SE - Big Data Platform

Location

United States + 7 moreAll locations: United States | United Kingdom | Germany | India | Australia | Japan | Bulgaria | Costa Rica

Posted

142 days ago

Salary

0

Seniority

Lead

Job Description

Principal SE - Big Data Platform

Smartsheet

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description As a Principal Data & AI/ML Ops Engineer at Smartsheet, you will have the opportunity to work across multiple teams and disciplines, building a versatile skillset while solving the complex challenges of a global platform. - Data Architecture and Design: Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems. - Data Modelling and Management: Developing and implementing data models, ensuring data quality, and establishing data governance policies. - Data Pipeline Development: Building and optimising data pipelines for ingesting, processing, and transforming large datasets from various sources. - Performance Optimisation: Identifying and resolving performance bottlenecks in data pipelines and systems, ensuring efficient data retrieval and processing. - Technology Evaluation and Innovation: Staying abreast of emerging data technologies and exploring opportunities for innovation to improve the organisation’s data infrastructure. - Troubleshooting and Problem Solving: Diagnosing and resolving complex data-related issues, ensuring the stability and reliability of the data platform. - Data Security and Compliance: Implementing data security measures, ensuring compliance with data governance policies, and protecting sensitive data. - Perform other duties as assigned. Qualifications - Enterprise SaaS software solutions with high availability and scalability. - Solution handling large scale structured and unstructured data from varied data sources. - Experience in building and maintaining data platform systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure ensuring scalability, reliability, efficiency and security. - Working with Product engineering team to influence designs with data, AI and analytics use cases in mind. - In depth experience in System design involving large Petabytes of data with Databricks Lakehouse. - Experience in modern AI/Data infrastructure patterns, Semantics layer Organizing data for AI agents (metadata, context). - AI/MLOps workflows on Databricks, MLFlow, Mosaic AI Agent Framework, Unity Catalog, Vector Search, Knowledge Graph. - Knowledge of AI/ML frameworks like LangChain, LangGraph for AI/ML Ops pipeline integration. - Cloud Platforms: Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP). Experience in AWS hosted data platform is preferable. - Programming languages like Python, SQL, and potentially Java or Scala. - Exposure to Snowflake and Data pipeline frameworks like Airbyte/Airflow is preferable. - Modern software engineering practices like Kubernetes, CI/CD, IAC tools (Preferably Terraform), Observability, monitoring and alerting. - Solution Cost Optimisations and design to cost. - Driving engineering excellence initiatives. - Legally eligible to work in India on an ongoing basis. Benefits - Your ideas are heard, your potential is supported, and your contributions have real impact. - You’ll have the freedom to explore, push boundaries, and grow beyond your role. - We welcome diverse perspectives and nontraditional paths. Equal Opportunity Employer Smartsheet is an Equal Opportunity (EEO) employer committed to fostering an inclusive environment with the best employees. It is our policy to provide equal employment opportunities to all qualified applicants in accordance with applicable laws in the US, UK, Australia, Germany, Costa Rica, Japan, Bulgaria, and India. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information. If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.

Job Requirements

  • Enterprise SaaS software solutions with high availability and scalability.
  • Solution handling large scale structured and unstructured data from varied data sources.
  • Experience in building and maintaining data platform systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure ensuring scalability, reliability, efficiency and security.
  • Working with Product engineering team to influence designs with data, AI and analytics use cases in mind.
  • In depth experience in System design involving large Petabytes of data with Databricks Lakehouse.
  • Experience in modern AI/Data infrastructure patterns, Semantics layer Organizing data for AI agents (metadata, context).
  • AI/MLOps workflows on Databricks, MLFlow, Mosaic AI Agent Framework, Unity Catalog, Vector Search, Knowledge Graph.
  • Knowledge of AI/ML frameworks like LangChain, LangGraph for AI/ML Ops pipeline integration.
  • Cloud Platforms: Hands-on experience with at least one major cloud provider (AWS, Azure, or GCP). Experience in AWS hosted data platform is preferable.
  • Programming languages like Python, SQL, and potentially Java or Scala.
  • Exposure to Snowflake and Data pipeline frameworks like Airbyte/Airflow is preferable.
  • Modern software engineering practices like Kubernetes, CI/CD, IAC tools (Preferably Terraform), Observability, monitoring and alerting.
  • Solution Cost Optimisations and design to cost.
  • Driving engineering excellence initiatives.
  • Legally eligible to work in India on an ongoing basis.

Benefits

  • Your ideas are heard, your potential is supported, and your contributions have real impact.
  • You’ll have the freedom to explore, push boundaries, and grow beyond your role.
  • We welcome diverse perspectives and nontraditional paths.
  • Equal Opportunity Employer
  • Smartsheet is an Equal Opportunity (EEO) employer committed to fostering an inclusive environment with the best employees. It is our policy to provide equal employment opportunities to all qualified applicants in accordance with applicable laws in the US, UK, Australia, Germany, Costa Rica, Japan, Bulgaria, and India. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information.
  • If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.

Related Categories

Related Job Pages

More Data Engineer Jobs

Binance logo

Senior Data Engineer – AI Data Service

Binance

The World’s Leading Blockchain Ecosystem and Digital Asset Exchange

Data Engineer142 days ago
Full TimeRemoteTeam 1,001-5,000Since 2017H1B No Sponsor

• Responsible for designing, building, and maintaining scalable data pipelines to support Square team’s data and feature engineering needs • Lead feature data preparation, transformation, validation, and monitoring for machine learning and recommendation/search systems • Collaborate closely with algorithm, product, and business teams to translate business requirements into reliable data and feature solutions • Drive the development of core data infrastructure and feature platforms with data-driven strategies to maximize business impact • Ensure data quality, stability, and performance across offline and online feature pipelines • Identify data gaps and optimization opportunities, and define success metrics together with Product and Business stakeholders

Singapore
Job Closed
Data Engineer142 days ago
Full TimeRemoteTeam 1,001-5,000Since 1996H1B Sponsor

• Design, develop, and maintain scalable, reliable data pipelines on GCP to support Analytics, Machine Learning, and AI initiatives. • Build and orchestrate data ingestion, transformation, and processing pipelines using Python, Jupyter Notebooks, and Dataproc. • Prepare, organize, and make data available for Machine Learning and Generative AI models. • Work with BigQuery for data analysis, transformation, modeling, and performance optimization. • Support the development of Generative AI applications by integrating data into solutions based on LangChain, Google ADK, and Vertex AI. • Manage data artifacts, models, and experiments using Artifact Registry. • Use Google Vector Database for solutions involving embeddings, semantic search, and RAG (retrieval-augmented generation) use cases. • Version code, pipelines, and notebooks using GitLab, following engineering best practices. • Collaborate with multidisciplinary teams in an agile environment, supporting data-driven architectures. • Contribute to data governance, quality, security, and observability practices.

Brazil
LMI logo

Data Engineer

LMI

Innovation at the Pace of Need™

Data Engineer142 days ago
OtherRemoteTeam 1,001-5,000Since 1961H1B Sponsor

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description LMI seeks an experienced Data Engineer to support the U.S. Army’s Holistic Health & Fitness (H2F) initiative as a member of the Analytics functional team within the H2F Program Support Team. The Data Engineer is responsible for designing, building, and maintaining data pipelines and data services that enable scientific analysis, analytics, and user engagement activities within the Holistic Health and Fitness Management System (H2FMS). This role focuses on data ingestion, transformation, storage, and accessibility, ensuring that data supporting research, analytics, and decision support is reliable, well-structured, and available for authorized use. The Data Engineer works closely with the Technical Project Manager, data governance specialists, epidemiologists, research psychologists, tactical sports scientists, data scientists, and software teams to translate analytic and research requirements into scalable data solutions under Government direction. This role does not set independent data policy or analytic strategy. Responsibilities - Design, develop, and maintain data ingestion and transformation pipelines supporting H2FMS analytics and research use cases. - Integrate data from multiple sources, including surveys, wearable and performance data, health and injury datasets, and operational systems as directed. - Ensure pipelines are reliable, scalable, and support downstream analytic and reporting needs. - Support development of analytic data models optimized for reporting, dashboards, and advanced analytics. - Work with data governance staff to ensure data models align with approved data definitions and standards. - Assist with management of structured and semi-structured data stores used within H2FMS. - Enable data access and preparation for data scientists and AI/ML engineers, ensuring data is usable for modeling and analysis. - Support feature preparation and data validation activities under Government and senior analytic direction. - Assist in troubleshooting data-related issues impacting analytics or models. - Support monitoring and resolution of data quality issues, including completeness, consistency, and timeliness. - Implement basic validation, logging, and error-handling mechanisms within data pipelines. - Coordinate with data governance and analytics teams to address recurring data issues. - Collaborate with epidemiologists, research psychologists, and tactical sports scientists to understand analytic data needs. - Coordinate with software teams to support integration between data services and application components. - Support documentation and communication of data pipeline designs and dependencies. Qualifications - Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field. - Demonstrated experience building and maintaining data pipelines and data integration solutions. - Familiarity with data transformation, storage, and analytics enablement concepts. - Experience working with structured and semi-structured data. - Ability to collaborate effectively within multidisciplinary teams spanning analytics, research, and software. - Strong problem-solving and communication skills. - Ability to obtain and maintain a Secret security clearance. Requirements - Experience supporting analytics or research-driven data environments. - Familiarity with cloud-based data services or analytics platforms. - Experience preparing data for dashboards, reporting, or AI/ML workflows. - Prior experience supporting DoW or federal customers. Location & Travel - Duty Location: This position may be performed in a remote or hybrid capacity. - Travel: Limited travel to Fort Eustis, Virginia or LMI Headquarters may be required to support planning, integration, or stakeholder engagement. Salary Target salary range: $101,986 - $170,154. The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances. Applicants must meet eligibility requirements for a U.S. Government security clearance. Only US Citizens are eligible for a security clearance. For this position, LMI will only consider applicants with security clearances or applicants who are eligible for security clearances, due to the nature of the work.

United States
$102.0K - $170.2K / year
Job Closed
Sistema Fibra logo

Postdoctoral Fellow, Data Engineering, Pipelines, PySpark

Sistema Fibra

Pelo Futuro da Indústria | Pelo Futuro do Trabalho

Data Engineer142 days ago
Full TimeRemoteTeam 1,001-5,000Since 1972H1B No Sponsor

• Plan and align the project with the Androidization strategy • Gather and validate functional and technical requirements • Design the solution architecture and the data model • Automate ingestion and processing of operational data • Model and automate refined tables • Implement monitoring and proactive alerts • Publish and validate tables in the production environment • Document the entire technical and functional structure of the platform • Conduct training sessions and formalize the technical handover

Brazil
R$9K / month