Atlan logo
Atlan

Modern Data Workspace ✨ | A Leader in The Forrester Wave™️ | Follow for resources, blogs, and more from the data world.

Principal Engineer (Data Platform)

Data EngineerData EngineerOtherRemoteLeadTeam 51-200Since 2020H1B SponsorCompany SiteLinkedIn

Location

United States + 1 moreAll locations: United States | Canada

Posted

86 days ago

Salary

0

Seniority

Lead

Job Description

Principal Engineer (Data Platform)

Atlan

Who We Are Atlan is building the missing context layer for data and AI, helping enterprises close the AI value chasm. Today, 95% of AI pilots fail because AI systems don’t understand the context behind data: what it means, how it’s governed, and how it should be used. Atlan connects to every part of the modern data and AI stack to unify this context into a single, shared layer that both humans and AI agents can rely on. With Atlan, teams can discover, understand, and trust their data; build and collaborate on a shared body of knowledge; and activate that context across analytics, operations, and AI workflows.Trusted by global enterprises like Mastercard, Workday, General Motors, Unilever, Ralph Lauren, FOX, Nasdaq, and Medtronic, we’re backed by world-class investors including GIC, Insight Partners, Meritech, Peak XV, and Salesforce Ventures About the Role Atlan is building the context layer for AI agents and applications - transforming how data platforms power the next generation of AI. We're looking for a Staff and Principal Engineer to help architect and scale the foundational data plane that makes it easy to build apps, agents, and solutions for the AI era. You'll work on systems handling billions of assets, serving 100K+ users, with 99.99% availability targets. This is a high-agency role where you'll define technical direction, drive multi-quarter initiatives, and pioneer AI-native development practices. What you will do 🤔 - Design and build platform services—APIs, infrastructure components, runtime systems, and ingestion frameworks—at enterprise scale - Architect the context store that transforms lakehouse infrastructure into AI-ready systems with multimodal capabilities (structured, unstructured, vector, graph) - Solve complex multi-tenant isolation and scaling problems for enterprise SaaS - Design data contracts governing ingestion, validation, processing, routing, storage, and serving across heterogeneous systems - Own critical shared infrastructure including lakehouse (Iceberg/Polaris), vector stores, graph databases, and OLTP systems - Drive technical standards through RFCs, architecture reviews, and documentation - Mentor senior engineers and influence architecture decisions across teams - Write production code using AI-assisted development tools (Claude Code, Cursor) - Debug distributed systems issues across Kubernetes, workflow orchestration, and microservices What makes you a match? 😍 Must Have - 8+ years in platform engineering, infrastructure, or backend systems at a SaaS company - Experience building enterprise-scale distributed systems at scale - Deep expertise in multi-tenant architectures and tenant isolation strategies - Strong Kubernetes, containerization, and cloud infrastructure skills (AWS/GCP/Azure) - Hands-on experience with distributed systems patterns—service mesh, event-driven architecture, orchestration - Track record of driving multi-quarter technical initiatives from concept through production at scale Deep Expertise in One or More - Lakehouse architectures - Vector stores - Graph databases - Streaming systems Strong to Have - Experience designing contract-driven or schema-first data platforms - Familiarity with Temporal or similar workflow orchestration systems - Data quality frameworks, observability systems, and cost attribution at scale - Experience supporting enterprise workloads with strict compliance requirements - CI/CD pipeline design and GitOps practices Who You Are - You embrace AI-native development and want to pioneer new engineering workflows - You have high agency and take ownership of ambiguous problems - You're a strong async communicator who can influence without authority - You're comfortable with fast-changing priorities in a scale-up environment - You act as a force multiplier—elevating the technical bar for those around you Team & Location (Remote) You'll join a distributed team (India/Australia/US Remote) working closely with two distinguished engineers leading the data platform charter. We operate in weekly sprints with strong emphasis on ownership, velocity, and AI-native practices. More About Us Atlan is building the shared context layer that enterprises need so AI can operate on trusted, governed context. The conversation has moved from data leaders asking: “Can we trust the data in our stack?” to businesses asking: “Can we trust AI inside the business?” We are the missing infrastructure for businesses becoming AI-forward - the connective tissue between their data stack, operational systems, and AI agents. Recognized as an industry-leading metadata, catalog, and data governance platform, we’ve been named a Leader by both Gartner and Forrester across enterprise data catalogs, metadata management, and governance. To learn more, visit www.atlan.com and follow us on LinkedIn Equal Opportunity Employer Atlan is committed to building an inclusive, diverse, and authentic workplace. We do not discriminate based on race, color, religion, national origin, age, disability, sex, gender identity or expression, sexual orientation, marital status, military or veteran status, or any other legally protected characteristic.

Related Categories

Related Job Pages

More Data Engineer Jobs

OtherRemoteTeam 51-200

What started as a small group of families gathered around a kitchen table in 1979 has blossomed into the nation's leading voice on mental health. The National Alliance on Mental Illness (NAMI) is the nation's largest grassroots mental health organization dedicated to building better lives for the millions of Americans affected by mental illness. Today, we are an alliance of hundreds of local affiliates, state organizations and a national office that work in communities across the United States to raise awareness and provide support and education that was not previously available to those in need. NAMI advocates for all who are affected by mental illness, both the individuals and the people in their lives. We work to address disparities and injustices and to promote dignity and inclusion for all people with mental illness and their families. In addition to being advocates, we educate, we listen, and we lead as evidenced by our public awareness campaigns, the range of programs we provide, and our strong public policy. We currently have an opening for a Senior Data Engineer. As NAMI's first dedicated Data Engineer, the individual in this role will architect and build our data pipeline from the ground up, balancing near-term reporting needs with a durable, scalable foundation for future growth. The Senior Data Engineer is part of the Software Engineering team responsible for building and operating data pipelines, curated datasets, and reporting foundations that enable NAMI to measure program impact, support affiliate reporting, and drive data-informed decisions. This role partners closely with Engineering, Salesforce, Programs & Services, Success Team, and the Data Team to improve data quality, reduce manual reporting workflows, and deliver trusted, well-documented data products. This full-time position is remote. Salary Range: $95k - $105k ESSENTIAL DUTIES AND RESPONSIBILITIES: - Design, build, and maintain scalable ELT/ETL pipelines integrating data from operational systems, program reporting tools, forms, and third-party services - Build and maintain canonical datasets and data models that support consistent reporting across program types and implementations - Implement data quality checks, validation rules, and automated monitoring/alerting for critical data products - Develop and maintain transformations using analytics engineering best practices (e.g., modular, testable, well-documented SQL/Python), including models, tests, and documentation - Configure and support automated job runs via a CI/CD pipeline (e.g. Github Actions) to enforce testing and promote reliable releases - Partner with stakeholders to translate reporting needs into clear data requirements and maintainable implementations - Improve data accessibility through role-based access controls and curated data marts for dashboards and self-service analytics - Create and maintain documentation (data definitions, lineage, runbooks) for both technical and non-technical audiences - Optimize pipeline reliability, performance, and cost across storage, compute, and orchestration (including optimizing workloads, file layouts, and incremental processing patterns) - Orchestrate and monitor workflows, including retries, alerting, and runbooks - Work with tooling for observability, uptime, and performance monitoring - Be a collaborative colleague who learns from and educates their team - Proactively communicates, maintains expectations, and keeps work records up to date in project management systems and team communication channels - Stay current with industry trends and identify new ways for the team to improve - Other duties as assigned MINIMUM QUALIFICATIONS: - 5+ years of experience in data engineering, analytics engineering, or backend engineering with significant data ownership - String proficiency in Python (preferred) or another programming language used for data engineering - Strong SQL skills and experience building production-grade data models for reporting and analytics - Experience using managed or self-hosted EL tools such as Airbyte or Fivetran to ingest and maintain sources - Experience building analytics platforms using a modern data warehouse (e.g., MotherDuck, BigQuery, Redshift, Databricks, Snowflake), and a modern data lake (e.g., Amazon S3, Azure Blob Storage) - Hands-on experience with transformation tools (dbt Core or equivalent) - Experience in modeling, testing, monitoring, and building CI/CD for data pipelines and transformations (including dbt tests and deployment practices) - Experience with orchestration/workflow tools (e.g., Airflow, Dagster, Prefect) and scheduling reliable jobs - Experience running transformation jobs in CI/CD tooling such as GitHub Actions (e.g., PR validation, scheduled runs, environment-based deployments) - Experience with data visualization tools such as Tableau, Looker, Power BI, or Metabase - Familiarity with access controls and least-privilege practices for datasets and reporting layers, including managing data access across teams and roles - Hands-on experience with Docker - Strong proficiency in Git/GitHub - Strong debugging skills and ability to troubleshoot data issues end-to-end (source → pipeline → model → dashboard) - Excellent communication and collaboration skills; comfort working cross-functionally with non-technical partners - Comfort in a remote-first workplace - Well organized team player - Must pass background check Your salary is only one component of the total compensation package. NAMI offers a range of standard and unique benefits that are reviewed annually: - Generous and comprehensive Health, Dental, and Vision Plans - Paid Time Off: Vacation, Personal, and Sick Leave - Paid Parental Leave - 403(b) retirement plan - Flexible Spending Accounts for health care, dependent care and commuter expenses - Life Insurance and Disability coverage paid by NAMI - Flexible Work and Telework programs - Professional Development Reimbursement program - A variety of wellness offerings to support team members - Employee Referral Program - The Employee Assistance Program (EAP) which provides support for personal and family problems common in contemporary life NAMI is proud to be an equal opportunity employer and is committed to creating a diverse and inclusive workforce. NAMI prohibits discrimination and harassment against any employee or applicant for employment because of race, color, religion, sex, national origin, marital status, age, disability, veteran status, sexual orientation, gender identity or expression, pregnancy, childbirth or related medical conditions, genetic information or any other legally protected group status. We also provide reasonable accommodation for candidates with disabilities.

United States
$95K - $105K / year
FUJIFILM logo

Senior Data Engineer

FUJIFILM

FUJIFILM is a publicly traded, multinational photography and imaging company with global headquarters in Tokyo, Japan and regional headquarters in Valhalla, New York. Established i

Data Engineer86 days ago

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Join FUJIFILM Biotechnologies to power analytics at scale. We’re seeking a Senior Data Engineer with deep expertise in Alteryx and Tableau to design, build, and operate scalable data pipelines and modern analytics platforms. You’ll shape engineering standards, elevate platform reliability and performance, and deliver secure, audit‑ready solutions that accelerate decision‑making across a regulated enterprise. Job Description What you’ll do: - Engineer pipelines that deliver impact: Design, build, and maintain high‑performance batch/streaming pipelines (SQL, dbt and/or Alteryx) for data products, analytics, and AI. - Own Alteryx at scale: Configure, administer, and optimize Alteryx Server/Cloud (environments, schedules, credentials, governance, packaging/promotions, upgrades). - Elevate Tableau performance: Engineer/administer Tableau Server/Cloud (sites/projects, permissions, extracts, schedules, LCM, performance tuning, version upgrades). - Run platforms like a pro: Implement monitoring/alerting, SLOs, capacity planning; troubleshoot incidents; drive root‑cause elimination and reliability improvements. - Raise data quality: Implement quality checks, lineage, and observability; define standards for naming, modeling, documentation; contribute to catalog/metadata. - Build security/compliance in: Align with Cybersecurity, data privacy, and where applicable GxP/21 CFR Part 11; execute changes under ITIL/PMO governance. - Partner to deliver: Translate business needs into technical designs; balance delivery velocity with platform health and best practices. - Be the escalation point: Provide L2/L3 support, guide service desk, maintain runbooks/knowledge articles, participate in on‑call rotations as needed. - Optimize for performance and cost: Tune queries/extracts; right‑size compute/storage; drive license hygiene and cost efficiency. - Standardize and improve: Establish engineering standards, SOPs/WIs, templates, peer reviews; evaluate and introduce targeted innovations. Qualifications - Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field; or an equivalent combination of education and experience. - 8+ years of related experience with a Bachelor’s; or 6+ years with a Master’s; or PhD with 3+ years; or equivalent experience. - Within the above, 5+ years in data engineering and/or analytics platform engineering, including 3+ years hands‑on administering and operating Alteryx and Tableau in enterprise settings. - Strong SQL and dimensional/relational data modeling; experience with data transformation/integration tools (e.g., Alteryx, dbt, Azure Data Factory/Talend). Preferred Requirements - Certifications: Alteryx Designer (Core/Advanced) and/or Server Admin; Tableau Desktop Specialist/Certified Professional, Tableau Server/Cloud Admin; ITIL Foundation v3/v4; cloud certifications (Azure/AWS/GCP) are a plus. - Hands‑on with Snowflake (highly considered); Python for automation; CI/CD (Git, DevOps pipelines); infrastructure‑as‑code basics. - Experience in biotech/life sciences or other regulated industries; familiarity with data privacy and, where applicable, GxP/CSV/CSA and 21 CFR Part 11. Benefits - Impact at enterprise scale: Your engineering will power analytics and AI across functions. - Technical leadership: Set standards, mentor peers, and influence platform roadmaps. - Modern stack + growth: Advance your skills across Alteryx/Tableau, dbt/SQL, cloud data services, and automation. EEO Information Fujifilm is committed to providing equal opportunities in hiring, promotion and advancement, compensation, benefits, and training regardless of nationality, age, gender, sexual orientation or gender identity, race, ethnicity, religion, political creed, ideology, national, or social origin, disability, veteran status, etc. ADA Information If you require reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to our HR Department (fdbglobaltalent@fujifilm.com).

United States
$120K - $172K / year
Job Closed
Propelus logo

Data Engineer II

Propelus

We power professionals.

Data Engineer86 days ago
Full TimeRemoteTeam 201-500Since 2001H1B No Sponsor

• Develop and deploy efficient ETL/ELT processes to extract, transform, and load data from various sources into our cloud data warehouse. • Own the implementation of data quality checks. You will identify and resolve data discrepancies (duplicates, missing values, formatting errors) before they reach downstream stakeholders. • Monitor and optimize existing data components to improve system performance, reduce latency, and ensure high system uptime. • Partner with Data Analysts and Software Engineers to understand their data requirements and build the structural solutions they need for deep-dive reporting. • Maintain clear, concise documentation for all pipelines and processes to ensure long-term transparency and maintainability across the team. • Identify and execute opportunities to automate manual data processes, increasing the speed and reliability of our data delivery.

Colombia
Job Closed
Insight logo

Data Engineer

Insight

Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge. Guiding organizations through complex digital decisions.

Data Engineer86 days ago
OtherRemoteTeam 10,001

Requisition Number: 104227 Employer: Insight Direct USA, Inc. Position Location: Chandler, AZ Position: Data Engineer Job Duties: - Design and implement ETL processes using appropriate cloud services for seamless data extraction, transformation, and loading. - Migrate customer data pipelines from various cloud providers to Google Cloud Platform (GCP), ensuring secure and efficient data migration to google cloud. - Perform data schema translation and transformation to guarantee compatibility with GCP storage and data warehouses such as BigQuery. - Establish data validation procedures to ensure the completeness and accuracy of migrated data. - Optimize data pipelines for performance and cost-effectiveness on GCP, leveraging tools like BigQuery for efficient data management. - Collaborate with customer data teams to facilitate a smooth transition to GCP, providing training and knowledge transfer on GCP data practices. - Analyze customer's existing cloud data landscape to assess migration complexity and plan the most effective approach. - Position is based out of Chandler, Arizona HQ but telecommuting is permitted on a case-by-case basis. Job Requirements: Education Requirements: - Bachelors degree in Information Systems and Security, Computer Science, or closely related. Employer will accept an advanced degree if in the same field. Experience Requirements: - 36 months of experience in job offered, Software Developer, or closely related. Special skills requirements: - Experience in building production-grade data solutions (relational and NoSQL) - Experience with Data Integration Tools: building data pipelines using modern data integration tools such as Fivetran, Striim, Data Fusion, etc. - Experience configuring and integrating with multiple Data Sources within and outside of Google. - Large Enterprise Migration: migrating entire cloud or on-prem assets to Google Cloud including Data Lakes, Data Warehouses, Databases, Business Intelligence, Jobs, etc. - Provide consultations for optimizing cost defining methodology, and coming up with a future state architecture. - Experience writing software in at least two or more languages such as Python, Java, Scala, or Go - Experience with systems monitoring/alerting, capacity planning, and performance tuning. Salary: Available upon request Work Schedule: 40 hours/week Qualified applicants send cover letter and resumes to: Insight Direct USA, Inc., Susan Triggs, Insight Corporate Paralegal, susan.triggs@insight.com, ref job#AA01. EOE. Standard Benefits. #LI-DNI #FB-DNI #IN-DNI #TW-DNI #GD-DNI The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here. Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law. Posting Notes: Chandler || Arizona (US-AZ) || United States (US) || IT Infrastructure & Support || None || US - Chandler,AZ ||

United States
Job Closed