iHerb, LLC logo
iHerb, LLC

Come join the movement....we are a vehicle to healthy living!

Principal Engineer - AI Platform

Platform EngineerPlatform EngineerFull TimeRemoteLeadTeam 1,001-5,000Since 1996H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

6 days ago

Salary

$204K - $260K / year

Seniority

Lead

Job Description

Principal Engineer - AI Platform

iHerb, LLC

Role Description The Principal Engineer operates at the intersection of deep technical execution and broad organizational influence. This role will resolve the hardest architectural questions, set the AI-native engineering bar, and ensure that iHerb's platform decisions compound over time rather than accumulate debt. Reporting to the VP of Engineering, this role collaborates closely with peer Principals, Engineering Managers, and peer VPs across the organization. This role owns the end-to-end technical strategy for iHerb's AI Platform and GenAI product experiences. This spans the user-facing AI layer (Wellness Agent, LLM-driven recommendations, RAG over catalog and reviews, generative content) and the shared AI infrastructure (RAG pipelines, evals framework, MLOps, guardrails, observability) that makes AI features production-grade and repeatable across the engineering organization. Job Expectations: - Define and own the AI platform architecture: retrieval infrastructure, model lifecycle, evals framework, guardrails, and GenAI product feature design. - Lead the build of the shared AI platform layer consumed by all AI product features and reusable by internal business teams. - Hands-on contributor: build production AI systems, write proofs of concept, and validate architecture through working software. - Set and enforce technical standards for the AI Platform team; drive architecture reviews and model quality reviews. - Coordinate with the Personalization team to define clear boundaries between the GenAI product layer and existing ML personalization infrastructure. - Contribute AI platform-specific patterns and lessons into iHerb's shared AI-driven SDLC golden path. - Drive the hardest cross-cutting technical decisions across multiple teams and shared platform services. - Establish and evolve iHerb's AI-driven SDLC golden path: shared standards, Claude Code skills, guardrails, and automation patterns. - Lead complex multi-team technical efforts by coordinating architecture reviews, aligning peer Principals and EMs, and resolving competing approaches. - Mentor and raise the technical bar across the engineering organization through code review, architecture review, and direct coaching of senior engineers. - Represent engineering in cross-functional conversations with product, data science, security, and infrastructure. - Feed architectural decisions into the shared knowledge base so institutional knowledge compounds across the organization. The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice. Qualifications - AI-driven SDLC (required): demonstrated use of AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor to ship production systems. - Architecture at scale: experience designing and evolving large-scale distributed systems across multiple teams and years: APIs, data pipelines, event-driven architectures, or high-traffic platforms. - Cross-org technical leadership: track record of driving architectural standards, technical roadmaps, or platform initiatives that span multiple teams or organizations. - Engineering quality mindset: deeply held opinions on code quality, observability, CI/CD, test automation, and maintaining velocity without accumulating hidden debt. - Communication and influence: able to write clear architecture documents, present to technical and non-technical audiences, and build consensus without formal authority. - Experience working in distributed teams across the US, China, and Latin America. - Production experience designing and operating AI platform systems: RAG pipelines, vector search, embedding infrastructure, or retrieval-augmented applications at scale. - Hands-on experience with LLM evaluation: building eval frameworks, defining quality metrics, and iterating on model and prompt quality using data. - MLOps experience: model deployment, monitoring, lifecycle management, and cost governance in a production environment. - Experience building and operating agentic systems using frameworks such as LangChain, LlamaIndex, or equivalent. - GenAI in production is required; prototype or research-only experience is not sufficient at this level. - High degree of accuracy and attention to detail. - Excellent organization skills and ability to multi-task. Requirements - Generally requires a minimum of 10+ years of software engineering experience, with a significant portion at senior, staff, or principal IC level. - Bachelor’s Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience. Physical Demands The physical demands described here are representative of those that must be met by a Team Member to successfully perform the essential functions of this job. While performing the duties of this job, the Team Member is regularly required to talk and hear. The Team Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms. Reaching above shoulder heights, below the waist or lifting as required to file documents or store materials throughout the work day. The Team Member may occasionally lift or move office products and supplies up to 25 pounds. Proper lifting techniques required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Work Environment - The noise in the work environment is usually moderate. - Hectic, fast-paced with multi-level distractions. - Professional, yet casual work environment. - Office / Warehouse environment. - Ability to work extended hours as required. Compensation The expected salary range for this role is $204,000.00 - $260,000.00 USD. The actual base pay offered will be determined by factors such as the candidate's relevant experience, education, geographic location, and internal equity. Staffing Agency Submission Notice iHerb does not accept unsolicited 3rd party ("Agency") candidates. If you are an Agency, please send any requests to be considered as a supplier in our Vendor Management System to staffingvendors@iherb.com. Do not contact iHerb employees directly. If requested to work on a role, any Agency candidates would be presented through the internal recruiting organization. Equal Opportunity Employer iHerb is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. iHerb provides equal employment opportunities to all applicants for employment and prohibits discrimination and harassment.

Related Categories

Related Job Pages

More Platform Engineer Jobs

SentinelOne logo

Senior Platform Engineer – Developer Platform, DevEx

SentinelOne

Secure your enterprise with the autonomous cybersecurity platform. Endpoint. Cloud. Identity. XDR. Now.

Full TimeRemoteTeam 1,001-5,000Since 2013H1B Sponsor

• Help create the Future: Dive deep into our current developer platform, identify pain points, and design innovative solutions to address them in an iterative way toward a shared vision. Participate in design and development of a new architecture that supports scalability, maintainability, and operational excellence. • Modernize the Stack: Collaborate with architects and teams to evaluate and implement the right tools, frameworks, and methodologies for building a robust, user-centric developer platform. • Hands-on Development: Write high-quality, production-ready code. • Mentor and Lead: Guide and mentor other engineers, contribute to their professional growth, share best practices and architectural insights, and foster a culture of engineering excellence. Your involvement increases the overall quality, whether you wrote it directly, reviewed it, or had a hand in designing it. • Collaborate Across Teams and Orgs: Partner with engineering, architects, product, design, quality, DevOps / Infra teams, and leadership to align on objectives, design, timelines, and execution strategies.

United States
$132K - $182K / year
Pantheon Platform logo

Staff Software Engineer – Data Platform

Pantheon Platform

Website Operations Platform for Drupal & WordPress

Full TimeRemoteTeam 501-1,000H1B No Sponsor

• Take the platform to the next level. Extend our robust, configuration-driven data platform to surface data insights directly within the Product experience, and to power the infrastructure behind Machine Learning and LLM-driven insights. • Enhance platform architecture. Serve as the lead technical member of the Data Platform team, maintaining and enhancing our core platform services: Ingest as a Service (consistent extraction and loading into the data lake), Curation as a Service (configuration-driven, audited transformations) and Retention as a Service (historical data hosting that balances access, compliance, and cost). • Build with modern data infrastructure. Work hands-on with Snowflake (including Snowpark for Python), Google Cloud Platform, Airflow , Docker, and Terraform. • Mentor the team. Guide a team of engineers in designing and implementing high impact projects, raising the technical bar across the group. • Own the full lifecycle. Operate in a full DevOps model — development, testing, operations, and support for the systems you build. • Raise the bar. Drive continuous improvement of engineering standards for coding, testing, deployment, and communication. • Partner cross-functionally. Work with Product, Sales, Ops, Finance and other teams to deliver high-impact data solutions and support a self-service, data-driven culture across Pantheon. • Support reliability. Participate in the Data team’s on-call rotation, contributing to the stability, reliability, and performance of Pantheon’s data infrastructure.

United States
$166.7K - $232K / year
Office Hours logo

Platform Engineer

Office Hours

We're on a mission to make human knowledge easily accessible by building the world’s best expert network platform.

Full TimeRemoteTeam 11-50Since 2020H1B No Sponsor

• Own the infrastructure and platform that power our marketplace • Keep systems reliable, observable, secure, and easy to operate • Manage cloud and cluster configuration with Terraform, Helm, and GitOps • Ship through GitHub Actions and GitOps with automated build and test • Perform SAST/DAST scanning and secrets management • Own metrics, logs, and traces across various platforms • Operate data systems such as PostgreSQL and MongoDB

California + 1 moreAll locations: California | New York
$160K - $180K / year
ZeroFox logo

Platform Engineer

ZeroFox

Protect Today. Predict Tomorrow.

Full TimeRemoteTeam 501-1,000Since 2013H1B No Sponsor

• Manage multiple customer initiatives while leading platform configuration and technical support efforts for enterprise services organization • Work with customers to prioritize and document challenges, articulate product solutions that will fit specific requirements, and communicate expectations back to customers • Improve processes and workflows; participate in improving the services we provide to our platform customers, including but not limited to configuration, product and managed services improvements for the ZeroFOX platform • Draw upon system architecture and its interrelated components to differentiate between common vs. critical system issues. Escalate to higher tiers of support accordingly • Communicate system requests / issues / improvements / enhancements, translating them to our cross-functional team(s), if necessary, and following through with our customers • Think creatively about ways to solve customer problems and increase the level of customer engagement over time • Manage ZeroFOX platform configurations • Act as an escalation point for our team and customers • Optimize configuration and support processes and ensure support quality • Enable efficiency and customer insight via systems, automation and best practices • Collaborate with management and cross-functionally with Sales, Product, and Professional Services teams

United States