Principal, AI Architect

AI EngineerMachine Learning EngineerFull TimeRemoteSeniorTeam 1,001-5,000H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

30 days ago

Salary

0

Seniority

Senior

Bachelor Degree

Job Description

Principal, AI Architect

The Baldwin Group

Principal, AI Architect Location: Remote US Full time Remote Job Description: Position Summary The Principal, AI Architect is the organization’s senior-most technical authority for designing and guiding the development of scalable, secure, and compliant AI platforms and capabilities. This role defines architectural direction, establishes engineering standards and reference patterns, and provides strategic technical leadership across multiple business and technology teams. Operating as an expert-level individual contributor, the Principal, AI Architect translates business use cases into robust platform designs, drives decisions on tooling, frameworks, and model integration, and ensures that AI systems meet enterprise requirements for performance, reliability, and regulatory compliance. This role tackles multi-dimensional, highly complex technical challenges with substantial autonomy. Additionally, this role influences senior leadership, partners across functions including Data, Product, Security, and Enterprise Technology, and provides guidance to engineering teams building AI solutions. The role introduces new architectural approaches, evaluates emerging technologies, and shapes the long-term roadmap for the firm’s AI ecosystem. Position Summary The Principal, AI Architect is the organization’s senior-most technical authority for designing and guiding the development of scalable, secure, and compliant AI platforms and capabilities. This role defines architectural direction, establishes engineering standards and reference patterns, and provides strategic technical leadership across multiple business and technology teams. Operating as an expert-level individual contributor, the Principal, AI Architect translates business use cases into robust platform designs, drives decisions on tooling, frameworks, and model integration, and ensures that AI systems meet enterprise requirements for performance, reliability, and regulatory compliance. This role tackles multi-dimensional, highly complex technical challenges with substantial autonomy. Additionally, this role influences senior leadership, partners across functions including Data, Product, Security, and Enterprise Technology, and provides guidance to engineering teams building AI solutions. The role introduces new architectural approaches, evaluates emerging technologies, and shapes the long-term roadmap for the firm’s AI ecosystem. Primary Responsibilities - Define and maintain the enterprise‑grade AI platform architecture, including orchestration layers, LLM integration patterns, vector/RAG pipelines, agent frameworks, API mesh, and reusable shared services. - Develop architectural standards, guardrails, and reference designs governing how engineering teams build and integrate AI workloads. - Translate business and product requirements into detailed technical designs, ensuring scalability, security, reliability, and alignment with enterprise architecture principles. - Evaluate build‑vs‑buy decisions for AI components, frameworks, and cloud services; develop recommendations and influence cross‑functional stakeholders. - Review solution designs from engineering teams; identify risks, surface architectural gaps, and recommend long‑term, sustainable approaches. - Partner with Security, Compliance, Legal, and Risk to embed SOX, SOC 2, PCI, PII, data residency, and other regulatory requirements into architectural designs. - Collaborate with Data Platform teams to define data access patterns, boundaries, governance expectations, and integration mechanisms aligned with enterprise data strategy. - Lead development of architectural decision records (ADRs), integration specifications, and platform documentation supporting engineering and compliance readiness. - Assess LLM providers, model hosting patterns (e.g., Bedrock, SageMaker, open-source models), and orchestration frameworks; continuously recommend improvements based on evaluation of emerging capabilities. - Drive cross-functional alignment on AI design choices and platform evolution; facilitate architectural reviews, design sessions, and technical deep dives. - Provide expert-level guidance and mentorship to engineering teams implementing AI services, pipelines, and production applications. - Ensure AI solutions follow cloud best practices across reliability, cost efficiency, observability, performance, and operational readiness. - Partner with Product, Engineering, and Enterprise Architecture to influence long-term platform direction, including multi-tenant patterns, internal developer experiences, and future-state AI services. - Support readiness for audits and risk assessments by ensuring AI platform design documentation, logs, and controls meet enterprise and regulatory expectations. - Champion engineering excellence, standardization, and modernization through clear architectural principles, platform governance, and adoption of best‑in‑class tools and patterns. Required Knowledge, Skills & Abilities - Deep technical expertise in AI/ML platform architecture, including LLMs, RAG pipelines, vector databases, agent frameworks, orchestration systems, and prompt/response patterns. - Expert-level AWS knowledge (e.g., Bedrock, SageMaker, Lambda, ECS/EKS, API Gateway, IAM, KMS, networking, security controls). - Strong understanding of enterprise integration patterns, API design, event-driven architectures, service mesh, and distributed systems engineering. - Advanced knowledge of secure design principles, compliance frameworks, and architectural controls for regulated environments (SOX, SOC 2, PCI, PII, data residency). - Ability to simplify highly complex concepts, communicate architectural decisions to technical and non-technical stakeholders, and influence senior leadership. - Strong analytical and problem‑solving skills, capable of evaluating multiple technical paths and making sound recommendations under ambiguity. - Demonstrated ability to drive architectural alignment across cross-functional engineering teams. - Proficiency with cloud-native observability, monitoring, scalability design, and performance tuning for AI workloads. - Ability to evaluate emerging AI technologies, model providers, and frameworks, and integrate them responsibly into a long-term architectural roadmap. - High degree of ownership, judgment, and technical leadership with the ability to operate independently and make decisions with wide organizational impact. Qualifications - Bachelor’s degree in computer science, engineering, or related field required; master’s degree preferred. - 8–10+ years of progressive software/platform engineering experience, including substantial depth in AI/ML system architecture. - Hands-on experience designing and deploying production AI systems using LLMs, RAG pipelines, orchestration frameworks (e.g., LangChain, LlamaIndex), and cloud-native AI services. - Significant experience with AWS cloud architecture, including design of scalable, secure, highly available distributed systems. - Experience operating in regulated industries or environments with strong compliance expectations preferred (financial services, insurance, or equivalent). - Demonstrated ability to influence cross-functional leaders, drive architectural standardization, and guide complex technical initiatives. - Strong written and verbal communication skills, including production of decision-quality technical documentation. - Proven ability to lead architecture for large-scale platforms and guide engineering teams in adopting modern, standardized patterns. The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.

Related Job Pages

More AI Engineer Jobs

CKEditor logo

Principal AI Engineer

CKEditor

Get total back- and front-end control over your WYSIWYG editor. Build anything imaginable, with limitless possibilities.

AI Engineer30 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Solve high-impact problems across product and internal systems, identifying where AI or automation can create real value. • Work closely with engineering, product, and business stakeholders to understand problems, clarify goals, and define the right approach. • Design pragmatic, end-to-end solutions from architecture and technical plans to production-ready systems. • Build systems involving LLMs, integrations, and multi-step or agentic workflows. • Write production-quality code, build prototypes, and evolve them into robust, scalable solutions. • Influence technical direction across teams, define best practices, and help others adopt AI effectively.

Poland
zł38K - zł45K / month
Mayo Clinic logo

AI/ML Engineer - Shared Services Automation

Mayo Clinic

Headquartered in Rochester, Minnesota, Mayo Clinic is a nonprofit medical institution ranked first in more specialties than all other hospitals in America. The company employs arou

AI Engineer30 days ago

Role Description The AI/ML Engineer is a hands-on builder of AI-enabled and agentic solutions for Finance Shared Services. This role develops, deploys, and supports ML models, LLM-based components, and agentic automations that extend the program beyond traditional RPA. The engineer works closely with the Solution Architect, Senior AI/ML Engineer, and delivery team to bring AI capabilities into production with the reliability and governance expected of enterprise Finance systems. - Develop and deploy ML models, LLM-enabled components, and agentic automations supporting Finance Shared Services use cases. - Integrate AI components with UiPath automations using Maestro, AI Center, Document Understanding, and Communications Mining where appropriate. - Partner with Solution Architects and the Senior AI/ML Engineer on architecture alignment, reuse, and standards. - Own responsible model lifecycle practices: evaluation, monitoring, drift detection, and retraining. - Contribute to engineering practice: code review, source control, CI/CD, and testing. - Support production solutions, triage incidents, and deliver root-cause fixes. - Stay current on emerging AI capabilities and surface candidate applications for Finance. Benefits - Medical: Multiple plan options. - Dental: Delta Dental or reimbursement account for flexible coverage. - Vision: Affordable plan with national network. - Pre-Tax Savings: HSA and FSAs for eligible expenses. - Retirement: Competitive retirement package to secure your future. Equal Opportunity All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.

United States
$116.0K - $142.1K / year
Optum logo

AI/ML Engineer - Remote or Hybrid in MN/DC/NJ

Optum

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

AI Engineer30 days ago
Full TimeRemoteTeam 160,000Since 2011

Requisition Number: 2359757 Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. You'll enjoy the flexibility to work remotely* from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week. Primary Responsibilities: - Design and build AI-powered features using NLP/LLMs and classical ML for provider chat and voice workflows - Deliver end to end: data preparation, modeling/experimentation, evaluation, API integration, deployment, and monitoring in cloud environments - Implement responsible AI guardrails (content safety, PHI/PII controls, prompt hygiene, evaluation suites) and collaborate with governance/review partners - Develop and maintain web services and APIs that expose ML capabilities; write clear documentation and runbooks - Apply MLOps practices (CI for ML, model registry, reproducible experiments) and contribute to on call/operational support with mentorship - Collaborate with product, architecture, security, data, and platform teams to align with enterprise standards and deliver measurable outcomes - Continuously improve code quality, test coverage, latency, reliability, and cost per inference - Design, develop, and deploy AI-powered solutions using no-code, low-code, and advanced platforms, translating business needs into scalable applications that enhance products, workflows and decision-making You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in. Required Qualifications: - 1+ years of total software engineering experience - 1+ years of experience with Python and/or Java programming - 1+ years of experience building and integrating model-backed APIs/services (Python, Node, or Java) into production systems - 1+ years of hands-on experience in AI/ML (e.g., NLP, GenAI, predictive modeling, or recommendation systems) - 1+ years of experience working with AWS cloud and core components (containers/serverless, IAM basics, storage/networking fundamentals, logging/metrics) - 1+ years of experience implementing security, access control, monitoring/alerting, and foundational resiliency/DR concepts for cloud applications - 1+ years of experience with version control, code reviews, automated testing, and CI/CD Preferred Qualifications: - Bachelors degree in Computer Science/related fields or equivalent experience - Exposure to healthcare data/processes *All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $72,800 to $130,000 annually based on full-time employment. We comply with all minimum wage laws as applicable. Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants. At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.

New Jersey
$72.8K - $130K / year
Job Closed
Board of Innovation logo

AI Engineer

Board of Innovation

We are a global innovation firm. Imagining tomorrow's products, services and businesses - and creating them today.

AI Engineer30 days ago
Full TimeRemoteTeam 51-200Since 2010H1B Sponsor

• Design and build AI systems behind real, production-grade applications • Own the full path from idea to deployment, including evaluation and observability • Create multi-step agents and tool-using LLM systems • Integrate AI workflows into business-critical environments • Collaborate with engineers, strategists, and designers

Portugal