RegScale logo
RegScale

Overcome gaps in legacy GRC by bridging security, risk, and compliance via our Continuous Controls Monitoring platform.

Senior AI Engineer

AI EngineerMachine Learning EngineerOtherRemoteSeniorTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

70 days ago

Salary

0

Seniority

Senior

Job Description

Senior AI Engineer

RegScale

RegScale is a continuous controls monitoring (CCM) platform that helps organizations automate and scale their security, risk, and compliance programs. We are at an inflection point, transitioning from startup execution to a disciplined, enterprise ready engineering organization, and we are building the team that will take us there. AI is central to where RegScale is going, woven into how compliance programs are automated, monitored, and delivered at scale. The Role Senior AI Engineers at RegScale own the design and delivery of production AI systems end to end. You bring genuine breadth across the AI engineering stack including data pipelines, model fine tuning and evaluation, agent design and orchestration, MCP server development, and AI safeguards, and you understand how these disciplines connect. You make sound decisions across all of them, not just within a narrow specialization. Your work lives inside Platform Engineering and is consumed by product teams building GRC features and by integrators connecting RegScale to the broader compliance ecosystem. You build primitives and frameworks others build on top of, and you raise the bar for how the engineering organization thinks about and delivers AI in production. This role is for an engineer who brings the same rigor to AI systems as to any other production engineering discipline, including reliability, observability, cost management, and ongoing behavior in the real world. Key Responsibilities - Design, build, and operate AI systems in production with full ownership across reliability, performance, cost, observability, and ongoing model behavior. - Build and maintain data pipelines that ingest, clean, transform, and version the data AI systems depend on, ensuring quality and traceability from source to model. - Design and implement retrieval augmented generation pipelines, vector and graph search systems, and hybrid retrieval strategies that make compliance data accessible for AI driven features. - Fine tune, evaluate, and monitor models against real world performance criteria, with a clear understanding of how to measure what matters in a compliance domain. - Architect and build AI agent systems and orchestration layers that coordinate multi step reasoning, tool use, and decision making across complex GRC workflows. - Build and maintain MCP servers that expose RegScale platform capabilities to AI systems, enabling reliable, secure, and observable AI integrations across the platform. - Design reusable AI primitives and frameworks that product and integration teams can build on, accelerating AI feature development across the organization. - Integrate AI capabilities into CI/CD pipelines with appropriate testing, evaluation gates, and deployment strategies that maintain production quality as models and data evolve. - Partner with Platform Engineering, Core Engineering, and Compliance as Code teams to ensure AI capabilities meet enterprise reliability and security standards. - Proactively identify risks in AI system behavior, data quality, and model performance, bringing proposed mitigations before they become production incidents. Required Qualifications - 8 or more years of software engineering experience with at least 4 years focused on building and operating AI or machine learning systems in production environments. - Demonstrated track record of shipping AI features that customers depend on, with ownership across the full production lifecycle including reliability, observability, cost management, and ongoing model behavior. - Strong data engineering fundamentals, including pipeline design, data modeling, transformation, quality validation, and performance monitoring at scale. - Hands on experience with retrieval augmented generation, vector and graph databases, embedding models, and hybrid retrieval strategies. - Experience designing and building AI agent systems and orchestration frameworks, including multi step reasoning, tool use, and failure handling in production contexts. - Solid understanding of model fine tuning and evaluation, including how to define meaningful performance criteria for domain specific applications. - Strong software engineering fundamentals applied to AI systems with production grade rigor. - Strong written and verbal communication skills, able to articulate AI architecture decisions and tradeoffs to both technical and non-technical stakeholders. Preferred Qualifications - Experience building AI systems in regulated industries or compliance focused platforms where auditability, explainability, and data sensitivity shaped design decisions. - Familiarity with secure MCP server development and protocols for exposing platform capabilities to AI systems. - Background in enterprise SaaS companies where AI features had to meet enterprise reliability, security, and integration standards. - Experience with inference cost optimization, caching strategies, and model selection tradeoffs at scale. - Familiarity with GRC frameworks such as FedRAMP, NIST, or CMMC and the compliance domain more broadly. - Experience with cloud native AI infrastructure in Azure or comparable platforms including model deployment, scaling, and monitoring. - Contributions to or deep familiarity with open-source AI frameworks for orchestration, evaluation, and observability. - Experience implementing and using data lake solutions (i.e. Snowflake, Databricks, Synapse Analytics, AWS Redshift) in a production environment. RegScale is only able to hire US Citizens

Related Job Pages

More AI Engineer Jobs

Senior AI Engineer - Full-time

Nesso Digitale

Più flessibili ed economici di una software house tradizionale, più affidabili del singolo freelance.

AI Engineer70 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Build and ship LLM-powered features end-to-end: from prototype to production-ready systems (RAG, agents, tool calling, workflow automation) • Design retrieval and search pipelines using OpenSearch / Elasticsearch, including indexing strategies and query patterns that work for real user needs • Develop backend services and APIs in Python, using Pydantic for robust data validation and clear contracts • Orchestrate async and scheduled workloads (batch jobs, pipelines, background workers) with Celery / Prefect • Own data modeling and persistence for AI workflows using SQLAlchemy • Add observability and reliability with OpenTelemetry: tracing, metrics, and logs that make systems debuggable and safe to operate • Collaborate async-first with product and engineering: align on trade-offs, ship continuously, improve based on feedback and usage • Proactively identify edge cases and failure modes (hallucinations, retrieval misses, long-tail inputs, timeouts) and fix them with pragmatic engineering

Indonesia
Rp18,000K - Rp28,000K / month
OtherRemoteTeam 1-10Since 2025

• Build production-grade systems that operate in real-world clinical settings • Integrate intelligent systems directly into neonatal precision medicine

Massachusetts
Job Closed

Role Description We are looking for a Senior Applied AI Engineer to help design, build, and scale the systems that power AI across the BrightPlan platform. This role will play an important part in shaping how AI systems evolve within BrightPlan’s product architecture. - Focus on developing reliable, scalable infrastructure and frameworks for LLM-powered applications. - Work closely with the CTO to help shape technical decisions around AI architecture, model usage, and system evolution. - Ideal for an engineer who enjoys owning complex technical problems and building the systems that make production AI reliable and scalable. - Opportunity to have significant technical impact in a real-world fintech environment. What You’ll Do - Design and implement scalable AI services and supporting infrastructure that enable AI-powered product capabilities across the platform. - Develop solutions for evaluating and improving LLM output quality. - Build frameworks and tooling that support AI feature development across the engineering team. - Develop and maintain systems that support model tuning, evaluation, and optimization. - Contribute directly to deployment and operational reliability of AI services in production environments. - Optimize AI services for latency, cost efficiency, and reliability. - Partner with the CTO to evaluate emerging AI capabilities and recommend technical approaches for model usage, architecture, and system design. - Provide technical guidance to engineers building AI-powered features and help establish effective development patterns and engineering best practices. - Contribute to technical architecture discussions related to AI systems and platform capabilities. What Success Looks Like - Contribute meaningfully to establishing reliable systems supporting AI-powered product features within your first 90 days. - Improve the performance, consistency, and reliability of AI-generated outputs. - Enable faster experimentation and iteration for AI product development. - Help establish development patterns and technical practices that enable other engineers to build AI-powered features more effectively. - Demonstrate strong technical leadership and ownership of AI system design and implementation. Qualifications - 5+ years of software engineering experience, including strong backend or systems development experience. - Strong Python development experience. - Experience designing and building backend services or distributed systems. - Experience integrating LLM APIs, generative AI services, or AI-enabled capabilities into production systems. - Experience evaluating or improving AI model performance in production environments. - Strong problem-solving and systems design skills. - Ability to collaborate effectively in a cross-functional team. Nice to Have - Experience with FastAPI or similar frameworks. - Experience with model fine-tuning, retrieval-augmented generation (RAG), prompt evaluation, or LLM evaluation methods. - Experience building internal tooling or infrastructure supporting AI applications. - Experience working with vector databases or AI data pipelines. - Experience working in fintech or B2B SaaS environments. Benefits - Build meaningful technology that helps people improve their financial lives. - Work on practical AI applications deployed in a live fintech product. - Collaborate in a remote-first environment with experienced product and engineering leaders. - Competitive compensation, benefits, and equity. Compensation - The estimated annual base salary range for this role is $160,000 to $195,000, depending on qualifications, experience, and location. - This role is also eligible for an annual performance bonus and equity participation. - Comprehensive benefits package.

United States
$160K - $195K / year
Job Closed
Auditdata logo

AI Platform Lead

Auditdata

Award-winning solutions for hearing care professionals. Follow us and stay updated with the latest audiology insights.🦻

AI Engineer70 days ago
Full TimeRemoteTeam 51-200Since 1992H1B No Sponsor

• Build and run AI services in production on Azure: dependable, observable, and cost-aware. • Own the transcription pipeline that turns clinical conversations into usable structured data. • Deliver LLM-powered capabilities for documentation and data transformation, with safety controls appropriate for a clinical context. • Create a reusable “AI workflow layer” so product teams can plug in AI features without reinventing orchestration, permissions, and traceability. • Define platform interfaces (APIs/SDKs) that make adoption easy across the engineering org. • Lead while building: mentor engineers, review designs, and raise the quality bar (~30% leadership; ~70% hands-on).

Poland
Job Closed