Building Advance AI & Cloud Native Software Using The "Virtual Silicon Valley" Model. Let’s Talk AI, Cloud and Outcomes.
AI / LLM Integration Engineer
Location
United States
Posted
20 days ago
Salary
0
Seniority
Senior
Job Description
AI / LLM Integration Engineer
Codvo.ai
• Design and optimize prompts that accurately interpret flagged reconciliation exceptions and generate structured, actionable resolution suggestions with confidence scoring • Integrate LLM APIs (Anthropic Claude, OpenAI) into the exception resolution layer using Python, the Anthropic SDK, and async API patterns for production-grade reliability • Develop human-in-the-loop workflows that balance automation with human oversight, ensuring financial accuracy and auditability at every step • Build robust API integration code that handles edge cases, rate limiting, token management, and graceful error recovery in a financial context • Collaborate with backend developers to embed AI outputs cleanly into the reconciliation pipeline and ensure seamless data flow into final reports • Implement LLM evaluation and benchmarking frameworks to measure prompt effectiveness, accuracy, and consistency across diverse exception types • Document prompt strategies and model behavior to enable knowledge sharing and continuous improvement across the engineering team • Monitor and iterate on model performance, refining prompts and integration logic based on real-world exception data and user feedback
Job Requirements
- 3+ years of professional software engineering experience, with at least 2+ years working directly with LLM APIs (Anthropic, OpenAI, or similar)
- Strong proficiency in Python, including hands-on experience with the Anthropic SDK and async API calls
- Demonstrated expertise in prompt engineering, particularly for structured outputs and domain-specific tasks
- Solid understanding of confidence scoring, uncertainty quantification, and human-in-the-loop AI workflows
- Experience writing clean, maintainable API integration code with attention to edge cases and error handling
- Ability to work independently and communicate effectively with cross-functional teams
- Familiarity with financial systems, reconciliation processes, or similar regulated domains is a plus
Benefits
- Flexible work environment: 100% remote with a collaborative, inclusive team culture
- Meaningful impact: Work on cutting-edge AI solutions that directly improve financial operations for our clients
- Professional growth: Opportunities to deepen expertise in LLMs, agentic AI, and financial technology
- Competitive compensation: Commensurate with experience and market rates
- Collaborative culture: Work alongside talented engineers and product teams who value innovation and continuous learning
Related Guides
Related Categories
Related Job Pages
More Solutions Engineer Jobs
• Develop and maintain RESTful APIs to support frontend and backend integrations • Build and manage Python-based AWS Lambda functions for serverless workflows • Configure and maintain Amazon Connect contact flows, routing logic, and queue behavior • Design and optimize DynamoDB schemas, indexes, and scalable data models • Work with AWS services such as Lambda, API Gateway, S3, DynamoDB, IAM, and CloudWatch • Collaborate with UI teams to enable seamless integration between frontend applications and backend systems • Manage infrastructure using Terraform and Infrastructure-as-Code practices • Support scalable cloud-native architectures and event-driven systems • Partner with Amazon Professional Services and internal engineering teams on key initiatives • Troubleshoot production issues and support deployments when required
• Developing trusted relationships with partners' Sales, Presales, and Technical leaders • Supporting partners with technical sales activities such as value confirmation education and delivery • Coordinating efforts for enabling partners on relevant products • Customizing resources such as sales plays, competitive intelligence and use cases to drive partner sourced opportunities • Representing partner needs to product teams while collaborating with internal groups like marketing, services, and support to ensure partner success. • Partnering with field sales teams to drive business through the channel
• Craft and refine the strategic vision for OpenAI's Solutions Engineering function • Lead and mentor a team through the sales cycle for maximum adoption and scalability • Collaborate with cross-functional teams to ensure cohesive customer engagement strategies • Act as technical contact for key clients, building trust with executive stakeholders • Advocate for effective application of AI technologies across various sectors
• Serve as Subject Matter and Solution Expert in M-Files software and Systems Integration. • Work closely with the Customer and Project Team to discuss customer needs and design solutions to satisfy those requirements on new and ongoing customer implementations. • Serve as the technical design leader on multiple projects. • Translate Business Requirements to a technical solution design to be implemented by the project consultants. • Work with other members of your project team to design, develop and deploy solutions on a varying number of Customer engagements. • Review requirements and develop solutions and relevant documentation. • Oversee delivery validation to ensure deliverables are met and exceed customer expectations for quality and reliability. • Work closely with Project Management on all aspects of project planning which includes developing timelines and outlining necessary tasks for successful project completion. • Coordinate with the Consultants on the technical aspects of deployments to ensure they are met. • Coordinate with project management and assist with any necessary change requests and product updates required for customer success from R&D and Product Management • Assist with requirements gathering, solution design, development, deployment, migration, QA, UAT, and other consulting related engagements • Help customer identify and clarify their needs. • Identify and validate M-Files integrations with existing data sources. • Provide consultation on design best practice. • Validate Customer Requirements are met. • Mentor and lead more junior members of the consulting unit. • Be a key participant in requirements review, solution design and documentation. • Ensure deployments exceed customer expectations for quality and reliability. • Work closely with M-Files Project Management to ensure timelines and technical aspects of a deployments are met.



