ClearlyAgile logo
ClearlyAgile

We meet you where you are in your Agile journey.

AI Agent Developer

LLM EngineerMachine Learning EngineerOtherRemoteMid LevelTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

Florida

Posted

66 days ago

Salary

0

Seniority

Mid Level

Job Description

AI Agent Developer

ClearlyAgile

AI Agent Developer (LLM Specialist) Role Overview The AI Agent Developer is responsible for designing, building, and deploying intelligent autonomous or semi-autonomous agents powered by Large Language Models (LLMs). This role focuses on enabling complex workflows, reasoning capabilities, system integration, and secure data interaction across enterprise environments. Key Responsibilities 🔹 Agent Design & Development - Architect and implement AI-powered agents using LLMs (e.g., GPT, Claude, Llama, Mistral, Gemini). - Develop prompt workflows, retrieval-augmented generation (RAG), and multi-step reasoning. - Configure agent behaviors for decision-making, task execution, and contextual understanding. - Implement function calling, tool use, or API integration to extend agent capabilities. 🔹 System Integration - Connect agents to internal systems, databases, knowledge bases, and APIs. - Use frameworks such as LangChain, LlamaIndex, Haystack, Semantic Kernel, or custom pipelines. - Implement connectors for CRMs, ERPs, ticketing platforms, or document repositories. 🔹 Data & Knowledge Management - Create structured and unstructured knowledge retrieval mechanisms. - Build and manage vector databases (Pinecone, Weaviate, Chroma, Milvus, Azure AI Search). - Implement embeddings, chunking strategies, metadata tagging, and query optimization. 🔹 Workflow Automation - Design agent orchestration pipelines to handle multi-agent collaboration. - Enable agents to automate research, reporting, email drafting, document processing, and customer interactions. - Integrate with workflow tools like Zapier, Airflow, UiPath, or Power Automate. 🔹 Model Optimization & Evaluation - Fine-tune or customize LLMs using organization-specific data. - Evaluate model performance for accuracy, latency, cost, hallucinations, and compliance. - Apply guardrails, prompt validation, and reinforcement techniques. 🔹 Security, Ethics & Compliance - Enforce data privacy and governance standards (GDPR, HIPAA, SOC2, ISO, CCPA). - Implement role-based access and secure API token handling. - Apply content filtering, moderation, and usage monitoring. 🔹 Collaboration & Documentation - Work with cross-functional teams (engineering, design, product, legal, security). - Maintain technical documentation, agent configuration logs, and deployment playbooks. - Train internal teams on capabilities and responsible use.

Job Requirements

  • Required Skills & Experience
  • Technical Stack
  • Experience with Python, TypeScript/JavaScript, or Go.
  • Familiarity with API development (REST, GraphQL, JSON).
  • Experience with cloud platforms: Azure OpenAI, AWS Bedrock, GCP Vertex AI, or Hugging Face.
  • Knowledge of vector databases and retrieval architectures.
  • AI/ML Expertise
  • Strong understanding of LLM architectures, embeddings, prompt engineering, and RAG.
  • Experience with fine-tuning or model adaptation techniques.
  • Familiarity with agent frameworks (LangChain Agents, CrewAI, AutoGen, Semantic Kernel).
  • Bonus Skills
  • Experience building chatbots, copilots, or domain-specific assistants.
  • Knowledge of event-driven architecture, microservices, or serverless functions.
  • Exposure to MLOps or LLMOps tooling.

Benefits

  • ABOUT THE COMPANY
  • ClearlyAgile is one of the fastest growing Agile companies in the Tampa Bay area. We foster career growth and are focused on having fun while delivering quality products and services to our clients. With Unlimited Paid Time Off; 10 paid holidays; Medical, Vision and Dental benefits that start on your first day; Share Apprecition Rights; 401(k); paid training certifications; and very competitive compensation plans, ClearlyAgile strives to listen to and invest in its most important asset…its people.
  • Our Mission: Transform our customer’s businesses using Agile methodologies and principles to help them succeed in a flexible, collaborative, self-organizing and fast-paced environment.
  • Our Values: We hire and reward based on our core values.
  • Show Your Passion - Have passion for what you do. Be an active learner with a commitment to grow. Attend and participate in events!
  • Be a Champion of Agile - Spread the word. Back it up with examples, case studies, and data points. Lead by example.
  • Teamwork - Be cooperative and collaborative while maintaining a team-first mindset.
  • Customer-centric - Always focus on the client and their customers. See the world from their perspectives.
  • Quality - Maintain a sense of pride in the quality of your work and the collective work of the team.
  • Be a Leader - Empower yourself to make decisions and don’t be paralyzed by fear of failure.
  • We are an equal opportunity employer and committed to a diverse workforce.
  • To learn more about us visit our website at www.clearlyagile.com.

Related Job Pages

More LLM Engineer Jobs

John Snow Labs logo

Machine Learning Engineer – Large Language Models

John Snow Labs

Award-winning AI and NLP company that helps healthcare and life science organizations put AI to work faster.

LLM Engineer66 days ago
ContractRemoteTeam 51-200Since 2015H1B No Sponsor

• Adapt LLMs to diverse healthcare use-cases using techniques such as Sparse Fine-Tuning (SFT), Prompt Engineering Fine-Tuning (PEFT), Direct Parameter Optimization (DPO), and Proximal Policy Optimization (PPO). • Optimize LLMs for Retriever-Augmented Generation (RAG) to enhance decision-making and information retrieval capabilities. • Collect, clean, and refine healthcare datasets for training LLMs to ensure high-quality data provisioning. • Convert models into various formats suitable for production environments, ensuring their readiness for real-world application.

Worldwide
$30 - $60 / hour
DOTSOFT SA logo

AI Engineer – NLP, Large Language Models

DOTSOFT SA

#software #smartcities #innovation #mobility

LLM Engineer67 days ago
Full TimeRemoteTeam 51-200Since 2004H1B No Sponsor

• Σχεδιασμός και ανάπτυξη λύσεων NLP με χρήση Large Language Models (π.χ. OpenAI, HuggingFace Transformers, LLaMA, Mistral κ.ά.). • Fine-tuning και βελτιστοποίηση προεκπαιδευμένων μοντέλων σε εξειδικευμένα datasets. • Ανάπτυξη pipelines για data preprocessing, training, evaluation και deployment σε cloud/edge περιβάλλοντα. • Συμμετοχή σε έργα R&D που ενσωματώνουν AI σε επιχειρησιακές και ερευνητικές πλατφόρμες. • Συνεργασία με Software Engineers, UI/UX Designers και Systems Architects για την ολοκληρωμένη υλοποίηση λύσεων. • Συμβολή στη συγγραφή τεχνικών παραδοτέων και τεκμηρίωσης AI modules. • Παρακολούθηση εξελίξεων στον χώρο του NLP & LLMs και εισαγωγή νέων μεθοδολογιών.

Greece
Job Closed
Toloka Annotators logo

Freelance Annotator (English) - AI Trainer

Toloka Annotators

Be a key player in crafting the high-quality data essential for AI innovation. Perfect for aspiring freelancers

LLM Engineer68 days ago
OtherRemoteTeam 51-200

Please submit your resume in English and indicate your level of English. At Toloka, we connect smart, curious people from around the world with freelance online tasks that train and improve artificial intelligence. What we do The Toloka Annotators connects individuals with Generative AI projects from leading tech innovators. Our mission is to unlock the full potential of AI by involving real people from around the world in the development process. About the Role Annotation is what helps AI make sense of the world. As an annotator, you may be invited to take part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses - when projects are available. Responsibilities: - Carefully review provided data (text, images, or videos) - Label or classify content based on project guidelines - Identify and flag factually incorrect, sensitive, inappropriate, or unclear material Important note: This is project-based work. Tasks are available only when projects are active. You may be invited to one or more projects depending on your profile and current opportunities. Each project has its own compensation level based on scope and expertise required. On this project, AI trainers earn up to $23 per hour equivalent.

Texas
Job Closed
Welo Data logo

Japanese Senior Prompt Engineer: LLM Migration & Optimization

Welo Data

Join our team at Welo Data and embark on a journey of growth and innovation.

LLM Engineer68 days ago
Part TimeRemoteTeam 1,001-5,000

Role Description Are you an expert at navigating the complex architecture of Large Language Models? Welo Data is seeking a highly technical Senior Prompt Engineer based in Japan to lead the end-to-end migration of template workflows into high-performance LLM autoraters. This is a specialized role for a technical architect who understands that "perfecting a prompt" is a rigorous engineering discipline. You will leverage advanced APG/APO tools and manual refinement to ensure our automated systems meet—and exceed—human accuracy baselines in both German and English contexts. - The Mission: Automated Quality at Scale - Architectural Migration: Take full ownership of the end-to-end technical migration of templates to LLM autoraters. - Optimization Leadership: Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and logic deadlocks. - Metrics-Driven Excellence: Continuously measure quality against "gold data" baselines, tracking precision, recall, and F1 scores to justify launch readiness. - Edge-Case Engineering: Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools cannot solve. Qualifications - Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field. - 4+ years of experience tuning LLMs for strict, structured outputs, complex classification, and few-shot learning. - High proficiency in identifying error patterns and using SQL or data analytics tools to monitor performance. - Fast learner capable of mastering proprietary internal tools and "Goose API" style interfaces with minimal oversight. Requirements - Native fluency in Japanese and professional fluency in English. - Part-Time (Set your own hours within project milestones). - 100% Remote (Must be currently based in Japan). - Freelance / Independent Contractor. Preferred Technical Skills - Familiarity with shadowbot monitoring and disagreement tracking between human and LLM ratings. - Hands-on experience with Chain-of-Thought (CoT) prompting and APO systems. - Deep linguistic expertise, including a strong understanding of semantics and formal logic. - Proven ability to draft high-level Launch Certification Documentation. Company Description Join our team at Welo Data and embark on a journey of growth and innovation.

Japan