Senior Prompt Engineer

Location

United States

Posted

22 days ago

Salary

0

Seniority

Senior

Job Description

Senior Prompt Engineer

Welo Global

Role Description We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance. - Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters. - Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus. - Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. - Solve edge-case scenarios by designing and refining manual prompts. - Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked. - Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall. - Draft technical launch readiness justifications (Launch Certification Documentation) for final. Qualifications - Native fluency in English. - Must be based in the United States. - Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field. - At least 4 years' experience as Prompt Engineer. - Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning. - Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools. - Ability to quickly learn and master proprietary tools with minimal supervision. - Excellent verbal and written communication skills. Requirements - Familiarity with enterprise-grade LLM interfaces like the Goose API. - Experience in AI model evaluation, data science, computational linguistics, or software engineering. - Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows. - Linguistic expertise, including an understanding of semantics and logic. Federal Law Compliance - In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States. - Complete a required employment eligibility verification form. - All new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment. To know more details (Click here) We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Related Categories

Related Job Pages

More Engineer Jobs

GitLab logo

Forward Deployed Engineer

GitLab

Build software faster. The One DevOps Platform enables your entire org to collaborate around your code. We're hiring.

Engineer22 days ago
Full TimeRemoteTeam 1,001-5,000Since 2014H1B No Sponsor

• Conduct deep technical discovery in selected strategic accounts to assess platform readiness, evaluate constraints, and identify high-value adoption opportunities across GitLab and GitLab Duo Agent Platform. • Lead architecture and delivery design for complex enterprise environments where platform migration, regulated requirements, and product boundaries intersect. • Partner with customer stakeholders and GitLab account teams to prioritize use cases based on business impact, technical feasibility, repeatability, and long-term platform value. • Design and build bounded proofs, prototypes, deployment patterns, and reusable accelerators across source code management, CI/CD, security, compliance, and AI-enabled workflows. • Architect self-managed and enterprise deployments, including runners, access controls, network boundaries, observability, AI Gateway, model connectivity, and governance controls. • Turn recurring field patterns into reusable assets such as runbooks, templates, design notes, technical guidance, product briefs, and reference architectures that can be used across accounts. • Contribute code, technical designs, or architecture changes when strategically necessary, in partnership with product and engineering, to address blockers that should be solved upstream. • Travel as needed for strategic customer engagements, architecture workshops, and team coordination, with expected travel up to 50%.

United States
Leega logo

Senior Data Visualization Engineer, Power BI

Leega

Inteligência, Inovação e Tecnologia.

Engineer22 days ago
Full TimeRemoteTeam 201-500Since 2010H1B No Sponsor

• This is not a role solely about processing data or building complex dashboards. We are looking for a professional who will be the business's official "translator" of data. You will be the right hand of strategy, turning SQL into persuasive narratives and recommendations that directly move the company's needle. • Your mission will be to "hunt" for opportunities in consumer behavior and market studies, ensuring that data answers business questions in an intelligent, visual, and strategic manner. • Impact Analysis: Conduct deep studies of consumer profiles and market behavior. • Executive Storytelling: Transform complex data into clear, fluid, and persuasive presentations (focus on PowerPoint and oral presentations). • Influence and Advocacy: Defend recommendations and actively participate in discussion forums and meetings with the executive team. • Business Partnership: Operate with a product/business mindset closely aligned with UX Designers, ensuring analyses focus on customer experience. • Versatile Interface: Connect with multiple areas to understand pain points and propose evidence-based solutions, supporting financial and performance decisions.

Brazil
Leega logo

Engenheiro de Data Visualization, PowerBI – Pleno

Leega

Inteligência, Inovação e Tecnologia.

Engineer22 days ago
Full TimeRemoteTeam 201-500Since 2010H1B No Sponsor

• Desenvolver e manter dashboards e relatórios no Power BI, garantindo performance e usabilidade; • Traduzir necessidades de negócio em soluções de visualização de dados; • Aplicar boas práticas de Data Visualization, storytelling e UX; • Trabalhar com modelagem de dados para suportar análises escaláveis e consistentes; • Conectar e transformar dados provenientes de diferentes fontes (como AWS e Redshift); • Apoiar a disseminação da cultura data-driven e self-service analytics; • Colaborar com times multidisciplinares (Produto, Growth, Analytics, entre outros).

Brazil
Speechify logo

Go-to-Market Engineer

Speechify

Get your reading done faster, easier, and on the go. Listen to any book, document, or website with Speechify.

Engineer23 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

Role Description As an Account Executive / Go-to-Market Engineer, you're equal parts dealmaker and builder. You'll own the full sales cycle for new customers — from first call to close — while also getting hands-on during technical evaluations, demos, and early deployment. You understand that selling voice AI isn't just about pitching features; it's about showing prospects exactly how SIMBA fits into their world and making that first integration feel effortless. This is a rare role for someone who can command a boardroom and open a terminal. - Own the full sales cycle from prospecting through close for mid-market and enterprise accounts - Run technically deep discovery calls to understand customer use cases, tech stack, and integration requirements - Build and demo custom voice agent prototypes during the sales process to accelerate buy-in - Partner with Forward Deployed Engineers to ensure a seamless handoff from sale to onboarding - Develop GTM playbooks, messaging, and outbound strategies to help SIMBA break into new verticals - Represent customer needs internally, influencing product roadmap and packaging decisions - Maintain a clean pipeline in CRM and accurately forecast revenue Qualifications - 3–6 years of experience in a sales, account executive, or GTM role at a technical B2B company - Track record of closing deals with both technical buyers (CTOs, engineers) and business stakeholders - Comfortable getting hands-on with APIs and no-code/low-code tools to build compelling demos - Strong understanding of the AI/ML or voice technology landscape — you follow this space closely - Exceptional communicator who can simplify complex technical concepts without losing their depth - Highly self-directed with strong pipeline discipline and a bias toward action Requirements - Experience selling AI, voice, or conversational technology (Nice to Have) - Familiarity with telephony infrastructure, contact centers, or customer experience platforms (Nice to Have) - Prior experience in a forward deployment or solutions engineering capacity (Nice to Have) - Multilingual or experience selling into international markets (Nice to Have) Benefits - Sell a product that genuinely impresses prospects — sub-second latency and 71+ languages speaks for itself - High ownership role with direct input on GTM strategy and positioning - Work alongside a team that stays embedded with customers, so you're never selling something that doesn't deliver - Competitive base + commission, equity, and benefits - Fast-moving startup environment where your wins have outsized impact - The United States Salary range for this role is - $105,000–$140,000 base salary. On-target earnings of $150,000–$200,000.

United States
$105K - $140K / year