Offering speech-to-text APIs for modern developers, AssemblyAI is ultimately on a mission to use the latest deep learning technology to build practical products that make futuristi
Research Engineer, Evaluations
Location
New York
Posted
66 days ago
Salary
$210K - $260K / year
Seniority
Junior
Job Description
Research Engineer, Evaluations
AssemblyAI
• Own model evaluation across accuracy, latency, and metrics • Build benchmarking pipelines • Design experiments to measure model impact • Manage evaluation datasets • Define real-world performance metrics • Summarize findings for leadership
Job Requirements
- Machine Learning / Research Engineering background
- Strong Python skills
- Understanding of ML models
- Familiarity with voice agent components
- Comfortable interpreting technical results
- 3-4 hours overlapping with Eastern US Time Zone
- Ownership mindset
Benefits
- Pay Transparency
- Equal opportunity to succeed
Related Guides
Related Categories
Related Job Pages
More Research Engineer Jobs
Lead UI/UX Design, Research Engineer
GovCIOGovCIO is a service-disabled-veteran-owned small business (SDVOSB) that offers technology services to improve business performance for government organizations.
• Develops and implements user interface components using React.js, Redux, and a comprehensive design system library, focusing on robust application integrations with REST/SOAP APIs and other established web services. • Participates in system planning and the development deployment process while ensuring adherence to software compliance and testing standards. • Responsible for overseeing the frontend development processes, creating user guidelines, and conducting system analysis to address questions regarding program intentions, output specifications, data input requirements, programming strategies, and control systems as needed. • Lead and guide a team of developers towards successful project execution, ensuring high-quality deliverables and timely completion. • Provide mentorship and leadership, fostering a culture of continuous improvement and excellence within the team. • Establish and promote best practices and coding standards to maintain high standards of excellence within the team. • Collaborate on gathering user requirements, developing user stories, and planning project timelines and estimates. • Oversee the preparation of comprehensive documentation, including reports, operational procedures, and maintenance manuals to ensure clear communication and record-keeping. • Lead integration testing efforts to ensure seamless system functionality and robustness. • Maintain proactive communication with both internal and external stakeholders to ensure alignment and address any project issues promptly. • Conduct in-depth analysis of system requirements, including data flow, input/output specifications, and hardware/software needs to optimize system performance. • Actively participate in code and sprint reviews, ensuring that all deliverables meet contractual obligations and project specifications.
• Process daily threat-feeds related to newly created malware and write detection rules for various technologies. • Investigate and resolve customer-related inquiries related to protection, performance, and usability. • Conduct research and threat hunting for the latest cybersecurity threats affecting our customers, including static and dynamic analysis of PE and other filetypes. • Provide feedback on new projects and tools related to your daily work, and suggest ideas on how to handle new threat types. • Support content creation efforts incl. threat descriptions, blogs, and presentations. • Investigate phishing and other web-based threats, and develop internal streams to collect new data. • Be a leader in the web protection space. • Utilize AI tools including LLM and machine learning to enhance and automate aspects of your workflow. • Respond to internal and external inquiries via a ticket management system, working on a 24/7/365 rotation to ensure full coverage.
Model Research Engineer
DeepslateBuilding Europe's Speech to Speech Voice AI for realtime applications.
• Your work sits directly at the intersection of AI research and scalable software engineering. You will define how natural, fast, and reliable our models perform in production. • Research & Train: Design, train, and evaluate our proprietary deep learning models. You will drive the development of new capabilities, such as emotion recognition, and integrate them into our core architecture. • High-Performance ML Systems: Optimize our models for maximum inference speed and efficiency, ensuring they can handle massive datasets and real-time workloads at scale. • Software Engineering: Write clean, production-ready code. We need researchers who are also strong software engineers, capable of translating complex research into highly available architectures. • MLOps & Tooling: Build and maintain the internal pipelines for data processing, model training, and evaluation to make our iteration cycles fast and reliable.
• Contribution to research into 5G/6G research projects (RAN related) • Design, validation of RAN related algorithms/architectures (e.g. RRM) • Development of simulations (or prototypes) related to 5G/6G • Responsibility for selected tasks in EU projects • Writing reports, papers, contributing to patents • Good command of Python or Matlab scripting is required • Knowledge of C/C++/Java will be a plus




