Senior Software Engineer – Agentic Search, Scraping
Location
Israel
Posted
5 days ago
Salary
0
Seniority
Senior
Job Description
Senior Software Engineer – Agentic Search, Scraping
Nebius Group
• Build distributed data acquisition systems that capture and structure the live web • Investigate and analyze browser internals, fingerprinting, and anti-automation systems to develop stealthy, adaptive orchestration layers • Prototype and deploy intelligent automation frameworks using Playwright, Puppeteer, and low-level browser control protocols (CDP) • Conduct hands-on research into network flows, JavaScript-based protections, and emerging web standards affecting automation • Collaborate with AI and infrastructure teams to integrate real-time web data into retrieval pipelines and LLM-powered agents • Translate deep technical insights into production-grade components, balancing research freedom with engineering rigor • Continuously evolve Tavily’s capabilities in resilience, speed, and authenticity of web interaction.
Job Requirements
- 3–5 years of experience as a backend or systems engineer, ideally working with large-scale, distributed, or web-facing infrastructure
- Strong programming skills in Python or Node.js, with experience in Go or C++ considered a strong plus
- Proven experience building and maintaining browser automation systems (Playwright, Puppeteer, or CDP) in production environments
- Solid understanding of browser internals, network protocols, and web interaction mechanisms
- Experience designing high-performance, resilient systems that handle scale, concurrency, and complex orchestration
- Strong debugging and analytical skills - able to investigate edge cases, performance bottlenecks, and behavior under dynamic web conditions
- Comfortable working in a fast-moving environment, collaborating closely with product, AI, and infrastructure teams to ship reliable systems quickly
- Excellent documentation and communication skills to ensure smooth integration and operational visibility.
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and work-life balance
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Senior Software Engineer, Test
Veeam SoftwareYour Single Backup and Data Management Platform for Cloud, Virtual and Physical
• Build, maintain, and improve on-premises and cloud-based infrastructures used for product development and testing • Develop and enhance automated test frameworks and expand product test coverage • Implement, maintain, and optimize CI/CD pipelines • Create tools and automation to streamline engineering and operational workflows • Develop and maintain Infrastructure as Code (IaC) templates and deployment automation • Collaborate cross-functionally with software engineers, QA, DevOps, and platform teams • Prepare and maintain technical documentation, specifications, and operational guides • Support quality initiatives focused on scalability, reliability, performance, and security
• Develop modular and scalable code for front-end applications. • Work in all phases of the software development lifecycle. • Provide a great user experience for our end users. • Work effectively with User Experience, Business Analyst and QA teams. • Contribute to presentation-layer standards and best practices.
Senior/Staff Software Development Engineer, EV Platform
MapboxMapbox powers navigation for people, packages, and vehicles everywhere.
• Design and implement scalable data pipelines and backend services • Work on the data infrastructure for Mapbox's global EV charging station coverage • Integrate with new charge point operators • Build systems to unify charging station data • Scale data ingestion pipelines for reliability and throughput • Support downstream Mapbox teams consuming EV charging data
• Ship full-stack features in C# .NET and React that meet the company’s quality, performance, and UX standards. • Translate user needs into delightful experiences that solve real problems (not just the spec), in close partnership with Product and Design. • Deliver data layers (PostgreSQL and MongoDB) that perform reliably at scale, with models and queries built to support large datasets. • Help shape architecture and engineering practices that scale with the product growth. • Raise the bar on code quality so the team can move fast without breaking what matters, through reviews, testing, and steady improvement. • Influence both product and technical direction by showing up as a full participant in team discussions, not just delivering specs.
