Dominate your competitive landscape
Python Scraping Engineer
Location
Spain
Posted
145 days ago
Salary
0
Seniority
Senior
Job Description
Python Scraping Engineer
Adthena
• Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites • Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches • Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms • Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability • Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput • Monitor scrape health, detect failures early, and rapidly debug production issues • Optimise performance, cost, and latency across scraping infrastructure • Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted • Document scraping logic and operational runbooks for long-term maintainability
Job Requirements
- Strong professional experience with Python, including production-grade scraping systems
- Deep hands-on experience scraping Google or similarly protected platforms
- Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
- Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks
- Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques
- Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems
- Comfortable working with asynchronous and concurrent scraping architectures
- Experience running scrapers at scale in cloud environments
- Strong debugging skills and ability to reason about complex failure modes
- Experience with headless browser fingerprinting and anti-bot evasion techniques
Benefits
- Startup Engineering culture
- Strong Culture: Our quarterly surveys show a 93% average approval rating for company culture, with an overall eNPS of 27.
- Award-Winning Product: US 2025 Search Awards for Best AI Search Software Innovation
- Stock Options: Our employees do incredible work, so as we grow, everyone shares the rewards.
- Trust-Based Vacation: Take as much time off as you need, when you need it.
- Remote-First: 52% of Adthenian’s work fully remote, with others choosing Hybrid Work at our 3 Geohubs (London, Austin, Sydney).
- Flexible Work: Work how and where you do your best, with full autonomy over your day.
- Career Growth: Bespoke training and career development via "Sherpa plans” to guide your growth.
- Monthly Hackdays & Training Days
- Family Care Package: Up to 6 months fully paid maternity leave, and 2 months paternity leave.
- Home Office Stipend: $200 for your ideal remote setup.
- Swag Welcome Gift: $70 credit to grab some merch.
- Birthday Day Off: Celebrate your special day.
- Regular Socials: Summer & Christmas parties, annual and quarterly offsites, monthly meet-ups. See here for more info.
- Volunteer Days: Make a difference with paid volunteer time each quarter. See here for more info.
Related Guides
Related Job Pages
More Backend Engineer Jobs
Staff Backend Engineer – Calendar Integrations
HighLevelThe all-in-one sales & marketing platform that agencies can white-label. CRM, Email, 2-way SMS, Funnel Builder, & more!
• Architect and evolve a plugin-based integrations marketplace that supports calendars, conferencing tools, CRMs, and productivity apps • Design a high-scale, multi-tenant sync engine for Google, Outlook, Apple Calendar, Zoom, Teams, and other providers • Implement delta sync pipelines using Google Sync Tokens, Microsoft Delta Queries, and CalDAV/WebDAV sync mechanisms • Define and maintain a normalized event model across providers, covering recurrence, attendees, reminders, and conferencing data • Ensure strict standards compliance with iCalendar (RFC 5545), ICS formats, RRULE logic, and timezone rules • Build resilient, idempotent workflows with retries, backoff, dead-letter queues, and replay-safe operations • Create automated sync health scoring and drift detection systems with self-healing and recovery paths. • Develop integration SDKs, OAuth flows, webhooks, and debugging tools to power partner and third-party extension development • Lead architecture reviews, RFCs, and cross-team technical strategy with Scheduling, Platform, AI, Experience, and SDET teams • Mentor engineers and elevate engineering quality through hands-on guidance, design leadership, and best practices
Senior Backend Engineer, Typescript, GraphQL
RecruityTalentConnecting top IT and Executive talents with great companies in EMEA/LATAM through tailored recruitment solutions.
• Design, develop, document and maintain high-quality API endpoints • Implement controls to ensure API security, availability and scalability • Work with DevOps to implement and manage continuous integration and deployment pipelines • Collaborate with team members in an Agile environment • Configure and manage API Gateways (e.g., AWS API Gateway, Zuplo or similar) for routing and authentication • Work closely with product managers, front-end developers, and QA teams to deliver seamless, data-driven applications • Integrate services with various systems and third-party services • Write and maintain unit and integration tests to ensure code reliability and performance • Monitor API performance, troubleshoot issues, and optimize endpoints for efficiency
Senior Software Engineer II, Backend – Account Insights
HubSpotSince launching in 2006, HubSpot has emerged as the force behind the industry-leading inbound marketing and sales platform. Among other accolades, HubSpot is also recognized by Gla
• Write and ship impactful production code • Design, build, and evaluate new features • Collaborate in a diverse, cross-functional team • Work closely with different teams across HubSpot • Help SMBs achieve their goals through enhancements
Software Engineer, Backend
Cumberland LabsEarly stage blockchain business builder and incubator from Cumberland & DRW
• Build core exchange logic: markets, users, collateral, fees, order routing • Implement professional liquidity sources, on-chain matching, margining, liquidation, and risk enforcement • Help design the end-to-end architecture of a perpetuals exchange • Ensure on-chain and off-chain systems operate as a cohesive, low-latency stack • Optimize systems for latency, throughput, and compute efficiency • Write thorough tests and maintain clear, living documentation • Improve developer tooling and onboarding experience • Design, implement, and deploy production-grade Solana smart contracts in Rust
