Smart Working logo
Smart Working

Empowering companies to work with the best engineers in the world

Python Scraping Engineer

Backend EngineerSoftware EngineerFull TimeRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

129 days ago

Salary

0

Seniority

Senior

Job Description

Python Scraping Engineer

Smart Working

• Design, develop, and maintain large-scale Python-based web scraping systems • Build scrapers capable of extracting data from Google and other highly protected websites • Develop scraping pipelines for dynamic, JavaScript-heavy websites using browser automation • Continuously adapt scraping systems to changes in page structure, request flows, and anti-bot defences • Engineer robust data extraction and processing pipelines to ensure high data quality and reliability • Implement advanced scraping strategies including proxy rotation, fingerprinting, and request routing • Monitor scraping systems and quickly identify and debug failures in production • Optimise scraping infrastructure for performance, reliability, cost efficiency, and low latency • Collaborate with data engineers, data scientists, and product teams to ensure data is usable and trusted • Maintain clear technical documentation and operational runbooks for scraping systems • Contribute to the adoption of AI-assisted development tools and agentic coding workflows

Job Requirements

  • Strong professional experience with Python development
  • Proven experience building production-grade web scraping systems
  • Hands-on experience scraping Google or similarly protected platforms
  • Strong understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
  • Experience using browser automation frameworks such as Playwright, Selenium, Puppeteer, or similar
  • Strong knowledge of HTML parsing, DOM traversal, and structured data extraction
  • Experience handling rate limiting, CAPTCHA systems, IP rotation, and bot detection mechanisms
  • Experience building asynchronous or concurrent scraping architectures
  • Experience operating scraping systems at scale in cloud environments
  • Strong debugging and troubleshooting skills for complex distributed systems
  • Experience working with headless browser fingerprinting and anti-bot evasion techniques

Benefits

  • Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter)
  • No Weekend Work: Real work-life balance, not just words
  • Day 1 Benefits: Laptop and full medical insurance provided
  • Support That Matters:Mentorship, community, and forums where ideas are shared
  • True Belonging: A long-term career where your contributions are valued

Related Job Pages

More Backend Engineer Jobs

Finom logo

Senior Backend Engineer – Product

Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Backend Engineer129 days ago
Full TimeRemoteTeam 501-1,000Since 2019H1B No Sponsor

• You're pragmatic, learn quickly, and have a proven track record of shipping products that matter. • You communicate clearly across disciplines and genuinely enjoy the dynamics of a cross-functional team where everyone contributes to solving the same customer problems. • You understand the "why" behind what you're building, challenge assumptions when needed, and proactively identify opportunities to create better outcomes. • You're comfortable discussing trade-offs with product managers, explaining technical constraints to business stakeholders, and collaborating with frontend and mobile engineers to design elegant end-to-end solutions. • You take ownership not just of your code, but of the outcomes. • You're curious about adjacent domains – you might peek at the frontend code, ask questions about the ML models, or dive into analytics to understand how features perform. • Quality is non-negotiable for you. Automated testing, thorough code reviews, and security best practices are fundamental to how you work.

Bulgaria
Finom logo

Senior Backend Engineer – Product

Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Backend Engineer129 days ago
Full TimeRemoteTeam 501-1,000Since 2019H1B No Sponsor

• Think like a product builder and thrive in a collaborative environment • Create robust, scalable financial infrastructure • Be part of a domain team for shared product area • Understand the "why" behind what you build • Challenge assumptions and identify opportunities for better outcomes • Discuss trade-offs with product managers and collaborate with frontend/mobile engineers • Deep expertise in .NET and C# with maintainable, scalable code • Take ownership of your code and the outcomes

Armenia
Finom logo

Senior Backend Engineer – Product

Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Backend Engineer129 days ago
Full TimeRemoteTeam 501-1,000Since 2019H1B No Sponsor

• Develop and maintain robust, scalable financial infrastructure • Collaborate with cross-functional teams to own and evolve shared product area • Communicate clearly across disciplines and contribute to solving customer problems • Take ownership of outcomes, jump into customer issues, and mentor colleagues • Maintain quality through automated testing, code reviews, and security best practices

Greece
Finom logo

Senior Backend Engineer – Product

Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Backend Engineer129 days ago
Full TimeRemoteTeam 501-1,000Since 2019H1B No Sponsor

• Create robust, scalable financial infrastructure • Collaborate with cross-functional teams • Understand the why behind the products and challenge assumptions • Discuss trade-offs with product managers and design end-to-end solutions • Take ownership of code and outcomes • Ensure quality through automated testing and security best practices

Serbia