Empowering companies to work with the best engineers in the world
Python Scraping Engineer
Location
India
Posted
129 days ago
Salary
0
Seniority
Senior
Job Description
Python Scraping Engineer
Smart Working
• Design, develop, and maintain large-scale Python-based web scraping systems • Build scrapers capable of extracting data from Google and other highly protected websites • Develop scraping pipelines for dynamic, JavaScript-heavy websites using browser automation • Continuously adapt scraping systems to changes in page structure, request flows, and anti-bot defences • Engineer robust data extraction and processing pipelines to ensure high data quality and reliability • Implement advanced scraping strategies including proxy rotation, fingerprinting, and request routing • Monitor scraping systems and quickly identify and debug failures in production • Optimise scraping infrastructure for performance, reliability, cost efficiency, and low latency • Collaborate with data engineers, data scientists, and product teams to ensure data is usable and trusted • Maintain clear technical documentation and operational runbooks for scraping systems • Contribute to the adoption of AI-assisted development tools and agentic coding workflows
Job Requirements
- Strong professional experience with Python development
- Proven experience building production-grade web scraping systems
- Hands-on experience scraping Google or similarly protected platforms
- Strong understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
- Experience using browser automation frameworks such as Playwright, Selenium, Puppeteer, or similar
- Strong knowledge of HTML parsing, DOM traversal, and structured data extraction
- Experience handling rate limiting, CAPTCHA systems, IP rotation, and bot detection mechanisms
- Experience building asynchronous or concurrent scraping architectures
- Experience operating scraping systems at scale in cloud environments
- Strong debugging and troubleshooting skills for complex distributed systems
- Experience working with headless browser fingerprinting and anti-bot evasion techniques
Benefits
- Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter)
- No Weekend Work: Real work-life balance, not just words
- Day 1 Benefits: Laptop and full medical insurance provided
- Support That Matters:Mentorship, community, and forums where ideas are shared
- True Belonging: A long-term career where your contributions are valued
Related Guides
Related Job Pages
More Backend Engineer Jobs
Senior Backend Engineer – Product
FinomFinancial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services
• You're pragmatic, learn quickly, and have a proven track record of shipping products that matter. • You communicate clearly across disciplines and genuinely enjoy the dynamics of a cross-functional team where everyone contributes to solving the same customer problems. • You understand the "why" behind what you're building, challenge assumptions when needed, and proactively identify opportunities to create better outcomes. • You're comfortable discussing trade-offs with product managers, explaining technical constraints to business stakeholders, and collaborating with frontend and mobile engineers to design elegant end-to-end solutions. • You take ownership not just of your code, but of the outcomes. • You're curious about adjacent domains – you might peek at the frontend code, ask questions about the ML models, or dive into analytics to understand how features perform. • Quality is non-negotiable for you. Automated testing, thorough code reviews, and security best practices are fundamental to how you work.
Senior Backend Engineer – Product
FinomFinancial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services
• Think like a product builder and thrive in a collaborative environment • Create robust, scalable financial infrastructure • Be part of a domain team for shared product area • Understand the "why" behind what you build • Challenge assumptions and identify opportunities for better outcomes • Discuss trade-offs with product managers and collaborate with frontend/mobile engineers • Deep expertise in .NET and C# with maintainable, scalable code • Take ownership of your code and the outcomes
Senior Backend Engineer – Product
FinomFinancial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services
• Develop and maintain robust, scalable financial infrastructure • Collaborate with cross-functional teams to own and evolve shared product area • Communicate clearly across disciplines and contribute to solving customer problems • Take ownership of outcomes, jump into customer issues, and mentor colleagues • Maintain quality through automated testing, code reviews, and security best practices
Senior Backend Engineer – Product
FinomFinancial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services
• Create robust, scalable financial infrastructure • Collaborate with cross-functional teams • Understand the why behind the products and challenge assumptions • Discuss trade-offs with product managers and design end-to-end solutions • Take ownership of code and outcomes • Ensure quality through automated testing and security best practices

