Market Research for the Disruptive Economy.
Web Scraping Engineer II
Location
India
Posted
113 days ago
Salary
0
Seniority
Senior
Job Description
Web Scraping Engineer II
YipitData
• Refactor and Maintain Web Scrapers • Overhaul existing scraping scripts to improve reliability, maintainability, and efficiency. • Implement best coding practices (clean code, modular architecture, code reviews, etc.) to ensure quality and sustainability. • Implement Advanced Scraping Techniques • Utilize sophisticated fingerprinting methods (cookies, headers, user-agent rotation, proxies) to avoid detection and blocking. • Handle dynamic content, navigate complex DOM structures, and manage session/cookie lifecycles effectively. • Collaborate with Cross-Functional Teams • Work closely with analysts and other stakeholders to gather requirements, align on targets, and ensure data quality. • Provide support, documentation, and best practices to internal stakeholders to ensure effective use of our web scraped data in critical reporting workflows. • Monitor and Troubleshoot • Develop robust monitoring solutions, alerting frameworks to quickly identify and address failures. • Continuously evaluate scraper performance, proactively diagnosing bottlenecks and scaling issues. • Drive Continuous Improvement • Propose new tooling, methodologies, and technologies to enhance our scraping capabilities and processes. • Stay up to date with industry trends, evolving bot-detection tactics, and novel approaches to web data extraction.
Job Requirements
- 3+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer).
- Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics.
- Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation).
- Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies.
- Experience with logging, metrics, and alerting to ensure high availability.
- Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability.
Benefits
- We care about your personal life and we mean it. We offer vacation time, parental leave, team events, learning reimbursement, and more!
- Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust.
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Principal Cyber Threat Intelligence Engineer
ProvidenceProvidence Shared Services is a service line within Providence that provides a variety of functional and system support services for our family of organizations across Alaska, California, Montana, New Mexico, Oregon, Texas, and Washington. We are focused on supporting our Mission by delivering a robust foundation of services and sharing specialized expertise. Providence is proud to be an Equal Opportunity Employer. We are committed to the principle that every workforce member has the right to work in surroundings that are free from all forms of unlawful discrimination and harassment on the basis of race, color, gender, disability, veteran, military status, religion, age, creed, national origin, sexual identity or expression, sexual orientation, marital status, genetic information, or any other basis prohibited by local, state, or federal law.
• Conduct in-depth analysis and research on cyber threats • Prepare and deliver well researched, impactful analytic findings for technical and non-technical stakeholders • Serve as a mentor for leveraging advanced analytic toolsets • Ability to classify, categorize, and analyze malware and threats • Maintain knowledge about the healthcare industry threat landscape • Collaborate with internal teams for actionable intelligence • Develop and maintain threat profiles • Perform root cause analysis and provide proactive measures recommendations • Continuously update threat intelligence processes • Monitor emerging technologies for threat detection and analysis
MES Validation Engineer
DAWAR CONSULTING INCOptimizing Your Workforce, Empowering Your Success with Cutting-Edge Solutions
• Develop, draft, and route validation protocols, test scripts, and reports • Execute computer system validation (CSV) in a GMP-regulated environment. • Support MES deployment , including validation strategy and testing. • Collaborate with IT/OT, quality, and business teams. • Ensure systems meet FDA, EMA, and GxP regulatory standards.
NetSuite Engineer
HALO Branded SolutionsBreak Through and unleash the power of your brand with one-of-a-kind experiences.
• Design, build, test, and deploy SuiteScript 2.x solutions following structured Dev/Test/Prod environment practices • Lead the development and maintenance of NetSuite customizations, including scripts, records, fields, workflows, and integrations, with a focus on scalability and best practices • Contribute to the expansion and optimization of HALO’s NetSuite instance by supporting subsidiary onboarding and continuous system improvements • Collaborate with internal stakeholders and implementation partners to turn business requirements into well-architected technical solutions • Contribute to the design and implementation of a CI/CD process for NetSuite development • Ensure strong documentation practices for all customizations, integrations, and processes • Participate in regular code reviews to ensure quality, performance, and adherence to standards • Develop and enforce coding standards for NetSuite development to promote maintainability, scalability, and long-term system health • Stay current with NetSuite updates and best practices, and share relevant insights or recommendations to support continuous improvement.
Resident Engineer
VPSCompanies trust VPS with their training needs. From instructor to simulation, to sales and technical, we deliver it all.
• Perform Resident Engineer (Extended Expertise) support focused on Endpoint Protection • Provide endpoint protection and response expertise including incident response, threat hunting, and SOC support • Assist with Splunk log parsing, XDR deployment, and cloud security monitoring • Help with customer enablement, troubleshooting, and best-practice guidance




