YipitData logo
YipitData

Market Research for the Disruptive Economy.

Web Scraping Engineer II

EngineerEngineerFull TimeRemoteSeniorTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

113 days ago

Salary

0

Seniority

Senior

Bachelor Degree3 yrs expEnglishPuppeteerSelenium

Job Description

Web Scraping Engineer II

YipitData

• Refactor and Maintain Web Scrapers • Overhaul existing scraping scripts to improve reliability, maintainability, and efficiency. • Implement best coding practices (clean code, modular architecture, code reviews, etc.) to ensure quality and sustainability. • Implement Advanced Scraping Techniques • Utilize sophisticated fingerprinting methods (cookies, headers, user-agent rotation, proxies) to avoid detection and blocking. • Handle dynamic content, navigate complex DOM structures, and manage session/cookie lifecycles effectively. • Collaborate with Cross-Functional Teams • Work closely with analysts and other stakeholders to gather requirements, align on targets, and ensure data quality. • Provide support, documentation, and best practices to internal stakeholders to ensure effective use of our web scraped data in critical reporting workflows. • Monitor and Troubleshoot • Develop robust monitoring solutions, alerting frameworks to quickly identify and address failures. • Continuously evaluate scraper performance, proactively diagnosing bottlenecks and scaling issues. • Drive Continuous Improvement • Propose new tooling, methodologies, and technologies to enhance our scraping capabilities and processes. • Stay up to date with industry trends, evolving bot-detection tactics, and novel approaches to web data extraction.

Job Requirements

  • 3+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer).
  • Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics.
  • Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation).
  • Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies.
  • Experience with logging, metrics, and alerting to ensure high availability.
  • Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability.

Benefits

  • We care about your personal life and we mean it. We offer vacation time, parental leave, team events, learning reimbursement, and more!
  • Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust.

Related Categories

Related Job Pages

More Engineer Jobs

Providence logo

Principal Cyber Threat Intelligence Engineer

Providence

Providence Shared Services is a service line within Providence that provides a variety of functional and system support services for our family of organizations across Alaska, California, Montana, New Mexico, Oregon, Texas, and Washington. We are focused on supporting our Mission by delivering a robust foundation of services and sharing specialized expertise. Providence is proud to be an Equal Opportunity Employer. We are committed to the principle that every workforce member has the right to work in surroundings that are free from all forms of unlawful discrimination and harassment on the basis of race, color, gender, disability, veteran, military status, religion, age, creed, national origin, sexual identity or expression, sexual orientation, marital status, genetic information, or any other basis prohibited by local, state, or federal law.

Engineer113 days ago
OtherRemoteTeam 10,001+Since 1856H1B Sponsor

• Conduct in-depth analysis and research on cyber threats • Prepare and deliver well researched, impactful analytic findings for technical and non-technical stakeholders • Serve as a mentor for leveraging advanced analytic toolsets • Ability to classify, categorize, and analyze malware and threats • Maintain knowledge about the healthcare industry threat landscape • Collaborate with internal teams for actionable intelligence • Develop and maintain threat profiles • Perform root cause analysis and provide proactive measures recommendations • Continuously update threat intelligence processes • Monitor emerging technologies for threat detection and analysis

Alaska + 7 moreAll locations: Alaska | California | Idaho | Montana | New Mexico | Oregon | Texas | Washington
$60.5K - $115.2K / year
Job Closed
DAWAR CONSULTING INC logo

MES Validation Engineer

DAWAR CONSULTING INC

Optimizing Your Workforce, Empowering Your Success with Cutting-Edge Solutions

Engineer113 days ago
OtherRemoteTeam 51-200Since 2009H1B No Sponsor

• Develop, draft, and route validation protocols, test scripts, and reports • Execute computer system validation (CSV) in a GMP-regulated environment. • Support MES deployment , including validation strategy and testing. • Collaborate with IT/OT, quality, and business teams. • Ensure systems meet FDA, EMA, and GxP regulatory standards.

United States
$85 - $92 / hour
Job Closed
HALO Branded Solutions logo

NetSuite Engineer

HALO Branded Solutions

Break Through and unleash the power of your brand with one-of-a-kind experiences.

Engineer113 days ago
OtherRemoteTeam 1,001-5,000H1B Sponsor

• Design, build, test, and deploy SuiteScript 2.x solutions following structured Dev/Test/Prod environment practices • Lead the development and maintenance of NetSuite customizations, including scripts, records, fields, workflows, and integrations, with a focus on scalability and best practices • Contribute to the expansion and optimization of HALO’s NetSuite instance by supporting subsidiary onboarding and continuous system improvements • Collaborate with internal stakeholders and implementation partners to turn business requirements into well-architected technical solutions • Contribute to the design and implementation of a CI/CD process for NetSuite development • Ensure strong documentation practices for all customizations, integrations, and processes • Participate in regular code reviews to ensure quality, performance, and adherence to standards • Develop and enforce coding standards for NetSuite development to promote maintainability, scalability, and long-term system health • Stay current with NetSuite updates and best practices, and share relevant insights or recommendations to support continuous improvement.

Illinois
$90K - $120K / year
Job Closed
VPS logo

Resident Engineer

VPS

Companies trust VPS with their training needs. From instructor to simulation, to sales and technical, we deliver it all.

Engineer113 days ago
OtherRemoteTeam 1,001-5,000Since 1922H1B No Sponsor

• Perform Resident Engineer (Extended Expertise) support focused on Endpoint Protection • Provide endpoint protection and response expertise including incident response, threat hunting, and SOC support • Assist with Splunk log parsing, XDR deployment, and cloud security monitoring • Help with customer enablement, troubleshooting, and best-practice guidance

United States
$135K - $145K / year