Job Closed
This listing is no longer active.
Global tech recruitment & staffing for fast-growing companies
Senior Scraping Infrastructure Engineer
Location
Peru
Posted
78 days ago
Salary
0
Seniority
Senior
Job Description
Senior Scraping Infrastructure Engineer
OnHires
• Architect, build, and maintain the core infrastructure for massive, large-scale asynchronous data extraction system. • Design, implement, and continuously optimize sophisticated anti-blocking strategies, IP rotation, fingerprint management, and anti-bot bypass techniques to ensure high reliability and consistent uptime against modern web blocking. • Implement robust monitoring, alerting, and logging systems to proactively debug, troubleshoot, and continuously improve scraper performance, reliability, and data quality across the platform. • Develop, test, and deploy highly robust and fault-tolerant web scraping components using advanced Python tools (Scrapy, Playwright, Selenium, Requests, etc.). • Manage and automate high-volume data ingestion pipelines and seamless integrations with internal and external REST APIs. • Drive DevOps best practices, including managing infrastructure with Docker, Nomad knowledge (a plus), CI/CD pipelines. • Partner with other engineers to set standards, enhance core infrastructure tooling, and mentor junior team members.
Job Requirements
- Proven, hands-on professional experience in high-volume web scraping and data extraction using Python.
- Deep, practical knowledge of anti-bot solutions, including CAPTCHA solving, browser fingerprinting, and effective proxy/IP management strategies.
- Solid understanding of HTML parsing, browser automation techniques, and asynchronous programming.
- Proficiency with leading web scraping frameworks (e.g., Playwright, Scrapy, or Selenium).
- Strong knowledge of REST APIs, HTTP protocols, and effective proxy management.
- Familiarity with both SQL and NoSQL databases for efficient data storage and processing.
- Experience with Docker, Linux environments, and version control (Git).
- Fluent in English (written and spoken).
- Self-driven, pragmatic, and capable of taking full ownership of critical, high-impact infrastructure projects.
Benefits
- Impact & Ownership: A high degree of freedom and the opportunity to have a meaningful, measurable impact on a growing scale-up business.
- Flexibility: A high degree of flexibility – our client is a remote-first company and actively support remote work.
- Growth: A competitive compensation package and dedicated support for your personal & professional development (ongoing training & coaching).
- Team & Atmosphere: A great work atmosphere within a small, talented, and international team.
- Office (Optional): A modern office located on the campus of Wildau Tech University, easily accessible by public transport (just outside Berlin).
Related Guides
Related Categories
Related Job Pages
More Infrastructure Engineer Jobs
• Converse with the model on infrastructure and platform engineering tasks using JavaScript, TypeScript, and Python • Verify architectural soundness and logical correctness • Assess code quality and testing strategies • Analyze performance bottlenecks and deployment risks • Capture reproducible failure cases • Suggest improvements to prompt design and evaluation metrics to strengthen model reasoning
• Engage the model on Java-centric infrastructure and platform engineering tasks • Verify architectural decisions related to concurrency, latency, throughput, and resource utilization • Assess infrastructure and application-level testing strategies • Analyze deployment and reliability risks • Capture reproducible failure modes • Provide structured feedback to improve model evaluation and reasoning frameworks
Change Configuration Infrastructure Mgmt Team Lead (ITIL/CCRM/CMDB)
Node.DigitalA Digital Automation Company - Enabling Frictionless Transactions with Digital Engagement & Intelligent Automation
Change Configuration Infrastructure Mgmt Team Lead (ITIL/CCRM/CMDB) Locaton: Remote Preferred: US Citizen Clearance/Other: Must meet DHS/USCIS background/EOD; comfortable with after‑hours change windows in SBU environments. Role Summary: Own USCIS Configuration Change & Release Management (CCRM) and CMDB for infrastructure/UC services. Run change governance, ISR processing, and release readiness; modernize with automation (IaC/PaC), CI/CD, and AIOps to increase speed, compliance, and stability. Key Responsibilities: • Lead enterprise change governance using ServiceNow ITSM/ITOM/ITBM; require Implementation & Communication Plans and complete VDD/As‑Built/SOPs. • Lead evolution and maintain digital CMDB and asset baselines/relationships; enforce documentation standards (EIDOCS) and deliver audit/KPI reports. • Lead evolution of intake/review/assignment (ISR) workflow meeting AQL timeliness; manage change calendar and communications. • Integrate change/config with automation and DevSecOps—standardized IaC, automated testing, and policy‑as‑code guardrails. • Establish AIOps‑enabled monitoring of change impacts (blast radius/MTTx), predictive alerting, and self‑healing runbooks; continuous improvement. • Gate releases for SLA/AQL compliance and lead PIRs/AARs and knowledge article curation. Required Technology Experience: • ITIL v3/v4 practices (Change, Configuration, Release); ServiceNow ITSM/ITOM/ITBM and CMDB modeling. • Toolchain & automation: Git/Jenkins CI/CD; Ansible/Terraform IaC; Sonatype; policy‑as‑code. • AIOps/predictive ops for event correlation, anomaly detection, and automated remediation.
Senior Cloud Infrastructure Developer
PagefreezerWe simplify Compliance and eDiscovery by automatically archiving website, social media, SMS, & enterprise network data.
• Develop and maintain resilient, cost-efficient infrastructure using AWS and other cloud services to meet evolving business needs. • Use IaC solutions to enable automated provisioning and ensure consistency across all environments. • Design, develop, and maintain advanced CI/CD pipelines, ensuring automated testing integration and deployment efficiency at scale. • Design and deploy comprehensive monitoring, logging, and alerting solutions (e.g., Kiali, Prometheus, etc) to proactively detect risks and assess system health. • Monitor AWS usage patterns to identify and implement strategies for cost reduction and resource optimization. • Implement security improvements to protect the platform's attack surface and develop disaster recovery processes to mitigate risks. • Continuously evaluate emerging paradigms - including agentic development, context engineering, and AIOps - to automate routine tasks, optimize deployment workflows, and transition infrastructure toward predictive, self-healing capabilities.



