Job Closed
This listing is no longer active.
The definitive solution for managing electricity bills.
Tech Lead – Web Scraping, Web Crawlers
Location
Brazil
Posted
102 days ago
Salary
R$13K - R$17K / month
Seniority
Senior
Job Description
Tech Lead – Web Scraping, Web Crawlers
Fattureweb
• Lead the web crawler development team, guiding best practices and performing code reviews; • Define priorities for improvements and strategies for preventive and corrective maintenance; • Continuously evaluate the architecture of crawlers and pipelines (Docker/Airflow), proposing optimizations; • Define and track operational and performance metrics (success rate, average capture time, stability, etc.); • Research and validate new tools and frameworks that improve crawler efficiency and resilience; • Act directly on critical production incidents, network blocks, or changes to distributor pages; • Document processes, standards, and best practices for the area; • Review and approve team code.
Job Requirements
- Proven experience with Python, with a focus on web automation and scraping
- Experience with web scraping and browser automation (Playwright, Selenium, or Puppeteer)
- Proven experience with high-volume crawlers running in distributed environments
- Experience dealing with network blocking, CAPTCHAs, and access countermeasures
- Experience using networking and proxy configurations in crawlers
- Knowledge of Docker (creating and maintaining containers)
- Experience with Git and best practices for version control and code review
- Experience working in Linux environments
- Degree in Computer Science, Systems Analysis, or Information Systems
- Understanding of information security and data privacy
- Familiarity with Airflow (DAGs, operators, and pipeline monitoring)
- Familiarity with Grafana and monitoring production metrics
- Background in scraping projects for critical sites
- Experience with large-scale monitoring and reliability metrics (SLA/SLO)
Benefits
- Salary advance
- 13th-month salary (annual bonus) for contractors (PJ)
- Birthday day off
- Vacation for contractors (PJ)
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Design and build GTM systems: data enrichment pipelines, lead scoring models, routing logic, signal-based workflows. • Find and connect data sources: discover new APIs, databases, and enrichment providers that give our clients an information edge. • Architect CRM and automation infrastructure: HubSpot, Salesforce, n8n, Clay whatever the client needs. • Build AI-powered workflows: use LLMs (Claude, GPT) and AI agents to automate research, personalization, qualification, and analysis at scale. • Work closely with clients: run feedback loops, present your work, and translate messy business problems into clean, repeatable systems. • Push the frontier: R&D is part of the job. Test new tools, new techniques, new approaches. Share what you learn with the team.
Software Developer
Wells FargoFounded in 1852, Wells Fargo is a community-based financial services company providing a diverse range of services, including banking, investments, insurance, m
• Design and develop Telerik Reports (parameterized, interactive, and exportable). • Create and enhance Telerik UI components such as Grids, Charts, Schedulers, and Report Viewers. • Integrate reports and UI into ASP.NET Core/MVC/Web Forms or desktop applications. • Design, develop, and maintain mobile applications (cross-platform or native) for field teams, QC inspectors, and project managers. • Ensure seamless synchronization of mobile app data with back-end systems and reports. • Implement PDF workflows using PDFTron for generation, annotation, and automation. • Support and enhance ColdFusion applications where needed. • Work with stakeholders to translate business requirements into technical solutions. • Optimize report performance, query execution, and UI responsiveness. • Participate in code reviews and enforce best practices.
• Design, develop, and maintain APIs, Django dashboards, and data pipelines supporting production systems • Lead and improve backend architecture and database schema design (PostgreSQL, MySQL, SQLite) for performance and scalability • Apply and uphold modern software engineering best practices, including version control, test-driven development (TDD), containerization, CI/CD pipelines, automated deployment and environment management, adherence to security and privacy standards, and the effective use of AI-assisted coding tools • Collaborate with front-end and mobile teams (JavaScript, Swift, Kotlin, Angular, Capacitor) to deliver end-to-end solutions • Maintain and monitor production applications using Azure cloud services • Contribute to system observability and reliability, optimizing logging, alerts, and telemetry (Sentry, Grafana) • Apply AI-assisted software development techniques responsibly, staying current with emerging tools while ensuring code quality, security, privacy, maintainability, and compliance with organizational standards • Leverage generative AI to improve development efficiency and deliver new value across internal tools and client-facing systems, applying sound engineering judgment and appropriate human oversight • Manage multiple tasks or projects simultaneously and work independently to resolve issues • Participate in Agile ceremonies including sprint planning and estimation, ensuring alignment with project goals, timelines, and budgets • Document architecture and workflows and provide technical mentorship to junior developers • Continuously research and integrate new technologies to enhance performance, scalability, and developer productivity • Communicate effectively within the team and with stakeholders, both verbally and in writing • Represent the software engineering team to provide technical guidance and support • Follow IT resource and policy standards.
🧠 The role Join as a Senior Full-Stack Software Engineer (Remote, EU) and help us build the end-to-end product experience around our engine. You’ll work across React/TypeScript frontends, Python services, data stores, and cloud infra; turning complex planning & routing problems into clean, fast, reliable tools that dispatchers love. 🔍 What you’ll do - Ship end-to-end features: from UX components to APIs, data models, and deployments. - Build and evolve our web app with a focus on usability, clarity, and performance. - Work across MongoDB / Cosmos DB / SQL to model, query, and optimize real workloads. - Use pub-sub / event-driven patterns for real-time dashboards and system visibility. - Leverage Redis for caching, queues, and low-latency coordination. - Own code quality, testing, CI/CD, and observability. - Collaborate with product, ops, and customers to turn workflows into intuitive UIs and robust systems. ✅ Must-have skills - 5–10 years of full-stack experience shipping production systems. - Experience with data-heavy dashboards, internal tools, or B2B SaaS. - Strong React + TypeScript expertise (hooks, state, component architecture). - Solid database experience: - MongoDB / Cosmos (NoSQL) - SQL (schemas, joins, migrations, performance basics) - Experience with pub-sub / messaging (Kafka, SNS/SQS, Service Bus, Pub/Sub, etc.). - Working knowledge of Redis (caching, sessions, queues). - Cloud & containers: Docker, Docker Compose, and familiarity with Kubernetes concepts. - Strong engineering foundations: testing, reviews, CI/CD, monitoring, logging. - Comfortable in a high-ownership, low-ego environment; fluent and advanced English. - Based in the EU or able to work full-time aligned with EU time zones. 🌟 Big plus - Mobile dev (React Native, Flutter, or native iOS/Android). - Python backend experience (APIs, services, data layer). - Strong design/UX sensibility (design systems, Figma, typography). - Experience in remote-first or async-oriented teams. 👩💻 How we work - Pragmatic engineering: simple first, measurable improvements always. - Tight feedback loops with customers and ops, you see the impact fast. - Small team, high ownership, high trust, you shape the stack and standards. - Remote-first in Europe, with core hours around CET. 🚀 What we offer - High-Ownership and Impact Environment: Shape the product foundations of a fast-growing company. - World-Class Team: Work directly with founders and researchers. - Fully remote within the EU, plus support for your home office / co-working setup. - Competitive compensation. If this sounds like you, we’d love to hear from you! CV and cover letter are required; certificates, Github portfolio and recommendation letters are highly beneficial.




