• We are seeking a Senior Software Engineer with expertise in web scraping, data processing, and search technologies to help build a large-scale data ingestion and classification system. • You will be responsible for extracting data from diverse sources (web pages, APIs, PDFs), cleaning and normalizing it, and building search capabilities using ElasticSearch/OpenSearch. • You will work with Python, Scrapy, Airflow, Kubernetes, AWS, and Spark to create scalable, high-performance data pipelines. • Build and design large scale, distributed crawling bots (perhaps AI agents) and infrastructure that operate in an adversarial environment aiming at low operational overhead. • Develop and maintain data pipelines to extract data from large volumes of web pages, documents, PDFs (OCR), and APIs. • Help unify heterogeneous documents into a coherent data schema across varied source formats. • Preprocess and normalize raw data for downstream classification, ML/NLP, and search indexing. • Build APIs to expose structured, classified data via ElasticSearch/OpenSearch. • Collaborate with ML/NLP teams to integrate classification models into the pipeline. • Automate workflows using Apache Airflow and deploy solutions in Kubernetes on AWS. • Optimize and scale data pipelines using Spark (EMR) for processing large datasets.

• Design and implement new features in a React/TypeScript codebase; • Manage routes and server-side rendering with React Router; • Build responsive, accessible UIs using Tailwind CSS and modular CSS; • Integrate with backend services via Axios (or similar) and maintain a clean API client layer; • Define and maintain TypeScript interfaces/models for data and service contracts; • Enforce code quality with ESLint, Prettier, lint-staged and Husky pre-commit hooks; • Write unit/integration tests (Jest, React Testing Library or equivalent); • Collaborate with product and design teams to translate requirements into polished UI; • Troubleshoot bugs, optimize performance, and participate in code reviews

• Develop and maintain applications using Java and React. • Implement microservices with a focus on scalability, performance, and security. • Integrate systems with cloud services, ensuring efficiency, reliability, and security. • Collaborate with cross-functional teams to define and deliver new features. • Participate in code reviews and ensure software quality. • Identify and resolve performance and scalability issues. • Contribute to architectures that support coexistence with legacy systems. • Work on event-driven solutions using tools such as Kafka. • Document processes, technical solutions, and architectural decisions. • Propose continuous improvements to processes and solutions with the team and the client.

• Atuar com o time de desenvolvimento na garantia de uma entrega de qualidade para nosso cliente; • Atuar com resolução de problemas de forma mais assertiva, com visão macro do negócio; • Ampliar os conhecimentos do time com elaboração de treinamentos/dojos