Somos especialistas em tecnologia, dados e design, impulsionando a transformação digital de grandes players do mercado há mais de 10 anos, nos setores financeiro, seguros e mobilidade. Com mais de 450 profissionais, estamos presentes no Brasil e Europa, atendendo aos mercados da América Latina, Europa e América do Norte, desenvolvendo produtos digitais de alta qualidade e com foco em resultados de negócios. Certificada pelo 7° ano consecutivo como Great Place to work aqui na ília acreditamos que pessoas mudam o mundo, e investimos nelas. Nossas awesome deliveries são feitas de pessoas para pessoas, afinal awesome people make awesome deliveries!
Senior Data Engineer (Python / Microservices)
Location
Brazil
Posted
16 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer (Python / Microservices)
ília
Role Description Esta oportunidade é para atuar em um time de alta performance. Buscamos um perfil híbrido que domine a Engenharia de Dados, mas que possua a "casca" de desenvolvimento de software. Diferente de posições tradicionais de dados, aqui você trabalhará diretamente com a integração entre pipelines e microsserviços, exigindo versatilidade para transitar entre diferentes stacks tecnológicas conforme o desafio do projeto. Responsabilidades: - Ingestão e Extração: Desenvolver scripts (Python puro ou PySpark) para consultar bases SQL Server, tratar os dados e publicá-los em buckets AWS S3. - Processamento (Arquitetura Medalhão): Construir pipelines para mover e refinar dados entre as camadas Bronze e Prata utilizando Python, PySpark e AWS Glue. - Disponibilização de Dados: Garantir a entrega de dados em OpenSearch (Fast Data) e no Amazon Redshift (para suporte ao time de BI). - Integração com Microsserviços: Colaborar com a camada de consumo, onde microsserviços em Node.js consultam o OpenSearch para servir as aplicações finais. - Visão Consultiva: Atuar de forma autônoma, indicando os melhores caminhos técnicos e arquiteturais para o projeto. Qualifications - Sólida vivência em projetos de engenharia de dados com autonomia para execução sem supervisão constante. - Domínio de Python e PySpark: Experiência avançada em processamento de dados e scripts de automação. - Software Engineering: Conhecimento profundo em Programação Orientada a Objetos (POO) e conceitos sólidos de Microsserviços. - Cloud AWS: Experiência prática com S3, Glue e Redshift. - Banco de Dados: Domínio de SQL para consultas e manipulações (SQL Server). - Mentalidade "Agnostic Stack": Flexibilidade e interesse em lidar com múltiplas linguagens e curvas de aprendizado (como baixar um projeto Node.js ou Java para testes e spikes). Requirements - Conhecimento prévio em Node.js. - Experiência com OpenSearch ou ferramentas similares de busca. - Experiência com AWS Glue utilizando Python. Benefits - Nossa contratação é CLT- 40h semanais com jornada flexível, sendo executada de forma remota. - Para Saúde e bem-estar: - Plano de Saúde e Odontológico SulAmérica extensivo a dependentes; - Vale Alimentação/Refeição em cartão flexível Caju benefícios; - Seguro de Vida; - Auxílio Home-Office em cartão flexível Caju benefícios; - Wellhub (Gympass); - Sesc – extensivo a dependentes, com acesso aos serviços em todo o Brasil; - TotalPass. - Para o seu Desenvolvimento: - ília University: Universidade Corporativa com mais de 20 mil cursos disponíveis para desenvolvimento pessoal e profissional; - Language Academy: Escola de idiomas para ílians; - í-talks e Chapter: Momentos e cerimônias em que o time compartilha práticas, estudos, projetos e ideias. Nas chapters ainda se reúnem pessoas com skills similares para compartilhamento de ideias, práticas e experiências; - Benefícios não convencionais: - Plano de Saúde PET - Guapeco; - Onhappy – benefício de viagem a lazer, com liberdade para você viajar com quem quiser; - BYOD - Alugamos o seu notebook pessoal te pagando um valor mensal para que você o use, mas disponibilizamos também máquinas de trabalho para ílians. Você quem decide! - Seu Niver, seu bolo! - Seu Networking Vale Prêmio - Programa de premiação a indicação de novos funcionários.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Software Engineer, Data Platform
LatticeLattice is a people success platform that empowers leaders to build engaged, high-performing teams & winning cultures.
• Standardize Lattice’s data infrastructure and practices through establishing a simple, cohesive, and reliable platform that seamlessly integrates internal and partner data • Design, develop, and deploy scalable data pipelines that can ingest, process, and serve data across multiple teams for batch and streaming workloads. • Make data effortlessly accessible – abstract infrastructure complexity through reusable SDKs, libraries, and tooling • Shape data governance practices ensuring access to data is secure, compliant, and high-quality. • Partner with Engineering, Product, and business leaders to identify data needs and implement solutions that align with strategic objectives.
Senior Foundry Engineer – Data Pipelines, Ontology
WorkanaThe largest platform for hiring top remote talent from Latin America.
• Build, optimize, and maintain data pipelines into Palantir Foundry. • Integrate multiple healthcare data sources, including clinical, claims, supply chain, and other enterprise datasets. • Support rapid data onboarding to accelerate ontology development and population. • Design, build, and refine ontology objects, properties, relationships, and data mappings in Palantir Foundry. • Collaborate with business and technical stakeholders to translate requirements into scalable data and ontology structures. • Support ontology governance, versioning, and best practices. • Work across Pipeline Builder, Code Repositories, data integration workflows, and Foundry-based modeling efforts. • Contribute to a fast-moving implementation environment where rapid iteration and practical delivery are required.
Role Description As the Data Engineer you will be responsible for designing, building, and maintaining the data engineering function for a remote-first technology organization. This role oversees the full lifecycle of data architecture, pipelines, modeling, tooling, and reliability. It also involves operational duties and direct collaboration with technical leadership, including defining the complete data engineering strategy from the ground up. - Architect, implement, and maintain scalable data pipelines across core systems. - Build and manage analytics infrastructure using both open-source and commercial tools. - Ensure data quality and schema discipline for operational reliability. - Deliver clean, consistent models and dashboards utilized by multiple teams. - Collaborate with stakeholders to support analytics, business intelligence, and decision-making initiatives. Qualifications - 5+ years hands-on data engineering experience; big plus if you’ve been the first data hire before. - Strong SQL plus real programming ability (Python preferred). - Production experience with data tooling (Airflow, dbt, Fivetran). - Experience integrating APIs and working with warehouses/lakes such as Redshift, ClickHouse, or similar. - Experience with analytics/BI tools (Metabase, Looker, Tableau, PowerBI, etc.). - Comfortable with cloud infrastructure and IaC (AWS strongly preferred). - Soft skills to understand business needs and collaborate with non-tech teams on their use cases. - Embedded and real-time analytics experience is a plus. - Streaming architectures (Kinesis/Kafka), ClickHouse, ELK, VictoriaMetrics, reverse-ETL is a plus. Requirements - $5,000 - $7,000 USD/month - Unlimited PTO
Staff Software Engineer - Data Delivery
StackAdaptStackAdapt is an advertising platform that delivers self-serve solutions that enable digital marketers and agencies to thrive. As an employer, the company has been recognized by Ad
Role Description As a Staff Software Engineer I on Data Delivery, you will lead complex technical initiatives across backend systems, with a focus on measurement and planning. You will act as a project and domain DRI for this area: - Translating product requirements into technical requirements - Clarifying feasibility and trade-offs - Shaping milestones and identifying risks - Keeping execution moving You will partner closely with product, engineering, and engineering management to recommend technical options, push back on unrealistic plans when needed, and help the team make sound decisions. Your work will help build the technical foundation for reliable customer-facing insights and make new product capabilities easier to launch and scale. What you’ll be doing - Domain ownership: Act as a project and domain DRI for measurement and planning initiatives within Data Delivery. - Technical planning: Translate product requirements into technical requirements, clarify feasibility and trade-offs, shape milestones, and identify risks early. - Execution leadership: Keep complex initiatives moving by unblocking decisions, coordinating across teams, and giving engineering leadership clear options and recommendations. - Scalable data systems: Build reliable systems that process, organize, and serve large volumes of campaign and marketing data across StackAdapt. - Customer-facing impact: Power reporting, measurement, planning, billing, pacing, exports, APIs, and analytics that customers and internal teams depend on. - System design: Make thoughtful technical decisions that balance correctness, reliability, latency, freshness, cost, and long-term maintainability. - Cross-functional partnership: Work closely with product, engineering, data science, analytics, and business teams to turn product goals into strong technical solutions. - Operational excellence: Improve monitoring, testing, data quality, incident response, and documentation so our systems are easier to trust and operate. - Technical mentorship: Support engineers through design reviews, code reviews, technical guidance, and clear communication of trade-offs. Qualifications - Backend and data systems experience: Strong experience building scalable services, distributed systems, data platforms, or data-intensive applications. - Project leadership: Experience leading complex technical projects with ambiguous requirements, multiple stakeholders, and meaningful trade-offs. - System design depth: Strong judgment across APIs, data pipelines, databases, distributed systems, observability, reliability, and operational ownership. - Data quality mindset: Ability to reason about correctness, freshness, completeness, consistency, cost efficiency, and customer trust. - Product judgment: Interest in building systems that support customer-facing reporting, measurement, planning, optimization, and analytics. - Technical communication: Ability to explain decisions clearly, align stakeholders, and document important trade-offs. - Mentorship: Experience helping other engineers grow and raising the technical bar of a team. - Technical stack: Strong programming skills; experience with Golang and technologies such as Kafka, TiDB, Redshift, Vitess, Iceberg, StarRocks, or Trino is a plus. - Domain experience: Experience in adtech, marketing technology, reporting, analytics, billing, attribution, planning, or high-volume event processing is a plus. What success looks like - Measurement and planning initiatives have clear technical direction, realistic milestones, and strong execution across teams. - Customers can trust the data they use to evaluate and optimize campaigns. - Core data systems are more reliable, scalable, and easier to build on. - New metrics, datasets, APIs, exports, and reporting capabilities can launch faster and with greater confidence. - Product and engineering teams can build new advertising, marketing, measurement, and AI-powered capabilities more easily. - The team makes better technical decisions because trade-offs are clearly understood and communicated. - Engineers around you grow through your mentorship, guidance, and example. - Data Delivery helps StackAdapt scale new product opportunities by giving customers a trusted view of performance across channels and the customer journey. Benefits - Highly competitive salary - Retirement/ 401K/ Pension Savings globally - Competitive Paid time off packages including birthday's off! - Access to a comprehensive mental health care program - Health benefits from day one of employment - Work from home reimbursements - Optional global WeWork membership for those who want a change from their home office and hubs in London and Toronto - Robust training and onboarding program - Coverage and support of personal development initiatives (conferences, courses, books etc) - Access to StackAdapt programmatic courses and certifications to support continuous learning - An awesome parental leave program - A friendly, welcoming, and supportive culture - Our social and team events!


