Somos especialistas em tecnologia, dados e design, impulsionando a transformação digital de grandes players do mercado há mais de 10 anos, nos setores financeiro, seguros e mobilidade. Com mais de 450 profissionais, estamos presentes no Brasil e Europa, atendendo aos mercados da América Latina, Europa e América do Norte, desenvolvendo produtos digitais de alta qualidade e com foco em resultados de negócios. Certificada pelo 7° ano consecutivo como Great Place to work aqui na ília acreditamos que pessoas mudam o mundo, e investimos nelas. Nossas awesome deliveries são feitas de pessoas para pessoas, afinal awesome people make awesome deliveries!
Senior Python Developer (data-focused)
Location
Brazil
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Senior Python Developer (data-focused)
ília
Role Description Buscamos um desenvolvedor Python com sólida experiência em dados que saiba escrever código de produção — APIs, pipelines, integrações — e que entenda profundamente o dado que trafega por ele. Buscamos quem já viveu os dois lados e se move entre eles com naturalidade. O time trabalha com um fluxo completo de dados: - Extração de bases relacionais, processamento em camadas na AWS (arquitetura medalhão) e disponibilização para microsserviços e BI. - A pessoa precisará atuar com autonomia, propor o melhor caminho técnico e transitar entre diferentes stacks conforme a demanda do projeto. Responsibilities - Ingestão e Extração: Desenvolver scripts (Python puro ou PySpark) para consultar bases SQL Server, tratar os dados e publicá-los em buckets AWS S3. - Processamento (Arquitetura Medalhão): Construir pipelines para mover e refinar dados entre as camadas Bronze e Prata utilizando Python, PySpark e AWS Glue. - Disponibilização de Dados: Garantir a entrega de dados em OpenSearch (Fast Data) e no Amazon Redshift (para suporte ao time de BI). - Integração com Microsserviços: Colaborar com a camada de consumo, onde microsserviços em Node.js consultam o OpenSearch para servir as aplicações finais. - Visão Consultiva: Atuar de forma autônoma, indicando os melhores caminhos técnicos e arquiteturais para o projeto. - Criar e consumir APIs dentro do ecossistema AWS (Lambda, Glue, S3). Qualifications - Python sólido: código estruturado, orientado a objetos e com testes (Pytest ou similar). - Experiência real com pipelines de dados: PySpark, AWS Glue, Mage.ai ou equivalente. - AWS na prática: S3, Lambda, Redshift, Glue. - Vivência com microsserviços e APIs — criação, integração e arquitetura. - SQL e integração com bases relacionais (SQL Server, PostgreSQL ou similar). - CI/CD e versionamento: GitHub Actions, GitLab, Terraform ou equivalente. - Perfil adaptável: confortável em trabalhar com diferentes stacks conforme o projeto exige. Differentials - Node.js — o microsserviço de consulta de dados do projeto está em Node. - Apache Kafka ou experiência com mensageria assíncrona. - OpenSearch ou Elasticsearch. - Atuação em contextos de alta criticidade ou volume de dados. Benefits - Esta contratação será no modelo PJ, atuando no modelo remoto.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, implement, and optimize modern data and analytics platforms using Microsoft Fabric, Azure, and Power BI • Develop scalable cloud and data platforms and build high-performance ETL/ELT processes • Design and evolve modern data models, data pipelines, and self-service analytics solutions • Define technical solution architecture and take responsibility for complex client projects • Coordinate and align interdisciplinary project teams, stakeholders, and clients in agile project environments
Senior Data Engineer – Cloud Data Products, Analytic Enablement
Highmark HealthCreating remarkable health experiences, freeing people to be their best.
• Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems • Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs • Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs • Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly • Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations. • Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking • Mentor other associate and intermediate data engineers as needed • Perform data analysis and provide insights to support decision-making across various departments • Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed
Senior Data Engineer
First Help FinancialWe provide auto loans to the underserved and care for our customers and partners with exceptional service.
Role Description First Help Financial, recently voted as a "Great Place to Work" for the fifth year in a row, is seeking a Senior Data Engineer to join our highly skilled and innovative team. First Help Financial is embarking on a new growth phase involving multiple game-changing projects. What you will do: - Lead data engineering delivery to build reliable, scalable pipeline leveraging Snowflake, Sigma and other applications to support complex data analytics and self-service reporting. - Drive integration with popular tools and services in the broader data warehousing ecosystem. - Optimize architectural performance across the Data stack by refining execution parameters and enforcing best practice strategies to maximize resource efficiency and throughput. - Establish and evolve a data governance operating model across data quality, lineage, metadata management, stewardship, cataloging, and lifecycle management. - Perform advanced code-level analysis and resource profiling to identify and mitigate systemic root causes, ensuring the stability and reliability of high-scale production workloads. - Coordinate with internal stakeholders to ensure effective communication, issue resolution, and on-time delivery of projects. - Participate in weekend and weekday on call rotation. Qualifications - 8+ years of experience in designing, building, testing, and maintaining data pipelines and data platforms. - 5 years of hands-on experience as a technical lead on a Data Engineering team, serving as the go-to person to resolve critical issues. - Expertise in SQL databases or data warehouses (such as Oracle, SQL Server, MySQL, Postgres and AWS RDS) and ETL technologies (such as Rivery, Informatica, DataStage, Talend, Fivetran). - Strong knowledge of data architecture, distributed processing, data modeling, and platform reliability engineering. - Hands-on experience with modern data warehouse and cloud data platform architectures including AWS and Snowflake. - Experience establishing and operating enterprise data governance capabilities, including data quality, lineage, metadata, and stewardship practices. - Demonstrable mastery of AI tools to enhance productivity and efficiency in daily tasks is a plus. - Working experience in financial services, especially auto finance and lending is preferred. - Proven ability to influence cross-functionally, such as with internal stakeholders or engineering teams. - Expert level knowledge in Python is desired. - Self-motivated and proactive, with a strong ability to identify issues and challenge the status quo. - Degree in Computer Science or related field/experience. Benefits - Great Perks – We offer generous salaries, social activities, monthly lunches, and a robust employee recognition and talent development program to enhance your career with us. - Culture - We are believers in maintaining a healthy work-life balance. While we work hard and care deeply about our customers and partners, we want you to have room for your family, friends, and yourself. - Growth - Company growth provides unprecedented career growth. FHF’s extraordinary year over year growth in revenue and new markets provides opportunity for you to establish and develop your career growth. We engage each employee to build a career plan that benefits everyone, and we have a proven record of investing in you. - Diversity and Inclusion - FHF is committed to building a culture that respects and embraces all walks of life, inclusive of all genders, race, culture, age, sexual orientation, and other identities. We will make accommodations when interviewing anyone with special needs.
Conversational Data Collection Associate (Audio Recording) - Swiss/Austrian Ger
Volga PartnersSmart and Reliable Technology Solutions
Role Description We are looking for individuals to record natural conversations using provided scripts. You will work with a partner and play a specific role (such as Customer or Support Agent). The goal is to create clear, natural-sounding audio recordings by following simple instructions. This project involves recording natural conversations based on customer support scenarios. Depending on the assignment, recordings may be completed individually or with a partner, with roles such as Customer or Support Agent. - Verifying account details - Solving basic technical issues - Explaining simple policies This project involves recording approximately 1 hour of natural audio conversations based on provided prompts and instructions. Participants may be asked to record in one or two languages, depending on the assignment. All recordings must be completed in a quiet, noise-free environment to ensure audio quality. Qualifications - Strong communication skills in required language(s) - Ability to follow instructions - Attention to detail - Willingness to work with a partner - Ability to meet deadlines Requirements - Speak naturally (like a real conversation, not robotic) - Follow all instructions carefully - Ensure clear audio with no background noise - Be available to re-record if needed - Computer or laptop with internet access - Working microphone - Basic knowledge of: - Google Sheets - Google Drive - Zencastr - Ability to download, rename, and upload files Benefits - You will be paid for up to 1 hour per assignment, based on approved work. - Payment depends on audio quality and following instructions. - Work that does not meet quality standards may be rejected or require re-recording. - Payment is processed after successful quality review. - $75 USD per hour. Agreement & Acknowledgement Selected participants will be required to sign an agreement and acknowledgement form confirming: - Understanding of the task and instructions - Acceptance of quality and payment terms - Consent to use of recorded data for the project Must be residing in Italy, Switzerland, or Austria.



