Specializes in building world-class development teams and extending runways for groundbreaking startups.
Data Engineer, Python, PySpark, AWS Glue, Amazon Athena, SQL, Apache Airflow
Location
Brazil
Posted
5 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer, Python, PySpark, AWS Glue, Amazon Athena, SQL, Apache Airflow
Wizdaa
• Build, optimize, and scale data pipelines and infrastructure using Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake • Design, operationalize, and monitor ingest and transformation workflows: DAGs, alerting, retries, SLAs, lineage, and cost controls • Collaborate with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows; work toward a feature store • Integrate pipeline health and metrics into engineering dashboards for full visibility and observability • Model data and implement efficient, scalable transformations in Snowflake and PostgreSQL • Build reusable frameworks and connectors to standardize internal data publishing and consumption
Job Requirements
- 4+ years of production data engineering experience
- Deep, hands-on experience with Apache Airflow, AWS Glue, PySpark, and Python-based data pipelines
- Strong SQL skills and experience operating PostgreSQL in live environments
- Solid understanding of cloud-native data workflows (AWS preferred) and pipeline observability (metrics, logging, tracing, alerting)
- Proven experience owning pipelines end-to-end: design, implementation, testing, deployment, monitoring, and iteration
- Experience with Snowflake performance tuning and cost optimization
- Real-time or near-real-time processing experience (e.g., streaming ingestion, incremental models, CDC)
- Hands-on experience with a backend TypeScript framework (NestJS is a strong plus)
- Experience with data quality frameworks, contract testing, or schema management
- Background in building internal developer platforms or data platform components (connectors, SDKs, CI/CD for data)
Benefits
- Fully remote position
- Work hours aligned with EST or PT time zones
Related Guides
Related Job Pages
More Backend Engineer Jobs
Software Engineer – Java, Spring Boot
QuidaxProcess large volumes of crypto, build crypto products with our API & get your token listed on Africa's leading exchange
• Get across the core Java/Spring Boot services, understand the critical flows, and ship your first meaningful fix. • Own specific features or services end to end, with support from the team where needed. • Independently investigate and resolve reliability issues across APIs, integrations, and transaction flows. • Reduce recurring issues: stuck transactions, failed callbacks, unclear states, and manual escalations. • Improve test coverage across critical flows and leave every area you touch cleaner than you found it. • Add observability where it's weak: better logging, alerts, and debugging hooks. • Participate in code reviews, share what you learn, and support engineers around you. • Grow your understanding of transaction heavy systems: idempotency, retries, state machines, and reconciliation.
Software Engineer, Ruby, Ruby on Rails
QuidaxProcess large volumes of crypto, build crypto products with our API & get your token listed on Africa's leading exchange
• Join a focused team working on the flows that matter most: deposits, withdrawals, partner integrations, and reconciliation. • Get across the RAMP codebase, understand the core flows, and ship your first meaningful fix in the first 30 days. • Own specific features or flows end-to-end by month 3, with support from the team where needed. • Independently investigate and resolve reliability issues across deposits, withdrawals, and partner callbacks by month 6. • Reduce recurring issues: stuck transactions, failed callbacks, unclear states, and manual escalations. • Improve test coverage across critical flows and leave every area you touch cleaner than you found it. • Add observability where it's weak: better logging, alerts, and debugging hooks. • Participate in code reviews, share what you learn, and support engineers around you. • Grow your understanding of transaction-heavy systems: idempotency, retries, state machines, and reconciliation.
Tech Lead, Java
Zup InnovationWe create digital assets to build, grow and accelerate your applications with efficiency, security and scalability.
• Lead the implementation of critical technical solutions, proposing improvements in architecture, observability, and security. • Analyze and propose scalable solutions for distributed systems, mitigating technical risks and anticipating bottlenecks. • Support development teams by promoting best practices, performing code reviews, and ensuring high-quality deliveries. • Design and implement robust CI/CD pipelines integrated with automations for multiple environments. • Define local standards for RESTful APIs and microservices, promoting consistency, monitoring, and reliability. • Develop security guidelines and ensure their adoption, reducing vulnerabilities and production incidents. • Collaborate with stakeholders to align technical decisions with strategic business objectives.
Senior Software Engineer, Backend
VTEXVTEX (NYSE: VTEX) is the composable and complete commerce platform that delivers more efficiency and less maintenance to organizations seeking to make smarter IT investments and modernize their tech stack. Through our pragmatic composability approach, we empower brands, distributors, and retailers with unparalleled flexibility and comprehensive solutions. VTEX is trusted by 2,400 global B2C and B2B customers, including Carrefour, Colgate, Motorola, Sony, Stanley Black & Decker, and Whirlpool, having 3,400 active online stores across 43 countries (as of FY ended on December 31, 2024). Founded in the year 2000, VTEX has a history of being unstoppable, leading a high-tech industry and positioned above market giants. We are building an extraordinary future with more than 1,300 employees across 25 locations in 16 countries in Latin America, North America, Europe, and Asia. At VTEX, you will work in a challenge-driven environment and collaborate with amazing peers. If you are powerful individually, join us, and we will be unstoppable together.
Role Description We are proactively seeking a highly skilled Senior Backend Engineer to join our team. The ideal candidate will have experience in developing multi-tenant SaaS solutions and a proven track record in backend development. As a Senior Backend Engineer, you will: - Serve as a technical reference for the team, providing guidance and expertise in backend development best practices. - Be responsible for important evolutions of our products in terms of scalability and product evolution to address main customers' demands and market opportunities. - Make contributions that will directly impact the success and global growth of our organization. Qualifications - Experience in building backend systems for large-scale applications. - Demonstrated experience in a technical guidance capacity, successfully guiding project teams and establishing strategic technical direction. - Proficient in multiple programming languages, with a primary focus on C#. - Academic background preferably in Engineering courses, such as Computer Engineering, Software Engineering, Electrical Engineering, Automation Engineering, or related fields. - Proven track record of working with cross-functional teams. - Ability to thrive in dynamic environments. - Effective communication skills in English and Portuguese. - Hands-on and curious about AI, using LLMs, automation, and design/dev tools to boost speed, quality, and clarity in workflow. Benefits - Annual profit-sharing program and equity eligibility. - Health, dental, and life insurance with national coverage provided by VTEX. - Annual budget for professional development in Tech. - Language development incentive program (English, Spanish, Portuguese). - Flexible meal allowance. - Extended parental leaves. - Child-care assistance. - Flexible work schedule and remote-first culture. - Financial assistance to build your work-from-home setup. - Wellness program. - Free shipping on 1000+ VTEX stores. Company Description VTEX (NYSE: VTEX) is the composable and complete commerce platform that delivers more efficiency and less maintenance to organizations seeking to make smarter IT investments and modernize their tech stack. Through our pragmatic composability approach, we empower brands, distributors, and retailers with unparalleled flexibility and comprehensive solutions. VTEX is trusted by 2,400 global B2C and B2B customers, including Carrefour, Colgate, Motorola, Sony, Stanley Black & Decker, and Whirlpool, having 3,400 active online stores across 43 countries (as of FY ended on December 31, 2024). Founded in the year 2000, VTEX has a history of being unstoppable, leading a high-tech industry and positioned above market giants. We are building an extraordinary future with more than 1,300 employees across 25 locations in 16 countries in Latin America, North America, Europe, and Asia. At VTEX, you will work in a challenge-driven environment and collaborate with amazing peers. If you are powerful individually, join us, and we will be unstoppable together.


