Wizdaa logo
Wizdaa

Specializes in building world-class development teams and extending runways for groundbreaking startups.

Data Engineer, Python, PySpark, AWS Glue, Amazon Athena, SQL, Apache Airflow

Backend EngineerSoftware EngineerFull TimeRemoteSeniorTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

5 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer, Python, PySpark, AWS Glue, Amazon Athena, SQL, Apache Airflow

Wizdaa

• Build, optimize, and scale data pipelines and infrastructure using Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake • Design, operationalize, and monitor ingest and transformation workflows: DAGs, alerting, retries, SLAs, lineage, and cost controls • Collaborate with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows; work toward a feature store • Integrate pipeline health and metrics into engineering dashboards for full visibility and observability • Model data and implement efficient, scalable transformations in Snowflake and PostgreSQL • Build reusable frameworks and connectors to standardize internal data publishing and consumption

Job Requirements

  • 4+ years of production data engineering experience
  • Deep, hands-on experience with Apache Airflow, AWS Glue, PySpark, and Python-based data pipelines
  • Strong SQL skills and experience operating PostgreSQL in live environments
  • Solid understanding of cloud-native data workflows (AWS preferred) and pipeline observability (metrics, logging, tracing, alerting)
  • Proven experience owning pipelines end-to-end: design, implementation, testing, deployment, monitoring, and iteration
  • Experience with Snowflake performance tuning and cost optimization
  • Real-time or near-real-time processing experience (e.g., streaming ingestion, incremental models, CDC)
  • Hands-on experience with a backend TypeScript framework (NestJS is a strong plus)
  • Experience with data quality frameworks, contract testing, or schema management
  • Background in building internal developer platforms or data platform components (connectors, SDKs, CI/CD for data)

Benefits

  • Fully remote position
  • Work hours aligned with EST or PT time zones

Related Job Pages

More Backend Engineer Jobs

Quidax logo

Software Engineer – Java, Spring Boot

Quidax

Process large volumes of crypto, build crypto products with our API & get your token listed on Africa's leading exchange

Full TimeRemoteTeam 11-50Since 2016

• Get across the core Java/Spring Boot services, understand the critical flows, and ship your first meaningful fix. • Own specific features or services end to end, with support from the team where needed. • Independently investigate and resolve reliability issues across APIs, integrations, and transaction flows. • Reduce recurring issues: stuck transactions, failed callbacks, unclear states, and manual escalations. • Improve test coverage across critical flows and leave every area you touch cleaner than you found it. • Add observability where it's weak: better logging, alerts, and debugging hooks. • Participate in code reviews, share what you learn, and support engineers around you. • Grow your understanding of transaction heavy systems: idempotency, retries, state machines, and reconciliation.

Nigeria
Quidax logo

Software Engineer, Ruby, Ruby on Rails

Quidax

Process large volumes of crypto, build crypto products with our API & get your token listed on Africa's leading exchange

Full TimeRemoteTeam 11-50Since 2016

• Join a focused team working on the flows that matter most: deposits, withdrawals, partner integrations, and reconciliation. • Get across the RAMP codebase, understand the core flows, and ship your first meaningful fix in the first 30 days. • Own specific features or flows end-to-end by month 3, with support from the team where needed. • Independently investigate and resolve reliability issues across deposits, withdrawals, and partner callbacks by month 6. • Reduce recurring issues: stuck transactions, failed callbacks, unclear states, and manual escalations. • Improve test coverage across critical flows and leave every area you touch cleaner than you found it. • Add observability where it's weak: better logging, alerts, and debugging hooks. • Participate in code reviews, share what you learn, and support engineers around you. • Grow your understanding of transaction-heavy systems: idempotency, retries, state machines, and reconciliation.

United States
Zup Innovation logo

Tech Lead, Java

Zup Innovation

We create digital assets to build, grow and accelerate your applications with efficiency, security and scalability.

Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Lead the implementation of critical technical solutions, proposing improvements in architecture, observability, and security. • Analyze and propose scalable solutions for distributed systems, mitigating technical risks and anticipating bottlenecks. • Support development teams by promoting best practices, performing code reviews, and ensuring high-quality deliveries. • Design and implement robust CI/CD pipelines integrated with automations for multiple environments. • Define local standards for RESTful APIs and microservices, promoting consistency, monitoring, and reliability. • Develop security guidelines and ensure their adoption, reducing vulnerabilities and production incidents. • Collaborate with stakeholders to align technical decisions with strategic business objectives.

Brazil
VTEX logo

Senior Software Engineer, Backend

VTEX

VTEX (NYSE: VTEX) is the composable and complete commerce platform that delivers more efficiency and less maintenance to organizations seeking to make smarter IT investments and modernize their tech stack. Through our pragmatic composability approach, we empower brands, distributors, and retailers with unparalleled flexibility and comprehensive solutions. VTEX is trusted by 2,400 global B2C and B2B customers, including Carrefour, Colgate, Motorola, Sony, Stanley Black & Decker, and Whirlpool, having 3,400 active online stores across 43 countries (as of FY ended on December 31, 2024). Founded in the year 2000, VTEX has a history of being unstoppable, leading a high-tech industry and positioned above market giants. We are building an extraordinary future with more than 1,300 employees across 25 locations in 16 countries in Latin America, North America, Europe, and Asia. At VTEX, you will work in a challenge-driven environment and collaborate with amazing peers. If you are powerful individually, join us, and we will be unstoppable together.

Full TimeRemoteTeam 1,001-5,000

Role Description We are proactively seeking a highly skilled Senior Backend Engineer to join our team. The ideal candidate will have experience in developing multi-tenant SaaS solutions and a proven track record in backend development. As a Senior Backend Engineer, you will: - Serve as a technical reference for the team, providing guidance and expertise in backend development best practices. - Be responsible for important evolutions of our products in terms of scalability and product evolution to address main customers' demands and market opportunities. - Make contributions that will directly impact the success and global growth of our organization. Qualifications - Experience in building backend systems for large-scale applications. - Demonstrated experience in a technical guidance capacity, successfully guiding project teams and establishing strategic technical direction. - Proficient in multiple programming languages, with a primary focus on C#. - Academic background preferably in Engineering courses, such as Computer Engineering, Software Engineering, Electrical Engineering, Automation Engineering, or related fields. - Proven track record of working with cross-functional teams. - Ability to thrive in dynamic environments. - Effective communication skills in English and Portuguese. - Hands-on and curious about AI, using LLMs, automation, and design/dev tools to boost speed, quality, and clarity in workflow. Benefits - Annual profit-sharing program and equity eligibility. - Health, dental, and life insurance with national coverage provided by VTEX. - Annual budget for professional development in Tech. - Language development incentive program (English, Spanish, Portuguese). - Flexible meal allowance. - Extended parental leaves. - Child-care assistance. - Flexible work schedule and remote-first culture. - Financial assistance to build your work-from-home setup. - Wellness program. - Free shipping on 1000+ VTEX stores. Company Description VTEX (NYSE: VTEX) is the composable and complete commerce platform that delivers more efficiency and less maintenance to organizations seeking to make smarter IT investments and modernize their tech stack. Through our pragmatic composability approach, we empower brands, distributors, and retailers with unparalleled flexibility and comprehensive solutions. VTEX is trusted by 2,400 global B2C and B2B customers, including Carrefour, Colgate, Motorola, Sony, Stanley Black & Decker, and Whirlpool, having 3,400 active online stores across 43 countries (as of FY ended on December 31, 2024). Founded in the year 2000, VTEX has a history of being unstoppable, leading a high-tech industry and positioned above market giants. We are building an extraordinary future with more than 1,300 employees across 25 locations in 16 countries in Latin America, North America, Europe, and Asia. At VTEX, you will work in a challenge-driven environment and collaborate with amazing peers. If you are powerful individually, join us, and we will be unstoppable together.

Brazil