Navigate Change
Mid-Senior Data Developer, PySpark, AWS
Location
Brazil
Posted
6 days ago
Salary
0
Seniority
Senior
Job Description
Mid-Senior Data Developer, PySpark, AWS
CI&T
• Design, implement, and maintain end-to-end data pipelines (ELT/ETL) with a focus on reliability, reprocessing, and cost efficiency. • Orchestrate jobs and routines using Airflow (on AWS) and serverless functions (AWS Lambda); support deployments on EKS when needed. • Model data in Snowflake (bronze/silver/gold layers) and develop transformations in dbt (macros, tests, docs). • Build integrations and services in Python with FastAPI to expose/consume data and automate processes. • Ingest, normalize, and version market data, with emphasis on historical data and distribution (batch; limited streaming). • Write high-performance SQL (tuning, partitioning/clustering in Snowflake and in Postgres). • Use Pandas for ad-hoc processing, validations, and transformation prototyping. • Ensure quality (dbt tests, data checks), observability (logs/metrics/alerts), security (access controls, masking), and documentation. • Collaborate with business, analytics, and product teams to define SLAs, data contracts, and governance standards.
Job Requirements
- Strong experience with SQL (query optimization, relational and analytical modeling).
- Hands-on experience with Snowflake (warehousing, roles, tasks, performance, cost management) and dbt (models, tests, sources, exposures).
- Experience building data pipelines in Airflow (DAGs, sensors, retries, SLAs) and AWS Lambda.
- Knowledge of Postgres (ingestion, basic replication/CDC or maintenance, routines).
- Experience with Python for data (Pandas) and API development with FastAPI.
- Practice in batch-oriented ELT/ETL, Git versioning, and CI/CD (secure deployment of pipelines/dbt models).
- Familiarity with data security and governance (access control, lineage, documentation, sensitive data).
- Technical English for reading documentation.
Benefits
- Health and dental insurance
- Food and meal allowance
- Childcare assistance
- Extended parental leave
- Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) / TotalPass
- Profit Sharing (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Employee discount club
- Free online platform dedicated to physical and mental health and well-being
- Prenatal and responsible-parenting course
- Partnerships with online course platforms
- Language learning platform
Related Guides
Related Job Pages
More Software Engineer Jobs
Senior Software Engineer (Fullstack), Digital Storefront
ToastToast is driven by its all-in-one platform that helps restaurants operate their business, increase sales, engage guests, and keep employees happy. Our FinTech business line designs and builds creative solutions to assist restaurants with their unique and evolving financial needs.
Role Description In this role, you will be in a unique position to work on a variety of different projects and have a strong voice in technology, product, and business strategy. This position is an exceptional opportunity for a smart, hands dirty, entrepreneurial engineer who wants to work with a modern stack and solve real business problems via technology. As such you should be prepared to run experiments and iterate quickly. Responsibilities include: - Design, scope and implement solutions using a combination of technologies - Enhance the platform to improve performance, usability, and scalability - Work closely with your team to identify high-impact opportunities - Total commitment to being a great teammate Qualifications - 5+ years of experience developing fullstack web applications - Working knowledge of JS frameworks such as React - Working knowledge of CSS and frameworks such as Tailwind, Bootstrap, or similar - Working knowledge of backend technologies like Node.js, Java, or Kotlin - Experience building on top AWS services with other tools like Docker, and Git - Familiarity implementing designs provided by high-fidelity UX mocks in Figma, Sketch, etc. - Experience shipping and maintaining testable code bases, including API design and unit-testing frameworks - Passionate about making users happy and seeing people use your product in the wild - Ability to embrace the agile mindset and understand that sometimes we need to ship features quickly and clean up the code later - Comfortable with testing methodologies and frameworks Requirements - Embrace changes that let us build more for our customers Benefits - Competitive compensation and benefits programs - Flexibility to meet Toasters’ changing needs - Base salary range based on skills, experience, and geographic location - Total rewards components include cash compensation (overtime, bonus/commissions if eligible), equity, and benefits
Alternance – Ingénierie de formation et accompagnement métier
RATP Dev USAYour future. Our destination.
• Créer et mettre à jour des modules e‑learning (avec les outils Storyline et K-studio) • Adapter des contenus existants (mettre à jour des fiches mémos sur le SharePoint Galaxie) • Accompagner les utilisateurs dans la prise en main des outils de gestion en particulier en se déplaçant dans les différents sites • Accompagner la chargée de communication et de formation dans l’animation et la mise en place des diverses campagnes d’information • Réaliser une veille simple sur les bonnes pratiques de communication • Communiquer sur les évolutions apportées à la GMAO • Contribuer à la mise à jour des communications sur le Share point de l’unité ISI
Staff Software Engineer - Admin
GoGuardianSince 2014, GoGuardian has been “on a mission to transform education” by creating software that helps schools manage their technology easily and protect students. Teachers also
Title: Staff Software Engineer - Admin Location: United States Job Description: What We Do At GoGuardian, we’re helping build a future where all learners are ready and inspired to solve the world’s greatest challenges. Our award-winning system of learning solutions is purpose-built for K-12 and trusted by school leaders to promote effective teaching and equitable engagement while helping empower educators to keep students safe. What It’s Like to Work at GoGuardian We are an outcomes-focused learning company with a steadfast focus on improving learning environments, one classroom at a time. Working with us means joining a remote team of diverse, committed, mission-driven employees who are inspired by our vision, dedicated to our customers, and ready to roll up their sleeves. Guardians put their heads together to solve problems, learn together from experiments that fail, and stand together by their work with full accountability. We balance our diligence with an inclusive culture that invites everyone to bring their whole self to work. Join us and learn why “I love the people here” is one of the most frequent comments we hear from Guardians. The Role We’re looking for a Staff Software Engineer to build new and maintain existing products in GoGuardian’s Safety product suite . In this role, you’ll contribute to the full software development lifecycle, from conception, research, definition, scoping, planning, implementation, and testing, to documentation, delivery and maintenance. This position sits on the Admin Team, GoGuardian Admin delivers a single, unified interface for setting filtering policies and reporting across ChromeOS, Windows, and macOS devices. Powerful DNS-protection helps schools comply with CIPA across BYOD, guest networks, and unmanaged devices, all managed from the same dashboard. The ideal candidate is curious, able to manage risk, and driven to deliver quality software. What You'll Do - Collaborate with a cross-functional team toward feature delivery; Working both independently and in pairs/groups with others of varying skill levels - Leverage strong problem solving skills to apply existing knowledge and experience to new problems and creative solutions - Write production-grade code for well-scoped features with the help of code reviewers - Understand, implement and contribute to GoGuardian’s best practices, including style guides, standards, code reviews, documentation management, and operational workflows - Being generally available to work during standard working hours and to participate in an on-call rotation for production application support - Work closely with Product Management to create new features and products. - Lead the application architecture decision making process. - Champion AI adoption across engineering by defining best practices and driving effective use of AI in development workflows to improve velocity, quality, and customer impact. - Continuously experiment with and operationalize AI tools to accelerate innovation, improve productivity, mentor teams on AI usage, and help shape the company’s AI engineering culture and strategy. - Take part in short and long term planning. - Build & operate AWS infrastructure - Monitor and track performance and reliability of our services and software to meet promised SLA - Mentor other developers to increase the overall performance of the team. Who You Are - 8+ years experience as a software engineer of SaaS applications and or working on customer facing products - Competency in one or more languages. Experience with Go, Javascript, React, and MySQL preferred - Competency with Kafka or other Event Sourcing Systems - Direct involvement in shipping at least one production application / product - Experience with monitoring, performance optimization, technical documentation, and unit / integration testing - Up-to-date knowledge of full stack web development languages, libraries, and technology - Writes production-grade code for well-scoped features; integrating feedback from code reviewers - Learns quickly, applies existing knowledge to new challenges and is building proficiency in relevant technical skills - Confident in making technical decisions and explaining the reasoning behind them - Have deployed software utilizing AWS, Terriform, Kubernetes, Docker, and/or other similar technology. - Can drive automation adoption and enhancement in areas such as Test Automation, Github Runners, CI/CD platforms, and other automation platforms - Can drive change beyond the scope of the team. Nice to Have - An interest in Machine Learning and AI technology What We Offer - Competitive pay, complete health insurance, 401(k) matching, and an employee equity plan. - Flexible time off, paid holidays, paid parental leave, and a paid year-end holiday break. - A robust catalog of benefits that support your professional growth and personal wellbeing, including work from home funds, fertility & adoption reimbursement, and more… Plus the intangible - A varied and challenging role in an innovative, global company. - Supportive, driven colleagues who have your back and share your passion. The typical base salary range for this position is $190,000 - $205,000 per year. The range displayed on this job posting reflects the minimum and maximum target for new hire base pay for this position and your pay will be determined by a variety of factors, including your primary work location, skills, qualifications and experience. Additional benefits information is listed on our careers page. Please share this with your friends or co-workers who may be interested in working at GoGuardian! We have multiple openings and are always looking for talented people. GoGuardian is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. GoGuardian does not discriminate against employees, applicants, interns or volunteers on the basis of race, religion, color, national origin, ancestry, physical disability, mental disability, medical condition, pregnancy, marital status, sex, age, sexual orientation, military and veteran status, registered domestic partner status, genetic information, gender, gender identity, gender expression, or any other characteristic protected by applicable law. GoGuardian's Job Applicant Privacy Policy is located here. #BI-Remote
• Collaborate with your engineering team on the design, development, and testing of features in Celonis’s cloud product. • Write clean, well-structured code using our modern tech stack, which includes Angular, Spring Boot, C++17, and Kubernetes. • Contribute to real product work — not toy projects — with ownership of specific features or components. • Work closely with senior engineers and your mentor to grow your technical skills and broaden your understanding of large-scale software systems. • Participate in code reviews, standups, and team rituals to get a full picture of how high-performing engineering teams operate. • Explore and contribute to open-source code and projects where applicable. • Bring curiosity and fresh perspective to the table — your ideas are welcome here.




