Job Closed

This listing is no longer active.

Stefanini Brasil logo
Stefanini Brasil

Co-creating Solutions for a Better Future

Data Engineer III

EngineerEngineerFull TimeRemoteSeniorTeam 10,001+Since 1987H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

58 days ago

Salary

0

Seniority

Senior

Bachelor DegreePortugueseAirflowApacheAWSAzurePySparkPythonSQL

Job Description

Data Engineer III

Stefanini Brasil

• Develop and maintain data pipelines in PySpark, ensuring high performance, scalability, and reliability. • Design and implement data ingestion, transformation, and provisioning solutions in AWS (S3, Glue, Athena, EMR). • Orchestrate data workflows using Apache Airflow, ensuring scheduling, monitoring, and failure recovery. • Model and optimize SQL queries for large data volumes, applying best practices for partitioning and column pruning. • Implement and maintain CI/CD pipelines for automated deployment of pipelines, scripts, and DAGs. • Collaborate with analytics, data science, and business teams to ensure timely delivery of reliable data. • Contribute to the continuous improvement of pipelines. • Develop solutions in Databricks for distributed processing and exploratory analysis. • Actively participate in agile ceremonies, such as planning, daily stand-ups, and retrospectives.

Job Requirements

  • Strong experience with Python and PySpark for large-scale data processing.
  • Proficiency in SQL for data modeling, transformation, and analysis.
  • Experience with Databricks (notebooks, jobs, Delta Lake).
  • Hands-on experience with AWS data services (S3, Glue, Athena, EMR).
  • Experience with Apache Airflow for pipeline orchestration (creating DAGs, sensors, operators).
  • Experience with CI/CD for data (Azure DevOps Pipelines, GitHub Actions, or similar).
  • Knowledge of Data Lake architectures (medallion architecture, columnar formats, Iceberg/Delta tables).
  • Ability to write clean, parameterized, and testable code.
  • Knowledge of code versioning tools (Git, branching strategies, pull requests).
  • Ability to work in an agile, collaborative environment.
  • Strong communication and teamwork skills.
  • Experience with Power BI for building dashboards and data visualizations.
  • Familiarity with AI-assisted development tools (Vibe Code, Kiro, Cursor) for accelerating development.
  • Experience with Apache Iceberg or Delta Lake for transactional tables.
  • Knowledge of data quality tools (Great Expectations or similar).

Benefits

  • Meal allowance or meal voucher.
  • Discounts on courses, universities, and language schools.
  • Stefanini Academy — platform with free, up-to-date online courses and certificates.
  • Mentoring.
  • Benefits club for medical consultations and exams.
  • Health insurance.
  • Dental insurance.
  • Discounts and perks at partner establishments.
  • Travel club.
  • Pet care benefits.

Related Categories

Related Job Pages

More Engineer Jobs

Rapid7 logo

Lead Data Engineer

Rapid7

At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome. Protecting 11,000+ customers against bad actors and threats means we’re continuing to push the envelope - just like we’ve been doing for the past 20 years. If you’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.

Engineer58 days ago
Full TimeRemoteTeam 1,001-5,000Since 2000H1B Sponsor

Lead Data Engineer, Data Engineering & Analytics Location: India Department: IT About Company: Rapid7 is seeking a Data Engineer, Data Engineering & Analytics to join a high-performing data engineering and reporting team. This role is responsible for participating in the management of a robust Snowflake infrastructure, data modeling in a modern tech stack, and optimizing the company's Tableau reporting suite, ensuring that all business units have access to timely, accurate, and actionable data. This is a critical position that will help to develop and maintain the data strategy, architecture, and analytics capabilities at Rapid7, driving insights that enable business growth. The ideal candidate will have experience in data engineering, analytics, and business intelligence, with equal amounts of business and technical acumen. About Role: - Implement data modeling best practices to enhance data accessibility and reporting capabilities. - Ensure data integrity, security, and compliance with industry standards and regulations. - Document plans and results in user-stories, issues, PRs, the team's handbook - following the tradition of documentation first! - Implement the Corp Data philosophy in everything you do. - Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale database environment. Maintain and advocate for these standards through code review. - Collaborate with IT and DevOps teams to optimize cloud infrastructure and data governance policies. - Manage and enhance the existing Tableau reporting suite, ensuring self-service analytics and actionable insights for stakeholders. - Design, develop, and extend DBT code repository to extend the Enterprise Dimensional Warehouse capabilities and infrastructure - Develop and maintain a single source of truth for business metrics, ensuring consistency across reporting platforms. - Approve data model changes as a Data Team Reviewer and code owner for specific database and data model schemas. - Provide data modeling expertise to all Rapid7 teams through code reviews, pairing, and training to help deliver optimal, DRY, and scalable database designs and queries in Snowflake and in Tableau. - Research and implement emerging trends in data analytics, visualization, and engineering, bringing innovative solutions to the organization. - Align to data governance frameworks, policies, and best practices, in collaboration with existing teams, policies, and governance frameworks. - Identify and lead opportunities for new data initiatives, ensuring Rapid7 remains data-driven and insights-powered. What You Bring to the Role - Ability to thrive in a fast-paced hybrid organization. - Comfort working in a highly agile, intensely iterative environment. - Demonstrated capacity to clearly and concisely communicate complex business activities, technical requirements, and recommendations. - 8+ years of experience in data engineering, analytics, or business intelligence. - 8+ years experience designing, implementing, operating, and extending enterprise dimensional data models. - 3+ years experience building reports and dashboards in Tableau and/or other similar data visualization tools. - Experience in DBT modeling and understanding modular, performant models. - Solid understanding of Snowflake, SQL, and data warehouse management. - Understanding of ETL/ELT processes, data pipelines, and cloud-based data architectures. - Familiarity with modern data stacks (DBT, Airflow, Fivetran, Matillion, or similar tools). - Hands-on experience building and operating cloud infrastructure on AWS. - Experience managing software installations, upgrades, and configuration in production environments. - Ability to manage data governance, security, and compliance requirements (SOC 2, GDPR, etc.). - A passion for continuous learning, innovation, and leveraging data for business impact. About Rapid7 At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what's possible and drive extraordinary impact. We're building a dynamic and collaborative workplace where new ideas are welcome. Protecting 11,000+ customers against bad actors and threats means we're continuing to push the envelope just like we' ve been doing for the past 20 years. If you 're ready to solve some of the toughest challenges in cybersecurity, we're ready to help you take command of your career. Join us.

India
Job Closed
ANS logo

Battery Storage Commissioning Engineer

ANS

We are an award winning, multi-disciplinary engineering firm.

Engineer58 days ago
Full TimeRemoteTeam 201-500Since 2005H1B Sponsor

• Communicate clearly with our client who is the Owner and operator of these projects. • Provide responses to close out the construction of the project by supporting the EPC and contractors. • Prioritize and lead the team in which testing comes first to ensure a safe and on time project. • Lead Reoccurring meetings with all stakeholders including the owner, EPC, vendors, engineers, utility and others. • Complete key testing deliverables. • Provide detailed review of all projects Mechanical and substantial completion tests from the EPC or contractor. • Lead interconnection testing with the utility to witness, record and pass utility energization and sync testing. • Manage different login portals for the site.

Kansas
$80K - $100K / year
WashU IT logo

Neuroimaging Engineer – Neurology

WashU IT

Washington University in St. Louis Information Technology

Engineer58 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

• Develop, implement, and maintain computer algorithms for analyzing structural and functional MRI data for neuroscience research • Assist with design and development of custom software for computer algorithms • Process existing neuroimaging data and perform quality assurance • Manage neuroimaging study databases • Prepare program descriptions and documentation for analysis software • Develop and apply statistical and analytical approaches to neuroimaging data using software programming tools

Missouri
$53.1K - $90.6K / year
Ensemble Health Partners logo

Senior Technologies Engineer

Ensemble Health Partners

Innovation in Revenue Cycle Management

Engineer58 days ago
Full TimeRemoteTeam 5,001-10,000H1B No Sponsor

• Lead the development, implementation, and maintenance of complex IT systems and networks • Oversee the design and implementation of hardware and software systems • Ensure network security and participate in daily IT operations • Manage and provide support for systems integrations, automation scripts, and improve existing technology • Collaborate with other IT teams to identify areas for automation to improve operational efficiency • Develop and implement IT policies and procedures for network and system security • Provide training and support to end-users on technology systems and processes • Monitor and manage network and system performance to ensure uptime and availability • Regularly report to management on IT projects, system performance, and network security.

United States
$111.8K - $167.7K / year
Job Closed