Job Closed

This listing is no longer active.

Stefanini Brasil logo
Stefanini Brasil

Co-creating Solutions for a Better Future

Data Engineer III

EngineerEngineerFull TimeRemoteSeniorTeam 10,001+Since 1987H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

10 days ago

Salary

0

Seniority

Senior

Bachelor DegreePortugueseAirflowApacheAWSAzurePySparkPythonSQL

Job Description

Data Engineer III

Stefanini Brasil

• Develop and maintain data pipelines in PySpark, ensuring high performance, scalability, and reliability. • Design and implement data ingestion, transformation, and provisioning solutions in AWS (S3, Glue, Athena, EMR). • Orchestrate data workflows using Apache Airflow, ensuring scheduling, monitoring, and failure recovery. • Model and optimize SQL queries for large data volumes, applying best practices for partitioning and column pruning. • Implement and maintain CI/CD pipelines for automated deployment of pipelines, scripts, and DAGs. • Collaborate with analytics, data science, and business teams to ensure timely delivery of reliable data. • Contribute to the continuous improvement of pipelines. • Develop solutions in Databricks for distributed processing and exploratory analysis. • Actively participate in agile ceremonies, such as planning, daily stand-ups, and retrospectives.

Job Requirements

  • Strong experience with Python and PySpark for large-scale data processing.
  • Proficiency in SQL for data modeling, transformation, and analysis.
  • Experience with Databricks (notebooks, jobs, Delta Lake).
  • Hands-on experience with AWS data services (S3, Glue, Athena, EMR).
  • Experience with Apache Airflow for pipeline orchestration (creating DAGs, sensors, operators).
  • Experience with CI/CD for data (Azure DevOps Pipelines, GitHub Actions, or similar).
  • Knowledge of Data Lake architectures (medallion architecture, columnar formats, Iceberg/Delta tables).
  • Ability to write clean, parameterized, and testable code.
  • Knowledge of code versioning tools (Git, branching strategies, pull requests).
  • Ability to work in an agile, collaborative environment.
  • Strong communication and teamwork skills.
  • Experience with Power BI for building dashboards and data visualizations.
  • Familiarity with AI-assisted development tools (Vibe Code, Kiro, Cursor) for accelerating development.
  • Experience with Apache Iceberg or Delta Lake for transactional tables.
  • Knowledge of data quality tools (Great Expectations or similar).

Benefits

  • Meal allowance or meal voucher.
  • Discounts on courses, universities, and language schools.
  • Stefanini Academy — platform with free, up-to-date online courses and certificates.
  • Mentoring.
  • Benefits club for medical consultations and exams.
  • Health insurance.
  • Dental insurance.
  • Discounts and perks at partner establishments.
  • Travel club.
  • Pet care benefits.

Related Categories

Related Job Pages

More Engineer Jobs

Rapid7 logo

Lead Data Engineer

Rapid7

At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what’s possible and drive extraordinary impact. We’re building a dynamic and collaborative workplace where new ideas are welcome. Protecting 11,000+ customers against bad actors and threats means we’re continuing to push the envelope - just like we’ve been doing for the past 20 years. If you’re ready to solve some of the toughest challenges in cybersecurity, we’re ready to help you take command of your career. Join us.

Engineer10 days ago
Full TimeRemoteTeam 1,001-5,000Since 2000H1B Sponsor

Lead Data Engineer, Data Engineering & Analytics Location: India Department: IT About Company: Rapid7 is seeking a Data Engineer, Data Engineering & Analytics to join a high-performing data engineering and reporting team. This role is responsible for participating in the management of a robust Snowflake infrastructure, data modeling in a modern tech stack, and optimizing the company's Tableau reporting suite, ensuring that all business units have access to timely, accurate, and actionable data. This is a critical position that will help to develop and maintain the data strategy, architecture, and analytics capabilities at Rapid7, driving insights that enable business growth. The ideal candidate will have experience in data engineering, analytics, and business intelligence, with equal amounts of business and technical acumen. About Role: - Implement data modeling best practices to enhance data accessibility and reporting capabilities. - Ensure data integrity, security, and compliance with industry standards and regulations. - Document plans and results in user-stories, issues, PRs, the team's handbook - following the tradition of documentation first! - Implement the Corp Data philosophy in everything you do. - Craft code that meets our internal standards for style, maintainability, and best practices for a high-scale database environment. Maintain and advocate for these standards through code review. - Collaborate with IT and DevOps teams to optimize cloud infrastructure and data governance policies. - Manage and enhance the existing Tableau reporting suite, ensuring self-service analytics and actionable insights for stakeholders. - Design, develop, and extend DBT code repository to extend the Enterprise Dimensional Warehouse capabilities and infrastructure - Develop and maintain a single source of truth for business metrics, ensuring consistency across reporting platforms. - Approve data model changes as a Data Team Reviewer and code owner for specific database and data model schemas. - Provide data modeling expertise to all Rapid7 teams through code reviews, pairing, and training to help deliver optimal, DRY, and scalable database designs and queries in Snowflake and in Tableau. - Research and implement emerging trends in data analytics, visualization, and engineering, bringing innovative solutions to the organization. - Align to data governance frameworks, policies, and best practices, in collaboration with existing teams, policies, and governance frameworks. - Identify and lead opportunities for new data initiatives, ensuring Rapid7 remains data-driven and insights-powered. What You Bring to the Role - Ability to thrive in a fast-paced hybrid organization. - Comfort working in a highly agile, intensely iterative environment. - Demonstrated capacity to clearly and concisely communicate complex business activities, technical requirements, and recommendations. - 8+ years of experience in data engineering, analytics, or business intelligence. - 8+ years experience designing, implementing, operating, and extending enterprise dimensional data models. - 3+ years experience building reports and dashboards in Tableau and/or other similar data visualization tools. - Experience in DBT modeling and understanding modular, performant models. - Solid understanding of Snowflake, SQL, and data warehouse management. - Understanding of ETL/ELT processes, data pipelines, and cloud-based data architectures. - Familiarity with modern data stacks (DBT, Airflow, Fivetran, Matillion, or similar tools). - Hands-on experience building and operating cloud infrastructure on AWS. - Experience managing software installations, upgrades, and configuration in production environments. - Ability to manage data governance, security, and compliance requirements (SOC 2, GDPR, etc.). - A passion for continuous learning, innovation, and leveraging data for business impact. About Rapid7 At Rapid7, our vision is to create a secure digital world for our customers, our industry, and our communities. We do this by harnessing our collective expertise and passion to challenge what's possible and drive extraordinary impact. We're building a dynamic and collaborative workplace where new ideas are welcome. Protecting 11,000+ customers against bad actors and threats means we're continuing to push the envelope just like we' ve been doing for the past 20 years. If you 're ready to solve some of the toughest challenges in cybersecurity, we're ready to help you take command of your career. Join us.

India
ANS logo

Battery Storage Commissioning Engineer

ANS

We are an award winning, multi-disciplinary engineering firm.

Engineer10 days ago
Full TimeRemoteTeam 201-500Since 2005H1B Sponsor

• Communicate clearly with our client who is the Owner and operator of these projects. • Provide responses to close out the construction of the project by supporting the EPC and contractors. • Prioritize and lead the team in which testing comes first to ensure a safe and on time project. • Lead Reoccurring meetings with all stakeholders including the owner, EPC, vendors, engineers, utility and others. • Complete key testing deliverables. • Provide detailed review of all projects Mechanical and substantial completion tests from the EPC or contractor. • Lead interconnection testing with the utility to witness, record and pass utility energization and sync testing. • Manage different login portals for the site.

Kansas
$80K - $100K / year
Washington University in St. Louis logo

Neuroimaging Engineer – Neurology

Washington University in St. Louis

Located in St. Louis, Missouri, Washington University in St. Louis is an award-winning institution of higher education dedicated to excellence in learning, teac

Engineer10 days ago

• Develop, implement, and maintain computer algorithms for analyzing structural and functional MRI data for neuroimaging-related neuroscience research purposes. • Assist with design and ongoing development of custom software necessary to implement computer algorithms. • Process existing neuroimaging data and perform robust quality assurance. • Database management for neuroimaging studies. • Prepare program descriptions and documentation both for newly developed and existing analysis software for the purpose of processing and analyzing neuroimaging data. • Develop and apply advanced statistical and analytical approaches to neuroimaging and related data using software programming tools (e.g., Linux, MATLAB, Python, R routines). • Transfer files to appropriate server and maintain study neuroimaging database. • Miscellaneous tasks related to laboratory neuroimaging analyses goals

United States
$53.1K - $90.6K / year
Ensemble Health Partners logo

Senior Technologies Engineer

Ensemble Health Partners

Innovation in Revenue Cycle Management

Engineer10 days ago
Full TimeRemoteTeam 5,001-10,000H1B No Sponsor

• Lead the development, implementation, and maintenance of complex IT systems and networks • Oversee the design and implementation of hardware and software systems • Ensure network security and participate in daily IT operations • Manage and provide support for systems integrations, automation scripts, and improve existing technology • Collaborate with other IT teams to identify areas for automation to improve operational efficiency • Develop and implement IT policies and procedures for network and system security • Provide training and support to end-users on technology systems and processes • Monitor and manage network and system performance to ensure uptime and availability • Regularly report to management on IT projects, system performance, and network security.

United States
$111.8K - $167.7K / year