Job Closed

This listing is no longer active.

Semantix logo
Semantix

AI for all!

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 501-1,000Since 2010H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

94 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expPortugueseEnglishAzureERPETLPySparkScalaApache SparkSQLTerraformUnity

Job Description

Senior Data Engineer

Semantix

• Build and maintain ETL/ELT pipelines in Azure Data Factory, integrating sources such as ERP/CRM/APIs/streaming into a Lakehouse (Delta Lake) and consumption layers. • Develop transformations and jobs in Databricks using Spark (PySpark/Scala) and SQL, ensuring performance, cost-efficiency, and reliability. • Perform data modeling (bronze/silver/gold) and provide datasets for consumption in Power BI and/or the DW/Lakehouse. • Act as a bridge between data engineering and BI, translating business requirements into analytical solutions. • Implement governance best practices (catalog, ownership, standards, access controls) and support compliance with LGPD. • Define and operate Data Quality, observability, and lineage with monitoring, alerts, and SLAs. • Automate infrastructure and deployments using Terraform and CI/CD. • Document solutions, design architecture, and participate in technical decisions and estimates.

Job Requirements

  • Senior experience with Azure, including Databricks and Azure Data Factory.
  • Strong knowledge of Delta Lake/Lakehouse, Spark (PySpark/Scala), and SQL.
  • Experience with data modeling for analytics/BI and integration with Power BI.
  • Experience with data governance/catalog and access controls (e.g., Unity Catalog and/or an enterprise catalog tool).
  • Experience with Data Quality, observability, lineage, and practices aligned with LGPD.
  • Experience with Terraform and CI/CD pipelines.
  • Soft skills: business communication, autonomy, and priority management.
  • Advanced English (meetings and documentation) — will be tested in the interview.

Benefits

  • Market-competitive salary;
  • Caju (flexible benefits card) with monthly top-up;
  • Bradesco Health Plan;
  • Bradesco Dental Plan;
  • Preventive care with Dr. Alper;
  • Life insurance;
  • Gympass;
  • SESC benefits;
  • Childcare assistance for mothers and fathers;
  • Learning: a department focused on developing hard and soft skills;
  • Partnerships with educational institutions for technical training, MBA, postgrad programs, certifications, English and Spanish courses;
  • Career development plan;
  • Discounts on products from a partner portal

Related Categories

Related Job Pages

More Data Engineer Jobs

Donnes logo

Senior Data Engineer

Donnes

Conectando talentos para impulsionar a evolução das empresas

Data Engineer94 days ago
Full TimeRemoteTeam 11-50Since 2021H1B No Sponsor

• Develop, maintain, and evolve scalable data pipelines using Airflow as the primary orchestration tool; • Build robust integrations across multiple data sources, ensuring consistency, auditability, and data quality; • Work on data modeling and transformations for analytical and operational layers; • Ensure stability and observability of critical pipelines, reducing incidents and increasing platform reliability; • Contribute best practices for versioning, automation, testing, and architectural standards; • Collaborate with Software Engineering, Architecture, Product, and business teams to prioritize and deliver requirements; • Participate in technical decisions that impact the evolution of the data architecture; • Support the modernization of legacy processes and the continuous improvement of the platform.

Brazil
Federato logo

Senior Data Engineer

Federato

When underwriters have real-time risk selection and portfolio insights at their fingertips, profitable growth follows!

Data Engineer94 days ago
OtherRemoteTeam 11-50H1B Sponsor

• Collaborate with Data Science, Product Managers and Software Engineers to build robust ETL pipelines that enable the Product Support team to deliver compelling user-facing features • Contribute to architecture decisions, observability tooling, and data quality initiatives that keep our platform robust and maintainable. • Contribute to a scalable internal framework for managing prompt engineering pipelines and other AI workflows. • Enforce and elevate engineering best practices across the AI/ML org, including code quality, testing, and documentation.

United States
$185K - $215K / year
Job Closed
Simple Solutions logo

Sr SAP Solutions Architect for S/4 Data Migration

Simple Solutions

NetApp / ONTAP Storage Engineering — FSx for ONTAP provisioning, volume and SVM management, snapshot policies, tiering policies, ONTAP CLI/REST API operations, and performance tuning AWS Storage Architecture — FSx for ONTAP sizing and deployment, throughput capacity planning, integration with VPCs, and cost optimization (capacity pool vs. SSD tier) Data Migration & Replication — SnapMirror configuration for cross-region replication, NetApp XCP or robocopy for bulk data migration, cutover planning, and data validation Cloud Network Architecture — VPC subnet design, security groups for NFS/SMB/iSCSI protocols, cross-region VPC peering for replication traffic, and DNS configuration for file system endpoints Linux / Windows Systems Engineering — NFS mount configuration on Linux, SMB share mapping on Windows, multi-protocol access testing, and client-side performance tuning Backup, DR & Data Protection — AWS Backup integration with FSx for ONTAP, snapshot scheduling, cross-region DR strategy, and RTO/RPO validation Security & Compliance — Encryption at rest (KMS), encryption in transit, IAM policies for FSx access, ONTAP export policies, and data governance controls

Data Engineer94 days ago
OtherRemoteTeam 2-10

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description The SAP S/4HANA Solution Architect is the technical and functional lead responsible for reviewing the current CLIENT blueprint and identifying process and system gaps between the existing SAP ECC / MES / PLM landscape and S/4HANA OOTB capabilities. - Lead architecture review of CLIENT's current SAP environment and blueprint documentation - Define and recommend migration approach (greenfield, Bluefield, or selective data transition) for CLIENT sites and product lines - Identify integration touchpoints between SAP S/4HANA, MES (Manufacturing Execution Systems), and PLM platforms - Design the target architecture ensuring OOTB S/4HANA processes are adopted wherever possible - Provide technical governance across all SAP functional workstreams - Collaborate with CLIENT DT stakeholders to validate architecture decisions - Support the development of 2–3 solution options for presentation to ITAR CLIENT Qualifications - 12-15+ years of SAP experience with at least 5-10+ years in S/4HANA implementations - Deep expertise in SAP S/4HANA architecture, data migration strategies, and integration frameworks - Experience with greenfield, Bluefield, and selective data transition approaches - Strong understanding of MES and PLM integration with SAP in a manufacturing context - Prior experience in aerospace, defense, or complex manufacturing industries preferred - Familiarity with ITAR-regulated environments is a plus - Excellent stakeholder communication and presentation skills Company Description

United States
Job Closed
OtherRemoteTeam 51-200

Join Our Team at Rancho BioSciences! As we continue to grow, Rancho BioSciences is seeking an experienced and dynamic R&D Architect/Principal Architect to join our team. This role is critical in driving results across a project, ensuring successful execution, strategic alignment, and effective team collaboration. This individual will drive engagements in data-related and technology-driven projects with a focus on development while maintaining strong client engagement. Who We Are Rancho BioSciences is a globally recognized leader in providing advanced services and products across data curation, governance, bioinformatics, and analytics. Our expertise includes project execution, process improvement, and business analysis, all delivered with a steadfast commitment to innovation and quality. We collaborate with research foundations, biotech companies, government labs, and academic institutions to enable breakthroughs in drug discovery, biomedical research, and precision medicine. Our mission is to bridge science and healthcare, helping to transform data into actionable insights that drive new discoveries and improve patient care across the globe. As a rapidly growing global team, we are excited to expand and welcome talented individuals to help us shape the future of data to drive outcomes for our clients. What You'll Do Key Responsibilities: - Lead the design and delivery of complex, scalable, and maintainable technical solutions across client and internal projects - Define and communicate system architecture, design patterns, and technical standards that guide implementation teams - Translate high-level business and functional requirements into robust, end-to-end solution architectures - Provide technical leadership across project workstreams, ensuring alignment with engineering principles and best practices - Proactively identify technical risks, integration challenges, and optimization opportunities, and drive resolution - Serve as a trusted technical advisor to clients – able to clarify requirements, validate approaches, and shape long-term technical roadmaps - Review and approve designs, code, and documentation to maintain quality and consistency across teams and projects - Mentor and support junior cohorts through technical guidance, feedback, and knowledge sharing - Collaborate with project managers and consulting leads to scope, estimate, and plan technical work - Contribute to the development of internal frameworks, accelerators, and reusable assets that improve delivery efficiency - Stay current on emerging technologies and evaluate their potential impact - Represent the engineering function in strategic client discussion What We're Looking For Must-Haves: - 5+ years of engineering experience, with demonstrated success designing and delivering complex technical solutions in consulting, data, or software delivery environments - Proven experience defining system or platform architectures, technical standards, and best practices - Deep proficiency in at least one core engineering domain – software/application, data, or cloud engineering; must have strong working knowledge of adjacent domains - Hands on experience in a modern technology stack (dbt, React, Vue, AWS/Azure/GCP, Python, SQL, Gremlin) and familiarity with integration patterns across systems and services - Strong understanding of software engineering and architectural principles - Experience with infrastructure as cod, CI/CD automation, and DevOps practices to support reliable deployments - Demonstrated ability to translate complex business needs into sound technical designs and actionable engineering plans - Proven success leading technical workstreams or teams, including mentoring and code/design reviews - Excellent written and verbal communication skills – ability to articulate design decisions and trade off clearly to both technical and non-technical stakeholders - Strong collaboration skills; able to partner with management consultants, project managers, and clients to guide technical direction and ensure delivery success - Commitment to quality, technical excellence, and continuous improvement in both engineering and consulting practices - Demonstrated experience leading and operating in agile, iterative, or hybrid project delivery environments Nice-to-Haves: - Advanced degree (PhD, MBA, or MS) or practical experience in a Life Science related field - Exposure and familiarity with emerging technologies in R&D, including AI/ML in drug discovery, real-world evidence (RWE), and digital clinical trials - Deep experience with data platform design (Snowflake, Databricks, Redshift/Athena, BigQuery, etc) - Proficiency with cloud native architecture patterns, microservices, and infrastructure-as-code (Teraform, CloudFormations, Pulumi) - Hands on experience implementing or governing DevOps and CI/CD pipelines, containerization (Docker, Kubernetes), and automation frameworks - Strong understanding of data architecture and modeling principles, including ELT/ETL frameworks, metadata management, and data lineage - Thought leadership in the engineering community through technical blogs, presentations, or open-source contributions - Proven ability to evaluate and recommend emerging technologies that align with business and R&D strategy Why You'll Love Working at Rancho BioSciences: - We offer a variety of health and wellbeing benefits, including medical, dental, and vision plans for you and your family - We offer financial wellbeing benefits, including a 401(k) with company match - We encourage continuous learning and facilitate career conversations and coaching to support your development - We value work-life balance, offering Paid Time Off, flexible working hours, and a 100% remote work environment

United States
Job Closed