Minsait logo
Minsait

Join a more human technology #MoreMinsait

Senior Data Engineer – Azure Data Lakehouse

Cloud EngineerCloud EngineerFull TimeRemoteSeniorTeam 10,001+Since 2016H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

7 days ago

Salary

0

Seniority

Senior

Bachelor DegreePortugueseAzurePySparkPythonSparkSQLUnity

Job Description

Senior Data Engineer – Azure Data Lakehouse

Minsait

• Design, develop, and maintain data ingestion and transformation pipelines in an Azure Data Lakehouse. • Build solutions using Azure Databricks with PySpark and SQL for data processing and modeling. • Implement and evolve integration and orchestration pipelines using Azure Data Factory. • Perform data audits, validations, and reconciliations using advanced SQL queries. • Monitor pipeline executions, logs, and performance, proposing improvements for performance, architecture, and cost. • Document pipelines, data flows, and architecture following corporate standards. • Work on integration across multiple data sources and environments. • Ensure best practices in data governance, quality, and security.

Job Requirements

  • Solid experience with Azure Data Lakehouse.
  • Experience with Azure Databricks (PySpark and SQL).
  • Advanced proficiency in PySpark, Python, and SQL (Spark SQL and T-SQL).
  • Knowledge of Data Lakehouse architecture, Delta Lake, and Unity Catalog.
  • Experience with Azure Data Factory for pipeline ingestion and orchestration.
  • Experience with Azure Synapse Analytics.
  • Experience with Git, Azure DevOps, and CI/CD pipelines.
  • Experience with versioning pipelines in corporate environments.
  • Knowledge of Delta Sharing, SFTP, and SQL-based audits.
  • Knowledge of data governance using Unity Catalog is a plus.
  • Experience in projects integrating multiple Data Lakes using Delta Sharing is a plus.
  • Knowledge of performance and cost optimization in Azure environments is a plus.
  • Experience in enterprise data architecture and data engineering best practices is a plus.
  • Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Software Engineering, Systems Analysis and Development, or a related field.

Benefits

  • Company-subsidized Health Plan for the employee.
  • Option to include dependents in the Health Plan with payroll-deduction.
  • Dental Assistance (optional).
  • Option to include dependents in the Dental Assistance Plan with payroll-deduction.
  • Meal Allowance or Food Voucher.
  • Transportation Voucher (optional).
  • Impact & Care - Personal Guidance Program offering confidential emotional support and counseling in psychological, legal, financial, social, and pet-related matters at no cost for the employee and legal dependents.
  • Gympass - Wellhub (Access to over 700 gyms across Brazil with plans starting at BRL 29.90, payroll-deducted).
  • Option to include dependents in Gympass - Wellhub (up to 3 dependents - paid via credit card).
  • Access to Udemy via our intranet.
  • Partnerships with major consumer brands.
  • Agreement with SESC for employee and dependents.
  • Discounts with educational institutions (undergraduate and postgraduate) and language/certification schools.
  • Group life insurance.

Related Categories

Related Job Pages

More Cloud Engineer Jobs

Aspire Software logo

Senior Cloud Engineer

Aspire Software

We never stop building. A vertical acquisition software company that owns, operates and manages a diverse portfolio.

Cloud Engineer7 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Design, build, and maintain secure, scalable, and cost-effective cloud infrastructure supporting global SaaS platforms. • Collaborate with software engineering, architecture, product management, and cybersecurity teams to deliver robust cloud solutions. • Lead and contribute to the modernization of cloud infrastructure and platform services. • Implement Infrastructure as Code (IaC) and automation to improve deployment consistency, speed, and reliability. • Support and optimize cloud-native applications to ensure high availability, performance, and scalability. • Define and promote cloud engineering best practices, standards, and governance across teams. • Enhance platform reliability, security, and operational efficiency through proactive engineering and continuous improvement. • Monitor, troubleshoot, and resolve complex cloud infrastructure and application issues in production environments. • Drive improvements in CI/CD pipelines, automation workflows, and release processes. • Collaborate with cybersecurity teams to implement and maintain strong security controls and compliance standards. • Evaluate and introduce new cloud technologies and tools to improve platform capabilities and efficiency.

India
Pragmatike logo

AWS Cloud Engineer

Pragmatike

Remote first tech projects

Cloud Engineer7 days ago
Full TimeRemoteTeam 11-50Since 2022H1B No Sponsor

• Build, maintain, and optimize secure, scalable AWS infrastructure supporting production applications • Design and implement Infrastructure as Code using Terraform, Terragrunt, Ansible, and related automation tools • Develop and maintain CI/CD pipelines to enable reliable and automated software delivery • Manage containerized workloads using Kubernetes, Docker, and Helm • Improve system observability by implementing monitoring, logging, and alerting solutions • Troubleshoot infrastructure and production issues, performing root cause analysis and implementing long-term improvements • Collaborate closely with software engineers to integrate DevOps best practices throughout the development lifecycle • Optimize cloud infrastructure for performance, reliability, security, and cost efficiency • Leverage AI coding assistants to accelerate infrastructure development, automation, and operational troubleshooting

Morocco
Valsoft Corporation logo

Senior Cloud Engineer

Valsoft Corporation

Valsoft Corporation acquires and builds market software solutions. The company invests in stable businesses and aims to foster an entrepreneurial environment po

Cloud Engineer7 days ago

Role Description We are seeking a Senior Cloud Engineer to join one of our software businesses within TAG Software Group. Working closely with software engineering, architecture, product management, and cybersecurity teams, you will design, build, and support secure, scalable, and cost-effective cloud solutions that power our software platforms across a global customer base. The successful candidate will play a key role in modernizing our cloud infrastructure, implementing automation and Infrastructure as Code, supporting cloud-native applications, and establishing cloud engineering best practices. You will help improve platform reliability, security, performance, and operational efficiency while supporting the ongoing evolution of our SaaS offerings. The ideal candidate will be highly motivated, capable of working independently and collaboratively, and passionate about continuous improvement and modern cloud technologies. Qualifications - Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or equivalent experience. - 5+ years of experience in cloud engineering or DevOps roles. - Strong hands-on experience with AWS cloud services and architectures. - Experience designing and supporting secure, scalable, and highly available cloud solutions. - Experience with Infrastructure as Code (Terraform, CloudFormation, or similar). - Experience with containerization and orchestration technologies such as Docker and Kubernetes. - Experience building and maintaining CI/CD pipelines and automation frameworks. - Strong understanding of cloud networking, security, monitoring, and disaster recovery. - Proficiency in scripting and automation using Python, Bash, or PowerShell. - Strong problem-solving, communication, and collaboration skills. Requirements - AWS certification (preferred). - Experience migrating applications to the cloud (preferred). - Experience supporting .NET and/or Java applications (preferred). - Experience with Azure or multi-cloud environments (preferred). Benefits - Work on modern cloud technologies that power mission-critical SaaS platforms used by customers around the world. - Play a key role in shaping the future of our cloud infrastructure, influencing architecture, automation, and engineering best practices. - Collaborate with experienced software engineering, architecture, product, and cybersecurity teams in a highly technical and supportive environment. - Gain hands-on experience with cloud-native applications, Infrastructure as Code (IaC), and automation technologies at scale. - Take ownership of meaningful technical initiatives that improve platform reliability, security, performance, and operational efficiency. - Be part of a culture that values innovation, continuous learning, and continuous improvement, with opportunities to expand your technical expertise. - Enjoy a role that offers both autonomy and collaboration, empowering you to make a real impact while working with talented colleagues. - Help build and evolve scalable cloud platforms that support the long-term growth of our software business and our customers.

India
Capco logo

Cloud Architect – Security & Guardrails (AWS/Azure) (She/ He/ They)

Capco

Capco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries

Cloud Engineer7 days ago
Full TimeRemoteTeam 1,001-5,000Since 1998H1B Sponsor

CAPCO POLAND *We are looking for Poland based candidate. At Capco, we specialize in management consulting and technology transformation for the financial services industry. We combine innovative thinking with deep industry expertise to help our clients navigate complex change, deliver meaningful outcomes, and build future-ready organizations. Our culture is entrepreneurial, collaborative, and inclusive. We empower our people to challenge the status quo, take ownership, and make an impact from day one. As we continue to expand our Cloud and Cybersecurity capabilities, we are looking for an experienced Cloud Architect – Security & Guardrails (AWS/Azure) to help shape and secure enterprise-scale cloud environments. ROLE OVERVIEW: We are seeking a highly skilled Cloud Architect specializing in Multi-Cloud Security Operations and Governance to secure and enhance enterprise AWS and Azure environments. This role goes beyond traditional cloud architecture. You will design and implement robust defense-in-depth security frameworks, establish automated compliance guardrails, integrate advanced security platforms, and drive cloud security governance across complex environments. Working at the intersection of Cloud Engineering, Cybersecurity, Risk, and Security Operations, you will play a key role in ensuring cloud platforms remain secure, compliant, resilient, and continuously monitored. KEY RESPONSIBILITIES: - Cloud Security Governance & Guardrails - Design, implement, and enforce security baselines and preventative guardrails across AWS and Azure environments. - Develop governance frameworks leveraging: - AWS Organizations - Service Control Policies (SCPs) - AWS Control Tower - Azure Policy - Azure Landing Zones - Ensure alignment with internal security standards, regulatory requirements, and industry best practices. SIEM, Monitoring & Logging Architecture - Design and optimize multi-cloud logging and monitoring strategies. - Build scalable telemetry pipelines integrating: - AWS CloudTrail - Amazon GuardDuty - Azure Activity Logs - Microsoft Defender for Cloud - Enable centralized visibility through enterprise SIEM platforms such as: - Microsoft Sentinel - Splunk - Support real-time threat detection, correlation, investigation, and alerting capabilities. Endpoint & Workload Protection - Define architecture and deployment strategies for: - EDR/XDR solutions - Cloud Workload Protection Platforms (CWPP) - Secure virtual machines, containers, Kubernetes environments, and serverless workloads across cloud platforms. - Collaborate with Security Operations teams to enhance threat detection and response. Vulnerability & Security Posture Management - Implement and optimize Cloud Security Posture Management (CSPM) capabilities. - Establish enterprise vulnerability management processes across cloud assets. - Enable continuous security scanning for: - Cloud misconfigurations - Infrastructure vulnerabilities - Container images - Operating systems - Develop automated remediation workflows and security playbooks. Identity & Access Security - Design and enforce Zero-Trust security principles. - Strengthen Identity and Access Management (IAM) governance across cloud platforms. - Implement: - Just-In-Time (JIT) access - Privileged Access Management (PAM) - Role-Based Access Control (RBAC) - Federated identity solutions - Partner with security stakeholders to reduce privileged access risks. Security Technology Integration - Evaluate, deploy, and govern best-in-class cloud security technologies. - Integrate third-party security platforms including: - CyberArk - Wiz - Palo Alto Prisma Cloud - CrowdStrike - Other strategic security tooling - Drive consistent security controls and operational excellence across the cloud ecosystem. REQUIRED QUALIFICATIONS: - Extensive experience designing and securing enterprise-scale AWS and Azure environments.Deep knowledge of cloud-native security services, controls, and governance frameworks.Hands-on expertise with: - SIEM platforms - EDR/XDR technologies - Vulnerability management solutions - CSPM tools Strong experience implementing: - Azure Policy - AWS Control Tower - Service Control Policies (SCPs) - Cloud governance frameworks Advanced Infrastructure as Code (IaC) skills, particularly with Terraform.Experience embedding security controls into CI/CD and cloud deployment pipelines.Strong understanding of: - Modern cyber threats - MITRE ATT&CK framework - Cloud attack vectors - Security monitoring and incident response processes Proven ability to collaborate effectively with: - Cloud Engineering teams - Security Operations Centers (SOC) - Risk, Compliance, and Audit functions Excellent stakeholder management and communication skills. We offer a flexible collaboration model based on a B2B contract, with the opportunity to work on diverse projects. Recruitment Process: - HR Interview with the recruiter - Technical Interview - Client Interview - Feedback and offer #LI-HYBRID

Poland