Mid-Level Data Engineer
Location
Brazil
Posted
3 days ago
Salary
0
Seniority
Senior
Job Description
Mid-Level Data Engineer
Sonepar
• Build and evolve scalable data pipelines. • Develop data ingestion, transformation, and provisioning processes. • Work with Spark and Databricks using a medallion architecture (Bronze/Silver/Gold). • Orchestrate data workflows and pipelines. • Ensure data quality, governance, and observability. • Optimize processing performance and cost. • Contribute to engineering best practices, version control, and documentation. • Support BI, Analytics, and AI teams and projects with reliable, well-organized data.
Job Requirements
- Bachelor's degree in Information Technology, Engineering, or a related field.
- Experience in data engineering and developing ETL/ELT pipelines.
- Proficiency in Python and advanced SQL.
- Experience with Spark and Databricks.
- Knowledge of Lakehouse/Data Lake architectures.
- Familiarity with orchestration tools such as Apache Airflow.
- Knowledge of analytical data modeling (Star Schema, Snowflake, OBT, among others).
- Experience with dbt for data transformation and modeling.
- Experience with data ingestion and integration tools (e.g., Azure Data Factory, Airbyte).
- Experience with Git and development best practices.
Benefits
- Opportunities for professional development
- Dynamic work environment
- Recognition of effort and celebration of achievements
- Diverse team
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Engineer II/III – Java / Spring Boot (AWS, APIs & Event-Driven Architecture)
Careers Mutual Of OmahaApplicants for this position must not now, nor at any point in the future, require sponsorship for employment. This role is classified as remote; however, periodic in-person attendance will be required at times for activities such as quarterly or project planning, training, or other business-critical meetings.
Role Description At Mutual of Omaha, we're modernizing how we connect with customers, partners, and Third-Party Benefit Administrators through API-first and event-driven solutions. We're seeking a seasoned software engineer with a background building cloud-native applications and integrations who enjoys remaining hands-on while serving as a mentor and technical leader for other developers. In this role, you'll help shape the future of our Group Insurance platform by developing scalable solutions using Java, Spring Boot, AWS, Kafka, MongoDB, and MuleSoft. You'll play a key role in driving modernization efforts, influencing technical decisions, and elevating engineering best practices across the team. What You'll Do - Play a key role in modernizing Mutual of Omaha's Group Insurance platform through the development and support of API and event-driven integrations. - Design, develop, deploy, and support Spring Boot microservices in AWS environments. - Build RESTful APIs and Kafka-based event solutions that enhance connectivity with Third-Party Benefit Administrators and external business partners. - Partner with business and technology teams to translate requirements into scalable, reliable, and maintainable solutions. - Serve as a senior technical contributor by mentoring developers, conducting code reviews, and sharing engineering best practices. - Influence application design, architectural discussions, and technical standards across the team. - Collaborate with architects and engineering leaders to evaluate technologies and drive modernization initiatives. - Promote operational excellence through automation, continuous improvement, and quality-focused development practices. - Lead by example in delivering secure, resilient, and high-performing software solutions. Qualifications - 5+ years of experience designing, developing, and implementing enterprise applications. - Strong experience with Java, Spring Boot, RESTful APIs, and microservices architectures. - Experience deploying applications within AWS cloud environments. - Experience building event-driven solutions using Kafka. - Experience utilizing AI tools and implementing AI-enabled solutions to enhance software development, improve team productivity, accelerate delivery, and support day-to-day technical decision-making. - Experience working with CI/CD pipelines and modern software delivery practices. - Strong problem-solving skills and the ability to learn and adapt to new technologies and business domains. - Experience mentoring developers, conducting code reviews, and contributing to a collaborative engineering culture. - Ability to influence technical direction and participate in architectural and design discussions. - Strong communication and collaboration skills, with the ability to work effectively across technical and business teams. - You promote a culture of diversity and inclusion, value different ideas and opinions, and listen courageously, remaining curious in all that you do. - Ability to work remotely with reliable high-speed internet access while residing in the United States or Puerto Rico. Preferred - MuleSoft development experience, including Anypoint Studio and DataWeave. - Experience designing and supporting enterprise integrations. - MongoDB experience. - Test-Driven Development (TDD) and automated testing practices. - Experience working within a SAFe Agile environment. - Previous experience serving as a technical lead, senior developer, or mentor within an engineering organization. - Experience supporting large-scale modernization, integration, or digital transformation initiatives. Benefits - Estimated Salary (Levels have variable responsibilities and qualifications): - Engineer II: $115,000 - $135,000, plus annual bonus opportunity - Engineer III: $135,000 - $155,000, plus annual bonus opportunity - 401(k) plan with a 2% company contribution and 6% company match. - Work-life balance with vacation, personal time, and paid holidays.
Role Description We are looking for a Data Engineer to join our Data Engineering team. In this role, you will design, build, and productionize end-to-end cloud data solutions that are secure, scalable, performant, and robustly integrated across systems. You will collaborate closely with client stakeholders, data engineers, architects, and engagement leaders to deliver high-quality solutions and advance phData’s delivery excellence. Key Responsibilities - Client Delivery: - Own and drive the design, development, and deployment of end-to-end data solutions and pipelines for enterprise clients. - Translate business requirements into technical data architectures, integration patterns, and models that align with phData methodologies, standards, and best practices. - Ensure solutions meet performance, security, reliability, and scalability requirements in production environments. - Ensure engagements are delivered on time, within scope, and with measurable business value for clients. - Collaboration & Leadership: - Collaborate with cross-functional partners including data engineering, software engineering, analytics, and platform teams to deliver successful client engagements. - Provide technical leadership during design and code reviews, proof-of-concepts, and implementation workshops. - Ensure high quality in deliverables through testing, documentation, and adherence to governance and change management processes. - Partner with practice and account leaders to identify opportunities to expand engagements, improve delivery, and standardize reusable patterns and components. - Practice & Firm Contribution: - Contribute to internal initiatives such as developing accelerators, templates, playbooks, and best practices for cloud data platforms. - Create clear technical documentation, including architectures, roadmaps, and operational runbooks, that can be reused across engagements. - Share knowledge with peers through mentoring, informal coaching, and internal communities of practice. - Represent phData with professionalism in all interactions, communicating clearly with both technical and non-technical stakeholders. Qualifications - 4+ years of experience as a Software Engineer and/or Data Engineer building and deploying production-grade data solutions. - Ability to develop end-to-end technical solutions into production, with a strong focus on performance, security, scalability, and robust data integration. - Programming expertise in Python and/or Scala for data processing, automation, and orchestration. - Hands-on experience with core cloud data platforms including Snowflake, AWS, Azure, and/or Databricks. - Strong SQL skills, including the ability to write, debug, and optimize complex queries. - Experience creating and delivering detailed technical presentations for client and internal stakeholders. - Experience producing detailed solution documentation (e.g., POCs and roadmaps, sequence diagrams, class hierarchies, logical system views, and related artifacts). - Experience delivering projects for external or internal clients in a professional services or consulting environment. - Ability to break down complex problems into structured, actionable steps and drive them through to completion. - Strong client-facing written and verbal communication skills in English. - Demonstrated ability to work effectively with distributed and cross-functional teams. - Proven track record of taking ownership, managing multiple priorities, and delivering high-quality work with minimal supervision. - 4-year Bachelor’s degree in Computer Science or a related field. Preferred Qualifications - Production experience in core data platforms such as Snowflake, AWS, Azure, GCP, Hadoop, and/or Databricks. - Experience with cloud and distributed data storage systems such as S3, ADLS, HDFS, GCS, Kudu, Elasticsearch/Solr, Cassandra, or other NoSQL storage systems. - Experience with modern data integration and streaming technologies such as Spark, Kafka, event/streaming platforms, StreamSets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure Data Factory, Informatica Intelligent Cloud Services (IICS), Google Dataproc, or similar tools. - Experience working with multiple data sources (e.g., queues, relational databases, files, search, APIs). - Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment of data-intensive applications. - Experience with automated data transformation and data curation using dbt, Spark, Spark Streaming, and automated data pipelines. - Experience with workflow management and orchestration tools such as Airflow, AWS Managed Airflow, Luigi, or NiFi. - Experience in specific industry verticals or problem spaces relevant to the role. - Hands-on experience with preferred tools, platforms, or methodologies. - Prior experience working in global or remote teams and partnering across US, LATAM, and/or India. - Contributions to open source, communities, speaking, writing, or internal accelerators are a plus. Location & Time Zone Expectations - This role is based in India and operates primarily in India business hours (IST) with some flexibility for global collaboration. - We are a remote-first company, and you should be comfortable working with a distributed global team. - Some flexibility may be required to collaborate across time zones with colleagues and clients. - Client needs may occasionally require flexibility in working hours to support key milestones or workshops. Benefits - Remote-First Workplace - Medical Insurance for Self & Family - Medical Insurance for Parents - Term Life & Personal Accident - Wellness Allowance - Broadband Reimbursement - Continuous learning and growth opportunities to enhance your skills and expertise - Other benefits include paid certifications, professional development allowance, and bonuses for creating company-approved content
Role Description As a Forward Deployed Engineer (FDE), you will be the hands-on technical engine bringing the future of work to our newly onboarded and existing clients. Your core mission will be driving end-to-end adoption and deep feature consumption for Gemini Enterprise, gPanel, and Promevo Insights. - Execute deployment and technical enablement for Google Workspace environments. - Assist in the architectural design, implementation, and feature activation of Google Workspace Enterprise features and agentic workflows. - Configure identity, access management, and secure connection protocols for client cloud environments. - Configure, integrate, and operationalize gPanel and Promevo Insights across client environments. - Configure and manage Google Cloud/Workspace APIs and integrations to support custom client automation. - Assist in the deployment and configuration of Chrome Enterprise policies. - Develop custom scripts and agentic workflows using Apps Script, Python, or PowerShell. - Lead executive-level technical discussions to align business goals with Gemini Enterprise capability. - Guide client IT administrators through initial setup and advanced administration features within gPanel. - Deliver high-impact technical training and enablement sessions for client admins and end-users. - Monitor client license usage, feature engagement, and platform telemetry through Promevo Insights. Qualifications - Proficient knowledge of DNS, Networking, and Email Administration. - 3+ years of experience administering MS Active Directory and/or Azure Active Directory. - 3+ years of experience administering Google Workspace (formerly G Suite). - 3+ years of experience with and/or understanding of Office 365, Exchange, or SharePoint Online. - Experience using migration and SaaS management tools (Google Workspace Migrate, CloudM, GAM, etc.). - 3+ years of working with integration tools Okta, ADFS, GAM, BetterCloud, CloudM Manage, GCDS, etc. - Familiarity with IT security practices such as identity and access management, device management, and data protection. - Demonstrated experience or strong working knowledge of Generative AI platforms (specifically Google Gemini). - Experience analyzing product telemetry or SaaS consumption metrics. - Certification (preference): Google Cloud Collaboration Engineer, Google Cloud Associate Engineer, Associate - Google Workspace Administrator, or relevant Generative AI certifications. - Strong communication and management skills. - Ability to travel to client sites as needed and requested. Requirements - Achieve targeted license activation rates for Gemini Enterprise and gPanel. - Drive measurable adoption increases in high-value features among enterprise accounts. - Successfully design and deploy custom agentic/automation workflows. - Proactively identify and remediate low-usage accounts through usage data analysis. - Successfully develop and manage robust integrations between client ecosystems and Promevo insights tools. Benefits - Competitive salary and bonus plan. - 14 Paid holidays. - Medical Insurance. - Dental Insurance, 100% company paid premiums. - Vision Insurance, 100% company paid premiums. - Fully Company Paid Short term Disability Insurance. - Fully Company Paid Long Term Disability Insurance. - Fully Company Paid Life Insurance and AD&D. - 401k plan with immediate eligibility and matching contributions. - Home office setup allowance. - Cell phone allowance. - 4 weeks of PTO and a healthy work/life balance. - Development and Training opportunities to help you grow.
Role Description As a member of the Everbridge Engineering team, you will be responsible for helping ensure the quality, reliability, and customer value of modern SaaS product experiences, including AI-assisted and agentic workflows. You will design, develop, and maintain modular, extensible, and reusable test cases, scripts, and validation approaches across UI, API, integration, and workflow layers. In this role, you will be embedded within an engineering team and partner closely with engineers, product managers, UX, and other quality professionals to drive quality best practices early in the application development lifecycle. You will help define acceptance criteria, validate complex user journeys, identify risks and edge cases, and promote a collaborative, proactive approach to quality. You will also be expected to use modern engineering and AI-assisted development practices, including coding agents, AI-assisted test generation, and automation tooling, to improve test coverage, accelerate feedback loops, and reduce manual regression effort. Promoting continuous improvement, you will identify opportunities to maximize the customer experience, reduce test cycle time, improve tooling and environments, eliminate waste, and support faster, more reliable delivery. - Own and execute manual testing activities during the development lifecycle, ensuring new features are thoroughly validated as part of the agile process. - Collaborate closely with engineers and product managers to define acceptance criteria, test strategies, and edge cases early in the development cycle. - Contribute to building and maintaining automated tests for API and UI layers, helping to expand coverage and reduce regression risk. - Support and evolve test environments, frameworks, and tools to improve test efficiency and reliability. - Use AI-assisted engineering tools, coding agents, and test generation techniques to accelerate test creation, improve coverage, debug failures, and support faster feedback loops. - Review AI-generated or AI-assisted test artifacts critically, ensuring tests validate business outcomes, system behavior, edge cases, and failure modes rather than only basic technical responses. - Monitor and communicate test results, escalate risks, and champion continuous improvements in quality practices and delivery speed. Qualifications - 3+ years of experience testing enterprise-grade, scalable, and distributed applications, products, and services. - Exposure to automation frameworks and tools (e.g., Pytest, Selenium, Playwright …) is beneficial, though specific technologies are less important than your ability to apply the right approach to the problem. - Experience with version control systems such as Github or GitLab. - Familiarity with AI-assisted development tools, coding agents, or AI-assisted test automation is a plus. - Exposure to testing products that incorporate large language models, AI/ML technologies, agentic workflows, recommendation systems, automation, or decision-support capabilities is a plus. - Strong debugging and problem-solving skills, with the ability to quickly learn new tools and technologies. - Ability to think critically about AI-assisted outputs, including identifying gaps, validating assumptions, testing edge cases, and ensuring business outcomes are correctly verified. - Experience working in an Agile environment. - Understanding of CI/CD and DevOps concepts is preferred. - Bachelor’s degree in Computer Science or a related field is preferred. Company Description


