Vem fazer parte do #melhortimedasgalaxias
Senior Data Engineer
Location
Brazil
Posted
5 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Beyond Soluções
• Connect technology talent to real-world projects. • Work in healthy environments with end-to-end professional growth opportunities. • Collaborate with other professionals and leadership on relevant, high-impact projects.
Job Requirements
- Solid experience as a Data Engineer in medium- to high-complexity environments.
- Advanced proficiency in SQL, Spark, and Python.
- Experience with distributed processing (Apache Spark, Flink, or similar).
- Experience with messaging and streaming systems (Kafka, Pulsar, or similar).
- Experience with orchestration tools (Airflow, Prefect, Dagster, or similar).
- Experience with Data Lakes (ADLS).
- Knowledge of data modeling (dimensional modeling and/or Data Vault).
- Experience with relational and NoSQL databases.
- Experience with cloud environments (Azure).
- Knowledge of optimized data formats (Parquet, ORC, Avro).
- Experience with version control (Git) and software engineering best practices.
- Ability to work strategically, autonomously, and collaboratively.
Benefits
- Flash Card - R$ 936.00 per month for flexible use on food, meals, and mobility.
- SulAmérica Health Plan – no copayment or payroll deductions.
- SulAmérica Dental Plan – no copayment or payroll deductions.
- Life Insurance.
- Gympass | Wellhub - Access to gyms and fitness activities.
- TotalPass - Access to gyms, fitness activities, wellness, and sports.
- SESC Partnership - Benefits for culture, leisure, sports, and wellness.
- Creditas - Access to financial services, loans, and pension/savings options.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Role Description We are seeking an experienced Data & AI Engineer to support the execution of our packaged QuickStarts, particularly those focused on GenAI (LLM Ops) and Data Lake architecture. This role will lead the development and deployment of scalable, production-ready AI/ML solutions built on AWS-native technologies. The ideal candidate thrives in a fast-paced, consulting environment and is comfortable navigating ambiguity while leading client-facing delivery. They are a proactive leader who asks the right questions, anticipates challenges, and drives clarity, while collaborating effectively across product, DevOps, and architecture teams. Above all, the ideal candidate embodies RevStar’s core values: - Self-Mastery: We hold a high bar for how we think, communicate, and improve. - Ownership: We own outcomes, not just effort. - Shared Destiny: We rise or fall together. Responsibilities - Design, build, and deploy LLM-based APIs using Amazon Bedrock, supporting models like Claude, Titan, Nova, and Cohere. - Implement retrieval-augmented generation (RAG) pipelines using OpenSearch + S3. - Build data pipelines for curated and raw data layers using AWS Glue, Athena, and Lake Formation. - Support real-time reporting and AI usage dashboards via Amazon QuickSight. - Design serverless workflows using AWS Lambda and manage prompt metadata with DynamoDB. - Implement prompt orchestration strategies, including fallback handling, versioning, and safety guardrails. - Collaborate with product managers, architects, and DevOps to align AI/ML delivery with customer and project goals. - Document solutions clearly and support onboarding for handoff to client teams. - Stay current with AWS innovations in GenAI, MLOps, and scalable data platforms. Qualifications - Bachelor’s or Master’s in Computer Science, AI/ML, Data Science, or related field. - 5+ years of experience designing, building, and deploying cloud-based ML or GenAI systems. - Deep hands-on experience with AWS AI/ML services: Amazon Bedrock, AgentCore, SageMaker, Lambda, S3, DynamoDB, Glue, Athena, Lake Formation, OpenSearch, and QuickSight. - Strong Python development skills, with a focus on data manipulation, API development, and automation. - Experience implementing retrieval-augmented generation, prompt orchestration, or LLMOps workflows preferred. - Familiarity with CI/CD, Infrastructure-as-Code (IaC), and Git-based workflows. - Excellent communication skills and ability to explain AI system design and tradeoffs to both technical and business stakeholders in a client-facing, professional services environment. Benefits - Paid Time Off – Take the time you need to recharge and stay productive. - Remote-First Working Environment – Collaborate from anywhere while staying connected with our global team. - Comprehensive Health Coverage – Medical, Dental, Vision. - 401(k) Retirement Plan – Plan for your future with access to a company-sponsored 401(k) program. - Annual Learning & Development Stipend – Invest in your skills with conferences, certifications, or courses. - Peer Mentorship & Coaching – Learn from experienced engineers, product managers, and architects to accelerate your growth. - Professional Growth Opportunities – Exposure to cutting-edge AWS GenAI, data, and cloud technologies across diverse industries. - Company Outings & Volunteer Opportunities – Build relationships and give back to the community. - Collaborative, Innovative Culture – Work alongside top talent in a fast-paced, supportive environment that values curiosity and initiative.
Senior Data Architect
AOT TechnologiesBuild business apps swiftly with our low code development platforms, ably supported by bespoke development services.
• Design and implement scalable data ingestion and transformation pipelines using Databricks and cloud platforms • Lead architecture decisions for modern data platforms, including Medallion Architecture and Lakehouse patterns • Build and maintain ETL/ELT pipelines using Python and SQL, following engineering best practices • Lead and mentor engineering teams, coordinating deliveries and driving technical standards • Establish and evolve CI/CD pipelines and Infrastructure as Code (IaC) practices for data platforms • Partner with clients and stakeholders to translate business requirements into scalable data solutions • Champion data governance, quality, and security using tools such as Unity Catalog • Contribute to platform modernization initiatives, including Data Warehouse to Lakehouse migrations • Apply Agile methodologies to plan, iterate, and deliver data engineering projects effectively
Software Engineer, Data Products
PersonaConfigurable identity infrastructure for KYC, AML, KYB, fraud detection, onboarding, and more.
• Build and grow customer-facing data products • Build AI-powered and agentic analytics tools • Build the backend services, APIs, and query layer that power these products • Partner with product and design to translate customer and business needs into reliable, performant, data-intensive features
• Designs and develops moderately complex queries, objects, ETL packages, reporting structures, and other objects necessary to support detailed analysis and self-service reporting needs. • Collaborates with analytics and business teams to create and improve data models that feed BI tools, increasing data accessibility, and fostering data-driven decision making across the organization. • Takes ownership of the health, reliability, and security of the data platform by designing and implementing processes and solutions that proactively monitor data delivery across the full pipeline — ensuring data is accurate, complete, consistent, and timely from source ingestion through gold layer curation. • Investigates, diagnoses, and resolves complex data pipeline failures across all system layers; uses findings to drive pipeline improvements and communicates status, root cause, and resolution clearly to the team throughout the full lifecycle of an incident. • Assists with the development and delivery of data solutions, including data pipelines, API integration, and other structures and processes to support the data platform • Identifies, designs, and implements internal process improvements, including the automation of manual processes, optimization of data delivery, and refactoring of code for improved performance • Builds pipelines to enable the optimal extraction, transformation, and loading of data from a wide variety of data sources • Provides strategic assistance to BI leadership and the BI team by making recommendations in the areas of data management and best practices • Collaborates with developers, database administrators, data architects, and others on reporting and data management projects as needed • Takes on other duties needed to help drive our Purpose, fulfill our Brand Principles, and abide by our Organization’s Values



