Senior Data Engineer – Databricks | Generative AI (Genie) - Temporary Project
Location
Brazil
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Databricks | Generative AI (Genie) - Temporary Project
Mjv Innovation
Role Description Projeto Temporário - 160 horas de Projeto. Freelancer em RPA (recibo de pagamento para autônomo). Buscamos um(a) Engenheiro(a) de Dados Sênior, com perfil hands-on, para atuar no desenvolvimento e evolução de soluções modernas de dados e Inteligência Artificial, utilizando Databricks como plataforma principal. Procuramos um profissional com forte capacidade técnica para projetar, desenvolver e otimizar pipelines de dados, além de atuar na construção de soluções de IA Generativa, com destaque para o uso do Databricks Genie. - Desenvolver e manter pipelines de dados escaláveis utilizando Databricks, Spark e PySpark. - Projetar soluções de ETL/ELT para ambientes de alta volumetria. - Desenvolver notebooks e workflows em Databricks com foco em performance, qualidade e governança. - Atuar na implementação de arquiteturas modernas de dados utilizando Unity Catalog, Delta Live Tables e demais recursos da plataforma Databricks. - Criar e evoluir soluções baseadas em IA Generativa utilizando Databricks Genie, Mosaic AI e integração com LLMs. - Desenvolver APIs e automações em Python para integração entre plataformas e soluções analíticas. - Atuar na modelagem, catalogação e governança de dados. - Participar da definição de arquitetura, padrões técnicos e boas práticas de Engenharia de Dados. - Trabalhar em conjunto com arquitetos, cientistas de dados e áreas de negócio na construção de soluções analíticas. Qualifications - Experiência sólida como Engenheiro(a) de Dados. - Perfil hands-on, com atuação direta no desenvolvimento de soluções. - Experiência avançada em: - Databricks; - Apache Spark / PySpark; - Python; - SQL; - ETL/ELT; - Data Lake e Data Lakehouse. - Vivência com ambientes Cloud (AWS, Azure, GCP ou OCI). - Experiência com versionamento de código, CI/CD e DevOps. - Conhecimento em modelagem de dados, governança e otimização de performance. Requirements - Experiência prática com Databricks Genie (Genie Spaces), Mosaic AI e desenvolvimento de soluções utilizando IA Generativa e LLMs. - Experiência com Unity Catalog e Delta Live Tables. - Vivência em desenvolvimento de APIs (FastAPI ou similares). - Experiência em Analytics Avançado e BI. - Certificações Databricks. - Ter atuado em projetos do segmento de energia (Utilities/Oil & Gas/Distribuição de Energia/Gás). Competências - Perfil analítico e orientado à solução de problemas. - Facilidade para atuar em ambientes colaborativos. - Proatividade e autonomia. - Boa comunicação e capacidade de interação com times multidisciplinares. - Foco em qualidade, performance e inovação.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer, Snowflake
BlueCloudGlobal leader in Data, Analytics and AI with exceptional focus on Innovation, Customer Service and Employee engagement
• Design, develop, and maintain scalable data pipelines and transformation workflows within Snowflake. • Build and optimize ELT/ETL processes using SQL, Python, Snowpark, dbt, and Snowflake-native capabilities. • Modernize existing Python- and stored-procedure-based pipelines using set-based processing, incremental loading, and reusable engineering patterns. • Implement Snowflake-native data-processing solutions using Dynamic Tables, Streams, Tasks, and stored procedures. • Improve platform performance and cost efficiency through query tuning, warehouse right-sizing, clustering strategies, workload isolation, and auto-suspend and auto-resume policies. • Develop reliable orchestration, dependency management, monitoring, error handling, retry, and recovery mechanisms. • Design and maintain dimensional, relational, and domain-oriented data models. • Implement data-quality checks, observability, testing, lineage, and documentation standards. • Integrate data from batch and real-time sources using tools such as Fivetran, Kafka, Airflow, or similar technologies. • Contribute to CI/CD pipelines, infrastructure-as-code practices, and automated deployment processes. • Work closely with architects and client stakeholders to translate business and technical requirements into production-ready solutions. • Participate in code reviews, technical design discussions, estimation, and Agile delivery activities.
Data Architect
BlueCloudGlobal leader in Data, Analytics and AI with exceptional focus on Innovation, Customer Service and Employee engagement
• Lead the architecture, assessment, and modernization of enterprise Snowflake data platforms. • Define current-state and target-state architectures across data ingestion, transformation, storage, orchestration, governance, security, and consumption. • Lead inventories and assessments of Python-, SQL-, and stored-procedure-based pipelines, classifying workloads by business criticality, frequency, volume, runtime, reliability, and cost. • Analyze Snowflake usage telemetry to establish cost and performance baselines across pipelines, warehouses, and workloads. • Identify architectural and engineering anti-patterns, including procedural row-by-row processing, unnecessary full refreshes, missing incremental patterns, redundant transformations, warehouse mis-sizing, and insufficient workload isolation. • Recommend modernization strategies using set-based processing, incremental data patterns, Dynamic Tables, Streams and Tasks, Snowpark, dbt, and appropriate orchestration technologies. • Design scalable data models, governed data domains, semantic layers, and context models that support analytics and AI use cases. • Architect Snowflake Cortex solutions using capabilities such as Cortex Analyst, Cortex Search, and Cortex LLM functions. • Establish architectural standards for security, access control, data governance, lineage, observability, performance, resilience, and business continuity. • Design data lakehouse and real-time data-processing architectures across AWS, Azure, or GCP. • Evaluate and recommend appropriate use of Snowflake Iceberg Tables and other open data architecture patterns. • Build prioritized optimization backlogs and sequenced delivery roadmaps based on business impact, technical risk, cost, performance, and implementation effort. • Provide technical leadership across multiple concurrent projects and guide engineers, analysts, QA specialists, and DevOps teams. • Support project planning, estimation, scope definition, dependency management, risk mitigation, and technical governance. • Lead discovery workshops and interviews with client stakeholders and subject-matter experts. • Present architecture decisions, assessment findings, quantified impact projections, and roadmap recommendations to technical and executive audiences. • Act as a trusted advisor to clients throughout architecture and delivery engagements. • Create and maintain architecture diagrams, decision records, technical standards, and platform documentation.
Pipeline Rehabilitation Discipline Lead
AECOMWe are the world’s trusted infrastructure consulting firm.
Role Description AECOM has an exciting opportunity for a Pipeline Rehabilitation Discipline Lead to remotely join our Water team. The candidate will work and learn directly from one of AECOM's globally recognized pipeline design experts and with a diverse team of regional technical leaders and project managers across delivering water conveyance infrastructure consulting services to our key clients. The position includes work on the evaluation, design, rehabilitation, and condition assessment of water, wastewater, and underground pipeline infrastructure systems. This includes supporting trenchless rehabilitation solutions, structural rehabilitation technologies, and the evaluation and design of municipal water and wastewater conveyance systems. You will support the team through various measures and resources that will be available to you. AECOM offers full life-cycle solutions for water infrastructure projects—from planning and condition assessment through design, rehabilitation, construction support, and asset management. Our experts integrate engineering knowledge with responsive and cost-effective project management, strong communication skills, and an understanding of industry standards and client objectives. - Provides technical leadership for a specialty and is considered to be a fully capable professional in their field. - Applies intensive and diversified knowledge of engineering principles and practices in broad areas of assignments and related fields. - Makes decisions independently on technical problems and methods and represents the organization in conferences. - Resolves important questions and plans and coordinates work. - Requires the use of advanced techniques and the modification and extension of engineering theories, practices, and related disciplines to develop innovative solutions for water infrastructure projects. - Collaborate with pipeline design experts to develop and review design and construction plans, specifications, and cost estimates on projects from planning through design and construction services for projects related to pipeline failure analysis, pipeline rehabilitation and new installation. - Provide technical guidance to AECOM project teams and mentor junior and intermediate-level staff. - Provide quality assurance and technical reviews for deliverables across the conveyance practice. - Provide engineering leadership on design-bid-build and collaborative delivery projects. - Technical writing, reviewing, and providing clear, concise input to investigations, memorandums, or engineering reports and documentation. - Stay current on industry trends and advancements in pipeline design and engineering. - Participation in relevant industry organizations, including writing white papers and delivering presentations. - Support project pursuits by contributing technical approaches, scope development, cost estimates, risk assessments, and proposal content. - Support regional Strategy and Growth Leads with client engagement where applicable to expand the Conveyance business across the Pacific Northwest market. - Collaborate with regional leadership to establish market positioning, service differentiation, and technical value propositions that strengthen competitive advantage. - Leverage industry relationships and professional networks to enhance market visibility and generate new business opportunities. Qualifications - BA/BS + 10 years of related experience or demonstrated equivalency of experience and/or education. - Candidate must be a U.S. Citizen or permanent resident and reside within the U.S. Mainland. - Successful candidate will have to pass a background check. - Professional Engineering (PE) license. Requirements - Bachelor's Degree in Civil Engineering, Structural Engineering, Environmental Engineering, or a related engineering discipline. - 15+ years of experience in water and wastewater infrastructure engineering, pipeline rehabilitation, or underground utility systems. - Experience with municipal water and wastewater infrastructure design, rehabilitation, condition assessment, or trenchless technologies. - Experience providing technical leadership on complex engineering projects and serving as a subject matter expert. - Experience collaborating with municipalities, utilities, contractors, and multidisciplinary engineering teams. - PE license in multiple states. Benefits - Medical, dental, vision, life, AD&D, disability benefits. - Paid time off, leaves of absences, voluntary benefits. - Perks, flexible work options, well-being resources. - Employee assistance program, business travel insurance. - Service recognition awards, retirement savings plan, employee stock purchase plan.
Role Description We are looking for an Analytics Data Engineer to design, build, and maintain the curated data products that power reporting, analytics, and strategic decision-making across the organization. This role is responsible for transforming raw and operational data into trusted, business-ready datasets, semantic models, and analytical assets that enable self-service analytics and enterprise reporting. The Analytics Data Engineer owns the Silver, Gold, and Semantic layers of the analytics platform and serves as the bridge between foundational data engineering and business intelligence. Working closely with Data Engineers, BI Developers, Strategic Insights Analysts, and business stakeholders, this role ensures that data is governed, consistent, scalable, and aligned with business definitions and reporting requirements. Remote location. 15% travel. Qualifications - 5+ years of experience in analytics engineering, data engineering, business intelligence, or related disciplines. - Advanced SQL and data modeling expertise. - Oracle and IQMS a plus. - Experience designing dimensional models, semantic models, and analytical data products. - Strong understanding of medallion architecture concepts (Bronze, Silver, Gold). - Experience building and maintaining enterprise reporting datasets. - Ability to translate business requirements into scalable technical solutions. - Experience working with cross-functional business and analytics teams. - Strong communication, documentation, and problem-solving skills. Requirements - Analytics Engineering - Data Quality and Governance - Analytics Platform Support

