Job Closed

This listing is no longer active.

Encora Digital

Encora, a leader in digital engineering, drives innovation by crafting cutting-edge, cloud-first, data-first, and AI-first solutions that redefine industries. Since its inception i

Senior Data Engineer

Location

Brazil

Posted

17 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Encora Digital

Role Description We at Coforge are hiring a Senior Data Engineer with the following skill set. - Design and implement scalable data pipelines using Databricks and Microsoft Fabric. - Build and maintain a Medallion Architecture (Bronze, Silver, Gold layers) to organize and process data across the organization. - Collaborate with the AI team to ensure high-quality data availability for RAG patterns and LLM components. - Develop and optimize data models that feed directly into the Microsoft Power Platform (Power BI). - Ensure data platform performance and reliability while maintaining a platform-agnostic approach where possible. Qualifications - Experience with Databricks: Proficiency with Spark, Delta Lake, and workspace management. - Knowledge of Microsoft Fabric: Experience navigating and implementing solutions within the Fabric ecosystem. - Architecture Design: Solid experience implementing Medallion Architecture. - Data Programming: Proficiency in Python (PySpark) and SQL for data transformation and engineering. Requirements - Cloud Ecosystem: Experience with the Azure platform and Azure Data Factory. - AI Integration: Familiarity with Vector Databases (e.g., ChromaDB) for LLM support. - Power Platform: Experience preparing data for Power BI and Power Apps consumption. - Domain Knowledge: Familiarity with industrial data or engineering calculations. - DevOps for Data: Experience with CI/CD for data pipelines and version control (Git). - Data Governance: Knowledge of data quality standards and metadata management. Company Description At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 10,001+H1B Sponsor

• Work on requirements gathering, backlog refinement, support for information architecture, technical documentation and collaboration with technical and business areas; • Development and maintenance of data solutions applied to the Climate context, involving integration, organization, processing and provisioning of information from various corporate and industrial sources; • Preparation and maintenance of technical documentation in Markdown, Word or SharePoint; • Development of data pipelines, support for information architecture, integration with SAP systems, APIs and databases, as well as structuring information for analysis, traceability and decision support; • Work in a multidisciplinary environment, with constant interaction between technical and business areas, participating in understanding requirements, refining needs, building solutions, producing technical documentation and monitoring deliveries throughout the development, evolution and maintenance lifecycle; • Integration and processing of data from REST APIs, RDBMS/NoSQL databases, SAP ERP/SAP Analytics environments and relational stores such as SQL Server, Oracle or PostgreSQL, using tools like SSMS, DBeaver, Postman and Insomnia;

Brazil
Full TimeRemoteTeam 10,001+H1B Sponsor

• Definir e evoluir arquitetura de dados cloud-native na AWS; • Projetar modelos de dados otimizados para: consulta operacional (APIs) e consumo pelo agente conversacional; • Liderar migração de dados históricos do mainframe; • Garantir consistência, integridade e rastreabilidade; • Trabalhar com grandes volumes e dados históricos complexos; • Construir e manter pipelines de ingestão e transformação; • Integrar fluxo existente (PeopleSoft, mainframe, RDS); • Otimizar consultas no PostgreSQL; • Implementar estratégias de particionamento, indexação e caching (Redis); • Reduzir latência para consultas frequentes; • Garantir aderência a LGPD, políticas de retenção; • Implementar controle de acesso a dados, mascaramento / anonimização quando necessário, auditoria e lineage; • Estruturar dados para consumo por LLMs; • Apoiar criação de camadas semânticas; • Trabalhar com embeddings / indexação semântica (diferencial); • Implementar validações de qualidade de dados; • Monitorar pipelines e consistência;

Brazil
Stefanini Brasil logo

Data Engineer – ML Specialist

Stefanini Brasil

Co-creating Solutions for a Better Future

Data Engineer17 days ago
Full TimeRemoteTeam 10,001+Since 1987H1B No Sponsor

• A specialist who will lead the creation and management of the data pipelines that feed the project's analytical models. • Responsible for ensuring the quality, integrity, and availability of data for training and inference of Machine Learning models in production. • Expected to mentor other team members and define data engineering and MLOps strategies.

Brazil

IT Data Platform Engineer 2

Evergen

Evergen is a global industry-leading contract development and manufacturing organization (CDMO) in regenerative medicine. As the only regenerative medicine company that offers a differentiated portfolio of allograft and xenograft biomaterials at scale, Evergen is headquartered in Alachua, FL, and has manufacturing facilities in West Lafayette, IN., Eden Prairie and Glencoe, MN., Neunkirchen, DE., Glasgow, UK., and Marton, NZ.

Data Engineer17 days ago

Role Description We are looking for a hands-on Data Platform Engineer to own, operate, and evolve our modern cloud data stack. You will be the primary technical owner of our data infrastructure — responsible for keeping data flowing reliably from source systems into Snowflake and ensuring clean, trusted data reaches our business teams through Power BI. This is a high-impact role on a small, focused team where your work will be directly visible to the business. What You Will Work On - DATA INGESTION - Own and manage Fivetran connectors across all source systems including NetSuite, HubSpot, ADP, SQL Server, SAP HANA, and SharePoint. - Configure and monitor sync schedules, column exclusions, and incremental load strategies to control cost and reliability. - Troubleshoot connector failures and proactively manage schema drift from upstream sources. - DATA TRANSFORMATION - Maintain and extend our dbt project across three layers: staging (L1), core dimensions and facts (L2), and business-ready marts (L3). - Write and optimize SQL models using incremental merge strategies and watermark patterns. - Author and maintain dbt tests, model documentation, and source freshness checks to ensure data quality. - Support the buildout of our finance EDW including GL activity, planning data from Workday Adaptive, and NetSuite financials. - ORCHESTRATION & PIPELINE OPERATIONS - Manage end-to-end pipeline scheduling and monitoring, ensuring daily refreshes complete reliably before business hours. - Maintain the integration between Fivetran, dbt, and Power BI dataset refresh triggers. - Build and maintain alerting so pipeline failures are caught and communicated before the business is impacted. - DATA WAREHOUSE & GOVERNANCE - Manage Snowflake environments including databases, schemas, roles, warehouses, and cost controls. - Implement and maintain access controls and role-based permissions across the data platform. - Contribute to data catalog and lineage documentation to support a growing team and reduce knowledge concentration risk. - COLLABORATION - Partner with Finance, Sales, and Operations teams to understand reporting requirements and translate them into reliable data models. - Support and mentor the junior member of the data team as they develop their skills. - Work closely with the incoming NetSuite implementation team to ensure clean data integration into the warehouse. Qualifications - 3 to 5 years of experience in data engineering, analytics engineering, or a closely related role. - Hands-on experience with dbt (Core or Cloud) including incremental models, tests, macros, and documentation. - Proficiency with Snowflake including schema design, query optimization, warehouses, and role-based access control. - Experience with a managed ingestion tool such as Fivetran and dlt including connector configuration and monitoring. - Strong SQL skills with the ability to write and debug complex analytical queries. - Familiarity with ELT pipeline patterns and medallion-style data warehouse architecture. - Experience troubleshooting pipeline failures independently and communicating issues clearly to non-technical stakeholders. - Comfort working autonomously in a small team environment with limited oversight. Requirements - Experience connecting to on-premises source systems (SQL Server, SAP HANA, Oracle) via ODBC or CDC tooling. - Familiarity with ERP financial data in NetSuite, SAP, or similar, particularly GL structures and chart of accounts. - Exposure to Power BI including dataset refresh management and understanding of how semantic models consume warehouse data. - Experience with Git-based workflows and basic CI/CD practices for data projects. - Prior involvement in an EDW build or dimensional modeling project (star schema, slowly changing dimensions). What Success Looks Like - In your first 30 days: - You have completed a full walkthrough of the existing stack with our departing team member. - You can independently run, monitor, and troubleshoot the daily pipeline end to end. - You have documented any gaps or risks you have identified in the current setup. - In your first 90 days: - All Fivetran connectors are live and the dlt migration is complete. - dbt is running in dbt Cloud or Snowflake Workspaces with jobs, alerting, and documentation in place. - The Finance team has improved confidence in the GL data flowing through the warehouse. - In your first year: - The data platform is running reliably with minimal intervention and strong business trust. - The NetSuite data integration is live and the finance EDW is serving reporting needs. - You have grown the junior team member's capability and reduced single-person dependency on yourself. Our Stack - Ingestion: Fivetran, dlt - Warehouse: Snowflake - Transformation: dbt (Cloud or Snowflake-native) - Reporting: Power BI - Sources: NetSuite, HubSpot, ADP, SQL Server, SAP HANA, Workday Adaptive, SharePoint, Oracle DB Company Description Evergen is a global industry-leading contract development and manufacturing organization (CDMO) in regenerative medicine. As the only regenerative medicine company that offers a differentiated portfolio of allograft and xenograft biomaterials at scale, Evergen is headquartered in Alachua, FL, and has manufacturing facilities in West Lafayette, IN., Eden Prairie and Glencoe, MN., Neunkirchen, DE., Glasgow, UK., and Marton, NZ.

United States
$130K - $145K / year