Job Closed
This listing is no longer active.
We create digital assets to build, grow and accelerate your applications with efficiency, security and scalability.
Data Engineering Specialist – Data Architecture
Location
Brazil
Posted
76 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineering Specialist – Data Architecture
Zup Innovation
• Develop and maintain MLOps pipelines to automate the lifecycle of machine learning models. • Implement and optimize CI/CD pipelines specific to machine learning workflows. • Continuously monitor model performance in production, including logs, metrics, and alerts. • Design and apply strategies to detect and mitigate model performance degradation. • Ensure the security, governance, and compliance of data and models in production environments. • Collaborate with multidisciplinary teams to document and standardize MLOps-related processes.
Job Requirements
- Advanced experience in MLOps, including pipeline automation and integration.
- Proficiency with containers (Docker, Kubernetes) and workflow orchestration. Knowledge of cloud providers (AWS) and their services applied to machine learning. Programming in Python for data operations and model workflows.
- Experience implementing monitoring, logging, and observability for production models. Strong understanding of data security, governance, and compliance best practices.
Benefits
- Freedom to work from anywhere
- Flexible working hours
- Education assistance
- Proprietary career development tool
- Internal guilds and study/interest groups
- Health insurance
- Dental insurance
- Discounted medication purchase partnership
- 24/7 telemedicine
- Free online therapy
- Wellhub
- Extended maternity leave
- Extended paternity leave
- CAZ – Zuppers Support Center
- Meal and grocery vouchers
- Life insurance
- Transport allowance
- Home office allowance
- Childcare allowance
- Phone plan allowance
- Profit-sharing (Participation in Profits and Results)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Information Management Data Architect
Switzerland Global EnterpriseWe support Swiss SMEs in their international business and help innovative foreign companies to establish in Switzerland.
• Assist in the analysis, design and development of a roadmap, design pattern, and implementation based upon a current vs. future state in a cohesive architecture viewpoint. • Gather and analyze data and develop architectural requirements at project level. • Responsible for multiple software projects as a project leader or internal consultant; support highly complex software projects that require in-depth domain knowledge or specialized architecture areas. • Participate in the data domain technical and business discussions relative to future architect direction. • Participate in the Data Governance Council. • Participate in development data and data delivery platforms that are service-oriented with reusable components that can be orchestrated together into different methods for different businesses. • Research and evaluate emerging technology, industry and market trends to assist in project development and/or operational support activities. • Effectively monitor and control costs in the organization.
Role Description We are hiring a Senior / Staff Data Engineer to build and evolve the data processing and pipeline layer that powers reporting, billing systems, and real-time data products at Index Exchange. This role focuses on designing and operating large-scale batch and streaming data pipelines , enabling reliable, scalable, and efficient data transformation across the platform. You will work on systems that transform raw, high-volume event data into clean, queryable, and production-grade datasets, supporting both API-driven data products and analytical workflows. - Process billions of events per day across distributed pipelines - Power core business datasets (reporting, billing, marketplace metrics) - Operate across batch (Spark) and streaming (Kafka / Flink) architectures - Require careful balancing of: - data correctness - processing efficiency - latency vs cost trade-offs You will solve problems such as: - Designing pipelines that scale without exploding compute costs - Managing data correctness at scale (deduplication, late data, joins) - Building systems that support both historical backfills and near real-time updates - Evolving pipelines from centralized processing (Hadoop) toward more distributed and efficient patterns - Streaming pipelines and Streaming DWs. Qualifications - Strong experience in data engineering at scale - Deep expertise in: - Spark (required) - SQL and data modeling - Experience with: - Airflow or workflow orchestration - Kafka or streaming systems - Strong understanding of: - distributed data processing - data modeling (large-scale datasets) - performance optimization - Ability to: - own pipelines end-to-end - debug complex data issues - work in high-scale, evolving environments Requirements - Define data processing standards and patterns across teams - Lead large-scale pipeline and platform initiatives - Influence data architecture and modeling decisions - Drive improvements across: - reliability - cost efficiency - scalability Benefits - Comprehensive health, dental, and vision plans for you and your dependents - Paid time off, health days, and personal obligation days plus flexible work schedules - Competitive retirement matching plans - Equity packages - Generous parental leave available to birthing, non-birthing, and adoptive parents - Annual well-being allowance plus fitness discounts and group wellness activities - Commuter benefits and discounts, where available - Employee assistance program - Mental health first aid program that provides an in-the-moment point of contact and reassurance - One day of volunteer time off per year and a donation-matching program - Bi-weekly town halls and regular community-led team events - Multiple resources and programming to support continuous learning - A workplace that supports a diverse, equitable, and inclusive environment
• Have key responsibilities within the requirements analysis, scalable & low latency streaming platform solution design, architecture, and end-to-end delivery of key modules in order to provide near real-time data solutions for our product • Analyze and translate business needs into data model & optimize for big data • Identify slow queries and optimize for better performance • Write clean scalable code using Scala / python / SQL and test and deploy applications and systems • Solve our most challenging data problems, in near real-time, utilizing optimal data architectures, frameworks, query techniques, sourcing from structured and unstructured data sources. • Be part of an engineering organization delivering high quality, secure, and scalable solutions to Aircall clients • Involvement in product and platform performance optimization and live site monitoring • Mentor team members through giving and receiving actionable feedback.
Paid Student / Co-op – Data Entry Clerk
OECQSP Geographics Inc. (QSP) is a fast-growing geospatial technology company that provides a range of industry-leading solutions in disciplines that include GIS services, CAD drafting, survey, engineering, and asset management services. We presently have over 125 employees with offices in Toronto and Ottawa.
Role Description QSP is seeking a detail oriented and responsible Locates Screener to join our team. The primary responsibility of this role is to accurately investigate utility records within the excavation areas. Based on records, look for any potential locates which can be cleared from the office, eliminating the need for a site visit. The Locates Screener plays an integral role in preventing damage to underground infrastructure and ensuring excavation work is performed safely. The ideal candidate will have a keen eye for detail, excellent communication skills, and a commitment to safety. Responsibilities - Review Utility Locate Requests - Receive and analyze utility locate requests submitted by contractors. - Review and complete locates, adhering to timeframes. - Ensure all necessary information is investigated for accurate utility locate clearances. - Map and Documentation Analysis: - Review maps, blueprints, and other documentation to identify potential utility conflicts. - Use Geographic Information Systems (GIS) and other tools to perform utility location analysis. - Utility Locate Sketch Creation: - Develop detailed and accurate sketches and geographical limits of locate sites. - Ensure all sketches are properly labeled and meet project specifications and requirements. - Maintain up-to-date knowledge of industry-standard software and tools for utility locating and sketching. Qualifications - Any combination of education and/or experience that provides the required knowledge, skills, and abilities to perform the essential functions of the position. A typical combination includes: - High school diploma or equivalent. - 1-2 years of experience in utility locating, surveying, construction, or a related field is preferred. Skills - Ability to read and interpret utility records (service tickets, FN’s and As-Laids). - Proficiency with GIS software, utility locating tools, and Microsoft Office Suite. - Strong attention to detail and accuracy in creating locate clearance packages. - Review appropriate records within the excavation area. - Quick learner, able to work in a time-sensitive environment. - Ability to work independently and with minimal supervision. Physical Requirements - May require working in flexible work environments as per project requirements. - Able to work comfortably and productively from home – Computer hardware and software will be provided. - Sitting for extended periods of time. Other Requirements - Ability to manage multiple tasks and prioritize effectively. - Customer service oriented and ability to work collaboratively with team members. Benefits - Potential to lead innovative projects and initiatives. - Career path exploration and development opportunities. - Opportunities to get involved with teams and charitable events that support the community. - Comprehensive total reward package. Company Description QSP Geographics Inc. (QSP) is a fast-growing geospatial technology company that provides a range of industry-leading solutions in disciplines that include GIS services, CAD drafting, survey, engineering, and asset management services. We presently have over 125 employees with offices in Toronto and Ottawa.


