De Pessoas Para Pessoas
Senior Software Engineer, Data Processing
Location
Brazil
Posted
6 days ago
Salary
0
Seniority
Senior
Job Description
Senior Software Engineer, Data Processing
Grupo Protege
• Design, build, and operate the ingestion systems that process large volumes of multimodal data into usable, well-structured datasets • Own the ingestion path end to end, from how data lands to how it is validated, processed, tracked, and made available downstream • Build modality-specific processing steps for real-world source data, such as medical imaging processing, audio and video metadata extraction, quality validation, and notes processing • Build parsers, validators, and normalization logic that can systematically handle messy, non-standard, and high-variance source formats • Turn repeated one-off data handling work into reusable processing patterns, internal tooling, and platform capabilities • Build for high volume and high throughput, optimizing systems for reliability, cost, and speed • Work across distributed and parallel compute systems to process workloads that do not fit well on a single machine • Choose the right execution model for the workload, including batch processing, distributed execution, and modern compute patterns for unstructured data and inference-heavy processing • Diagnose and resolve bottlenecks across ingestion and processing systems, and keep performance from degrading as volume and modality complexity grow • Build validation and quality checks that catch bad, incomplete, or malformed data before it propagates downstream • Handle sensitive and regulated data, including PHI, with the security and care the domain demands, including de-identification where required • Track provenance, metadata, and usage constraints through the ingestion path so downstream use remains compliant and auditable • Raise the quality bar for observability, debuggability, and operational reliability across the ingestion layer • Partner with product and Data Lab to support new modalities, new partner requirements, and non-standard source data • Work directly with partner engineering teams when needed to translate source-system realities into robust ingestion and processing design • Surface recurring patterns that are worth standardizing into reusable transforms, validators, and internal tooling • Help shape how Protege handles new data types as the platform expands into more complex data environments
Job Requirements
- 5+ years building and operating production backend or data systems, with real experience in data processing at scale
- Hands-on experience designing and running large-scale data pipelines
- Strong programming skills in Python
- Experience with distributed data processing
- Strong proficiency with AWS
- Comfort with messy, varied, high-volume data and high ambiguity, with a knack for finding patterns in complex environments
- Attention to detail without losing speed, and a bias to action
- Excited to work on a product built around moving and processing large volumes of data
- Curious, tenacious, and proactive
Benefits
- Health insurance
- Professional development opportunities
- Flexible working hours
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Build polished product experiences for users using Resend. • Turn complex technical concepts into simple, clear, and trustworthy user experiences. • Own features end-to-end: product thinking, UX details, implementation, instrumentation, launch, and iteration. • Collaborate closely with design, engineering, and customer success to understand user problems and ship high-quality solutions. • Build debugging and observability experiences that help users understand what happened to their emails, webhooks, domains, and API requests. • Talk to users, understand customer pain, and turn those insights into better product decisions. • Help raise the bar for craft, performance, accessibility, reliability, and product quality across Resend.
Software Engineer, Fullstack
FirstupConnect every worker, everywhere with the right information at the right time.
• Contribute to the design, development, and maintenance of public-facing APIs used by enterprise customers. • Build and maintain integrations with external enterprise systems, including HRIS platforms. • Support shared platform services used across the engineering organisation. • Write clean, well-tested, and well-documented code, and participate in code reviews. • Work within large-scale multi-tenant cloud services, developing your understanding of scalability and fault-tolerance. • Use Generative AI tools and coding agents in day-to-day workflows to improve code quality and delivery speed. • Collaborate with teammates and cross-functional partners to solve problems and deliver customer value. • Contribute to production health, including on-call rotations and incident response, in a 'you build it, you run it' environment. • Identify and help resolve availability, reliability, and performance issues.
Senior Software Engineer, Fleet Response Training
WaymoWaymo is an autonomous driving technology company creating a new way forward in mobility.
• Work with the operations team to build out a comprehensive training suite that enables FROs to do their best work assisting Waymo’s cars and riders
• Proven experience developing with Java / Spring Boot. • Strong experience in front-end development with Angular 16+. • Knowledge and hands-on experience with integration protocols and technologies, including: • HTTP/HTTPS, REST and SOAP. • Basic Database knowledge (JDBC). • Message Queues (JMS, AMQP). • Knowledge of Java EE, preferably with EJB technologies and JDK6/JDK7 versions.




