Grupo Protege logo
Grupo Protege

De Pessoas Para Pessoas

Senior Software Engineer, Data Processing

Full-stack EngineerSoftware EngineerFull TimeRemoteSeniorTeam 10,001+Since 1971H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

6 days ago

Salary

0

Seniority

Senior

Bachelor Degree5 yrs expEnglishAWSPython

Job Description

Senior Software Engineer, Data Processing

Grupo Protege

• Design, build, and operate the ingestion systems that process large volumes of multimodal data into usable, well-structured datasets • Own the ingestion path end to end, from how data lands to how it is validated, processed, tracked, and made available downstream • Build modality-specific processing steps for real-world source data, such as medical imaging processing, audio and video metadata extraction, quality validation, and notes processing • Build parsers, validators, and normalization logic that can systematically handle messy, non-standard, and high-variance source formats • Turn repeated one-off data handling work into reusable processing patterns, internal tooling, and platform capabilities • Build for high volume and high throughput, optimizing systems for reliability, cost, and speed • Work across distributed and parallel compute systems to process workloads that do not fit well on a single machine • Choose the right execution model for the workload, including batch processing, distributed execution, and modern compute patterns for unstructured data and inference-heavy processing • Diagnose and resolve bottlenecks across ingestion and processing systems, and keep performance from degrading as volume and modality complexity grow • Build validation and quality checks that catch bad, incomplete, or malformed data before it propagates downstream • Handle sensitive and regulated data, including PHI, with the security and care the domain demands, including de-identification where required • Track provenance, metadata, and usage constraints through the ingestion path so downstream use remains compliant and auditable • Raise the quality bar for observability, debuggability, and operational reliability across the ingestion layer • Partner with product and Data Lab to support new modalities, new partner requirements, and non-standard source data • Work directly with partner engineering teams when needed to translate source-system realities into robust ingestion and processing design • Surface recurring patterns that are worth standardizing into reusable transforms, validators, and internal tooling • Help shape how Protege handles new data types as the platform expands into more complex data environments

Job Requirements

  • 5+ years building and operating production backend or data systems, with real experience in data processing at scale
  • Hands-on experience designing and running large-scale data pipelines
  • Strong programming skills in Python
  • Experience with distributed data processing
  • Strong proficiency with AWS
  • Comfort with messy, varied, high-volume data and high ambiguity, with a knack for finding patterns in complex environments
  • Attention to detail without losing speed, and a bias to action
  • Excited to work on a product built around moving and processing large volumes of data
  • Curious, tenacious, and proactive

Benefits

  • Health insurance
  • Professional development opportunities
  • Flexible working hours

Related Job Pages

More Full-stack Engineer Jobs

Resend logo

Product Engineer

Resend

Email API for developers

Full TimeRemoteTeam 1-10Since 2022H1B No Sponsor

• Build polished product experiences for users using Resend. • Turn complex technical concepts into simple, clear, and trustworthy user experiences. • Own features end-to-end: product thinking, UX details, implementation, instrumentation, launch, and iteration. • Collaborate closely with design, engineering, and customer success to understand user problems and ship high-quality solutions. • Build debugging and observability experiences that help users understand what happened to their emails, webhooks, domains, and API requests. • Talk to users, understand customer pain, and turn those insights into better product decisions. • Help raise the bar for craft, performance, accessibility, reliability, and product quality across Resend.

Europe
$150K - $170K / year
Firstup logo

Software Engineer, Fullstack

Firstup

Connect every worker, everywhere with the right information at the right time.

Full TimeRemoteTeam 201-500H1B No Sponsor

• Contribute to the design, development, and maintenance of public-facing APIs used by enterprise customers. • Build and maintain integrations with external enterprise systems, including HRIS platforms. • Support shared platform services used across the engineering organisation. • Write clean, well-tested, and well-documented code, and participate in code reviews. • Work within large-scale multi-tenant cloud services, developing your understanding of scalability and fault-tolerance. • Use Generative AI tools and coding agents in day-to-day workflows to improve code quality and delivery speed. • Collaborate with teammates and cross-functional partners to solve problems and deliver customer value. • Contribute to production health, including on-call rotations and incident response, in a 'you build it, you run it' environment. • Identify and help resolve availability, reliability, and performance issues.

United Kingdom
Waymo logo

Senior Software Engineer, Fleet Response Training

Waymo

Waymo is an autonomous driving technology company creating a new way forward in mobility.

Full TimeRemoteTeam 1,001-5,000Since 2016H1B Sponsor

• Work with the operations team to build out a comprehensive training suite that enables FROs to do their best work assisting Waymo’s cars and riders

California
$213K - $263K / year
Verity Group logo

Senior FullStack Developer

Verity Group

Somos Humanos. Somos Digitais. Somos Verity!

Full TimeRemoteTeam 51-200Since 2010H1B No Sponsor

• Proven experience developing with Java / Spring Boot. • Strong experience in front-end development with Angular 16+. • Knowledge and hands-on experience with integration protocols and technologies, including: • HTTP/HTTPS, REST and SOAP. • Basic Database knowledge (JDBC). • Message Queues (JMS, AMQP). • Knowledge of Java EE, preferably with EJB technologies and JDK6/JDK7 versions.

Brazil