Job Closed

This listing is no longer active.

Seekerh logo
Seekerh

Conectando Talentos aos Desafios do Seu Negócio

Data Engineer – AWS, Spark, Delta Lake

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1-10Since 2019H1B No SponsorCompany SiteLinkedIn

Location

Brazil

Posted

112 days ago

Salary

R$2K / hour

Seniority

Senior

Job Description

Data Engineer – AWS, Spark, Delta Lake

Seekerh

• Develop, maintain and evolve data pipelines for ingestion, transformation and delivery of large-scale data, covering both batch and streaming processing • Design, optimize and maintain ETL/ELT processes using Apache Spark and Delta Lake, ensuring data performance, quality and reliability • Integrate data solutions with AWS services such as AWS Glue, Amazon DynamoDB, Amazon Athena, AWS Lambda and Amazon SQS • Monitor pipeline execution and health using Amazon CloudWatch, proactively identifying and resolving failures • Automate data infrastructure using AWS CloudFormation to ensure standardization, scalability and version control • Apply the Medallion architecture pattern (Bronze, Silver and Gold) for organization, governance and evolution of analytical data

Job Requirements

  • Hands-on experience with Apache Spark, including Spark SQL
  • Strong SQL skills for data manipulation, transformation and querying
  • Experience developing batch and streaming ETL pipelines
  • Experience with NoSQL databases such as Amazon DynamoDB
  • Knowledge and practical experience with Delta Lake (delta.io)
  • Practical experience with the following AWS services: AWS Glue, Amazon DynamoDB, Amazon Athena, AWS Lambda, Amazon SQS, Amazon CloudWatch and AWS CloudFormation

Benefits

  • Contract: PJ (hourly)
  • Caju credits — BRL 2,000.00
  • Meal voucher (VR) — BRL 704.00
  • Wellhub
  • Bradesco health and dental plan

Related Categories

Related Job Pages

More Data Engineer Jobs

Innodata logo

Senior Data Engineer – Real-Time & Distributed Systems, GCP

Innodata

Innodata, with over 35 years of expertise, is a trusted leader in data solutions and AI innovation. The company specializes in training and deploying generative

Data Engineer112 days ago

• Design, build, and optimize scalable data pipelines for batch and real-time processing • Develop and maintain event-driven architectures for high-throughput systems • Ensure data reliability, performance, and low-latency processing across distributed environments • Collaborate with data scientists and application teams to enable analytics and AI use cases • Implement best practices in performance tuning, monitoring, and cost optimization

New Jersey
Job Closed
Teamified logo

AI Data Engineer

Teamified

Empower Global Teams

Data Engineer112 days ago
Full TimeRemoteTeam 201-500Since 2021H1B No Sponsor

• Design and develop our Teamified AI data architecture & API using Python (Django Framework) and other relevant python libraries • Manage our RDBMs [SQL], NoSQL [MongoDb] and Vector [Pinecone] databases and conduct proper data governance & research • Collaborate with our leadership, product experts and software architect to integrate AI solutions into our Teamified Platform • Optimize AI augmentation models, context builders and prompt builders for performance, scalability, and efficiency. • Conduct research and stay up-to-date on the latest advancements in AI and data engineering.

India
Job Closed

Data Migration Analyst

Mark43

Mark43 is a trusted leader in public safety technology, providing innovative solutions to help law enforcement and public safety agencies save time, ensure comp

Data Engineer112 days ago

• Lead pre-migration discovery sessions with public safety agencies. • Guide agencies through completion of migration questionnaires and data documentation. • Serve as the primary migration point of contact for agency stakeholders. • Clearly explain differences between legacy systems and Mark43 data structures and functionality. • Bridge gaps between how data existed historically and how it will function within Mark43. • Partner closely with the Mark43 Data Migration Engineering team to translate agency requirements into technical migration deliverables. • When applicable, collaborate with third-party migration contractors to support accurate data mapping, transformation, and execution. • Ensure alignment between customer expectations and technical implementation. • Support project planning and track migration milestones alongside project Program Managers. • Identify data risks, inconsistencies, and timeline concerns early in the process. • Facilitate structured migration validation rounds with agencies. • Track validation feedback and drive issue resolution in coordination with engineers and contractors. • Participate in user acceptance testing and quality assurance efforts. • Contribute to improving migration questionnaires, documentation, and validation workflows. • Support scalable and repeatable migration processes within Professional Services.

Alabama + 34 moreAll locations: Alabama | Arizona | California | Colorado | Connecticut | Florida | Idaho | Illinois | Iowa | Kansas | Maine | Nebraska | New Hampshire | New Jersey | New Mexico | New York | North Carolina | Ohio | Oklahoma | Oregon | Maryland | Massachusetts | Michigan | Minnesota | Missouri | Pennsylvania | South Carolina | Tennessee | Texas | Utah | Vermont | Virginia | Washington | West Virginia | Wisconsin
Job Closed
EVOTEK logo

Data Center Engineer - Remote

EVOTEK

Today’s Emerging Technology will be Tomorrow’s Competitive Advantage

Data Engineer112 days ago
OtherRemoteTeam 51-200H1B No Sponsor

Join EVOTEK: North America’s Premier Digital Business Enabler As North America's premier enabler of secure digital business, we integrate cutting-edge technical expertise across data center, network, security, cloud, and communications domains. By delivering cohesive digital solutions, we help businesses drive measurable impact and accelerate their transformation. Our award-winning culture is the cornerstone of everything we do. Recognized multiple times by Inc. Magazine as a "Best Place to Work", we’re proud to create an environment where innovation and collaboration thrive. Locally, we’ve been honored by The San Diego Business Journal as a "Best Place to Work" more than seven times, and our excellence is reflected in accolades like CRN's "Solution Provider 500", "Tech Elite 250", and "Top 150 Growth Companies”. We’ve also earned a spot among CRN’s "Triple Crown” award winners. If you’re ready to be part of a team that values innovation, culture, and business impact, EVOTEK is the place for you. Role Summary The Data Center Engineer will be responsible in design, implementation, support, and migration enterprise infrastructure across on-premises, hybrid, and cloud environments. This role focuses on virtualization, containerization, and automation to deliver secure, resilient, and scalable infrastructure solutions. Responsibilities - Deliver billable professional services engagements across hybrid data center, virtualization, and cloud environments - Execute implementation, migration, upgrade, and modernization projects for enterprise clients - Deploy and support VMware, hyperconverged, storage, and Kubernetes platforms - Lead technical workstreams during project lifecycle phases (plan, design, implement, optimize, document) - Troubleshoot and resolve complex infrastructure issues across compute, storage, and data center networking domains - Develop client-facing deliverables including implementation documentation, cutover plans, validation reports, and knowledge transfer materials - Provide regular engagement status updates to project managers and client stakeholders - Ensure solutions are deployed according to scope, best practices, and performance expectations - Contribute to repeatable delivery methodologies, standards, and service offerings - Desire and commitment to achieve and maintain vendor and industry related certifications

California
Job Closed