Job Closed
This listing is no longer active.
Inteligência Artificial para Acessibilidade Digital
Senior Data Architect
Location
Brazil
Posted
177 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Architect
Hand Talk
• Work with team members and architects from other teams to ensure a cohesive Data Platform architecture. • Ensure the Data Platform (Data Lakehouse) architecture is scalable and robust. • Design the taxonomy and structure of the Data Catalog so data is easily discoverable and accessible. • Establish standards (file formats, compression, partitioning strategies) to maximize query efficiency. • Lead the selection of new tools, architectural changes, and features, communicating trade-offs between cost, complexity, and performance to the team. • Design security architecture using AWS Lake Formation to ensure data isolation and auditing. • Implement and manage the data catalog with governance and access controls.
Job Requirements
- Strong experience in data modeling tailored for Lakehouse environments (Medallion layers) and formats such as Apache Iceberg.
- Solid knowledge of microservices architecture and exposing data via APIs (REST, GraphQL) using AWS capabilities.
- Advanced knowledge of AWS architecture and services for data processing.
- Experience with cataloging tools, data lineage, and fine-grained access control.
- Fluent in Terraform to ensure the architecture is 100% reproducible.
- Fluent English (spoken and written).
- Good communication skills.
- Integration mindset.
- Team player.
- Ability to present technical concepts to different audiences (including non-technical stakeholders).
- Ability to handle ambiguity and uncertainty.
- Flexible and able to adapt to a dynamic environment.
Benefits
- CLT employment contract: employment rights and protections guaranteed from day one.
- Caju Benefits Card (R$ 1,160.00): Flexible balance you can use for meals, groceries, home office, culture, and mobility.
- Remote work — work from anywhere in Brazil with flexibility and comfort.
- SulAmérica Health Plan.
- SulAmérica Dental Plan.
- SulAmérica Life Insurance.
- Online medical consultations via Conexa Saúde (telemedicine).
- Wellhub: support for your overall wellbeing.
- Extended year-end break: enjoy a longer holiday period to recharge with family and friends.
- Birthday day off: a special day off during your birthday month.
- Extended parental leave: support and time for those growing their families.
- Continuous professional development: access to platforms like LinkedIn Learning plus an annual allowance for courses and training in your field.
- University partnerships: support through discounts and giveaways.
- Libras (Brazilian Sign Language) training: learn an important language for our community.
- English learning support through partnerships.
- Work equipment provided as part of your onboarding kit.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Build and maintain data extraction pipelines from various sources into BigQuery • Refactor and modernize existing extraction systems • Implement monitoring and alerting for pipeline health • Help design and implement our orchestration platform (tooling TBD as a team) • Build scheduling, dependency management, and failure recovery into our data workflows • Create visibility into pipeline status for the broader team and business • Maintain and optimize our BigQuery data warehouse • Support DBT model development and deployment workflows • Implement CI/CD for data infrastructure changes • Support SOC 2 compliance requirements for data systems • Implement security controls and access management in BigQuery • Document data flows and maintain data catalogs
Data Engineer – Medior
Refinery89Helping publishers and advertisers to drastically increase their results from ads #ForPublishersByPublishers
• Design, build, and maintain data pipelines supporting Refinery89’s core data platform • Contribute to the design and evolution of the company’s data architecture and tooling • Implement reliable ingestion, transformation, and storage processes for structured and semi-structured data • Ensure data reliability, consistency, and basic data quality controls across systems • Collaborate with engineers and internal stakeholders to support analytics and operational use cases • Maintain clear, consistent technical documentation for data systems and workflows
• Develop ETL jobs on AWS Glue (PySpark/Python) • Implement ingestion pipelines and configure Glue Crawlers • Collect and ingest data from multiple sources (internal APIs, SharePoint) • Monitor and troubleshoot pipelines • Integrate with Redshift for loading curated data • Core services: AWS Glue, Amazon S3, Redshift, AWS Data Lake.
• Design, develop, and maintain scalable ETL pipelines and data workflows. • Build, optimize, and maintain data processing solutions using Azure Databricks. • Support phased data migration from legacy databases and ETL tools. • Implement layered lakehouse data architectures in Databricks. • Develop data processing notebooks, workflows, and distributed data transformations using Python and PySpark. • Develop data validation, reconciliation, and testing processes. • Integrate Databricks data platforms with analytics and reporting tools. • Support data governance initiatives including metadata management. • Maintain source control and CI/CD pipelines for Databricks workflows. • Provide ongoing support for Databricks workflows and troubleshoot complex issues. • Provide guidance to junior data engineers and contribute to documentation and team enablement.
