Job Closed
This listing is no longer active.
Inteligência, Inovação e Tecnologia.
Senior Data Engineer, AWS
Location
Brazil
Posted
54 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, AWS
Leega
• Make data originating from global (external) sources available in an analytical data store for business areas, ensuring governance and access in accordance with policies and governance established by Rumo. • Build data pipelines with DevOps practices, using Terraform and Jenkins/GitHub to automate AWS infrastructure provisioning and solution deployments. • Assist data analysts in classifying personal and sensitive data and configuring it in AWS Lake Formation (column- and row-level access permissions). • Process large volumes of data using Spark via EMR Studio and AWS Glue Jobs and Workflows. • Assist data analysts in designing dimensional models for data analysis (facts and dimensions).
Job Requirements
- Programming skills in Python
- Work closely with business stakeholders to understand data sources and map data
- Structure and consolidate data and metrics in AWS, ensuring datasets follow appropriate templates for direct consumption in Power BI for dashboard creation
- Knowledge of CDC and Oracle GoldenGate
- Experience working with data mesh and medallion architecture — raw, refined, and business-rule layers
Benefits
- Position also open to candidates with disabilities
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Integration Specialist (Contractor)
Alloy.aiAlloy.ai is purpose-built to help consumer goods brands sell more products, save time and solve complex supply chain challenges. With daily SKU-store level insights in Alloy.ai, brands can quickly sense problems, respond in seconds instead of days, and predict issues their competitors won’t see coming. Alloy.ai is built on a cloud data platform powered by 850+ pre-built connectors that integrate point-of-sale and inventory data with supply chain data — giving brands complete and instant visibility into demand and inventory across their network. Alloy.ai is trusted by companies ranging from the Fortune 500 to digital-natives, including Crayola, Bic, Valvoline, Bosch, Simplisafe, and Melissa & Doug. Customers routinely achieve a 35%+ reduction in out-of-stocks, a 5%+ bottom line impact, and millions of dollars in incremental orders with their retail partners.
About Alloy.ai At Alloy.ai, we work with consumer goods companies that make the products we eat, wear, and use every day, as well as the ones we occasionally splurge on. We’re tackling a real and complex problem for them—managing supply and demand in the face of constantly changing customer behavior, highly complex supply chain networks, 40-year-old data standards and labor-intensive manual processes. Alloy.ai is a fast-growing, well-funded startup with an expanding presence across the world. Our team hails from successful startups, leading tech companies and Fortune 100 enterprises. We believe deeply in fostering individual ownership, iterating to excellence, focusing on what matters, communicating openly & respectfully, and supporting one another. We encourage people of all backgrounds to apply. Alloy.ai is committed to creating an inclusive culture, and we celebrate diversity of all kinds. About The Role Our network-based data platform is one of Alloy.ai’s core strategic assets. When we work with manufacturers, we are able to quickly integrate disparate information shared by their trading partners, including retailers, material suppliers, distributors and logistics providers, and we can do that up to an order of magnitude faster than other solutions. Most of our integration infrastructure with more than 400 active integrations is fully reusable, and connections to common trading partners are maintained across multiple Alloy customers. Our implementation team is in charge of building,and deploying data for customers, ensuring integration best practices are adhered to. This contractor role extends our implementation team and will interface with integration specialists, project managers and our engineering team. About You In this role, you will help a project team deliver retailer data integrations to our customers. Your task is to devise data mapping procedures for new retailer data feeds based on existing best practices for feed design and implementations and to deliver them to our customers. You will write data transformations for our data pipeline which processes our customers’ data at any time of day. You will get to know the data back office of retailers you may know from your daily shopping and learn more about some of your favourite brands’ businesses. To succeed in this position, you should possess curiosity, creativity, good problem solving skills and be an effective communicator all while being able to work successfully in a team and independently. What You Will Do - Design and build new integrations for retailer data sources based on customer requirements to unlock powerful cross-retailer analyses combining data from various, disparate data sources. - Critically QA and test your work. - Analyze data for issues and report back possible solution paths to team members if you cannot solve them. - Facilitate quality checks and provide User Acceptance Testing dashboards for integrations prior to customer sign off. - Work together with a project team of project managers, integrations specialists, and data engineers to deliver a stellar customer experience throughout the implementation journey. - Deliver against a project plan with deadlines and timelines while providing progress as necessary to internal stakeholders. What We Are Looking For - You are adept at data analysis and data wrangling through programming (e.g. pandas, dplyr), database querying (SQL), or spreadsheets (Excel). - You can successfully work independently on projects and deliver to deadlines. - Ability to communicate regularly to stakeholders and identify delays or roadblocks early to ensure key deadlines and milestones are met. - You are intellectually curious, especially about data, and are constantly eager to find out how things work and how to fix them. - You are a self-starter, and actively seek advice from other team members to maximize the quality of your work. - You are an effective communicator both verbally and written with a knack for translating technical details to non-technical audiences. - You are organized, can effectively keep track of a long to-do list in order to prioritize and deliver tasks on time. You leave no loose ends! - Preferably, you have some experience working with versioning tools and code review. $30 - $30 an hour Role Specifics - Contract role is hourly with an expected initial scope of 20 hours a week with daily, set hours overlapping with 9am - 5pm EST. There is potential for additional hours up to 40 hours a week, with flexibility to set your own schedule over time if deliverables are being met. - This is a 6 month contract position to start with a potential opportunity for extension. - Role is preferred to be in person in Vancouver or Toronto but Remote will be considered for the right candidate. - Work needs to be completed from the United States or Canada unless discussed ahead of time with the VP of Operations and hiring manager. - Contractor needs to have a computer that meets the below requirements (if not possible please let us know ahead of time for potential alternatives) and comply with all of Alloy’s security requirements including a basic background check. - Must be able to enable full hard disk encryption - Pay will be semi-monthly. This is not a full time position and does not offer benefits. Alloy reserves the right to request a schedule change even after schedule is set as business needs arise but contractor can as well as long as it fits with other contractors. Any days off (including statutory holidays) should be agreed upon in advance to ensure coverage. This is a month to month contract position with an initial commitment of 6 months. Contractor will need to meet Alloy’s security requirements including: basic background check upon offer as Contractor will be dealing with sensitive data, accepting and complying with all Alloy security policies, and have a computer with full hard disk encryption (if not possible please let us know ahead of time for potential alternatives).
Data Science Investigations Department: Investigations Employment Type: Full Time Location: Remote Description Who are we? Hi! 👋 We are Ravelin! We're a fraud detection company using advanced machine learning and network analysis technology to solve big problems. Our goal is to make online transactions safer and help our clients feel confident serving their customers. And we have fun in the meantime! We are a friendly bunch and pride ourselves in having a strong culture and adhering to our values of empathy, ambition, unity and integrity. We really value work/life balance and we embrace a flat hierarchy structure company-wide. Join us and you’ll learn fast about cutting-edge tech and work with some of the brightest and nicest people around - check out our Glassdoor reviews. If this sounds like your cup of tea, we would love to hear from you! For more information check out our blog to see if you would like to help us prevent crime and protect the world's biggest online businesses. The Role We are currently looking for a Junior level Data Scientist to join a fantastic team of client-facing data scientists and client support analysts. You will be working to discover patterns and trends concerning fraud in our clients' data. In this key role, you'll be applying exploratory analysis to form realistic and useful narratives from data, asking “why” as well as “what” and “how". You will interact directly and indirectly with clients to help them understand what is happening with their fraud, and help us to target our efforts ever more precisely. Key Responsibilities Responsibilities - Work directly with clients to provide fraud analytics and ML model insights - Analyse datasets with millions of rows to identify fraud patterns, trends and emerging threats to improve client performance - Discuss specific fraud problems with clients, in order to deeply understand how they manifest and to propose effective and elegant solutions - Prepare reports and present findings of analysis to clients when required - Identify new model features and improve model performance - Optimise the performance of our graph networks using network analysis - Get hands on experience with our cloud infrastructure and make the most of the available tools for enhancing our clients’ data and performance - Build internal tools in Python for optimising and improving our analytical capabilities Skills, Knowledge and Expertise Requirements - 1 years' experience or training as a data analyst, intelligence analyst or data scientist - Strong critical thinking skills, intuitively curious and able to diagnose data issues - Strong communication and presentation skills - Diligence, attention to detail, ability to prioritise and follow through on tasks - Experience with SQL - ability to run complex queries to answer your own questions - Experience with Python for data analysis - Knowledge of supervised and unsupervised ML techniques - Desirable: some knowledge, understanding or experience of network analysis - Desirable: hands-on experience with DBT Benefits Benefits - Flexible Working Hours & Remote-First Environment — Work when and where you’re most productive, with flexibility and support. - Comprehensive BUPA Health Insurance — Stay covered with top-tier medical care for your peace of mind. - £1,000 Annual Wellness and Learning Budget — Prioritise your health, well-being and learning needs with funds for fitness, mental health, and more. - Monthly Wellbeing and Learning Day — Take every last Friday of the month off to recharge or learn something new, up to you. - 25 Days Holiday + Bank Holidays + 1 Extra Cultural Day — Enjoy generous time off to rest, travel, or celebrate what matters to you. - Mental Health Support via Spill — Access professional mental health services when you need them. - Aviva Pension Scheme — Plan for the future with our pension program. - Ravelin Gives Back — Join monthly charitable donations and volunteer opportunities to make a positive impact. - Fortnightly Randomised Team Lunches — Connect with teammates from across the company over in person or remote lunches every other week on us! - Cycle-to-Work Scheme — Save on commuting costs while staying active. - BorrowMyDoggy Access — Love dogs? Spend time with a furry friend through this unique perk. - Weekly Board Game Nights & Social Budget — Unwind with weekly board games or plan your own socials, supported by a company budget. *Job offers may be withdrawn if candidates do not meet our pre-employment checks: unspent criminal convictions, employment verification, and right to work.*
Data Integration Specialist (Contractor)
Alloy.aiAlloy.ai is purpose-built to help consumer goods brands sell more products, save time and solve complex supply chain challenges. With daily SKU-store level insights in Alloy.ai, brands can quickly sense problems, respond in seconds instead of days, and predict issues their competitors won’t see coming. Alloy.ai is built on a cloud data platform powered by 850+ pre-built connectors that integrate point-of-sale and inventory data with supply chain data — giving brands complete and instant visibility into demand and inventory across their network. Alloy.ai is trusted by companies ranging from the Fortune 500 to digital-natives, including Crayola, Bic, Valvoline, Bosch, Simplisafe, and Melissa & Doug. Customers routinely achieve a 35%+ reduction in out-of-stocks, a 5%+ bottom line impact, and millions of dollars in incremental orders with their retail partners.
About Alloy.ai At Alloy.ai, we work with consumer goods companies that make the products we eat, wear, and use every day, as well as the ones we occasionally splurge on. We’re tackling a real and complex problem for them—managing supply and demand in the face of constantly changing customer behavior, highly complex supply chain networks, 40-year-old data standards and labor-intensive manual processes. Alloy.ai is a fast-growing, well-funded startup with an expanding presence across the world. Our team hails from successful startups, leading tech companies and Fortune 100 enterprises. We believe deeply in fostering individual ownership, iterating to excellence, focusing on what matters, communicating openly & respectfully, and supporting one another. We encourage people of all backgrounds to apply. Alloy.ai is committed to creating an inclusive culture, and we celebrate diversity of all kinds. About The Role Our network-based data platform is one of Alloy.ai’s core strategic assets. When we work with manufacturers, we are able to quickly integrate disparate information shared by their trading partners, including retailers, material suppliers, distributors and logistics providers, and we can do that up to an order of magnitude faster than other solutions. Most of our integration infrastructure with more than 400 active integrations is fully reusable, and connections to common trading partners are maintained across multiple Alloy customers. Our implementation team is in charge of building,and deploying data for customers, ensuring integration best practices are adhered to. This contractor role extends our implementation team and will interface with integration specialists, project managers and our engineering team. About You In this role, you will help a project team deliver retailer data integrations to our customers. Your task is to devise data mapping procedures for new retailer data feeds based on existing best practices for feed design and implementations and to deliver them to our customers. You will write data transformations for our data pipeline which processes our customers’ data at any time of day. You will get to know the data back office of retailers you may know from your daily shopping and learn more about some of your favourite brands’ businesses. To succeed in this position, you should possess curiosity, creativity, good problem solving skills and be an effective communicator all while being able to work successfully in a team and independently. What You Will Do - Design and build new integrations for retailer data sources based on customer requirements to unlock powerful cross-retailer analyses combining data from various, disparate data sources. - Critically QA and test your work. - Analyze data for issues and report back possible solution paths to team members if you cannot solve them. - Facilitate quality checks and provide User Acceptance Testing dashboards for integrations prior to customer sign off. - Work together with a project team of project managers, integrations specialists, and data engineers to deliver a stellar customer experience throughout the implementation journey. - Deliver against a project plan with deadlines and timelines while providing progress as necessary to internal stakeholders. What We Are Looking For - You are adept at data analysis and data wrangling through programming (e.g. pandas, dplyr), database querying (SQL), or spreadsheets (Excel). - You can successfully work independently on projects and deliver to deadlines. - Ability to communicate regularly to stakeholders and identify delays or roadblocks early to ensure key deadlines and milestones are met. - You are intellectually curious, especially about data, and are constantly eager to find out how things work and how to fix them. - You are a self-starter, and actively seek advice from other team members to maximize the quality of your work. - You are an effective communicator both verbally and written with a knack for translating technical details to non-technical audiences. - You are organized, can effectively keep track of a long to-do list in order to prioritize and deliver tasks on time. You leave no loose ends! - Preferably, you have some experience working with versioning tools and code review. $30 - $30 an hour Role Specifics - Contract role is hourly with an expected initial scope of 20 hours a week with daily, set hours overlapping with 9am - 5pm EST. There is potential for additional hours up to 40 hours a week, with flexibility to set your own schedule over time if deliverables are being met. - This is a 6 month contract position to start with a potential opportunity for extension. - Role is preferred to be in person in Vancouver or Toronto but Remote will be considered for the right candidate. - Work needs to be completed from the United States or Canada unless discussed ahead of time with the VP of Operations and hiring manager. - Contractor needs to have a computer that meets the below requirements (if not possible please let us know ahead of time for potential alternatives) and comply with all of Alloy’s security requirements including a basic background check. - Must be able to enable full hard disk encryption - Pay will be semi-monthly. This is not a full time position and does not offer benefits. Alloy reserves the right to request a schedule change even after schedule is set as business needs arise but contractor can as well as long as it fits with other contractors. Any days off (including statutory holidays) should be agreed upon in advance to ensure coverage. This is a month to month contract position with an initial commitment of 6 months. Contractor will need to meet Alloy’s security requirements including: basic background check upon offer as Contractor will be dealing with sensitive data, accepting and complying with all Alloy security policies, and have a computer with full hard disk encryption (if not possible please let us know ahead of time for potential alternatives).
• Collaborate with cross-functional teams to gather integration and data migration requirements. • Design and implement integration and data migration solutions aligned with business requirements. • Develop custom APIs, connectors, and transformation logic using MuleSoft Anypoint Platform. • Design and implement ETL workflows and migration frameworks. • Prepare and maintain detailed implementation documentation including integration points, configuration details, and migration artifacts. • Troubleshoot and resolve issues to ensure high availability and performance. • Participate in design discussions and contribute to architecture decisions. • Ensure all solutions adhere to security, compliance, and performance standards.



