Senior Data Engineer - South Africa
Location
South Africa
Posted
58 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer - South Africa
Digital Luxury Group, DLG
WHO WE ARE DLG (Digital Luxury Group) is a Swiss-headquartered company building an AI-powered market intelligence platform used by leading luxury brands to understand their markets, competitors, and consumers. Our platform processes millions of data points across search trends, social signals, and market movements to give luxury executives clarity they can't get anywhere else. We're growing our tech team in South Africa as part of our international operation spanning Europe, China and the US. You'll work on real products using Python, BigQuery, cloud infrastructure, and AI/LLM integrations — with direct impact and genuine ownership of what you build. This is a fully remote position based in South Africa - Cape Town. WHAT YOU’LL DO We are looking for a Senior Data Engineer to make a significant contribution to our core data platform. Key focus is on maintenance, enhancement and optimization of existing data pipelines. We will also expect key involvement in new development initiatives, requiring database architecture, design and development. The role is reporting to our Head of Data, based in Shanghai. Responsibilities - Design and development of data processing, data cleansing, data transformation and QA scripts using Python and SQL - Operations, maintenance and enhancements of existing mission-critical data pipelines and ETLs including - Monitoring and regular maintenance of data pipelines, ensuring data reliability and quality standards - Enhancements to meet evolving business requirements - Optimization of ETLs for performance - Migration of legacy data pipelines into more a scalable architecture - Typical data engineering responsibilities including - SQL database design, maintenance and optimization - Fetching datasets from external data sources: REST API, JSON or CSV - Performing data migrations and batch data updates - Exploratory projects including - Analysis of various datasets to support business requirements - Developing Proof-of-concept of new data pipelines - Working with other data team members to complete common deliverables and provide technical expertise WHAT YOU WILL NEED TO BE GREAT IN THIS ROLE Required: - Graduate in Computer Science, Information Systems, Statistics, Mathematics, or related fields - At least 2 years relevant experience in data engineering, database or ETL development - Excellent skills in Python - Excellent skills in SQL and data warehouse design/development - Experience with ETL development and maintenance - An “AI-first” mindset: leveraging the latest AI technologies to increase both the speed and quality of what we do Nice to have: - Experience with PostgreSQL and BigQuery - Experience with Apache Airflow - Experience with dbt - Experience with GCP or similar cloud platforms General: - Ability to work independently and with team members from different backgrounds - Strong result orientation and ownership - Proficient in English (writing and speaking) - Passionate about new technologies and innovation WHAT WE OFFER - Highly competitive package, above market rates for the right candidate - Remote-friendly role with international team collaboration across Switzerland, the UK and China - Direct exposure to senior leadership — no layers of middle management - Opportunity to grow with a platform that's scaling across the luxury industry - Wellbeing and learning support
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
RH: Lessly Mujica Location: any state of Mexico General Description: Working experience in GCP cloud with good knowledge in python , SQL/NoSQL , BigQuery, Workflow orchestration(Airflow/Cloud Composer) Responsibilities: · Hands knowledge or GCP Big Query (SQL) · Knowledge on Data warehouse · Data forms · Excellent data engineering skills including expert SQL, data modeling, and query optimization · Strong experience with big data stack (Spark, PySpark, Hadoop, HIVE, BigQuery, Pub/Sub) in building scalable ETL pipelines · Excellent programming skills (Python) including production level coding techniques (testing, OOP structures, optimization, etc) · Demonstrated cloud-native focus with relevant cloud experience, preferably Google Cloud Platform or Azure · Data visualization and dashboarding experience · Great at debugging, troubleshooting, designing, and implementing solutions to complex technical issues · Aptitude to independently learn new technologies, prototype, and propose solutions Soft skills: Work Underpressure, Quality at work, Results Oriented What can YOU expect in a career with Capgemini? - Working in a team environment, Consultants will focus on the analysis, design and development of technology-based solutions for Capgemini’s clients. - You will work alongside technical, functional and industry specialists to assist with the development, implementation and integration of innovative system solutions including methods, techniques and tools. - You will contribute to client satisfaction by providing timely and responsive value-added services and work products. - Capgemini offers a competitive compensation and benefits package. - Headquartered in Paris, France, Capgemini has a presence of more than 340 thousand professionals in Mexico distributed among 3 sites located in Mexico City, Monterrey and Aguascalientes. A deeply multicultural organization. - Capgemini has developed its own way of working, the Collaborative Business ExperienceTM, and draws on Rightshore, its worldwide delivery model. You will love this job because - Capgemini focuses on giving each new hire a YOU-nique experience through our recruitment process and on-boarding program, as well as by helping you to build your own career and professional skills foundation. - Capgemini provides a collaborative environment that embodies and holds the following stated values close to heart: Honesty, Boldness, Trust, Freedom, Team Spirit, Modesty, and Fun. - Capgemini cultivates an atmosphere for development that enables YOU to be hands-on, planning for your growth, both horizontally and vertically.
This is a remote position. Azure Specialist Overview We are seeking an Azure Specialist to design, implement, and support cloud-based solutions that power AI-driven applications, data platforms, and client-facing systems. This role will focus on building and optimizing solutions within Microsoft Azure, while supporting integrations with AWS, Tableau, Power BI, and DealCloud CRM. This is a hands-on role ideal for someone with strong Azure experience and a background in cloud infrastructure, data platforms, and modern application architectures. Key Responsibilities - Design, deploy, and manage Azure-based infrastructure and services - Build and support environments for AI/ML workloads, data pipelines, and analytics platforms - Implement scalable, secure, and highly available cloud solutions in Azure - Support integrations between Azure services and: - AWS environments (multi-cloud) - BI tools (Tableau, Power BI) - CRM platforms (DealCloud) - Develop and maintain infrastructure as code (IaC) using tools such as ARM templates, Bicep, or Terraform - Monitor and optimize systems for performance, cost, and reliability - Implement and manage security controls, including identity (Azure AD), access, and encryption - Support CI/CD pipelines and DevOps practices for deployment automation - Troubleshoot and resolve issues across Azure infrastructure and applications - Collaborate with engineering, data, and architecture teams to align with best practices and standards Requirements Required Qualifications - 4–7 years of experience working with Microsoft Azure - Strong hands-on experience with core Azure services such as: - Virtual Machines, Storage Accounts - Azure SQL, Cosmos DB - Azure Functions, App Services - Virtual Networks, Azure Active Directory - Experience supporting data platforms, ETL/ELT pipelines, or analytics workloads - Experience with infrastructure as code (ARM, Bicep, Terraform, or similar) - Familiarity with CI/CD tools and DevOps practices (e.g., Azure DevOps, GitHub Actions) - Strong understanding of cloud networking, security, and architecture principles - Experience troubleshooting and supporting production cloud environments Key Traits for Success - Strong technical troubleshooting and problem-solving skills - Ability to work independently and collaboratively - Proactive mindset focused on optimization and improvement - Adaptability in a fast-paced, AI-driven environment - Strong communication across technical teams
Lead Consultant Data Architecture & Engineering (GDC) | Remote
TASQ Staffing SolutionsTalent Acquisition done with Speed Quality
Work Setup: Remote Schedule: Midshift Job Highlights: - Leadership Opportunities - This role will help you extend and expand your knowledge and experience in technical leadership positions. These include technical decision- making; guidance and mentorship of more junior team members; and developing relationships with project, client, and company leadership all while remaining hands-on in your areas of expertise. - Our technology focus is on Azure - you'll have plenty of exciting opportunities to grow your skills in Microsoft and Azure in an environment committed to technical excellence and client experience in a very specific, defined space. Six months of experience on our team is worth years somewhere else. - Microsoft Partnerships - Our great global relationship with Microsoft ensures that we have a pipeline of cutting-edge Azure work opportunities, and access to the teams that have built the platform. You wont find this at other places. - Competitive compensation package, salary, allowance, standard benefits including quarterly and annual performance-based cash bonus and other remuneration. - Great working environment and company culture with flexible work location. General Required Technical Skills: - Experience leading small to medium sized technical teams (this includes work allocation/distribution to team members, technical escalation and support, representing the team in Agile ceremonies and client meetings). - Expertise in designing and implementing logical and physical data models for cloud and hybrid data warehouse environments - Implementing data architectures to support a variety of data formats and structures including structured, semi-structured and unstructured data - Experience with multiple full life-cycle data warehouse implementations - Understanding of data architectures required to support data integration processing - Experience with data modeling technologies such as ER/Studio, ER/Win or similar - Experience with Microsoft Azure Data Platform services including Azure Data Lake Store, Azure Storage, Azure Synapse, Azure Data Factory, Azure SQL database, Logic Apps, APIs - Demonstrated ability to quickly learn, adopt and apply new technologies - Data profiling and creation of source to target mappings - Ability to provision and configure Azure data service resources Detailed Required Skills: - Python & SQL Scripting - SQL, PySpark - General Cloud Architecture competency skillset - Capable of taking requirements and building out data pipelines - API Knowledge is required, but preference given to candidates who can create APIs Preferred Experience/Skills/Certifications: - Microsoft Fabric - Microsoft Azure Cosmos DB, Data Flows, Express Route, Azure Active Directory - Experience creating strategies to migrate customers from on-premise environments to Azure - Power BI and semantic modeling - AWS Glue & Azure Data Factory - AWS S3 & Azure Blob - AWS Athena & Azure Databricks - AWS Redshift & Azure Synapse - AWS ECS & Azure AKS
• Design and structure the build of a data platform on AWS that meets the needs of internal stakeholders; • Identify the best solutions to optimize the architecture of our data platform; • Ensure data observability, quality, and reliability for our internal and external stakeholders; • Automate pipeline testing processes for onboarding new data sources, integrated with CI/CD; • Execute the data platform adoption plan together with the teams responsible for data governance; • Collaborate with data scientists and software engineers to enable an integrated data flow.




