Aubrant Digital logo
Aubrant Digital

Creating Digital Businesses

Senior Data Engineer

Data EngineerData EngineerContractRemoteSeniorTeam 51-200Since 2013H1B No SponsorCompany SiteLinkedIn

Location

Latin America (LATAM)

Posted

22 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer

Aubrant Digital

Role Description As a Senior Data Engineer, you will design, build, and tune the data layer that powers our clients' mission-critical applications on Azure and SQL Server. You will own complex query performance, indexing strategy, and concurrency design, and you will architect the data access patterns that connect application code to the database through linq2db, LINQ-to-SQL, Entity Framework, and ADO.NET. You will partner with application engineers, architects, and product teams to deliver high-throughput, low-latency data solutions, and you will mentor others on database design, query optimization, and modern data engineering practices. Qualifications - A database craftsperson who treats query performance, indexing, and concurrency as first-class engineering concerns rather than afterthoughts. - A clear communicator who can explain execution plans, locking behavior, and data access trade-offs to engineers, architects, and product stakeholders. - Comfortable operating with ambiguity, capable of profiling production workloads and proposing concrete solutions backed by evidence. - A mentor who raises the bar for the team through code review, query review, and pattern guidance. - Customer-obsessed and outcome-focused, balancing delivery speed with the long-term health and scalability of the data platform. Requirements - Bachelor's Degree in Computer Science or a related discipline, or equivalent experience; MUST be proficient in written and spoken English (85%). - 5 to 8 years of professional data engineering or back-end engineering experience with a strong database focus. - Expert-level proficiency in SQL on SQL Server 2019+, including complex queries, window functions, set-based operations, query plan analysis, indexing strategy, statistics, RCSI, isolation levels, and Change Data Capture. - Expert-level proficiency in database performance tuning, including bottleneck identification, index design, query rewrites, and concurrency design under production load. - Strong proficiency in C# data access using linq2db, LINQ-to-SQL (DBML), Entity Framework, and ADO.NET; ability to choose the appropriate tool for each scenario and avoid ORM performance pitfalls. - Strong proficiency in Python for data engineering tasks, scripting, and automation. - Hands-on experience with Azure data services (Azure SQL, storage, networking, security) and deploying production data workloads in Azure. - Experience with database CI/CD, schema versioning, and migration tooling. - Solid Git, code review discipline, and familiarity with modern engineering practices including testing and observability. - Experience with Azure Data Factory, Synapse, or other Azure analytics services is a plus. - Experience designing event-driven or streaming data architectures is a plus. - Excellent analytical and problem-solving skills; strong communication, collaboration, customer orientation, innovation mindset, and adaptability under ambiguity. Responsibilities - Design and maintain SQL Server 2019+ schemas, indexes, and query patterns that meet performance, scalability, and concurrency requirements. - Analyze execution plans, identify bottlenecks, and tune queries, indexes, and statistics; advise on RCSI and isolation level choices. - Design and operate Change Data Capture (CDC) pipelines and other change-tracking patterns to support downstream consumers. - Implement and review data access using linq2db, LINQ-to-SQL (DBML), Entity Framework, and ADO.NET; choose the right tool for each scenario. - Translate business and application requirements into efficient SQL and C# data access code that is performant, testable, and maintainable. - Partner with application engineers to align ORM usage with database performance characteristics and avoid common anti-patterns. - Design and operate data solutions on Azure, including Azure SQL, storage, networking, and security configurations. - Contribute to CI/CD for database changes through migration scripts, schema versioning, and automated deployments. - Mentor engineers on database design, query optimization, and data access patterns; set standards for the team.

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description We're Hiring: Senior AWS Redshift Data Engineer We are looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that power our data-driven decisions. You'll architect and maintain high-performance data pipelines and databases across platforms like MSSQL, Redshift, and Snowflake, ensuring data is reliable, accessible, and optimized for scale. If you thrive on solving complex problems, love optimizing systems for performance, and want to be the go-to expert in a collaborative, high-impact environment, we'd love to meet you. What You Will Do: - Design and maintain scalable, efficient, and well-partitioned schemas in MSSQL, Redshift, and Snowflake - Architect and optimize complex queries, stored procedures, indexing strategies, and partitioning for large datasets - Build, monitor, and maintain data pipelines that ensure timely and accurate delivery of data to internal and external consumers - Own and enforce data refresh SLAs, ensuring availability, consistency, and reliability across production and reporting environments - Collaborate with software engineers, analysts, and DevOps teams to ensure data models and queries align with product and reporting requirements - Proactively identify and remediate performance bottlenecks, slow queries, and data inconsistencies - Implement and manage database change workflows using schema migration/versioning tools - Define and promote best practices for data access, security, compliance, and observability Qualifications - 7+ years of experience in database engineering or backend systems development - Deep expertise with MySQL, Amazon Redshift, and Snowflake, including schema design and performance optimization - Design, build, and maintain scalable data pipelines and ETL processes tailored to client needs - Proven track record maintaining data freshness SLAs and data quality across production pipelines - Hands-on experience with T-SQL, LinkSQL, query optimization, and indexing strategies - Experience with query optimization, mapping tables to blocks and partitions, sub-table structure and keying/indexing for efficiency - Experience of relational data modeling and schema versioning in support of software development - Experience as the sole or lead database expert on a development team - Familiarity with source control systems (e.g., Git/Bitbucket) and CI/CD integration - Strong problem solving skills are desirable - Transforming product requirements into workable solutions, in collaboration with several development and testing teams - Writing robust functions, procedures and scripts using SQL - Being heavily involved in the day to day running of the business dealing with support and performance issues - Diagnose and troubleshoot data-related issues, providing quick and effective resolutions - Analyze data workflows and identify areas for improvement, recommending and implementing solutions to optimize performance - Utilize a proactive approach to foresee potential problems and address them before they impact operations Benefits - Work with a fast-growing global data engineering team - Opportunity to learn and grow in advanced cloud and analytics technologies - Competitive salary and performance-based incentives - A collaborative and innovation-driven work environment Interview Process - L1 Technical Discussion: Virtual Discussion Via Gmeet or Teams - L2 Technical Discussion: In-Person (Face-to-Face) at the Chennai/Madurai location - Client Interview: Virtual - HR Discussion: Virtual / In-Person - Onboarding: Mandatory visit to the Chennai/Madurai branch

India
Full TimeRemoteTeam 201-500H1B No Sponsor

• Lead the Data Engineering team both functionally and disciplinarily • Build, design and further develop modern data platforms and data lakehouse architectures (e.g., based on Databricks) • Provide strategic advice to our clients on the introduction and scaling of data-driven platforms across various industries • Develop and optimize ETL/ELT pipelines for processing large volumes of data in both batch and streaming scenarios • Ensure quality, best practices and technical excellence within the team — from code reviews and architectural decisions to standards for DataOps and CI/CD • Actively shape the unit strategy and portfolio and support go-to-market and pre-sales activities

Germany
Job Closed

Provider Data Processor

NTT DATA Services

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers, and application services. Our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

Data Engineer22 days ago

Role Description Analyzing and processing provider transactions in accordance with plan provisions. - Should follow the policy and procedure which is defined by the customer. - Secure the PHI information. - Established working knowledge and application of specialized technical skills. - Understands how work impacts results for their area. - Demonstrates knowledge of internal operations and develops relationships to facilitate workflow. - Knowledge of related regulations and standards. - Strong understanding of current processes and procedures and may identify opportunities for improvement. - Completes a wide range of tasks and assignments. - Projects and assignments are typically non-routine and variable in nature. - Resolves more complex situations by applying demonstrated knowledge and skills generally acquired through job experience. Company Description

United States
Lean Solutions Group logo

Senior Data Engineer

Lean Solutions Group

Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.

Data Engineer22 days ago
Full TimeRemoteTeam 501-1,000

Role Description We are seeking a highly skilled engineer to play a pivotal role in both maintaining our current data infrastructure and spearheading its evolution. This position requires mastery of custom Python development, particularly with Object-Oriented principles, and expert-level SQL skills to manage and troubleshoot our bespoke ETL frameworks and data warehouse. The successful candidate will be responsible for ensuring the stability and reliability of our existing systems by diagnosing and resolving complex issues within a custom codebase. Concurrently, you will be a key technical contributor in our strategic migration to a modern, cloud-based data stack, with platforms like Snowflake and Databricks under evaluation. This role demands a high degree of autonomy and a proactive problem-solving mindset, with the ability to navigate unfamiliar or undocumented code to perform root cause analysis and implement effective solutions. As a senior member of our global team, you will work collaboratively to execute the technical roadmap for our 2026 modernization strategy, contributing to a significant technological transformation while upholding high engineering standards. Qualifications - 3–5 years of recent, hands-on experience in a Data Engineering role. - Backend Development background and previous experience. - Advanced proficiency in Python, with a deep understanding of Object-Oriented Programming and Fundamentals for building and maintaining custom ETL frameworks. - Expert-level SQL skills, including the ability to write, optimize, and troubleshoot complex queries, Stored Procedures, and Functions. - Proven ability to design, build, and maintain robust, scalable custom ETL/ELT pipelines. - Practical experience with Git-based development workflows and working within CI/CD pipelines for continuous integration and deployment. - Basic familiarity with AWS services such as EventBridge and Batch, along with experience running jobs within a Spark environment. - Demonstrated ability to autonomously deconstruct, troubleshoot, and resolve issues within complex and unfamiliar codebases. - Candidate must be comfortable with a role focused 70% on maintenance and troubleshooting of legacy systems and 30% on modernization strategy. - Proven ability to navigate, deconstruct, and implement fixes in undocumented or poorly documented custom codebases. - Experience mentoring other engineers through code reviews, technical guidance, and the promotion of engineering best practices. Requirements - Familiarity with modern data platforms such as Snowflake or Databricks. - Experience with, or a desire to learn, data orchestration and transformation tools like Airflow and dbt. - Previous experience working with legacy systems such as DB2, Denodo, or other data virtualization technologies. - General familiarity with Infrastructure as Code (IaC) principles and tools, for example, Terraform or CloudFormation. Soft Skills - Proactive Problem-Solving: Demonstrating the ability to independently analyze complex, unfamiliar, or poorly documented systems, perform root cause analysis, and implement effective solutions to ensure data pipeline reliability. - Autonomy and Ownership: Taking full ownership of technical tickets and project deliverables, working with a high degree of independence to navigate legacy codebases and drive tasks to completion in alignment with the team's modernization roadmap. - Collaborative Mentorship: Actively engaging with a global team of engineers, providing technical guidance, participating in comprehensive code reviews, and promoting engineering best practices to elevate the team's collective skill set. - Adaptability: Maintaining a positive and forward-looking mindset toward learning new technologies and methodologies, embracing the transition from legacy systems to a modern, cloud-based data stack. - Responsible AI Usage: Understanding how to leverage AI tools as a powerful supplement to enhance engineering knowledge and productivity, rather than as a replacement for fundamental problem-solving skills. Benefits - Join a powerful tech workforce and help us change the world through technology. - Professional development opportunities with international customers. - Collaborative work environment. - Career path and mentorship programs that will lead to new levels.

Latin America (LATAM)
Job Closed