Truelogic Software logo
Truelogic Software

Premium boutique software development company that helps brands with big ideas to make a difference in people’s lives.

Senior/Lead Data Engineer – AI-Native Aftermarket Platform

Data EngineerData EngineerFull TimeRemoteSeniorTeam 501-1,000Since 2004H1B No SponsorCompany SiteLinkedIn

Location

Dominican Republic

Posted

10 days ago

Salary

0

Seniority

Senior

Job Description

Senior/Lead Data Engineer – AI-Native Aftermarket Platform

Truelogic Software

• Design and build robust, idempotent data pipelines from scratch utilizing a modern data stack. • Design star and snowflake schemas, writing precise, grain-aware SQL to construct scalable data marts. • Write production-grade, unit-tested Python code at the module level, adhering to strong engineering disciplines such as type hinting and testing. • Build and test dbt models across staging, intermediate, and mart layers while managing overall project structure. • Author and deploy jobs using Databricks Asset Bundles (DAB) following documented architectural patterns. • Implement rigorous data quality checks at source, intermediate, and destination layers to prevent silent drops of nulls or duplicates. • Maintain data governance through comprehensive dbt tests and strict documentation-at-merge-time discipline. • Operate securely within a multi-repository architecture, utilizing service principals and ensuring zero personal credentials in production deployments. • Run cross-repository exposure checks prior to merging schema-breaking changes. • Own data pipelines end-to-end, making key technical design decisions and mentoring mid-level engineers through substantive code reviews. • Define overarching technical direction across core data systems, including modeling standards, branching strategies, observability thresholds, and secret management policies. • Act as a technical leader to unblock the team and actively participate in hiring panels to scale the engineering organization.

Job Requirements

  • Expertise in SQL and dimensional modeling methodologies, including medallion architecture, SCDs, and grain management.
  • Proven ability to design idempotent pipelines utilizing incremental, checkpoint, and replaceWhere strategies.
  • Extensive experience with production-grade Python engineering, including type hints, pytest, and ruff.
  • Strong capability to diagnose and resolve failing Spark / PySpark jobs utilizing tools like Spark UI.
  • Deep understanding of Delta Lake features such as MERGE, OPTIMIZE, Z-ORDER, and time travel.
  • Hands-on expertise with dbt, including models, tests, and exposures.
  • Experience authoring and deploying jobs using Databricks Asset Bundles (DAB) and operating within a Unity Catalog environment.
  • Commitment to data quality via pre-write asserts, schema checks, and maintaining dbt relationship and uniqueness tests.
  • Strong adherence to disciplined Git workflows, conventional commits, and strict documentation practices.
  • Experience provisioning and utilizing Service Principals, GitHub environment secrets, and secret management tools like Azure Key Vault or Databricks secret scopes.
  • Strong written technical communication skills for PR descriptions and runbooks, with the ability to translate pipeline work into business metrics.
  • Proven decision-making abilities to navigate ambiguity and balance trade-offs between cost, latency, and reliability.
  • Experience leading technical initiatives, establishing architectural standards, and contributing to interview rubrics is preferred.
  • Experience reading or modifying Azure Data Factory (ADF) pipelines and familiarity with Azure Data Lake storage is highly preferred.
  • Familiarity with dbt observability tools, such as Elementary, is a plus.
  • Awareness of PII detection and masking best practices is preferred.
  • Experience with multi-tenant configuration patterns to onboard new tenants with zero code changes is a strong plus.
  • Proficiency in reading and editing GitHub Actions workflows for Databricks deployment is preferred.
  • Ability to make cost-aware compute decisions, selecting the appropriate cluster shape per workload, is a plus.
  • Proficiency in AI-assisted development tools like Claude Code for daily work and code review is preferred.
  • Experience writing incident post-mortems and coordinating feature handovers with Data Science teams is a plus.

Benefits

  • 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.
  • Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.
  • Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.
  • Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.
  • Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

Wrisk

Wrisk provides digital insurance solutions, specializing in automotive solutions, to create personalized and accessible insurance options through innovative technology. Wrisk promo

Data Engineer10 days ago

Senior Data Engineer Remote Full time Edinburgh, Scotland, United Kingdom Description As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build impactful products. You’ll play a key role in designing and delivering scalable, production-ready analytical solutions that turn complex data into meaningful insights. You will own and improve the systems that ingest, transform, and serve large-scale transactional data sets. You will be responsible for designing resilient data pipelines, implementing robust data models, deploying real-time and batch processing systems, and introducing observability, testing and automation to keep our data trustworthy at scale. You will work closely with the data science and product teams to understand customer needs and the direction of internal strategy, producing measurable data engineering outcomes. We’re looking for someone who’s passionate about technology, curious about data infrastructure, and excited to solve real problems. You’ll need a strong foundation in data engineering, a creative mindset, and the ability to communicate clearly with both technical and non-technical stakeholders. You’ll be supported with training and development opportunities to deepen your expertise and stay ahead of industry trends. Responsibilities - Design, build, and operate data ingestion and ETL/ELT pipelines for our data systems that power Atto products and customer-facing applications. - Build and maintain our data platform architecture and infrastructure, including data pipelines, warehouses that power analytics and product features and reporting. - Implement data modelling, schema design, and data contracts to make datasets easy to consume. - Introduce and maintain observability, data quality checks, and automated testing for our production data flows. - Driving impact at scale by improving data workflows, service reliability, and making Atto’s capabilities faster, more reliable and widely accessible. - Collaborate with product managers and cross-functional teams to translate market signals and customers’ needs into innovative data-driven solutions. - Create new systems and approaches, while continuously improving and scaling existing ones for performance, reliability, and efficiency. - Conduct deep analysis of transactional datasets to validate data models, surface data quality issues, and propose engineering fixes. - Optimise performance and cost of data processing and storage across cloud services. - Communicate technical findings and recommendations clearly to both technical and non-technical stakeholders across the business. - Stay current with industry developments, emerging technologies, and best practices in data engineering. Requirements - A Bachelor's degree in Computer Science, Data/Software Engineering, or a related discipline. - 5+ years of hands-on experience in data engineering with a proven track record of delivering scalable, production-grade data platforms and data models. - Strong SQL skills and proven experience designing, building and optimising data pipelines and data warehouse schemas. - Strong proficiency in Python for production data engineering with a focus on building maintainable, testable and clean code. - Track record of implementing data quality, observability, monitoring and testing practices. - Solid experience with at least one cloud provider (Azure, AWS or GCP), and their managed data services. - Experience with CI/CD, infrastructure-as-code and working in containerised environments. - Familiarity with modern data stack tools: Databricks, Snowflake or RedShift, etc. - Experience working with reporting and modelling tools such as Power BI, including designing performant data models and supporting self-serve analytics. - Advanced experience in pattern recognition with the ability to translate complex data into actionable insights. - A results-oriented mindset, able to take concepts from ideation through to tangible outputs. - Comfortable working in a fast-paced, delivery-focused environment, balancing multiple priorities with agility. - A proactive and collaborative approach, with a willingness to iterate, share knowledge, and challenge assumptions constructively Bonus Points (We’re getting greedy) - Experience building or scaling data platforms in large-scale, regulated data environments. - Experience with DevOps for data, platform engineering, or building large data pipelines and real-time data streaming systems. - Exposure to working in a high-growth, evolving environment where the customer is at the heart of product and engineering decisions. . Benefits - A team of passionate, interesting people committed to your development and success - £70-£80k gross/pension - Personal training and Continuous Professional Development budget (CPD) - Uncapped bike to work scheme - Half-day Fridays every last week of the month to recharge - Wellness partnerships - In-person and virtual team events and workshops - Volunteering (Social Good Connect partnership) - 33 days holiday allowance to take when you want - £200 home working contribution to make sure you have everything you need to do your best work (get comfy - we want you to stay) - Ask us about our remote-first, flexible culture - this is core to who we are, and we're rated one of Scotland's most flexible employers Creating a more predictable future for lenders We are on a mission to enable our customers across the globe to effortlessly make use of real-time transaction data to better understand their customers, grow their business, revolutionise their offerings and delight with customer service. At Atto, you will be working for a business that is creating a more predictable future for lenders through our real-time transaction data platform. We use today's data to better predict tomorrow. This is an exciting stage in our growth, and we'd love you to be part of the story. Don’t speculate. Calculate.

MLN + 1 moreAll locations: MLN | United Kingdom
Imagemaker logo

Data Engineer – Semi Senior

Imagemaker

Let’s co-create awesome digital experiences!

Data Engineer10 days ago
Full TimeRemoteTeam 201-500Since 2003H1B No Sponsor

• Migrar y ordenar código suelto: Tomar las queries SQL y scripts informales creados por los equipos de análisis y traducirlos a modelos limpios, estructurados y automatizados dentro de Dataform. • Armar y automatizar los "Bundles": Empaquetar el código de los pipelines junto con sus configuraciones para que se desplieguen de forma automática a producción usando GitLab CI/CD y Terraform, eliminando los pasos manuales. • Validar los datos codo a codo con el negocio: Trabajar directamente con los usuarios que usan los datos para entender sus necesidades, resolver dudas y asegurar juntos que las nuevas tablas reflejen la lógica real del negocio. • Acelerar el desarrollo usando IA (Claude/GPT): Utilizar asistentes de Inteligencia Artificial mediante Prompt Engineering para optimizar queries lentas, documentar el código de forma rápida y generar pruebas de calidad automáticas. • Optimizar el rendimiento en BigQuery: Aplicar técnicas de particionado y clustering en las tablas para asegurar que las consultas de los usuarios sean rápidas, eficientes y no generen costos innecesarios en la nube.

Chile
In All Media logo

Data Engineer – Analytics, Modeling

In All Media

Imagine the future of business. Ideas for a Digital Renaissance.

Data Engineer10 days ago
ContractRemoteTeam 1,001-5,000H1B No Sponsor

• Provide critical technical execution and analytical leadership, acting as a driving force in translating raw data into robust, production-ready data models. • Ensure cross-functional teams have seamless access to un-compromised, highly performant, and real-time datasets. • Responsible for dismantling legacy data workflows, engineering scalable data pipelines, and establishing rigorous validation standards to guarantee data reliability and pipeline health.

Mexico
Full TimeRemoteTeam 501-1,000Since 2015H1B Sponsor

• Create and maintain complex, enterprise-scale data pipelines and foundational datasets while defining technical strategy and architectural direction for advertising products • Design and build sophisticated ETL processes, data models, and analytical frameworks using SQL, Python, and modern data stack technologies • Build and maintain the data infrastructure that powers Ads ML - feature pipelines, label generation workflows, and training data systems that enable our ranking and delivery models • Develop data quality frameworks, monitoring systems, automated anomaly detection, and alerting infrastructure that operates at massive scale • Collaborate with data scientists, ML engineers, and product teams to identify high-impact data infrastructure opportunities, owning design through implementation • Drive cross-functional technical initiatives solving sophisticated data engineering challenges • Build scalable rubrics that help lead and mentor engineers through projects that accelerate launch velocity and harden data systems • Navigate ambiguity and make sound technical decisions with incomplete information, balancing short-term delivery with long-term infrastructure investment

United States
$248K - $279K / year