In the age of AI, differentiation isn’t in what you build - it’s in the problems you choose to solve and the outcomes they unlock. That’s why we help leaders cut through the noise, focus on what matters most, and solve it right the first time. By fusing problem-first thinking, deep technical craftsmanship, and fast, flawless delivery, we de-risk transformation and deliver solutions that stick, scale, and prove their worth. With a deep bench of end-to-end technologists, architects, and engineers, no challenge is too complex and no solution is half-built. At Sparq, your mission is our mission. We’re modular by design - meeting you where you are and accelerating you toward where you’re meant to be. We don’t just guide - we climb with you. Embedded alongside your teams, we chart the course, build with precision, and navigate complexity until your outcomes are achieved. Built to solve, not just to build.
Principal Data Engineer
Location
United States
Posted
6 days ago
Salary
0
Seniority
Lead
Job Description
Principal Data Engineer
Sparq
Role Description Why you will enjoy Mondays again: - Opportunity to work alongside a talented, diverse team in a collaborative and creative environment - Ongoing investment in your growth through training, mentorship, and industry certifications - Hands-on exposure to cutting-edge technologies across multiple industries - Recognition programs and employee awards within an inclusive culture that celebrates great work, including our AI Innovators Program - Remote or hybrid work options - Competitive salary + bonus opportunities - Robust benefits package, matching 401(k) plan, and substantial PTO - Tuition reimbursement A Day in the Life: - Own data pipelines end to end—from ingestion and transformation through validation and delivery—while bridging modern cloud data architecture with legacy enterprise reporting systems still in active use. - Architect solutions for scale, including designing data models, partitioning and clustering strategies, and query optimization for datasets ranging from multiple terabytes to petabytes. - Apply advanced, hands-on Google Cloud Platform and BigQuery expertise to make architectural decisions related to partitioning, clustering, and cost and slot management. - Build and operate production pipelines from ingestion through final delivery, taking full ownership rather than contributing to only one part of a shared system. - Use advanced SQL to develop complex queries and optimize performance at scale. - Work extensively within legacy enterprise reporting environments using SQL Server, stored procedures, and SSRS. This is an active requirement, not simply a technology associated with a previous role. - Build data monitoring, reconciliation, and automated quality-assurance frameworks to support data validation and integrity. - Manage ETL/ELT processes and data integration at production scale. - Use intermediate-level Python for automation and data processing. - Apply strong database design principles across data solutions. - Work with data visualization tools such as Power BI, Looker, or comparable platforms; Tableau experience is transferable. - Approach work with strong analytical skills and attention to detail while independently managing responsibilities and delivering results. - Actively use AI tools, including Claude through our Anthropic partnership, to streamline tasks, improve the quality of your work, and share best practices with teammates while continuously identifying new ways to integrate AI into everyday workflows. Qualifications - Consultative approach and problem solving skills to successfully align digital solutions with long-term business goals of the client - Hands-on experience using AI tools to enhance daily work, or a strong desire to do so, including a willingness to experiment, learn, and champion AI adoption within your role - Commitment to understanding and exceeding client expectations - Ability to perform project oversight and execution of deliverables - Flexibility to adapt within a high-growth organization - Ability to lead, mentor and motivate those around them - Hunger for continuous learning and professional development - Intellectual curiosity to provide creative solutions - Full understanding of the software development life cycle - Ability to positively impact fellow colleagues through effective leadership, presentations, coaching, etc. - Desire to work in a team environment - Good interpersonal, written and verbal communication skills Equal Employment Opportunity Policy Sparq is proud to offer equal employment opportunity without regard to age, color, disability, gender, gender identity, genetic information, marital status, military status, national origin, race, religion, sexual orientation, veteran status, or any other legally protected characteristic. We are committed to providing equal employment opportunities and believe in an inclusive workplace. If you require reasonable accommodations to participate in the job application or interview process, please let us know by contacting recruiting@teamsparq.com . #LI-REMOTE
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Provide technical leadership to the Data Engineering team, promoting best practices and supporting team development; • Define and evolve the data platform architecture, ensuring scalability, performance, security, governance, and cost efficiency; • Design, review, and guide the implementation of data pipelines (ETL/ELT, batch and streaming), ensuring data quality, availability, and reliability; • Define development, architecture, data modeling, and system integration standards; • Develop and evolve solutions for ingesting and processing data from APIs, relational databases, legacy systems, and cloud services; • Evolve Data Lakes, Data Warehouses, and Data Marts to support Analytics, Artificial Intelligence, and business applications; • Implement observability, monitoring, and alerting strategies for pipelines, applications, and data infrastructure; • Ensure adoption of engineering best practices, including version control, automated testing, CI/CD, and Infrastructure as Code (IaC); • Conduct code reviews and design reviews, continuously raising the technical quality of deliverables; • Collaborate with Product, Software Engineering, and business teams to define and prioritize solutions; • Support strategic platform decisions, identifying opportunities for continuous improvement in architecture, performance, costs, and scalability.
Senior Data Engineer – Full Stack
ESL FACEIT Group - EFGWe create worlds beyond gameplay where players and fans become community.
• End-to-End Architecture & Delivery: Define, design, and implement complex data infrastructure, pipeline ingestion, and transformation layers spanning multiple business units (Esports, Festivals, Commerce, HR, Finance, and FACEIT); • Pipeline & Platform Engineering: Construct scalable architectures using well-architected framework principles (reliability, security, performance, and automation). Manage workflow orchestration, CI/CD pipelines, and infrastructure automation; • Data Modeling & Semantic Layers: Standardise enterprise-grade dimensional modeling (Kimball/Inmon), star schemas, and centralised semantic layers to define trusted, cross-pillar metrics; • AI-Ready Datasets: Create clean, optimised, AI-ready datasets with structured metadata, clear naming conventions, and explicit documentation to support downstream AI agents and cognitive models; • Technical Standards & Governance: Establish and enforce best practices for Python/SQL development, dbt optimisation, testing frameworks, and version control across the hybrid data domain; • Efficiency & Cost Optimisation: Proactively monitor and optimise performance and infrastructure platform costs across storage, compute, and querying layout (e.g., BigQuery configurations); • Stakeholder Partnership: Act as a strategic partner to business leaders and analysts, translating complex objectives into scalable self-service data products; • Incident Response & Data Integrity: Lead incident response efforts for both system downtime and data quality anomalies, implementing automated testing to ensure Industry Standard Data Integrity; • Mentorship & Growth: Mentor junior and mid-level engineers through rigorous code reviews and technical guidance, supporting their professional growth and advancing team standards.
Principal Telemetry Pipeline Specialist
DynatraceDynatrace is a global application performance management software firm and a former member of Compuware. As an employer, the company is in support of helping it
Your role at DynatraceAbout the Role: Dynatrace is seeking a high-impact Telemetry Pipeline Specialist to serve as the business and technical evangelist for the next generation of data-driven Observability. This is a specialist role focused on the intersection of Bindplane, OpenTelemetry (OTel), and Enterprise Data Governance. You will partner with our Global Sales and Customer Success teams to help organizations navigate the complexities of data explosion in hybrid and AI-native environments, ensuring they achieve high-signal observability while maintaining absolute control over their telemetry costs and routing. Domain Expertise & Solution Leadership - Act as a subject matter expert in log management and observability - Stay current with OpenTelemetry, cloud logging, and pipelines - Lead proof of concepts and demonstrate technical value Competitive Strategy & Value Selling - Execute competitive displacement strategies - Build ROI and economic value cases - Position Dynatrace effectively in enterprise environments Technical Solution Guidance - Advise on telemetry pipelines (OpenTelemetry, Fluentd, Logstash) - Support Kubernetes, serverless, and cloud ecosystems - Optimize data routing and analytics strategies Customer Adoption & Growth - Drive platform adoption and usage - Deliver best practices and technical workshops - Improve consumption and customer outcomes Collaboration & Pipeline Development - Build pipeline through channels, events, and outbound - Collaborate cross-functionally with sales, engineering, and marketing - Maintain CRM accuracy and forecasting discipline What will help you succeedQualifications & Requirements: - Experience: 5+ years in sales or presales roles, with at least 3 years focused on log management, telemetry pipelines, or data streaming environments Domain Expertise: - Deep understanding of telemetry routing and edge processing (Bindplane, Fluent Bit, or similar) - Familiarity with cloud-native ecosystems (AWS, Azure, GCP, Kubernetes) and event streaming platforms (Kafka, Kinesis, Pub/Sub) - Sales Execution: Experience supporting complex enterprise sales cycles and influencing both technical and executive stakeholders; Ability to articulate “Data Gravity” and - “Ingest Economics” and translate them into executive-level value (CIO/CFO) - Competitive Knowledge: Familiarity with observability and pipeline competitors such as Splunk, Datadog, Elastic, or Cribl - Enablement: Ability to scale impact through field enablement, play development, and technical evangelism - Education: Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience Preferred Skills - Experience with Cribl LogStream or Splunk Heavy Forwarders for displacement strategies. - Familiarity with FinOps principles (matching telemetry spend to business value). Why you will love being a Dynatracer - Dynatrace is a leader in unified observability and security. - We provide a culture of excellence with competitive compensation packages designed to recognize and reward performance. - Our employees work with the largest cloud providers, including AWS, Microsoft, and Google Cloud, and other leading partners worldwide to create strategic alliances. - You'll get to work at the forefront of innovation with Dynatrace Intelligence—the industry's first agentic operations system. Bringing together deterministic and agentic AI, it helps teams understand what's happening, why it matters, and what to do next— automatically. - Over 50% of the Fortune 100 companies are current customers of Dynatrace. Compensation and Rewards
Role Description Na ROIT, acreditamos que dados são um dos principais ativos para transformar negócios. Estamos construindo uma plataforma de dados moderna, escalável e preparada para suportar produtos analíticos, inteligência Artificial e soluções que impactam milhares de empresas. Buscamos um(a) Tech Lead | Data Platform para liderar tecnicamente essa evolução. Essa pessoa será responsável por: - Definir a arquitetura da plataforma; - Estabelecer padrões de engenharia; - Apoiar o crescimento técnico da equipe; - Garantir que nossas soluções sejam escaláveis, confiáveis, eficientes e preparadas para os desafios do futuro. Procuramos alguém com perfil hands-on, que goste de resolver problemas complexos, tomar decisões arquiteturais e construir produtos de dados de alta qualidade. Qualifications - Experiência sólida em Engenharia de Dados, atuando como Tech Lead ou referência técnica de equipes; - Domínio de Python para desenvolvimento de aplicações e pipelines de dados; - Experiência prática com Google Cloud Platform (GCP); - Conhecimento sólido em BigQuery, Cloud Storage, Pub/Sub, Cloud Run e Dataproc; - Experiência com arquitetura de Data Lake, Data Warehouse e Data Marts; - Conhecimento avançado em bancos de dados SQL e NoSQL; - Experiência com arquiteturas distribuídas, microsserviços e arquiteturas orientadas a eventos; - Vivência com CI/CD, Git e Infraestrutura como Código (Terraform ou similar); - Experiência com monitoramento, observabilidade e troubleshooting de pipelines de dados; - Capacidade de conduzir discussões técnicas, definir padrões de engenharia e apoiar a evolução técnica da equipe. Requirements - Experiência com Apache Spark (PySpark); - Experiência com Apache Airflow ou orquestradores de workflows; - Vivência com processamento de dados em tempo real (streaming); - Experiência em ambientes de alta volumetria de dados; - Conhecimento em arquiteturas Lakehouse; - Experiência com plataformas de Inteligência Artificial e Machine Learning; - Vivência com otimização de custos em ambientes cloud (FinOps). Benefits - Python - Google Cloud Platform (GCP) - BigQuery - Dataproc (PySpark) - Cloud Run - Pub/Sub - Cloud Storage - GitHub / Bitbucket - Arquiteturas orientadas a eventos
