Digital Customer Experience. Trust & Safety. AI Services.
Senior Data Engineer
Location
Worldwide
Posted
4 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
TaskUs
Role Description As a Senior Data Engineer, you are the engine room of our data strategy. You don't just "move data"; you build resilient, self-healing systems that transform raw data into high-fidelity data products. You will take the Architect’s blueprints and turn them into production-grade code, ensuring there is clean and reliable data. Work Mode: Remote What the Senior Data Engineer will own: - Pipeline Engineering: Build and maintain high-throughput ETL/ELT pipelines that ingest data from various sources into our Lakehouse. - Code Quality & Tooling: Drive the adoption of dbt for transformation and PySpark for heavy lifting. Responsible for writing modular, reusable code that follows strict CI/CD practices. - Observability & Reliability: Implement "Data SLAs." Build monitoring and alerting systems that notify the team of data drift or pipeline failures before the business notices. - Data Productization: Work closely with the BI team and Data Scientists to prepare "feature-ready" datasets. - Performance Tuning: Deep-dive into SQL and Spark query plans to optimize slow-running jobs, reducing cost and latency. - Local Development Advocacy: Implement a workflow where engineers can develop and test complex SQL transformations locally using DuckDB, drastically reducing "waiting-for-cluster" time and lowering development costs. - Cost-Efficient Micro-Pipelines: Build specialized pipelines for specific client reporting or data-quality checks that run on single-node containers (e.g., Lambda or small ECS tasks) using DuckDB, avoiding the minimum billing cycles of larger warehouses. - Embedded Analytics: Explore ways to use DuckDB as an embedded engine for internal tools or "edge" processing within the BPO’s local site offices where bandwidth to the cloud might be a constraint. Qualifications - 5+ Years in Data Engineering: You’ve lived through the "on-call" life and know how to build systems that don't break at 3 AM. - The Power Trio: Expert-level proficiency in Python, SQL, and PySpark. - Modern Lakehouse Stack: Hands-on experience with Databricks (Delta Lake) or Snowflake. You understand the nuances of the Medallion Architecture (Bronze/Silver/Gold). - Transformation & Modeling: Advanced experience with dbt (Data Build Tool). You treat data models like software, including version control, testing, and documentation. - Orchestration: Experience with Apache Airflow or Prefect, specifically building complex, idempotent DAGs. - Streaming Experience: Familiarity with Kafka, Kinesis, or Spark Streaming is a huge plus—our BPO operations move in real-time. - Infrastructure as Code (IaC): Comfort with Terraform or CloudFormation to manage your own data infrastructure. - In-Process Analytics (DuckDB): Proven experience using DuckDB for high-speed local development, unit testing data transformations, or as a query engine for "small-to-medium" datasets (up to 100GB) without the overhead of a distributed cluster. - Hybrid Execution Patterns: Ability to identify when to use heavyweight compute (PySpark/Databricks) versus lightweight compute (DuckDB/Python) to minimize cloud costs and reduce job latency. - Parquet/Iceberg Interaction: Experience using DuckDB to directly query data stored in S3/Azure Blob (via Parquet or Iceberg files) for rapid ad-hoc analysis or local dashboarding. - Orchestration: Kubernetes (K8s) with a deep understanding of Pods, Deployments, Services, ConfigMaps, and Secrets management. How We Partner To Protect You TaskUs will neither solicit money from you during your application process nor require any form of payment in order to proceed with your application. Kindly ensure that you are always in communication with only authorized recruiters of TaskUs. DEI In TaskUs we believe that innovation and higher performance are brought by people from all walks of life. We welcome applicants of different backgrounds, demographics, and circumstances. Inclusive and equitable practices are our responsibility as a business. TaskUs is committed to providing equal access to opportunities. If you need reasonable accommodations in any part of the hiring process, please let us know. Benefits - Competitive industry salaries. - Comprehensive benefits packages. - Commitment to a People First culture. - Inclusive environment and positive impact on the community. - Encouragement of internal mobility and professional growth. Company Description TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming media, food delivery, ride-sharing, HiTech, FinTech, and HealthTech. The People First culture at TaskUs has enabled the company to expand its workforce to approximately 45,000 employees globally. Presently, we have a presence in twenty-three locations across twelve countries, which include the Philippines, India, and the United States. Join our team today and experience firsthand our dedication to supporting People First.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
ReplyReply designs and implements innovative solutions in the areas: Digital Services, Technology and Consulting.
Role Description Atuação remota!! - Construir e gerenciar pipelines confiáveis de dados envolvendo ingestão/coleta, processamento, integração, armazenamento e disponibilização de dados na organização. - Atuar em uma arquitetura de sistemas distribuídos para o processamento de dados massivos em paralelo (MPP), combinando diversas fontes de dados heterogêneas e colaborando com equipes de análise e ciência de dados na construção de soluções e geração de valor baseadas em dados. Qualifications - Experiência prática com ingestão, integração, processamento e armazenamento de grandes volumes de dados. - Atuação em projetos de Big Data. - Behavior Driven Development (BDD). - Extração de dados em Python e processamento de dados com PySpark. - Experiências em ferramentas ETL's. - Conhecimento em modelagem de dados relacionais e dimensionais (Data WareHouse). - Experiência com bancos de dados SQL. - Experiência com conjunto de ferramentas relacionadas a Big Data na AWS como: EMR, Kinesis, RedShift, S3, Glue, ElasticSearch. - Conhecimento em Kafka. - Conhecimento com Data Lake e Data Ops. Requirements - Certificações AWS (desejável/diferencial). - Conhecimento em ferramentas de provisionamento de infraestrutura em cloud via código tais como: Terraform, CloudFormation (desejável/diferencial). Benefits - Cartão flexível Swile pra você usar como quiser (VA e VR). - Totalpass ou Gympass. - Apoio à Saúde Mental – Psicologia Viva. - Plano de Saúde Bradesco. - Plano Odontológico Bradesco. - Participação nos Lucros. - Auxílio-Creche para nossas mamães. - Incentivo a certificações. - Palestras e Webinars especiais. - Programa RAF de bonificação por indicações. - Seguro de Vida. - Subsídio para Inglês ou Italiano. - Desconto Open English. - Presente de aniversário. - Possibilidade de mudança do país. - Parcerias com Universidades.
Online Data Entry Specialist
Globe Life AOWork for a Fortune 500 company that rewards performance, invests in your growth, and provides a launchpad for a high-earning remote sales career. This isn’t just a job — it’s your path to leadership, income, and long-term success.
Role Description We are actively hiring and scheduling interviews this week for a fully remote Work From Home position. Immediate hiring – secure your spot and get hired. Entry level position for the applicants and full training provided. This is a legitimate opportunity with full training provided and guidance to obtain your Life & Health Insurance license. No prior experience required. We are looking for motivated U.S. residents ready to grow in a long-term remote career. - Communicate professionally with clients - Provide information and guidance - Follow a structured system - Maintain consistent performance Qualifications - Strong communication skills - Reliable internet connection - Self-motivated and coachable - Must be a U.S. resident - Willingness to obtain a Life & Health Insurance license (assistance provided) Benefits - 100% Remote - Full training program - Licensing guidance and support - Advancement opportunities - Supportive leadership team Company Description
Role Description Oxford's client, a global leader in the biopharma industry, is seeking a Data Engineer to support a growing workload within their innovation team. This role will be instrumental in building and maintaining scalable data pipelines, delivering high-quality, production-ready datasets to cross-functional teams including IT and AI. - Design, build, and maintain robust data pipelines within a Snowflake environment - Transform raw global data (including datasets from China and other international regions) into clean, structured, and production-ready outputs - Deliver polished datasets to downstream teams including IT and AI/ML teams - Collaborate closely with AI teams to support data-driven models and workflow automation initiatives - Utilize Databricks to support data processing, analytics, and pipeline orchestration - Structure and optimize data models to ensure usability, scalability, and performance - Partner with IT teams involved in data mining and analytics to ensure seamless data access and usability - Help reduce backlog by supporting and scaling existing data engineering efforts - Ensure data processes align with industry compliance standards and business requirements Qualifications - Exposure to AI/ML workflows, including automation and data pipeline integration - Experience in the biopharma, life sciences, or regulated industries - Proven experience as a Data Engineer in a complex, data-driven environment - Strong hands-on experience with Snowflake - Experience building and maintaining end-to-end data pipelines - Proficiency with Databricks and modern data engineering tools - Solid understanding of data modeling and structuring techniques - Experience working with both structured and semi-structured data - Ability to work independently as a self-starter in a fast-paced environment - Experience working with global datasets and distributed teams Preferred Qualifications - Familiarity with data compliance, governance, and regulatory requirements - Experience supporting or collaborating with AI/ML teams
Role Description Our client is looking for an AI / Data Engineer to design and deliver data platforms, pipelines and AI-enabled solutions for our clients. This is a hands-on consulting and delivery role for someone who can take ownership of ambiguous client problems, shape a practical technical approach, and deliver robust solutions across data engineering, data architecture and AI innovation. You will work with the company’s colleagues, client stakeholders and external technical teams to acquire, structure, transform and expose data through analytics, applications, APIs and AI-enabled experiences. Duties & Responsibilities - Own the delivery of client data and AI engineering work from discovery through design, implementation, testing and deployment. - Work with client stakeholders to understand business problems, clarify requirements and translate them into practical technical solutions. - Design and build data ingestion pipelines from APIs, third-party systems, files, online sources and operational platforms. - Develop scalable warehouse and transformation layers that convert raw data into trusted, reusable client data products. - Apply sound data architecture, modelling, quality, lineage and governance practices. - Identify and implement opportunities to use AI, automation, retrieval and agent-based workflows within client solutions. - Build or support APIs, data access layers and application integrations that make data products usable by reporting tools, software applications and AI experiences. - Contribute reusable technical patterns, documentation and engineering standards across the company. Qualifications - Ownership and Client Problem-Solving: You take ownership of outcomes rather than waiting for fully defined requirements. You are comfortable working through ambiguity, asking the right questions, identifying gaps and helping clients move from a business problem to a practical solution. - AI-First Mindset: You are interested in how AI can improve data collection, enrichment, research, automation, retrieval and decision support. You do not need to be an AI researcher, but you should be comfortable evaluating where LLMs, agents and AI-enabled workflows can create practical value. - Data Engineering and Warehousing Capability: You have strong hands-on experience designing and delivering modern data pipelines and warehouse solutions. You understand ingestion patterns, orchestration, data modelling, transformation layers, quality controls, observability, lineage, performance and security. - Collaborative Delivery Mindset: You work well in a consulting environment, communicate clearly with technical and non-technical stakeholders, and are comfortable sharing ideas, challenging assumptions and working closely with client and internal delivery teams. Requirements - Approximately five to ten years of relevant experience in data engineering, analytics engineering, data platform delivery or related technical consulting roles. - Practical experience with several of the following: - Modern cloud data warehouses such as Snowflake, BigQuery, Redshift, Databricks or Synapse. - SQL, data modelling and transformation frameworks such as dbt. - Cloud platforms, particularly AWS, Azure or GCP. - API integration, external data ingestion and pipeline orchestration. - Data quality, monitoring, observability and governance practices. - Software engineering practices including Git, automated testing and CI/CD. - Building data products for analytics, reporting, APIs or software applications. - Experience with AI orchestration frameworks, LLM tool calling, retrieval workflows, vector search, agent-based systems or related AI technologies. Success in This Role Success will mean delivering reliable, scalable and commercially useful data and AI solutions for the clients. You will combine sound engineering discipline with strong client problem-solving: understanding the real need, designing the right solution, delivering it effectively and helping clients derive measurable value from their data. Kindly regard your application as unsuccessful if you have not heard from the agency within 2 weeks.

