GCP Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

Canada

Posted

6 days ago

Salary

0

Seniority

Senior

Job Description

GCP Data Engineer

TELUS Digital

• Utilize DevOps principles to evaluate current and new solutions • Discover, evaluate, and provide Data engineering support to EMR platforms • Directly impact ongoing pursuit to enhance infrastructure and data initiatives to provide real time health alerts • Help frontline and support teams quickly identify problems • Contribute to reduce mean time to repair and provide after action reports which will enhance understanding of the health status of services.

Job Requirements

  • Willingness to learn and become an expert in new technologies
  • Leading, inspiring and supporting team members to drive high performance and team engagement
  • Collaborating and fostering strong working relationships with internal and external stakeholders
  • Providing support to our internal customers through the design and implementation of solutions.
  • Working closely with the ours and other teams to ensure requirements are understood and delivered
  • Helping develop and drive automation opportunities, both on various databases and AWS side
  • Continuously improving processes and a relentless pursuit of reliability and efficiency
  • Identify & enhance operational support tools & network monitoring solutions
  • Experience with DB technologies like Oracle, MySQL, MSSQL, MongoDB
  • Streaming Architectures: Strong expertise in Apache Flink, and Apache Kafka for real-time data processing.
  • Data Processing and management: Solid foundation in any single node Python framework.
  • PySpark
  • Experience in SQL, Stored Procedures, Data Modelling
  • Experience with cloud infrastructure (any one of GCP and/or AWS with preference to GCP)
  • Some experience with Terraform coding
  • Modern Big-Data storage technologies (Iceberg - Preferred, Hudi, Delta)
  • Good experience with GCP services, specifically DB related, like BigQuery, Cloud Storage, Cloud Dataflow, and Dataproc
  • Expertise with Data Analytics
  • Strong sense of business ownership and customer focus
  • Advanced oral and written English language and communication skills.

Benefits

  • No benefits or perks listed.

Related Categories

Related Job Pages

More Data Engineer Jobs

Sirius XM Radio logo

Senior Staff Data Engineer

Sirius XM Radio

One of Forbes magazine's "World's Most Innovative Companies," SiriusXM is one of the world's largest audio entertainment and subscription media companies. Found

Data Engineer6 days ago

Role Description As a Senior Staff Data Engineer, you will join a highly performing team of engineers who build, own, and maintain backend services, data products, and reporting applications. You will design, collaborate, and execute building the AdsWizz data products and reporting systems at scale while automating and providing insights into the data onboarding with the SXM Media and AdsWizz services. - Design and build high-performance, reliable, and scalable reporting APIs and data pipelines. - Lead high-level architecture discussions and planning sessions work with ad measurement, revenue, and addressability data. - Work with various teams of engineers building software in a collaborative development process. - Collaborate with the Product team to clarify the scope of the projects by giving thoughtful feedback which challenges and clarifies requirements intent. - Execute tasks with utmost clarity and precision, demonstrating a strong sense of ownership and providing clear direction to drive projects forward effectively. - Collaborate with the Global Operations and Cloud Infrastructure teams to ensure flawless production deployments and support the Incident Management team. - Responsible for mentoring and guiding junior engineers. Qualifications - 12+ years of software engineering experience in Python or Java programming language (preferably JDK17 or higher). - 7+ years designing, building, and managing data pipelines using Spark, BigQuery, AWS EMR, and GCP Cloud Analytics. - 7+ years of experience crafting REST API based-microservices and scalable products, utilizing diverse cloud platforms (ideally AWS). - Cloud data warehouse & analytics platforms (Snowflake, BigQuery). - Observability tools like Prometheus, Grafana, ELK stack. - Data pipeline expectations framework experience (like Monte Carlo data, Great Expectations, Soda). - Working with containers (Docker, Kubernetes). - Messaging platforms and stream data processing (like Kafka, Flink, Pub/Sub). - Collaboration tools like Miro (or Lucidchart), Jira and Confluence. - Strong understanding of engineering software processes, lifecycle methodology, configuration management, release management, and system verification and testing. - Ability to work independently and oversee entire projects or significant parts, focusing on research and completing the tasks on time. - Strong analytical and problem-solving skills, with meticulous attention to detail and a dedication to continuous improvement. - Nice to have expertise in Caching implementations (like Redis, Memcached, etc.). - Nice to have expertise in Designing and maintaining Public APIs and data contracts. - Nice to have Security basics (e.g., OAuth2 standard). - Nice to have Foundational Amazon Cloud Services, like S3, CloudTrail, SQS, SNS, Lambda, API Gateway, ElasticCache, Athena, Kinesis, EKS, Cognito, and others. - Nice to have NoSQL databases knowledge (Druid, DynamoDB, SingleStore, or others). - Nice to have hands-on experience with AI coding assistants and tools to help with coding and data analytics. - Bachelor’s Degree in Computer Science/Mathematics or a similar field. - Must have legal right to work in the U.S. Requirements - At SiriusXM, we carefully consider a wide range of factors when determining compensation, including your background and experience. These considerations can cause your compensation to vary. - We expect the base salary for this position to be in the range of $126,700 to $215,000 and will depend on your skills, qualifications, and experience. - This role might be eligible for discretionary short-term and long-term incentives. Benefits - Our goal at SiriusXM is to provide and maintain a work environment that fosters mutual respect, professionalism, and cooperation. - SiriusXM is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, creed, color, religion, national origin, ancestry, alienage or citizenship status, age, disability or handicap, sex, gender identity, marital status, familial status, veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws. - The requirements and duties described above may be modified or waived by the Company in its sole discretion without notice.

United States
$126.7K - $215K / year
Job Closed
Beacon Biosignals logo

Senior Data Engineer

Beacon Biosignals

Our mission is to improve human health by enabling rapid, targeted interventions through advanced brain analytics.

Data Engineer6 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Lead the design and integration of new services and components for data and event processing • Contribute to scaling the Datastore’s core infrastructure • Collaborate with platform and application teams to implement APIs that unlock new workflows in Beacon’s expanding portfolio of clinical studies and digital health products • Partner with product managers, internal stakeholders, and other development and support teams to design new integrations, services, and solutions for scaling Beacon's data platform • Implement features with attention to detail, demonstrating product awareness and high standards for data integrity, design soundness, and maintainability across the lifespan of the system • Draft RFCs to lead complex feature discovery and technical design phases, soliciting and incorporating input, and helping your team align on a set of decisions to guide development • Leverage feedback from internal stakeholders and external partners to improve operational robustness and ease of use of the Datastore and its services via new documentation, tools, and dashboards.

United States
$150K - $170K / year
Beacon Biosignals logo

Senior Software Engineer, Data

Beacon Biosignals

Our mission is to improve human health by enabling rapid, targeted interventions through advanced brain analytics.

Data Engineer6 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Lead the design and integration of new services and components for data and event processing • Contribute to scaling the Datastore’s core infrastructure • Collaborate with platform and application teams to implement APIs that unlock new workflows in Beacon’s expanding portfolio of clinical studies and digital health products

New York
$150K - $170K / year
InnoData logo

Data Engineer

InnoData

Soluzioni tecnologiche

Data Engineer6 days ago
Full TimeRemoteTeam 2-10Since 2019

• Design and implement data-driven solutions on GCP including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Looker/BI. • Build ETL scripts using SQL and Python to extract, clean, and transform structured and unstructured data from ERP, procurement, logistics, and facility management systems. • Develop and optimize data pipelines for ingestion, transformation, and loading into enterprise data lakes and warehouses. • Build and extend end-to-end data and BI solutions, spanning extraction, storage, transformation, and visualization layers. • Partner with supply chain, real estate, and AI/ML teams to provide pipelines for AI solutions (e.g., RAG ingestion, Copilot integration, multi-agent workflows). • Ensure data governance, lineage, and compliance across supply chain datasets. • Continuously optimize query performance, ETL processes, and pipeline reliability.

Canada