3Pillar Global logo
3Pillar Global

Building digital businesses, together.

Senior Data Engineer, Snowflake

Data EngineerData EngineerContractRemoteSeniorTeam 1,001-5,000H1B SponsorCompany SiteLinkedIn

Location

India

Posted

46 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer, Snowflake

3Pillar Global

• Steering projects that redefine urban living and drive innovation in healthcare. • Lead a team actively shaping the tech landscape for clients, setting global standards.

Job Requirements

  • Experience: 5-10 years of experience in data engineering.
  • Strong exp in Snowflake.
  • Programming & Scripting: Strong programming skills in Python and Linux Bash for automation and data workflows.
  • Framework Proficiency: Hands-on experience with Luigi for orchestrating complex data workflows.
  • Data Processing & Storage: Expertise in Hadoop ecosystem tools and managing SQL databases for data storage and query optimization.
  • AWS Cloud Services: In-depth knowledge of AWS EC2, S3, RDS, and EMR to deploy and manage data solutions.
  • Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
  • Communication & Leadership: Proven ability to lead projects, communicate with stakeholders, and guide junior team members.
  • Data Architecture: Experience designing or optimizing data lake solutions.
  • Security Practices: Understanding of data security practices, data governance, and compliance for secure data processing.
  • Automation & CI/CD: Familiarity with CI/CD tools to support automation of deployment and testing.
  • Big Data Technologies: Knowledge of big data processing tools like Spark, Hive, or related AWS services.
  • Advanced Analytics: Background in analytics or data science to contribute to more data-driven decision-making.
  • Cross-Functional Collaboration: Experience collaborating with non-technical teams on business goals and technical solutions.

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

MLabs LTD

Founded in 2018, MLabs is a private software engineering consultancy specializing in Haskell and Rust development with a focus on blockchain, artificial intelli

Data Engineer46 days ago

Location: Remote - Europe Remote | Full-time Compensation: $110K - $125K We are hiring on behalf of our client who is a premier infrastructure provider within the decentralized web (Web3) ecosystem, serving as the critical connectivity layer for tens of thousands of applications and millions of users globally. Having established a dominant market position, the organization is now expanding its horizons by launching a sophisticated payments solution. This new initiative enables merchants and payment providers to utilize blockchain rails for stablecoin checkouts, payouts, and deposits, already reaching millions of terminals worldwide through strategic global partnerships. The data systems supporting this infrastructure are foundational to the company's success. As the organization transitions from MVP pipelines to a scalable production architecture, there is a need for a Senior Data Engineer to join the team. This individual will help design and operate the data foundation behind a global payments network, ensuring that systems tracking wallet connections, transaction health, and financial reconciliations are as reliable as the payment flows themselves. This role sits at the intersection of data engineering and backend systems. The successful candidate will build event-driven pipelines, maintain real-time processing systems, and develop backend services that expose critical data to internal platforms and APIs. Key Responsibilities - Data Platform & Pipeline Engineering: Design and operate scalable, near real-time data pipelines for payment and platform data. Evolution of the current architecture from MVP status to a high-availability production environment is a primary focus. - Financial Data Modeling: Model and process complex transactional and ledger-style data to support financial reconciliation, merchant reporting, and settlement tracking. - Data Quality & Observability: Ensure the accuracy and freshness of data across critical workflows. This includes building robust monitoring and alerting systems that meet the stringent reliability standards of financial infrastructure. - Backend & API Development: Build and maintain backend services to expose data to internal platforms and downstream consumers, ensuring clean integration points for product and engineering teams. - Operational Ownership: Own systems end-to-end, from initial deployment to ongoing monitoring and reliability. This includes contributing to engineering standards and operational playbooks within a remote-first, asynchronous environment.

Portugal
Job Closed

Senior Data Engineer

MLabs LTD

Founded in 2018, MLabs is a private software engineering consultancy specializing in Haskell and Rust development with a focus on blockchain, artificial intelli

Data Engineer46 days ago

Location: Remote - Europe Remote | Full-time Compensation: $110K - $125K We are hiring on behalf of our client who is a premier infrastructure provider within the decentralized web (Web3) ecosystem, serving as the critical connectivity layer for tens of thousands of applications and millions of users globally. Having established a dominant market position, the organization is now expanding its horizons by launching a sophisticated payments solution. This new initiative enables merchants and payment providers to utilize blockchain rails for stablecoin checkouts, payouts, and deposits, already reaching millions of terminals worldwide through strategic global partnerships. The data systems supporting this infrastructure are foundational to the company's success. As the organization transitions from MVP pipelines to a scalable production architecture, there is a need for a Senior Data Engineer to join the team. This individual will help design and operate the data foundation behind a global payments network, ensuring that systems tracking wallet connections, transaction health, and financial reconciliations are as reliable as the payment flows themselves. This role sits at the intersection of data engineering and backend systems. The successful candidate will build event-driven pipelines, maintain real-time processing systems, and develop backend services that expose critical data to internal platforms and APIs. Key Responsibilities - Data Platform & Pipeline Engineering: Design and operate scalable, near real-time data pipelines for payment and platform data. Evolution of the current architecture from MVP status to a high-availability production environment is a primary focus. - Financial Data Modeling: Model and process complex transactional and ledger-style data to support financial reconciliation, merchant reporting, and settlement tracking. - Data Quality & Observability: Ensure the accuracy and freshness of data across critical workflows. This includes building robust monitoring and alerting systems that meet the stringent reliability standards of financial infrastructure. - Backend & API Development: Build and maintain backend services to expose data to internal platforms and downstream consumers, ensuring clean integration points for product and engineering teams. - Operational Ownership: Own systems end-to-end, from initial deployment to ongoing monitoring and reliability. This includes contributing to engineering standards and operational playbooks within a remote-first, asynchronous environment.

Netherlands
Job Closed

Senior Data Engineer

MLabs LTD

Founded in 2018, MLabs is a private software engineering consultancy specializing in Haskell and Rust development with a focus on blockchain, artificial intelli

Data Engineer46 days ago

Location: Remote - Europe Remote | Full-time Compensation: $110K - $125K We are hiring on behalf of our client who is a premier infrastructure provider within the decentralized web (Web3) ecosystem, serving as the critical connectivity layer for tens of thousands of applications and millions of users globally. Having established a dominant market position, the organization is now expanding its horizons by launching a sophisticated payments solution. This new initiative enables merchants and payment providers to utilize blockchain rails for stablecoin checkouts, payouts, and deposits, already reaching millions of terminals worldwide through strategic global partnerships. The data systems supporting this infrastructure are foundational to the company's success. As the organization transitions from MVP pipelines to a scalable production architecture, there is a need for a Senior Data Engineer to join the team. This individual will help design and operate the data foundation behind a global payments network, ensuring that systems tracking wallet connections, transaction health, and financial reconciliations are as reliable as the payment flows themselves. This role sits at the intersection of data engineering and backend systems. The successful candidate will build event-driven pipelines, maintain real-time processing systems, and develop backend services that expose critical data to internal platforms and APIs. Key Responsibilities - Data Platform & Pipeline Engineering: Design and operate scalable, near real-time data pipelines for payment and platform data. Evolution of the current architecture from MVP status to a high-availability production environment is a primary focus. - Financial Data Modeling: Model and process complex transactional and ledger-style data to support financial reconciliation, merchant reporting, and settlement tracking. - Data Quality & Observability: Ensure the accuracy and freshness of data across critical workflows. This includes building robust monitoring and alerting systems that meet the stringent reliability standards of financial infrastructure. - Backend & API Development: Build and maintain backend services to expose data to internal platforms and downstream consumers, ensuring clean integration points for product and engineering teams. - Operational Ownership: Own systems end-to-end, from initial deployment to ongoing monitoring and reliability. This includes contributing to engineering standards and operational playbooks within a remote-first, asynchronous environment.

Romania
Job Closed

Senior Data Engineer

MLabs LTD

Founded in 2018, MLabs is a private software engineering consultancy specializing in Haskell and Rust development with a focus on blockchain, artificial intelli

Data Engineer46 days ago

Location: Remote - Europe Remote | Full-time Compensation: $110K - $125K We are hiring on behalf of our client who is a premier infrastructure provider within the decentralized web (Web3) ecosystem, serving as the critical connectivity layer for tens of thousands of applications and millions of users globally. Having established a dominant market position, the organization is now expanding its horizons by launching a sophisticated payments solution. This new initiative enables merchants and payment providers to utilize blockchain rails for stablecoin checkouts, payouts, and deposits, already reaching millions of terminals worldwide through strategic global partnerships. The data systems supporting this infrastructure are foundational to the company's success. As the organization transitions from MVP pipelines to a scalable production architecture, there is a need for a Senior Data Engineer to join the team. This individual will help design and operate the data foundation behind a global payments network, ensuring that systems tracking wallet connections, transaction health, and financial reconciliations are as reliable as the payment flows themselves. This role sits at the intersection of data engineering and backend systems. The successful candidate will build event-driven pipelines, maintain real-time processing systems, and develop backend services that expose critical data to internal platforms and APIs. Key Responsibilities - Data Platform & Pipeline Engineering: Design and operate scalable, near real-time data pipelines for payment and platform data. Evolution of the current architecture from MVP status to a high-availability production environment is a primary focus. - Financial Data Modeling: Model and process complex transactional and ledger-style data to support financial reconciliation, merchant reporting, and settlement tracking. - Data Quality & Observability: Ensure the accuracy and freshness of data across critical workflows. This includes building robust monitoring and alerting systems that meet the stringent reliability standards of financial infrastructure. - Backend & API Development: Build and maintain backend services to expose data to internal platforms and downstream consumers, ensuring clean integration points for product and engineering teams. - Operational Ownership: Own systems end-to-end, from initial deployment to ongoing monitoring and reliability. This includes contributing to engineering standards and operational playbooks within a remote-first, asynchronous environment.

Poland
Job Closed