AgileEngine logo
AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

Data Engineer (GCP) ID56375

Data EngineerData EngineerFull TimeRemoteMid LevelTeam 1,001-5,000

Location

India

Posted

46 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Engineer (GCP) ID56375

AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE WHAT YOU WILL DO - Build and maintain scalable, distributed, fault-tolerant data pipelines on GCP; - Develop and manage lakehouse layers and Delta Lake workflows using BigQuery and Dataproc; - Collaborate with stakeholders across data engineering, compliance, and business teams; - Design and implement pipelines to acquire, normalise, transform, and release large volumes of financial data; - Design and implement bitemporal data models on BigQuery for regulatory-grade time-series datasets; - Build and maintain testing frameworks for data pipelines and transformation logic; - Own end-to-end solutions including ingestion pipelines, QA workflows, correction management, and audit trails; - Contribute to shared platform services in a collaborative environment; - Support implementation of AI solutions including data ingestion, anomaly detection, and semantic search using Vertex AI. MUST HAVES - 6–8 years of experience in data engineering; - Proficiency in Python for data pipelines, transformation logic, and automation; - Proficiency in SQL with hands-on experience in BigQuery including partitioning, clustering, and time-series queries; - Experience with Cloud Composer (Apache Airflow) for pipeline orchestration; - Working knowledge of Dataproc (Apache Spark) for batch ingestion and incremental processing; - Experience with AI-assisted development tools such as GitHub Copilot or similar; - Experience with Git version control and collaboration workflows; - Familiarity with REST APIs for integrations; - Familiarity with GCP technologies (Cloud Storage, Pub/Sub, Datastream, Cloud Monitoring, IAM, VPC Service Controls); - Understanding of financial data concepts related to equities and& other asset classes; - Upper-intermediate English level. NICE TO HAVES - Knowledge of data libraries such as pandas or PySpark; - Experience with columnar storage and time-series analytics tools such as ClickHouse; - Familiarity with Dataplex for data governance and lineage; - Understanding of Change Data Capture (CDC) using Datastream; - Understanding of bitemporal data modeling concepts; - Knowledge of financial reference data such as equities, fixed income, or corporate actions; - Experience with BigQuery cost management techniques; - Experience with CI/CD pipelines and Terraform for infrastructure as code; - Exposure to LLMs and& Agentic AI using Vertex AI for data-related use cases. PERKS AND BENEFITS - Remote work & Local connection: Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts. - Legal presence in India: We ensure full local compliance with a structured, secure work environment tailored to Indian regulations. - Competitive Compensation in INR: Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness. - Innovative Projects: Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.

Related Categories

Related Job Pages

More Data Engineer Jobs

Danaher Corporation logo

Material Safety Data Sheet (MSDS) Author - 12 month FTC

Danaher Corporation

Join our winning team today. Together, we’ll accelerate the real-life impact of tomorrow’s science and technology. We partner with customers across the globe to help them solve their most complex challenges, architecting solutions that bring the power of science to life. For more information, visit www.danaher.com .

Data Engineer46 days ago
Full TimeRemoteTeam 10,001+H1B Sponsor

Wondering what’s within Beckman Coulter Diagnostics? Take a closer look. At first glance, you’ll see that for more than 90 years we’ve been dedicated to advancing and optimizing the laboratory to move science and healthcare forward. Join a team where you can be heard, be supported, and always be yourself. We’re building a culture that celebrates backgrounds, experiences, and perspectives of all our associates. Look again and you’ll see we are invested in you—providing the opportunity to build a meaningful career, be creative, and try new things with the support you need to be successful. Beckman Coulter Diagnostics is proud to work alongside a community of fellow Diagnostics Companies at Danaher. Together, we’re working at the pace of change to improve patient lives with diagnostic tools that address the world’s biggest health challenges. The Material Safety Data Sheet (MSDS) Author for Beckman Coulter Diagnostics is responsible for ensuring that Beckman Coulter products, processes, and documentation comply with local, national, and international chemical safety and regulatory requirements, enabling safe product use and global market access. This position is part of the Global Chemical Compliance Department and will be fully remote. At Beckman Coulter, our vision is to relentlessly reimagine healthcare, one diagnosis at a time. You will be a part of the Global Chemical Compliance team and report to the Director of Global Compliance and Regulatory Affairs, responsible for global chemical compliance strategy and regulatory alignment. If you thrive in a highly collaborative, global-facing role and want to help build a world‑class compliance organization—read on. In this role, you will have the opportunity to: - Generate and maintain Safety Data Sheets (SDSs) in compliance with worldwide chemical user safety regulations. - Partner cross‑functionally with product developers, chemists, and site teams to support chemical compliance across Beckman Coulter locations. - Interpret and apply evolving global chemical regulations to products, processes, and documentation. - Develop and support chemical compliance strategies, including risk identification, mitigation planning, and regulatory readiness. - Provide guidance and subject‑matter expertise to internal teams on safe handling, labeling, and disposal requirements. - Support audits, regulatory inquiries, and internal compliance initiatives as required. The essential requirements of the job include: - Bachelor’s degree in Chemistry, Chemical Engineering, Environmental Science, Toxicology, or a related field. - 5+ years of professional experience in chemical compliance, regulatory affairs, or a related discipline. - Demonstrated knowledge of global chemical safety regulations governing the creation and management of SDSs. - Experience working cross‑functionally with technical and scientific stakeholders. - Ability to travel periodically to the United States (minimum once per year). It would be a plus if you also possess previous experience in: - UL WERCS - Oracle Business Systems - Prior experience supporting in‑vitro diagnostic devices or other highly regulated industries At Beckman Coulter Diagnostics we believe in designing a better, more sustainable workforce. We recognize the benefits of flexible, remote working arrangements for eligible roles and are committed to providing enriching careers, no matter the work arrangement. This position is eligible for a remote work arrangement in which you can work remotely from your home. Additional information about this remote work arrangement will be provided by your interview team. Explore the flexibility and challenge that working for Beckman Coulter Diagnostics can provide. Join our winning team today. Together, we’ll accelerate the real-life impact of tomorrow’s science and technology. We partner with customers across the globe to help them solve their most complex challenges, architecting solutions that bring the power of science to life. For more information, visit www.danaher.com.

Ireland
CargoSprint logo

Data Architect, Data Platform (Azure)

CargoSprint

Empowering the people that make global commerce happen.

Data Engineer46 days ago
Full TimeRemoteTeam 201-500Since 2012H1B Sponsor

About You You're a builder who can turn messy, inconsistent data into a trusted warehouse, clean data marts, and reporting that business teams actually use. You're opinionated about architecture and governance, but pragmatic about migration paths and incremental delivery. About the role This role is responsible for our data platform and data delivery. You will design and build our data warehouse, data marts, and reporting layer to support product, finance, operations, and customer-facing reporting. You'll own the architecture, standards, and execution plan across an Azure data platform (or similar). What you'll do - Own the design and delivery of our data warehouse and data marts: models, schemas, semantic consistency, and documentation. - Build and evolve reporting foundations: curated datasets, metric definitions, and repeatable reporting patterns. - Partner with stakeholders to define source-of-truth metrics and ensure consistent definitions across teams. - Establish standards for data quality, testing, reconciliation, lineage, access control, and lifecycle management. - Drive modernization: reduce legacy data debt, simplify flows, and improve reliability and performance across the platform. - Define data contracts with application teams (schemas, events/CDC patterns) so downstream reporting is stable. - Enable self-serve analytics by making data discoverable, documented, and safe to use. Qualifications - 8+ years in data engineering, analytics engineering, or platform engineering with architecture ownership. - Proven experience building data warehouses and marts that support business reporting at scale. - Strong SQL and data modeling skills (dimensional modeling, star schemas, and/or semantic models). - Experience with Azure data platforms (Synapse/Fabric, ADLS, Databricks on Azure, ADF) or comparable equivalents (Snowflake, BigQuery, Redshift). - Experience with orchestration and transformation tooling (ADF, Airflow, dbt, Dagster, or equivalent). - Track record of modernization with incremental migration and clear deprecation plans. - Ability to align engineering and business stakeholders around shared definitions and priorities. Nice to have - Experience with BI layers and semantic modeling (Power BI preferred; Tableau/Looker also fine). - Governance/catalog tooling and PII controls. - Streaming/event-driven data patterns (Kafka/Kinesis/PubSub) or CDC experience. - Payments, billing, invoicing, or other high-volume transactional domains. - Logistics, cargo, or supply chain experience. - Spanish language proficiency. Compensation and benefits We offer competitive pay and benefits designed to fuel our team's success. - Health and Wellness: Medical, dental, and vision plans for you and your family - Future-Ready: 401(k) with company match - Work Life Balance: Generous flexible PTO program and paid holidays - Grow With Us: Professional development opportunities #LI-Remote Does this role sound like the next step in your career? We’d love to hear from you! If you don’t meet all of the requirements exactly, we encourage you to use your cover letter to tell us about your unique experience—talent comes from many places, and skills are transferable. Our Commitment to an Extraordinary Work Environment At CargoSprint, we value diversity and inclusivity. We strive to create a welcoming and supportive community for employees from all backgrounds. Regardless of your gender, sexual orientation, physical ability, religion, ethnicity, race, or age, you will find a place where you can thrive and be your authentic self. Our CargoSprint Recruitment Team personally reviews every application.

United States
PTV Logistics logo

Data Engineer

PTV Logistics

New Unified Brand for PTV Logistics & Conundra | Redefining the Future of Logistics Software

Data Engineer46 days ago
Full TimeRemoteTeam 201-500Since 1983H1B No Sponsor

• Work as part of a specialized data engineering team that supplies our logistics planning and optimization products with high‑quality geographic and non‑geographic data, with a focus on data from toll systems. • Take responsibility for collecting, analyzing, preparing, and processing large datasets using modern Geographic Information Systems (GIS) and automated, cloud‑based data processing pipelines. • Ensure data accuracy and timeliness by applying automated validation mechanisms as well as targeted manual quality assurance processes. • Collaborate closely with data engineers and software developers who operate and continuously enhance our data processing environment.

Poland
PLN105K - PLN140K / year
Job Closed
Full TimeRemoteTeam 201-500

Hello and thank you for your interest! We're looking for folks nationwide who are great at data entry and typing. We offer a flexible work from home remote position that allows you to stay home with the family! The pay range is flexible from $16/ph to $30/ph DOE and level of experience. You'll meet these requirements to work from home remotely • Stable Internet connection • Work can be done using the following: Phone device, laptap or computer • Must be able to type accurately with a minimum speed of 30 words per minute • Able to focus on tasks without being distracted • Must be resident of the US • Not afraid of emailing clients as needed We're looking for folks who we can depend on who can work from home remotely without distraction and are go-getters. Pay range from 16 to 30 hourly depending on the role, level of experience and proven ability to work from home at the same level as from an office. Data entry clerks come from all different backgrounds including, data entry, telemarketing, customer service, sales, clerical, secretary, administrative assistant, warehouse, inventory, receptionist, call center, part-time, retail fields & more • Must be 16 years of age or older • Must be proficient with basic PC skills • Must have an internet connection • Basic english written language • Basic english spoken language Thank you for your interest!

United States
$16 - $30 / hour