AgileEngine logo
AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

Data Engineer (GCP) ID56375

Data EngineerData EngineerFull TimeRemoteMid LevelTeam 1,001-5,000

Location

India

Posted

95 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Engineer (GCP) ID56375

AgileEngine

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE WHAT YOU WILL DO - Build and maintain scalable, distributed, fault-tolerant data pipelines on GCP; - Develop and manage lakehouse layers and Delta Lake workflows using BigQuery and Dataproc; - Collaborate with stakeholders across data engineering, compliance, and business teams; - Design and implement pipelines to acquire, normalise, transform, and release large volumes of financial data; - Design and implement bitemporal data models on BigQuery for regulatory-grade time-series datasets; - Build and maintain testing frameworks for data pipelines and transformation logic; - Own end-to-end solutions including ingestion pipelines, QA workflows, correction management, and audit trails; - Contribute to shared platform services in a collaborative environment; - Support implementation of AI solutions including data ingestion, anomaly detection, and semantic search using Vertex AI. MUST HAVES - 6–8 years of experience in data engineering; - Proficiency in Python for data pipelines, transformation logic, and automation; - Proficiency in SQL with hands-on experience in BigQuery including partitioning, clustering, and time-series queries; - Experience with Cloud Composer (Apache Airflow) for pipeline orchestration; - Working knowledge of Dataproc (Apache Spark) for batch ingestion and incremental processing; - Experience with AI-assisted development tools such as GitHub Copilot or similar; - Experience with Git version control and collaboration workflows; - Familiarity with REST APIs for integrations; - Familiarity with GCP technologies (Cloud Storage, Pub/Sub, Datastream, Cloud Monitoring, IAM, VPC Service Controls); - Understanding of financial data concepts related to equities and& other asset classes; - Upper-intermediate English level. NICE TO HAVES - Knowledge of data libraries such as pandas or PySpark; - Experience with columnar storage and time-series analytics tools such as ClickHouse; - Familiarity with Dataplex for data governance and lineage; - Understanding of Change Data Capture (CDC) using Datastream; - Understanding of bitemporal data modeling concepts; - Knowledge of financial reference data such as equities, fixed income, or corporate actions; - Experience with BigQuery cost management techniques; - Experience with CI/CD pipelines and Terraform for infrastructure as code; - Exposure to LLMs and& Agentic AI using Vertex AI for data-related use cases. PERKS AND BENEFITS - Remote work & Local connection: Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts. - Legal presence in India: We ensure full local compliance with a structured, secure work environment tailored to Indian regulations. - Competitive Compensation in INR: Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness. - Innovative Projects: Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer III

SAIF Corporation

SAIF Corporation is a not-for-profit workers' compensation insurance company dedicated to providing affordable coverage and ensuring workplace safety across the

Data Engineer95 days ago

Compensation Grade:‏‏‎ ‎157 Job Description When it comes to city development, city engineers are essential in designing and building stable, efficient, and effective roads and infrastructure to meet the needs of the people who use them. From helping to design, develop, and support data pipelines to extracting, cleaning, and loading data into the data warehouse, our data engineers are like the city engineers of SAIF’s data program. Our new data engineer will work closely with data analysts and data scientists, as well as other key stakeholders throughout the company, to ensure our data systems are designed to meet the organization’s needs. A qualified candidate has 3+ years’ experience working with various programming languages and data management tools, such as SQL, Python, Fivetran, dbt, Databricks and cloud-based data processing platforms like AWS or Azure. If you’d enjoy the opportunity to use cutting-edge technologies to work with large and complex datasets, and to join a collaborative and supportive team to build and design our enterprise Data Lake from the ground-up, we encourage you to apply. Please note: The selected candidate must reside in Oregon and may work remotely from their home office or from a SAIF office. Responsibilities: - Design, develop, and support data pipelines, including scripts required to extract, transform, clean, and load data into a data warehouse or data lake. - Design and build analytics solutions that utilize the data repository to provide actionable insights that will enable data driven decision-making. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, automating data validation, etc. - Create data solutions for analytics and data teams to assist them in building and optimizing our data assets to be innovative industry leaders. - Lead and coordinate the work of other less experienced decision support team members. - Conduct research into new technologies and determine viability for adoption. - Develop best practices on installing, configuring, and using BI and analytics solutions to enhance productivity. - Create and document data warehouse development standards. - Work with stakeholders and data analysts throughout the organization to assist with data-related technical issues and support their data infrastructure needs. - Incorporate new and existing subject areas into an enterprise model. - Design and develop multidimensional OLAP cubes for end users. - Provide direction for data verification and testing methods. - Review data loaded into the data warehouse and data lake for accuracy. - Troubleshoot, maintain, revise, and test existing data warehouse solutions, and tune for performance. - Design, develop, and support semantic data layers for ingest by BI applications. - Troubleshoot data issues for power users and other stakeholders who develop self-service data analysis on behalf of their divisions. - On-call support may be required on an as needed basis or part of a rotating schedule, including availability outside of business hours to support urgent IT issues or system implementations. - Explore diverse perspectives and consistently behave sensitively toward differences in cultural norms, expectations, and ways of communicating. Work effectively with others who have different perspectives, backgrounds, and/or work styles. Additional functions: - Perform other duties as assigned by management to support team objectives and organizational goals, demonstrating flexibility and adaptability in responding to evolving priorities and needs. Recommended qualifications: - Five or more years of experience in Data Warehousing concepts in relational databases like SQL Server, Oracle and Snowflake. Five or more years of experience working with ETL technologies like SSIS, Informatica and Databricks. Demonstrated experience supporting and working collaboratively in cross-functional teams, including conveying technical messages to non-technical stakeholders and team members. - A bachelor’s degree in computer science, information technology, or a related field. - Other combinations of skills and experience may be considered. Next step To receive consideration, please submit your resume with a cover letter by the close of this recruitment. We want your submission to count, so be sure it’s complete. This recruitment will close on Monday, April 20, 2026. If a sufficient number of qualified applications are received this recruitment may close early. Compensation & Benefits Typical hiring range:‏‏‎ ‎$118,329‏‏‎ ‎-‏‏‎ ‎$139,210.‏‏‎ ‎The pay range for this position is annually based on a full-time schedule. Actual compensation will be determined using factors such as experience, skills, training, certifications & education. SAIF provides a wide range of benefits to employees who work at least 20 hours per week, including health care, retirement savings plans, paid time off, and more. For additional information about SAIF's total rewards, visit our website at: Total rewards (saif.com) *Note that eligibility and cost of benefits can vary depending on the number of regularly scheduled hours, and job status such as regular full-time, regular part-time, seasonal, or temporary employment. Full salary range:‏‏‎‏‏‎ ‎$104,410‏‏‎ ‎-‏‏‎ ‎$174,015 Veterans We provide preference to qualifying and disabled veterans. For more information please visit saif.com/veterans. About us Since 1914, SAIF has been taking care of injured workers, helping people get back to work, and keeping rates low by focusing on workplace safety. Together with our partners, we strive to make Oregon the safest and healthiest place to work. For questions related to this job, please reach out to us at jobs@saif.com. SAIF is an Equal Opportunity Employer that values diversity in its workplace.

United States
$104K - $174K / year

Senior Data Engineer (SQL)

Experian

We're unlocking the power of data to help create a better tomorrow.

Data Engineer95 days ago
Full TimeRemoteTeam 10,001+Since 1996H1B Sponsor

Company Description Experian is a global company in data services, helping organizations and consumers manage risk and make informed decisions. We empower individuals and businesses at important life moments, from purchasing a home to expanding customer bases. With over 125 years of experience, we specialize in data gathering, analysis, and fraud prevention. Our 21,700 employees across 30 countries are dedicated to innovation and creating opportunities for a better tomorrow. Recently ranked the fifth-best company to work for in Costa Rica, we prioritize inclusive culture, employee well-being, and career development. Join us at www.experian.com/careers to be part of our team. Job Description We are looking for a Senior Data Developer (SQL) with experience in SQL Server and data integration to help build data solutions used across the business. You will focus on developing reliable databases, ETL processes, and automation scripts that power critical applications. You will work with other developers, analysts, and partners to provide high‑quality data solutions in a collaborative environment. You will report to the Manager of Data Development. Responsibilities - You will develop and maintain SQL Server stored procedures, functions, views, and queries. - Build, enhance and support SSIS packages for data integration and transformation. - Perform database performance tuning, including query optimization and indexing. - Create scripts (such as PowerShell) to automate deployments and maintenance. - Monitor, troubleshoot, and resolve database, SSIS, and job execution issues. - Collaborate with team members to understand data requirements and provide reliable solutions. Qualifications - 5+ years of hands-on experience with Microsoft SQL Server. - 5+ years of experience developing SSIS packages. - Skills writing complex SQL queries, stored procedures, and tasks. - Experience with database performance tuning and optimization techniques. - Experience with PowerShell or a similar scripting language for automation. - Experience with relational database design and data normalization. Additional Information Benefits/Perks: Our benefits include: Medical, life and dental insurance, Asociacion Solidarista, International Share Save Plan, Flex Work/Work from home, Paid time off, Annual Performance Bonus, Education Reimbursement, Family Bonding, Bereavement Leave, Referral Program, and more. This is a fully remote job opportunity. #LI-Remote Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward and recognition, volunteering... the list goes on. Experian's people first approach is award-winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why. Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity. - Employee Status: Regular - Role Type: Hybrid - Department: Technology - Schedule: Full Time - Shift: Day Shift

Costa Rica

Senior Data Engineer, Cloud & Analytics

Experian

We're unlocking the power of data to help create a better tomorrow.

Data Engineer95 days ago
Full TimeRemoteTeam 10,001+Since 1996H1B Sponsor

• Support cloud-based data pipelines for ingestion, transformation, and storage. • Work with AWS services to help maintain and improve data workflows. • Help with data validation, monitoring, and troubleshooting of analytics pipelines. • Contribute to data lake solutions used for reporting and analytics. • Support reporting and visualization tools used by business partners. • Follow best practices for source control, documentation, and team collaboration.

Costa Rica
Enroute logo

Senior Data Engineer – Cloud, Snowflake, PySpark

Enroute

We deliver IT services and solutions provided by a team of passionate problem solving individuals highly skilled.

Data Engineer95 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Design, build, and maintain **scalable, reliable, and high-performance data pipelines** • Develop end-to-end **ETL / ELT workflows** • Process large-scale datasets using **Spark / PySpark** • Build and orchestrate cloud-native pipelines in **AWS and/or Azure** • Design and optimize **Snowflake data warehouse solutions** • Ensure **performance, scalability, governance, and cost optimization** • Write and optimize **advanced SQL queries** • Collaborate with **Data Scientists, Analysts, and Software Engineers** • Translate business requirements into **production-ready data solutions** • Ensure **data consistency, availability, and quality** • Implement **CI/CD, Git workflows, and Dockerized deployments** • Improve reliability and observability of data platforms

Mexico
Job Closed