We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
Data Architect
Location
India
Posted
11 hours ago
Salary
0
Seniority
Lead
Job Description
Data Architect
Weekday (YC W21)
• Collaborate closely with internal technical teams to deliver multiple data initiatives simultaneously. • Design, develop, and optimize scalable data solutions using Python, Snowflake, and SQL. • Review and maintain high-quality code developed by offshore engineering teams. • Lead technical discussions and translate business requirements into scalable technical solutions. • Work directly with Business and IT stakeholders to gather, refine, and validate requirements. • Build data solutions independently whenever rapid execution is required. • Monitor project progress, identify risks proactively, and communicate updates to leadership. • Ensure project deliverables meet quality, performance, and timeline expectations. • Provide technical guidance and mentor team members to achieve successful project outcomes.
Job Requirements
- 10–15 years of experience in Data Engineering, Data Architecture, or Data Analytics.
- Strong hands-on experience with Python.
- Strong expertise in Snowflake.
- Advanced SQL skills with experience writing and optimizing complex queries.
- Working knowledge of Looker.
- Experience designing scalable data pipelines and data warehouse solutions.
- Strong analytical and problem-solving abilities.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer
CapcoCapco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries
Job Title: Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Role Description Experience : 10-12 Years Job Location : Bangalore/Pune/Hyderabad Notice Period: 0 - 30 days JD: Role : - Key Responsibilities · Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle data processing. · Develop and optimize ETL/ELT workflows for ingesting, transforming, and loading high-volume financial datasets. · Create and maintain robust data models and schema designs aligned to trade lifecycle (front-to-back processing). · Onboard and integrate DTCC data sources, including RTTM and Settlement Web, into a Unified Trade Record (UTR) schema. · Design and implement ingestion frameworks using messaging systems (MQ) and API-based data extraction. · Process and normalize financial messages, including ISO 15022 formats. · Populate and maintain Trade Exceptions databases, ensuring accuracy and consistency of exception workflows. · Collaborate with business stakeholders (operations, reconciliation, settlements teams) to align data structures with business processes. · Optimize SQL Server queries, indexing strategies, and database performance. · Work with AWS cloud-native data services (e.g., S3, EKS (Kubernetes/Docker), RDS) for scalable data solutions. · Ensure data quality, lineage, governance, and observability across pipelines. · Troubleshoot complex data issues and provide analytical insights into trade discrepancies and exceptions. Required Skills & Qualifications · 10+ years of experience in data engineering, with a strong focus on capital markets. · Deep understanding of trade lifecycle (execution, clearing, settlement, reconciliation). · Strong experience with ETL/ELT frameworks and large-scale data processing. · Expertise in data modeling and schema design, particularly for trade and transaction data. · Hands-on experience with DTCC data sources, especially RTTM and Settlement Web. · Strong knowledge of ISO 15022 message formats and financial data standards. · Experience building ingestion frameworks using MQ (e.g., IBM MQ, Kafka) and REST APIs. · Advanced SQL skills with strong experience in SQL Server (performance tuning, indexing, stored procedures). · Experience with AWS cloud-native data platforms and services. · Strong analytical, debugging, and problem-solving skills. Preferred Qualifications · Experience with unified data models such as Unified Trade Record (UTR) and Schema development and Trade Exceptions management experience. · Familiarity with data governance, lineage, and cataloging tools. · Experience with real-time or near-real-time data processing frameworks. · Knowledge of regulatory reporting and compliance requirements in capital markets. · Knowing FIX messages and processing FxML messages will be an add-on experience. · Prior consulting or client-facing experience. Soft Skills · Excellent communication and stakeholder management skills. · Strong attention to detail and data accuracy. · Ability to work independently and in collaborative environments. · Proactive approach to problem-solving and continuous improvement. If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.
Data Engineer
CapcoCapco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries
Job Title: Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Role Description Experience : 5-8 Years Job Location : Bangalore/Pune/Hyderabad Notice Period: 0 - 30 days JD: Role : - Key Responsibilities · Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle data processing. · Develop and optimize ETL/ELT workflows for ingesting, transforming, and loading high-volume financial datasets. · Create and maintain robust data models and schema designs aligned to trade lifecycle (front-to-back processing). · Onboard and integrate DTCC data sources, including RTTM and Settlement Web, into a Unified Trade Record (UTR) schema. · Design and implement ingestion frameworks using messaging systems (MQ) and API-based data extraction. · Process and normalize financial messages, including ISO 15022 formats. · Populate and maintain Trade Exceptions databases, ensuring accuracy and consistency of exception workflows. · Collaborate with business stakeholders (operations, reconciliation, settlements teams) to align data structures with business processes. · Optimize SQL Server queries, indexing strategies, and database performance. · Work with AWS cloud-native data services (e.g., S3, EKS (Kubernetes/Docker), RDS) for scalable data solutions. · Ensure data quality, lineage, governance, and observability across pipelines. · Troubleshoot complex data issues and provide analytical insights into trade discrepancies and exceptions. Required Skills & Qualifications · 10+ years of experience in data engineering, with a strong focus on capital markets. · Deep understanding of trade lifecycle (execution, clearing, settlement, reconciliation). · Strong experience with ETL/ELT frameworks and large-scale data processing. · Expertise in data modeling and schema design, particularly for trade and transaction data. · Hands-on experience with DTCC data sources, especially RTTM and Settlement Web. · Strong knowledge of ISO 15022 message formats and financial data standards. · Experience building ingestion frameworks using MQ (e.g., IBM MQ, Kafka) and REST APIs. · Advanced SQL skills with strong experience in SQL Server (performance tuning, indexing, stored procedures). · Experience with AWS cloud-native data platforms and services. · Strong analytical, debugging, and problem-solving skills. Preferred Qualifications · Experience with unified data models such as Unified Trade Record (UTR) and Schema development and Trade Exceptions management experience. · Familiarity with data governance, lineage, and cataloging tools. · Experience with real-time or near-real-time data processing frameworks. · Knowledge of regulatory reporting and compliance requirements in capital markets. · Knowing FIX messages and processing FxML messages will be an add-on experience. · Prior consulting or client-facing experience. Soft Skills · Excellent communication and stakeholder management skills. · Strong attention to detail and data accuracy. · Ability to work independently and in collaborative environments. · Proactive approach to problem-solving and continuous improvement. If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.
Senior Software Engineer - Python and Data Ecosystem
ClickHouseClickHouse is an open-source, column-oriented OLAP database management system.
Role Description As a Senior Software Engineer specializing in Python and the Data Ecosystem , you'll be a core contributor owning and evolving critical parts of ClickHouse's data engineering ecosystem. This role sits at the intersection of high-performance database engineering and developer experience. You'll craft tools that enable Data Engineers and Data Scientists to harness ClickHouse's speed and scale in the frameworks they already use. We're looking for someone who has lived the Data Engineer or Data Scientist experience firsthand. The data practitioner's world is shifting rapidly: - Databases are no longer just query targets. - They are becoming active participants in AI-powered workflows. - They serve as vector stores for RAG pipelines, backends for LLM-powered agents, and real-time feature stores for ML inference. You understand these workflows not from the outside, but because you've operated within them. You don't just build integrations; you bring product-level insight into what we should build and why. You'll own the full lifecycle of key Python integrations, driving architecture, performance, and feature direction across: - Orchestration Platforms: Apache Airflow, Dagster, Prefect - Transformation Tools: dbt, SQLMesh - AI & LLM Ecosystem: LangChain, LlamaIndex, n8n, and broader AI tooling. Your job is to make ClickHouse's potential real by building the robust, production-ready connectors that make ClickHouse the natural choice when data practitioners design their next-generation AI and data systems. What you'll do: - Own and evolve ClickHouse's Python connector and SDK ecosystem, raising the bar on performance, reliability, and API design. - Build and maintain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt) to enterprise-grade quality standards. - Drive the AI/LLM integration strategy: designing connectors and patterns that make ClickHouse a natural fit in RAG architectures, ML feature pipelines, and LLM-powered data applications. - Engage actively with the open-source community: triage issues, support contributors, advocate for users, and shape the roadmap based on real-world feedback. - Collaborate with Product, Cloud, and other engineering teams to align integration work with broader platform priorities. - Bring a practitioner's perspective to roadmap decisions, grounding prioritization in genuine Data Engineer and Data Scientist workflows. Qualifications - 7+ years of software development experience, including hands-on time as a Data Engineer, Data Scientist, or ML Engineer. - Deep, proven experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for at least one major platform (orchestration, BI, MLOps, or data transformation). - Hands-on experience applying AI/ML in production data-engineering contexts: embedding generation, vector search, feature pipelines, or LLM-powered tooling that shipped and ran in production. - Solid experience with the Python data ecosystem: Pandas, NumPy, Pydantic, and related libraries. - Strong database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases. - Solid experience with concurrent Python: threading, multiprocessing, and async patterns. - Outstanding written and verbal communication; comfortable collaborating across engineering functions and with open-source communities. Requirements - Prior experience as a Data Engineer or Data Scientist in a product-facing or platform role. - Familiarity with ClickHouse or similar high-performance OLAP platforms. - Familiarity with the JVM ecosystem. - Experience deploying AI/ML models in production, including inference APIs and vector databases. Benefits - Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. - Healthcare - Employer contributions towards your healthcare. - Equity in the company - Every new team member who joins our company receives stock options. - Time off - Flexible time off in the US, generous entitlement in other countries. - A $500 Home office setup if you’re a remote employee. - Global Gatherings - Opportunities to engage with colleagues at company-wide offsites. - Culture - As part of a rapidly scaling startup, you will be instrumental in shaping our culture.
Finance Engineer
VirtuagymWe’re a leading innovator in digital health & fitness SaaS, serving trainers, studios, clubs, and corporate wellness clients worldwide. 175+ people across Amsterdam, Medellín, and a few other locations, 35+ nationalities and one mission: make the world a healthier and happier place. 📈 Many opportunities for personal and professional growth within the company. 😎 A fun, healthy, and international work environment made up of over 35+ nationalities. 🗣 We believe in a flat hierarchy with room to take ownership: your voice will be truly heard. ⚽ Organized Virtuagym sports events throughout the year. 🎉 Awesome company events such as New Year's dinners, summer outings, ski trips, etc.
Role Description Turn complex financial data into scalable systems that power smarter business decisions. As Virtuagym keeps growing, we are looking for a Finance Engineer to join our Finance Automation and Data team. In this unique role, you will combine data engineering with financial systems expertise to design, optimize, and scale our ERP environment and its integrations with other business-critical tools. You’ll be working with billions of rows of data from thousands of clients, with a special focus on finance operations and automation. You’ll help us build scalable workflows, integrate systems, and develop reporting solutions that drive both financial accuracy and operational efficiency. This is a great opportunity if you’re excited about data engineering challenges but also want to apply your skills to the finance domain, where automation, accuracy, and compliance are key. Join a high performing team and make an impact! We're a passionate, driven team with a strong focus on growth and delivering outstanding results. At Virtuagym, we cultivate a high-performance culture built on dedication, ownership, and driving excellence. If you're a self-starter who embraces challenges, thrives in a fast-paced, dynamic environment, and keeps going where others might stop, this could be the perfect role for you! In return, you’ll join a team where you can grow, develop, and truly unlock your full potential. This is a remote position, where you will be working as part of our Global Finance Automation & Data team. We are looking for somebody on a full-time, part-time, or freelance basis. We are a remote-friendly company, meaning you can work from your home at all times. The location of this role is flexible within the European timezone. Responsibilities - Design, implement, and manage highly scalable financial data workflows. - Connect, transform, and visualize large datasets (ERP, BI, transactional data). - Develop and maintain integrations between NetSuite, Stripe, Salesforce, and other platforms. - Create and optimize reporting and dashboards in close collaboration with Finance and BI teams. - Lead projects end-to-end: gather business requirements, architect solutions, test in sandbox environments, and roll out to production. - Collaborate with product managers, data scientists, and finance analysts to accelerate automation and analytics. - Contribute to shaping the future of Finance Automation at Virtuagym, ensuring scalable, automated, and robust financial systems. Qualifications - Bachelor’s or Master’s degree in Computer Science, Information Systems, Statistics, or Finance/Business with a strong technical affinity. - 1+ years of experience in data engineering, finance systems engineering, or ERP development. - Strong knowledge of SQL and relational databases. - Hands-on programming/scripting skills (Python, Java, SuiteScript, etc.). - Experience with cloud services (AWS, RDS, EC2, etc.). - Finance knowledge: basic understanding of BS, P&L, Cash Flow, reconciliation, FX, etc. - Excellent verbal and written English communication skills. - Strong interest in automation, data-driven solutions, and the future of finance operations. Benefits - 🌎 Remote-friendly working setup, with the flexibility to work from home; - 🌴 Paid vacation days, depending on your location and contract type; - 💻 Home office setup and hardware; - 💪 The Virtuagym Health Program: access to video-on-demand workouts and meditation through the Virtuagym platform, plus company-wide health and fitness challenges; - ✈ Work-from-abroad opportunities, where applicable and in line with local policies; - 💬 Unlimited access to on-demand coaching with psychologists via chat, phone, or video call through OpenUp. Ready to join us? Please do not hesitate to apply by clicking the 'Apply for this Job' button below! We will get back to your application within 10 working days. For any questions on the vacancy, please get in touch with the recruitment team at recruitment@virtuagym.com .


