Capco logo
Capco

Capco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries

Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1,001-5,000Since 1998H1B SponsorCompany SiteLinkedIn

Location

India

Posted

11 hours ago

Salary

0

Seniority

Senior

English

Job Description

Data Engineer

Capco

Job Title: Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Role Description Experience : 5-8 Years Job Location : Bangalore/Pune/Hyderabad Notice Period: 0 - 30 days JD: Role : - Key Responsibilities · Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle data processing. · Develop and optimize ETL/ELT workflows for ingesting, transforming, and loading high-volume financial datasets. · Create and maintain robust data models and schema designs aligned to trade lifecycle (front-to-back processing). · Onboard and integrate DTCC data sources, including RTTM and Settlement Web, into a Unified Trade Record (UTR) schema. · Design and implement ingestion frameworks using messaging systems (MQ) and API-based data extraction. · Process and normalize financial messages, including ISO 15022 formats. · Populate and maintain Trade Exceptions databases, ensuring accuracy and consistency of exception workflows. · Collaborate with business stakeholders (operations, reconciliation, settlements teams) to align data structures with business processes. · Optimize SQL Server queries, indexing strategies, and database performance. · Work with AWS cloud-native data services (e.g., S3, EKS (Kubernetes/Docker), RDS) for scalable data solutions. · Ensure data quality, lineage, governance, and observability across pipelines. · Troubleshoot complex data issues and provide analytical insights into trade discrepancies and exceptions. Required Skills & Qualifications · 10+ years of experience in data engineering, with a strong focus on capital markets. · Deep understanding of trade lifecycle (execution, clearing, settlement, reconciliation). · Strong experience with ETL/ELT frameworks and large-scale data processing. · Expertise in data modeling and schema design, particularly for trade and transaction data. · Hands-on experience with DTCC data sources, especially RTTM and Settlement Web. · Strong knowledge of ISO 15022 message formats and financial data standards. · Experience building ingestion frameworks using MQ (e.g., IBM MQ, Kafka) and REST APIs. · Advanced SQL skills with strong experience in SQL Server (performance tuning, indexing, stored procedures). · Experience with AWS cloud-native data platforms and services. · Strong analytical, debugging, and problem-solving skills. Preferred Qualifications · Experience with unified data models such as Unified Trade Record (UTR) and Schema development and Trade Exceptions management experience. · Familiarity with data governance, lineage, and cataloging tools. · Experience with real-time or near-real-time data processing frameworks. · Knowledge of regulatory reporting and compliance requirements in capital markets. · Knowing FIX messages and processing FxML messages will be an add-on experience. · Prior consulting or client-facing experience. Soft Skills · Excellent communication and stakeholder management skills. · Strong attention to detail and data accuracy. · Ability to work independently and in collaborative environments. · Proactive approach to problem-solving and continuous improvement. If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.

Related Categories

Related Job Pages

More Data Engineer Jobs

ClickHouse logo

Senior Software Engineer - Python and Data Ecosystem

ClickHouse

ClickHouse is an open-source, column-oriented OLAP database management system.

Data Engineer11 hours ago
Full TimeRemoteTeam 51-200Since 2016H1B Sponsor

Role Description As a Senior Software Engineer specializing in Python and the Data Ecosystem , you'll be a core contributor owning and evolving critical parts of ClickHouse's data engineering ecosystem. This role sits at the intersection of high-performance database engineering and developer experience. You'll craft tools that enable Data Engineers and Data Scientists to harness ClickHouse's speed and scale in the frameworks they already use. We're looking for someone who has lived the Data Engineer or Data Scientist experience firsthand. The data practitioner's world is shifting rapidly: - Databases are no longer just query targets. - They are becoming active participants in AI-powered workflows. - They serve as vector stores for RAG pipelines, backends for LLM-powered agents, and real-time feature stores for ML inference. You understand these workflows not from the outside, but because you've operated within them. You don't just build integrations; you bring product-level insight into what we should build and why. You'll own the full lifecycle of key Python integrations, driving architecture, performance, and feature direction across: - Orchestration Platforms: Apache Airflow, Dagster, Prefect - Transformation Tools: dbt, SQLMesh - AI & LLM Ecosystem: LangChain, LlamaIndex, n8n, and broader AI tooling. Your job is to make ClickHouse's potential real by building the robust, production-ready connectors that make ClickHouse the natural choice when data practitioners design their next-generation AI and data systems. What you'll do: - Own and evolve ClickHouse's Python connector and SDK ecosystem, raising the bar on performance, reliability, and API design. - Build and maintain integrations with orchestration platforms (Airflow, Dagster, Prefect) and transformation tools (dbt) to enterprise-grade quality standards. - Drive the AI/LLM integration strategy: designing connectors and patterns that make ClickHouse a natural fit in RAG architectures, ML feature pipelines, and LLM-powered data applications. - Engage actively with the open-source community: triage issues, support contributors, advocate for users, and shape the roadmap based on real-world feedback. - Collaborate with Product, Cloud, and other engineering teams to align integration work with broader platform priorities. - Bring a practitioner's perspective to roadmap decisions, grounding prioritization in genuine Data Engineer and Data Scientist workflows. Qualifications - 7+ years of software development experience, including hands-on time as a Data Engineer, Data Scientist, or ML Engineer. - Deep, proven experience designing, building, and maintaining production-grade Python connectors, SDKs, or integrations for at least one major platform (orchestration, BI, MLOps, or data transformation). - Hands-on experience applying AI/ML in production data-engineering contexts: embedding generation, vector search, feature pipelines, or LLM-powered tooling that shipped and ran in production. - Solid experience with the Python data ecosystem: Pandas, NumPy, Pydantic, and related libraries. - Strong database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases. - Solid experience with concurrent Python: threading, multiprocessing, and async patterns. - Outstanding written and verbal communication; comfortable collaborating across engineering functions and with open-source communities. Requirements - Prior experience as a Data Engineer or Data Scientist in a product-facing or platform role. - Familiarity with ClickHouse or similar high-performance OLAP platforms. - Familiarity with the JVM ecosystem. - Experience deploying AI/ML models in production, including inference APIs and vector databases. Benefits - Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. - Healthcare - Employer contributions towards your healthcare. - Equity in the company - Every new team member who joins our company receives stock options. - Time off - Flexible time off in the US, generous entitlement in other countries. - A $500 Home office setup if you’re a remote employee. - Global Gatherings - Opportunities to engage with colleagues at company-wide offsites. - Culture - As part of a rapidly scaling startup, you will be instrumental in shaping our culture.

Northern America + 2 moreAll locations: Northern America | Western Asia (Middle East) | Western Europe

Finance Engineer

Virtuagym

We’re a leading innovator in digital health & fitness SaaS, serving trainers, studios, clubs, and corporate wellness clients worldwide. 175+ people across Amsterdam, Medellín, and a few other locations, 35+ nationalities and one mission: make the world a healthier and happier place. 📈 Many opportunities for personal and professional growth within the company. 😎 A fun, healthy, and international work environment made up of over 35+ nationalities. 🗣 We believe in a flat hierarchy with room to take ownership: your voice will be truly heard. ⚽ Organized Virtuagym sports events throughout the year. 🎉 Awesome company events such as New Year's dinners, summer outings, ski trips, etc.

Data Engineer13 hours ago

Role Description Turn complex financial data into scalable systems that power smarter business decisions. As Virtuagym keeps growing, we are looking for a Finance Engineer to join our Finance Automation and Data team. In this unique role, you will combine data engineering with financial systems expertise to design, optimize, and scale our ERP environment and its integrations with other business-critical tools. You’ll be working with billions of rows of data from thousands of clients, with a special focus on finance operations and automation. You’ll help us build scalable workflows, integrate systems, and develop reporting solutions that drive both financial accuracy and operational efficiency. This is a great opportunity if you’re excited about data engineering challenges but also want to apply your skills to the finance domain, where automation, accuracy, and compliance are key. Join a high performing team and make an impact! We're a passionate, driven team with a strong focus on growth and delivering outstanding results. At Virtuagym, we cultivate a high-performance culture built on dedication, ownership, and driving excellence. If you're a self-starter who embraces challenges, thrives in a fast-paced, dynamic environment, and keeps going where others might stop, this could be the perfect role for you! In return, you’ll join a team where you can grow, develop, and truly unlock your full potential. This is a remote position, where you will be working as part of our Global Finance Automation & Data team. We are looking for somebody on a full-time, part-time, or freelance basis. We are a remote-friendly company, meaning you can work from your home at all times. The location of this role is flexible within the European timezone. Responsibilities - Design, implement, and manage highly scalable financial data workflows. - Connect, transform, and visualize large datasets (ERP, BI, transactional data). - Develop and maintain integrations between NetSuite, Stripe, Salesforce, and other platforms. - Create and optimize reporting and dashboards in close collaboration with Finance and BI teams. - Lead projects end-to-end: gather business requirements, architect solutions, test in sandbox environments, and roll out to production. - Collaborate with product managers, data scientists, and finance analysts to accelerate automation and analytics. - Contribute to shaping the future of Finance Automation at Virtuagym, ensuring scalable, automated, and robust financial systems. Qualifications - Bachelor’s or Master’s degree in Computer Science, Information Systems, Statistics, or Finance/Business with a strong technical affinity. - 1+ years of experience in data engineering, finance systems engineering, or ERP development. - Strong knowledge of SQL and relational databases. - Hands-on programming/scripting skills (Python, Java, SuiteScript, etc.). - Experience with cloud services (AWS, RDS, EC2, etc.). - Finance knowledge: basic understanding of BS, P&L, Cash Flow, reconciliation, FX, etc. - Excellent verbal and written English communication skills. - Strong interest in automation, data-driven solutions, and the future of finance operations. Benefits - 🌎 Remote-friendly working setup, with the flexibility to work from home; - 🌴 Paid vacation days, depending on your location and contract type; - 💻 Home office setup and hardware; - 💪 The Virtuagym Health Program: access to video-on-demand workouts and meditation through the Virtuagym platform, plus company-wide health and fitness challenges; - ✈ Work-from-abroad opportunities, where applicable and in line with local policies; - 💬 Unlimited access to on-demand coaching with psychologists via chat, phone, or video call through OpenUp. Ready to join us? Please do not hesitate to apply by clicking the 'Apply for this Job' button below! We will get back to your application within 10 working days. For any questions on the vacancy, please get in touch with the recruitment team at recruitment@virtuagym.com .

European timezones
Dynatrace logo

Lead Telemetry Pipeline Specialist

Dynatrace

Dynatrace is a global application performance management software firm and a former member of Compuware. As an employer, the company is in support of helping it

Data Engineer16 hours ago
Full TimeRemoteTeam 5,600Since 2005

Your role at DynatraceAbout the Role: Dynatrace is seeking a high-impact Telemetry Pipeline Specialist to serve as the business and technical evangelist for the next generation of data-driven Observability. This is a specialist role focused on the intersection of Bindplane, OpenTelemetry (OTel), and Enterprise Data Governance. You will partner with our Global Sales and Customer Success teams to help organizations navigate the complexities of data explosion in hybrid and AI-native environments, ensuring they achieve high-signal observability while maintaining absolute control over their telemetry costs and routing. Domain Expertise & Solution Leadership - Act as a subject matter expert in log management and observability - Stay current with OpenTelemetry, cloud logging, and pipelines - Lead proof of concepts and demonstrate technical value Competitive Strategy & Value Selling - Execute competitive displacement strategies - Build ROI and economic value cases - Position Dynatrace effectively in enterprise environments Technical Solution Guidance - Advise on telemetry pipelines (OpenTelemetry, Fluentd, Logstash) - Support Kubernetes, serverless, and cloud ecosystems - Optimize data routing and analytics strategies Customer Adoption & Growth - Drive platform adoption and usage - Deliver best practices and technical workshops - Improve consumption and customer outcomes Collaboration & Pipeline Development - Build pipeline through channels, events, and outbound - Collaborate cross-functionally with sales, engineering, and marketing - Maintain CRM accuracy and forecasting discipline What will help you succeedQualifications & Requirements: - Experience: 5+ years in sales or presales roles, with at least 3 years focused on log management, telemetry pipelines, or data streaming environments Domain Expertise: - Deep understanding of telemetry routing and edge processing (Bindplane, Fluent Bit, or similar) - Familiarity with cloud-native ecosystems (AWS, Azure, GCP, Kubernetes) and event streaming platforms (Kafka, Kinesis, Pub/Sub) - Sales Execution: Experience supporting complex enterprise sales cycles and influencing both technical and executive stakeholders; Ability to articulate “Data Gravity” and - “Ingest Economics” and translate them into executive-level value (CIO/CFO) - Competitive Knowledge: Familiarity with observability and pipeline competitors such as Splunk, Datadog, Elastic, or Cribl - Enablement: Ability to scale impact through field enablement, play development, and technical evangelism - Education: Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience Preferred Skills - Experience with Cribl LogStream or Splunk Heavy Forwarders for displacement strategies. - Familiarity with FinOps principles (matching telemetry spend to business value). - Fluent in Portuguese Why you will love being a Dynatracer - Dynatrace is a leader in unified observability and security. - We provide a culture of excellence with competitive compensation packages designed to recognize and reward performance. - Our employees work with the largest cloud providers, including AWS, Microsoft, and Google Cloud, and other leading partners worldwide to create strategic alliances. - You'll get to work at the forefront of innovation with Dynatrace Intelligence—the industry's first agentic operations system. Bringing together deterministic and agentic AI, it helps teams understand what's happening, why it matters, and what to do next— automatically. - Over 50% of the Fortune 100 companies are current customers of Dynatrace. Compensation and RewardsThe base salary range for this role is $128,000 - $160,000. When determining your salary, we consider your experience, skills, education, and work location. Our total compensation package includes unlimited personal time off, an employee stock purchase plan, and a reward system. We also offer medical/dental benefits, and a company matching 401(k) plan for retirement Equal Employment OpportunityDynatrace provides equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other protected characteristic. We actively foster an inclusive workplace that celebrates differences and promotes accessibility, collaboration, and growth for all.

Texas
$128K - $160K / year

Data Specialist Locations:New York, NY / Albany, NY Information Technology Full Time Hybrid Job Description: Data Specialist Employment Type: Full-Time Mid-Level Department: Data Science As a Data Specialist for CGS, you will help our government client in processing data using LAW. The ideal candidate will regularly load large volumes of production data, running exports from the database for creating discovery party productions. Downloading files from our file sharing tool JEFS and performing quality control on load and export files to ensure accuracy is vital to this job position. CGS brings motivated, highly skilled, and creative people together to solve the governments most dynamic problems with cutting-edge technology. To carry out our mission, we are seeking candidates who are excited to contribute to government innovation, appreciate collaboration, and can anticipate the needs of others. Here at CGS, we offer an environment in which our employees feel supported, and we encourage professional growth through various learning opportunities. Skills and attributes for success: - Modify load files and perform quality control on loaded data quickly and accurately - Assist with creating and updating document processing procedures as needed - Run multiple load streams simultaneously - Perform native file processing in LAW - Export data from Relativity to create load files for other various platforms as requested by Case Manager - Performs data conversion processing including conversions of various document types - Perform special format data conversions and file manipulation requests - Handle quality control on load files and Relativity data loads and exports - Perform advanced requests such as creating data exports for productions and performing quality control on files and complicated overlays or appends privilege clawbacks and sequestration of documents - Perform quality control to confirm accuracy on loads completed by new Data Specialists - Provide hands-on training to other Data Specialist as needed - Perform basic Relativity searching and global updates to mark and/or tag records as requested to include confirming record counts in Save Searches and Image redactions prior to creating exports for production - Clearly and accurately discusses data inconsistencies found with Project Manager - Assists on calls relating to data load file formats or media encryption software with Case Manager and other IT individuals as requested Qualifications: - Modify load files and perform quality control on loaded data quickly and accurately - Assist with creating and updating document processing procedures as needed - Run multiple load streams simultaneously - Perform native file processing in LAW - Export data from Relativity to create load files for other various platforms as requested by Case Manager - Performs data conversion processing including conversions of various document types - Perform special format data conversions and file manipulation requests - Handle quality control on load files and Relativity data loads and exports - Perform advanced requests such as creating data exports for productions and performing quality control on files and complicated overlays or appends privilege clawbacks and sequestration of documents - Perform quality control to confirm accuracy on loads completed by new Data Specialists - Provide hands-on training to other Data Specialist as needed - Perform basic Relativity searching and global updates to mark and/or tag records as requested to include confirming record counts in Save Searches and Image redactions prior to creating exports for production - Clearly and accurately discusses data inconsistencies found with Project Manager - Assists on calls relating to data load file formats or media encryption software with Case Manager and other IT individuals as requested Our Commitment Contact Government Services (CGS) strives to simplify and enhance government bureaucracy through the optimization of human, technical, and financial resources. We combine cutting-edge technology with world-class personnel to deliver customized solutions that fit our clients specific needs. We are committed to solving the most challenging and dynamic problems. For the past seven years, weve been growing our government-contracting portfolio and along the way, weve created valuable partnerships by demonstrating a commitment to honesty, professionalism, and quality work. Here at CGS, we value honesty through hard work and self-awareness, professionalism in all we do, and to deliver the best quality to our consumers, mending those relations for years to come. We care about our employees. Therefore, we offer a comprehensive benefits package: - Health - Dental - Vision - Life Insurance - 401k - Flexible Spending Account (Health, Dependent Care, and Commuter) - Paid Time Off and Observance of State/Federal Holidays Contact Government Services LLC is an Equal Opportunity Employer. Applicants will be considered without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.$61,152 - $82,992 a year We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

New York
$61.2K - $83.0K / year