MetroStar logo
MetroStar

Powering Change

Senior Data Engineer I

Data EngineerData EngineerFull TimeRemoteSeniorTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

8 hours ago

Salary

$138K - $156K / year

Seniority

Senior

Bachelor Degree5 yrs expEnglishETLPython

Job Description

Senior Data Engineer I

MetroStar

• Work with AI team members to operationalize data pipelines and ML tasks. • Provide day-to-day support of deploying Python-native ML pipelines and perform data engineering tasks to enable AI/ML capabilities. • Present results to a diverse audience in presentation or report form. • Support architectural leadership, technical support, and advisement services to ensure identity management system technologies are integrated and meeting the appropriate security requirements. • Support leadership who engage with senior level executives at a public facing Federal agency and provide subject matter expertise in security architecture and other key domain areas.

Job Requirements

  • The ability to obtain and maintain a DHS Suitability
  • 5+ years of experience in Data/ML engineering (if school experience is used, at most that would contribute to 4 years of actual experience).
  • Experience with ETL, Data Labeling and Data Prep.
  • Experience designing, implementing, and maintaining data architecture and services to be used for AI/ML. Additionally, operationalizing and maintaining AI/ML models in production.
  • Ability to perform data analytics on program related or system related activities. This will include assessing performance and manual processes implementing methods/algorithms to automate/optimize
  • Bachelor’s degree in Computer Science, Information Technology Management or Engineering, or other comparable degree or experience and the ability to obtain and maintain DHS Suitability.

Benefits

  • Health, dental, and vision insurance
  • 401(k) retirement plan with company match
  • Paid time off (PTO) and holidays
  • Parental Leave and dependent care
  • Flexible work arrangements
  • Professional development opportunities
  • Employee assistance and wellness programs

Related Categories

Related Job Pages

More Data Engineer Jobs

Rush Street Interactive logo

Data Engineer

Rush Street Interactive

BetRivers | PlaySugarHouse | RushBet

Data Engineer8 hours ago
Full TimeRemoteTeam 501-1,000Since 2012H1B No Sponsor

• Maintain and enhance the Snowflake data platform and data pipelines, leveraging AI-assisted development tools to improve efficiency, reliability, and maintainability. • Drive innovation by adopting modern engineering practices, AI-assisted development, and automation to continuously improve the data platform and accelerate delivery. • Design, build, and optimize incremental data integration pipelines with a strong focus on data quality, performance, scalability, and cost efficiency. • Implement and maintain data security controls, support audit and compliance requirements, and monitor platform usage and costs. • Collaborate closely with Engineering, Product, and Operations teams to deliver reliable, scalable data solutions.

Estonia
Weekday (YC W21) logo

Data Architect

Weekday (YC W21)

We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent

Data Engineer11 hours ago
Full TimeRemoteTeam 11-50Since 2021H1B No Sponsor

• Collaborate closely with internal technical teams to deliver multiple data initiatives simultaneously. • Design, develop, and optimize scalable data solutions using Python, Snowflake, and SQL. • Review and maintain high-quality code developed by offshore engineering teams. • Lead technical discussions and translate business requirements into scalable technical solutions. • Work directly with Business and IT stakeholders to gather, refine, and validate requirements. • Build data solutions independently whenever rapid execution is required. • Monitor project progress, identify risks proactively, and communicate updates to leadership. • Ensure project deliverables meet quality, performance, and timeline expectations. • Provide technical guidance and mentor team members to achieve successful project outcomes.

India
Capco logo

Senior Data Engineer

Capco

Capco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries

Data Engineer11 hours ago
Full TimeRemoteTeam 1,001-5,000Since 1998H1B Sponsor

Job Title: Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Role Description Experience : 10-12 Years Job Location : Bangalore/Pune/Hyderabad Notice Period: 0 - 30 days JD: Role : - Key Responsibilities · Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle data processing. · Develop and optimize ETL/ELT workflows for ingesting, transforming, and loading high-volume financial datasets. · Create and maintain robust data models and schema designs aligned to trade lifecycle (front-to-back processing). · Onboard and integrate DTCC data sources, including RTTM and Settlement Web, into a Unified Trade Record (UTR) schema. · Design and implement ingestion frameworks using messaging systems (MQ) and API-based data extraction. · Process and normalize financial messages, including ISO 15022 formats. · Populate and maintain Trade Exceptions databases, ensuring accuracy and consistency of exception workflows. · Collaborate with business stakeholders (operations, reconciliation, settlements teams) to align data structures with business processes. · Optimize SQL Server queries, indexing strategies, and database performance. · Work with AWS cloud-native data services (e.g., S3, EKS (Kubernetes/Docker), RDS) for scalable data solutions. · Ensure data quality, lineage, governance, and observability across pipelines. · Troubleshoot complex data issues and provide analytical insights into trade discrepancies and exceptions. Required Skills & Qualifications · 10+ years of experience in data engineering, with a strong focus on capital markets. · Deep understanding of trade lifecycle (execution, clearing, settlement, reconciliation). · Strong experience with ETL/ELT frameworks and large-scale data processing. · Expertise in data modeling and schema design, particularly for trade and transaction data. · Hands-on experience with DTCC data sources, especially RTTM and Settlement Web. · Strong knowledge of ISO 15022 message formats and financial data standards. · Experience building ingestion frameworks using MQ (e.g., IBM MQ, Kafka) and REST APIs. · Advanced SQL skills with strong experience in SQL Server (performance tuning, indexing, stored procedures). · Experience with AWS cloud-native data platforms and services. · Strong analytical, debugging, and problem-solving skills. Preferred Qualifications · Experience with unified data models such as Unified Trade Record (UTR) and Schema development and Trade Exceptions management experience. · Familiarity with data governance, lineage, and cataloging tools. · Experience with real-time or near-real-time data processing frameworks. · Knowledge of regulatory reporting and compliance requirements in capital markets. · Knowing FIX messages and processing FxML messages will be an add-on experience. · Prior consulting or client-facing experience. Soft Skills · Excellent communication and stakeholder management skills. · Strong attention to detail and data accuracy. · Ability to work independently and in collaborative environments. · Proactive approach to problem-solving and continuous improvement. If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.

India
Capco logo

Data Engineer

Capco

Capco, a Wipro company, is a management & technology consultancy dedicated to the financial services & energy industries

Data Engineer11 hours ago
Full TimeRemoteTeam 1,001-5,000Since 1998H1B Sponsor

Job Title: Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Role Description Experience : 5-8 Years Job Location : Bangalore/Pune/Hyderabad Notice Period: 0 - 30 days JD: Role : - Key Responsibilities · Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle data processing. · Develop and optimize ETL/ELT workflows for ingesting, transforming, and loading high-volume financial datasets. · Create and maintain robust data models and schema designs aligned to trade lifecycle (front-to-back processing). · Onboard and integrate DTCC data sources, including RTTM and Settlement Web, into a Unified Trade Record (UTR) schema. · Design and implement ingestion frameworks using messaging systems (MQ) and API-based data extraction. · Process and normalize financial messages, including ISO 15022 formats. · Populate and maintain Trade Exceptions databases, ensuring accuracy and consistency of exception workflows. · Collaborate with business stakeholders (operations, reconciliation, settlements teams) to align data structures with business processes. · Optimize SQL Server queries, indexing strategies, and database performance. · Work with AWS cloud-native data services (e.g., S3, EKS (Kubernetes/Docker), RDS) for scalable data solutions. · Ensure data quality, lineage, governance, and observability across pipelines. · Troubleshoot complex data issues and provide analytical insights into trade discrepancies and exceptions. Required Skills & Qualifications · 10+ years of experience in data engineering, with a strong focus on capital markets. · Deep understanding of trade lifecycle (execution, clearing, settlement, reconciliation). · Strong experience with ETL/ELT frameworks and large-scale data processing. · Expertise in data modeling and schema design, particularly for trade and transaction data. · Hands-on experience with DTCC data sources, especially RTTM and Settlement Web. · Strong knowledge of ISO 15022 message formats and financial data standards. · Experience building ingestion frameworks using MQ (e.g., IBM MQ, Kafka) and REST APIs. · Advanced SQL skills with strong experience in SQL Server (performance tuning, indexing, stored procedures). · Experience with AWS cloud-native data platforms and services. · Strong analytical, debugging, and problem-solving skills. Preferred Qualifications · Experience with unified data models such as Unified Trade Record (UTR) and Schema development and Trade Exceptions management experience. · Familiarity with data governance, lineage, and cataloging tools. · Experience with real-time or near-real-time data processing frameworks. · Knowledge of regulatory reporting and compliance requirements in capital markets. · Knowing FIX messages and processing FxML messages will be an add-on experience. · Prior consulting or client-facing experience. Soft Skills · Excellent communication and stakeholder management skills. · Strong attention to detail and data accuracy. · Ability to work independently and in collaborative environments. · Proactive approach to problem-solving and continuous improvement. If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.

India