OTC Markets Group has a rich history dating back to the early 1900's and over the years has gone through several changes making the company what it is today, th
Assistant Vice President, Data Engineer
Location
New York
Posted
26 days ago
Salary
$0 / year
Seniority
Mid Level
Job Description
Assistant Vice President, Data Engineer
OTC Markets Group
Title: AVP, Data Engineer Location: New York, NY OTC Markets Group - New York, NY - Full Time OTC Markets Group Inc., operator of premier US financial marketplaces, is seeking a Data Engineer to join our IT Infrastructure team. We’re looking for a talented and driven Data Engineer to help power our data ecosystem. In this role, you won’t just maintain pipelines — you’ll build the foundation that enables analytics, insights, and informed decision-making across the organization. If you’re passionate about designing scalable data systems, optimizing performance, and turning complex data flows into reliable, high-quality assets, we’d love to talk to you. We invest heavily in employee satisfaction and offer all our employees a highly competitive compensation package. As a dynamic, growing company that fosters an open culture, we emphasize autonomy, responsibility, innovation, and self-discipline. We are looking for someone who wants to make an impressive impact at a company known for its reputation on quality and achievement. Base compensation for this role is up to $150,000.00 annually, depending on experience. In addition, the position is eligible for our discretionary annual bonus program and equity. What You’ll Do: - Design, build, and optimize scalable ETL pipelines that move data from operational systems into our data warehouse and data lake environments - Integrate data from multiple platforms and perform complex transformations, aggregations, and calculations - Design and implement robust data models, schema, tables, views, indexes, and stored procedures - Ensure data integrity, quality, and consistency by embedding validation and monitoring into pipelines - Tune and optimize SQL queries and stored procedures to maximize performance and efficiency - Troubleshoot and resolve production ETL issues as part of a bi-weekly on-call rotation - Partner with cross-functional teams to translate business needs into reliable, high-performing data solutions - Additional responsibilities, as assigned. What We’re Looking For: - 5+ years of hands-on experience building and managing ETL/data pipelines - 5+ years of experience with relational databases (1 or more of: Informix, SQL Server, PostgreSQL, MySQL) - Expertise in schema design, indexing strategies, SQL development, and query performance tuning - Strong scripting skills (Shell, Python) - Experience working with AI coding assistant tools and source code management tools such as GIT - Working knowledge of AWS services such as RDS, Athena, S3 and Glue - Familiarity with columnar databases - Excellent communication skills and the ability to collaborate across technical and non-technical teams - Bachelor’s degree in Computer Science (or related field) and/or relevant certifications What OTC Markets Offers its Team Members (Why You Should Choose Us): Benefits: - Generous Paid Time Off (PTO) - Health, Dental, and Vision Coverage - Health Savings Account (HSA) - Flexible Spending Accounts (FSA) Dependent & Healthcare - Limited Purpose Flexible Spending Account (LPFSA) - Generous Paid Parental Leave Program - Annual bonus and Stock Incentive Program - 401(K) Plan - Retirement - Commuter Transit & Parking Program - Income Protection (Life Insurance, Short- & Long-Term Disability) - Voluntary Benefits (Accident, Critical Illness, & Hospital Indemnity) Perks: - Hybrid Work Schedule - Class Pass Partnership (Fitness & Wellness Programs) - Citi Bike Membership Program - Mondays – Breakfast Bagels & Wednesdays – Pizza Lunch - Office Snacks and Beverages - Monthly birthday celebrations About OTC Markets Group Inc. OTC Markets Group Inc. (OTCQX: OTCM) operates regulated markets for trading 12,000 U.S. and international securities. Our data-driven disclosure standards form the foundation of our public markets: OTCQX® Best Market, OTCQB® Venture Market, OTCID™ Basic Market and Pink Limited™ Market. Our OTC Link® Alternative Trading Systems (ATSs) provide critical market infrastructure that broker-dealers rely on to facilitate trading. Our innovative model offers companies more efficient access to the U.S. financial markets. OTC Link ATS, OTC Link ECN, OTC Link NQB, and MOON ATS™ are each SEC regulated ATS, operated by OTC Link LLC, a FINRA and SEC registered broker-dealer, member SIPC. To learn more about how we create better informed and more efficient markets, visit www.otcmarkets.com. We are an equal opportunity and E-Verify employer and prohibit discrimination and harassment of any kind. All employment decisions are based on business needs, job requirements, and individual qualifications, without regard to race, creed, color, religion, gender, national origin, age, marital status, political belief, physical or mental disability, sexual orientation, military or veteran status, genetic information, family or parental status, gender identity, pregnancy, including childbirth or related medical condition, or any other characteristic protected by federal, state, or local law. We encourage applicants of all ages and backgrounds. Applicants have rights under Federal Law: Equal Employment Opportunity is the Law Polygraph Protection Act FMLA
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Architect
Wavestone Germany AGLet’s power the future together. Vom Business Case bis hin zur Umsetzung: Als führendes Beratungsunternehmen für strategische Transformationen sind wir vertrauenswürdiger Partner für unsere Kunden - und für unsere Mitarbeitenden. Verantwortungsvoll, leistungsstark und immer mit dem Menschen im Fokus. #WeAreWavestone Mit unserem 360°-Portfolio an Beratungsleistungen verbinden wir erstklassige Branchenexpertise mit einem breiten Spektrum an branchenübergreifenden Kompetenzen, arbeiten interdisziplinär und denken über den Tellerrand hinaus. Wir freuen uns über eine Kontaktaufnahme!
Role Description Wir suchen einen erfahrenen Datenarchitekten (m/w/d) für den Aufbau und die Umsetzung unternehmensweiter Datenstrategien sowie die Etablierung von Data-Governance-Modellen und skalierbaren Datenplattformen innerhalb einer modernen IT-Landschaft. - Analyse des Ist-Zustands, Definition von Ziel-Architekturen (Business-, Daten- und Technologielayer) und Ableitung einer langfristigen Roadmap für Datenmanagement und -nutzung - Konzeption, Implementierung und Roll-out von Governance-Modellen, Rollen- und Verantwortlichkeitsmatrix, Richtlinien, Prozesse und KPIs zur Sicherstellung von Datenqualität, -sicherheit und -compliance - Ermittlung und Dokumentation von Daten- und Metadaten-Standards (Naming-Conventions, Datenmodelle, Schnittstellen, Qualitätsmetriken) sowie deren Verbreitung und Schulung im Unternehmen - Auswahl und Integration von Technologien (Data Lake, Data Warehouse, Streaming, Master-Data-Management, Data-Catalog, Cloud-Services) sowie Aufbau von skalierbaren, ausfallsicheren und performant konfigurierten Plattformen - Unterstützung von Projektteams bei der Umsetzung von Data-Science-, Reporting- und Integrationsprojekten, Sicherstellung der Alignment-Zur-Governance-Richtlinien und Durchführung von Architecture-Reviews - Definition von Rollen, Verantwortlichkeiten und Schulungsprogrammen, Coaching von Fachbereichen und IT-Teams sowie Förderung einer datengetriebenen Kultur - Abstimmung von Data-Architecture mit IT Service Management (ITSM), Projekt-Portfolio-Management (PPM) und Demand Management, um konsistente Prozesse und einheitliche Datenservices sicherzustellen Qualifications - Mindestens 8 Jahre Erfahrung im Aufbau und der Steuerung von Data-Architecture-Programmen in mittelständischen bis großen Unternehmen - Nachweisliche Erfolge beim Erarbeiten und Implementieren von Unternehmens-Datenstrategien sowie messbare Verbesserungen bei Datenqualität und -verfügbarkeit - Praktische Erfahrung in der Einführung von Data-Governance-Frameworks sowie der Definition von Rollen und Umsetzung von Governance-Prozessen - Tiefgehendes technisches Wissen zur Architektur von Data Lakes, Data Warehouses und Master-Data-Management-Lösungen (z. B. Snowflake, Azure Synapse, Google BigQuery, Kafka, Delta Lake) - Expertise in der Integration von modernen Datenplattformen in hybride Cloud-Umgebungen - Erfahrung im Erarbeiten von Daten- und Metadaten-Standards, Naming-Conventions und Data-Quality-Regeln sowie in der konzeptionellen, logischen und physischen Datenmodellierung - Fundierte Kenntnisse in TOGAF (ADM-Phasen) und DAMA-DMBOK sowie deren Anwendung auf Datenarchitektur - Expertise in regulatorischen Anforderungen wie DSGVO/GDPR, CCPA und ISO 27001-Relevanz für Daten - Erfahrung mit Datenmanagement-Tools wie Collibra, Alation, Informatica, Talend, dbt, Apache Airflow, Power BI oder Tableau - Erfahrung in der Gestaltung von APIs, Event-Driven-Architekturen, ETL/ELT-Pipelines und Data-Ops-Methoden - Fähigkeit zur Begleitung von Daten- und BI-Projekten sowie zur Durchführung technischer Architektur-Reviews zur Standardsicherung - Ausgeprägte Fähigkeiten im Change- und Stakeholder-Management sowie im Coaching von Fachbereichen und IT-Teams - Fähigkeit zur Analyse datenbasierter Business-Herausforderungen und Entwicklung von Lösungskonzepten mit quantifizierbarem Geschäftsnutzen - Sehr gute Deutsch- und Englischkenntnisse in Wort und Schrift Company Description Let’s power the future together. Vom Business Case bis hin zur Umsetzung: Als führendes Beratungsunternehmen für strategische Transformationen sind wir vertrauenswürdiger Partner für unsere Kunden - und für unsere Mitarbeitenden. Verantwortungsvoll, leistungsstark und immer mit dem Menschen im Fokus. #WeAreWavestone Mit unserem 360°-Portfolio an Beratungsleistungen verbinden wir erstklassige Branchenexpertise mit einem breiten Spektrum an branchenübergreifenden Kompetenzen, arbeiten interdisziplinär und denken über den Tellerrand hinaus. Unseren Partnerunternehmen und Freelancern können wir so umfassende Perspektiven innerhalb unserer eigenen Projekte bieten und unterstützen als langjähriger Rahmenvertragspartner bei der Besetzung von Projektvakanzen – zeitnah und direkt. Wir freuen uns auf Ihre Kontaktaufnahme!
• Own the infrastructure that turns raw events from millions of mobile users into trustworthy data the business runs on. • Design and scale the pipelines, warehouses, and tooling. • Work side-by-side with analytics, product, and growth teams. • Design, build, and maintain scalable data architecture. • Own ingestion, transformation, storage, and modelling. • Write clean, efficient Python to power reliable pipelines. • Lead our dbt project on BigQuery. • Partner with analytics to ship Metabase dashboards. • Set the bar for what 'trustworthy data' means here.
Title: Data Engineer Location: Crystal City, VA Full Time Mid Level INTEGRITYOne Partners Data Engineer: Mid-Level Location: Hybrid – 1-2 days per week on-site in Crystal City, VA The Role As a mid-level Data Engineer, you'll be at the forefront of delivering software solutions that directly impact our clients' law enforcement mission. You'll work with dedicated team members and clients to solve complex technical problems and develop systems that keep our country safe and secure. About Us INTEGRITYOne Partners specializes in IT modernization and business transformation for Federal clients. We tackle big problems with missions that positively impact our country's health, safety, and security. Our team of dedicated consultants and technologists thrives on learning new technologies, frameworks, and methodologies. With decades of experience, we pride ourselves on building outstanding and sustainable software products and systems. Ideal Candidate Profile - Demonstrates intellectual curiosity and a passion for continuous learning - Thrives in a collaborative, fast-paced environment - Shows adaptability and resilience in the face of complex challenges - Exhibits strong problem-solving skills and attention to detail - Possesses excellent communication and interpersonal skills Technical Skills Required - Python - Java - Microservices (REST/SOAP/GraphQL) - JSON and JSON format mediation techniques - AWS Managed Services for back-end infrastructure (S3, RDS, EC2, Lambda) - High-volume ETL solutions - LINUX (RHEL preferred), shell scripting - Relational database knowledge in Oracle or Postgres, Strong SQL Knowledge - DevSecOps tools and techniques (Jenkins, Ansible, Terraform, Vault) Key Responsibilities - Collaborate with cross-functional teams to deliver results over 2-week sprints - Gather requirements, design, implement, and test software and systems - Develop scalable, high-performance, and highly available applications and systems components - Diagnose and resolve complex system issues - Communicate effectively with clients, team members, and other development teams - Respond to client requirements in tight timeframes, demonstrating flexibility in work location and hours Requirements - US Citizenship (ability to obtain and maintain a DHS 6C Public Trust clearance) - Bachelor's degree or higher (computer science background recommended but not required with suitable experience) - Ability to work on-site in Crystal City, Virginia, 1-2 days per week Experience - 4-6 years of experience in Agile software development - Proven track record in designing and developing scalable applications - Experience working in government or high-security environments is a plus Career Development At INTEGRITYOne Partners, we reward hard work and outstanding results. We offer: - Mentorship programs - Ongoing training and certification opportunities - Clear path for advancement within the organization - Exposure to cutting-edge technologies and high-impact projects - Competitive raises, bonuses, and promotions Ready to Make a Difference? If you're passionate about technology, driven by innovation, and want to contribute to national security, we want to hear from you. Apply now and join our team of dedicated professionals shaping the future of federal IT solutions. Interviewing Tips From researching to preparing for your interview and putting your best foot forward, we want you to be prepared and confident as you explore opportunities with INTEGRITYOne Partners. Check out interviewing tips from our recruiters. At INTEGRITYOne Partners, we have high standards for the members of our team ---- and when our people meet these standards, the personal and professional rewards are plentiful. We help INTEGRITYOne Partners’ employees grow in their careers by gaining enhanced Federal knowledge and experience, sought-after skills, greater discipline and drive, and targeted education and training INTEGRITYOne Partners is an equal opportunity employer Minorities / Females / Veterans / Disabilities. All qualified applicants will be considered without regard to race, ethnicity, color, national origin, religion, sexual orientation, gender identity, veteran status, or status as a qualified individual with a disability or any other personal characteristic protected by law.
Data Engineer III
itD TechAbout itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client. You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints. The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow!
Role Description itD is seeking a Data Engineer to support a high-impact enterprise data migration initiative focused on transitioning business-critical operations from Salesforce to an internal entity-modeled data platform. This role will contribute directly to the success of Meta’s Developer Ecosystem Success organization by building scalable ETL pipelines, designing data architectures, and ensuring reliable, AI-ready data infrastructure across distributed systems. - Design and build bidirectional ETL/ELT data pipelines between Salesforce, distributed data warehouses, and internal operational data platforms. - Develop and maintain streaming data pipelines using Kafka, Kinesis, Pulsar, or equivalent distributed event-streaming systems. - Design and manage dimensional and entity-modeled schemas, including access permissions and mutation rules. - Build data validation, reconciliation, and monitoring frameworks to ensure data quality, consistency, and auditability throughout migration activities. - Develop and maintain schema documentation, transformation logic, data dictionaries, and source-to-target mapping documentation. - Collaborate with software engineers, Salesforce administrators, and business stakeholders to define data contracts, SLAs, and migration requirements. - Investigate and resolve data quality issues, pipeline failures, and reconciliation discrepancies across batch and streaming workloads. - Utilize AI-assisted development tools such as GitHub Copilot, Cursor, and Claude Code to accelerate development workflows and schema migrations. - Support data restructuring and transformation initiatives to prepare datasets for downstream AI and analytics applications. Qualifications - 5+ years of professional data engineering experience. - Strong proficiency in SQL and relational databases such as MySQL. - Experience with Hack/PHP development and GraphQL. - Hands-on experience building and maintaining large-scale ETL/ELT pipelines in distributed data warehouse environments such as Hive, Spark, Presto/Trino, BigQuery, Snowflake, or Databricks. - Experience with real-time event-streaming systems including Kafka, Pulsar, Kinesis, or equivalent technologies. - Experience with ORM frameworks and entity/schema modeling. - Strong understanding of data quality engineering, validation, reconciliation, and monitoring frameworks. - Experience using AI-assisted coding tools such as GitHub Copilot, Claude Code, or Cursor within development workflows. - Strong troubleshooting, problem-solving, and communication skills with the ability to work independently. Requirements - Experience with Salesforce data migrations and integrations. - Familiarity with AI-ready data architecture and AI development workflows. - Experience supporting event and subscription handling systems. - Prior experience working within large-scale technology or distributed systems environments. - Experience collaborating with cross-functional engineering and business operations teams. Education - Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field required. Benefits - Comprehensive medical benefits. - 401k plan. - Paid holidays. - Networking & career learning and development programs. Company Description About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries.
