Marvik logo
Marvik

We are a hands-on AI consulting firm

Lead Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200Since 2018H1B No SponsorCompany SiteLinkedIn

Location

Latin America

Posted

1 day ago

Salary

0

Seniority

Senior

Bachelor Degree10 yrs expEnglishMongoDBPostgreSQL

Job Description

Lead Data Engineer

Marvik

• Partner with the CTO and leadership to set the Intelligence strategy and roadmap; own the execution. • Build, hire, and develop the Intelligence team — set the bar for craft, shape the operating cadence, and build the collaboration patterns with product, platform, and engineering. • Stand up the canonical data substrate: schema discipline, tenancy isolation, data contracts, lineage, and governance that AI/ML workloads run cleanly against. • Stand up the ML and AI platform: model lifecycle, feature store, vector store, training and serving infrastructure, and MLOps practice. • Lead the learning and reasoning capabilities of the platform: RAG architectures, agentic data systems, knowledge graphs, and the patterns that let Stratus's data compound into platform intelligence. • Develop and drive evaluation frameworks measuring model quality, agent reliability, drift, and platform effectiveness — make AI workloads observable to engineering, product, and customer success. • Drive the build-vs-buy posture for the AI/ML stack; set production readiness standards for AI workloads in close collaboration with the platform team. • Partner with product on the AI use case portfolio; engage directly with customers when needed to ground Intelligence decisions in real workflow problems.

Job Requirements

  • 10+ years of professional experience in AI/ML, data engineering, or data science, with 4+ years in formal leadership roles (Senior Manager, Director, or Head of) at a B2B SaaS or AI/ML platform company.
  • Demonstrated track record of building and leading AI/ML or data teams of 5–15 people, with a strong hiring track record in the AI/ML market within the last two to three years.
  • Deep technical credibility across the modern AI/ML stack: data platforms (Postgres, pgvector, MongoDB or equivalent), ML platforms (training, serving, MLOps), and generative AI (LLMs, embeddings, RAG, fine-tuning, evals).
  • Experience shipping production ML and AI workloads to enterprise customers with the trust patterns that come with it: evals, observability, drift detection, confidence scoring.
  • Excellent communication across all audiences — engineers, product, executives, and customers; strong cross-functional partnership instincts with product, engineering, and customer-facing teams.

Benefits

  • Projects ranging from massive batch processing to real-time streaming and event-driven architectures.
  • Exposure to the cutting edge of AI Engineering: integrating Vector Databases and preparing unstructured data (text, images).
  • Opportunity to work with top-tier open-source orchestration and processing tools (Airflow, Spark, Kafka).
  • A culture of continuous learning

Related Categories

Related Job Pages

More Data Engineer Jobs

Peraton Corporation logo

Data Scientist / ML Platform Engineer

Peraton Corporation

Peraton Corporation, a national security company headquartered in Herndon, Virginia, supplies solutions for mission-critical programs and systems. Founded in 20

Data Engineer2 days ago

Role Description We are looking for a Data Scientist / ML Platform Engineer to contribute across the full ML development lifecycle — from model building and experimentation to production deployment and monitoring. Core responsibilities are in applied data science and MLOps, with secondary contributions to data engineering and light platform operations. This role works within established platform patterns alongside dedicated infrastructure engineers, without requiring their involvement for routine ML and data tasks. All work is performed in a HIPAA-governed, FedRAMP-compliant healthcare analytics environment. - Develop, train, and evaluate ML models (classification, regression, clustering, anomaly detection) and contribute to LLM-based capabilities such as RAG pipelines and prompt evaluation. - Support model governance and deployment practices using MLFlow, including experiment tracking, model versioning, registry promotion workflows, and automated testing across the ML lifecycle. - Contribute to production ML operations: model performance monitoring, drift detection, automated alerting, and incident escalation to maintain reliability and SLA compliance. - Build and improve model serving infrastructure, feature pipelines, and lifecycle automation to support reproducible, scalable model development and inference. - Apply explainability techniques (e.g., SHAP, LIME) and produce technical documentation to support stakeholder transparency and compliance requirements. - Contribute to data ingestion, ELT/ETL transformation, and pipeline reliability using Spark and SQL-based frameworks within Snowflake and Databricks environments. - Support pipeline orchestration, medallion architecture conventions, and data stewardship practices (metadata management, PII handling, lineage tracking in Unity Catalog). - Perform occasional system administration tasks in collaboration with platform teams, including environment configuration, access management, compute troubleshooting, and secrets handling using platform-native tools. Qualifications - Associate's with 6 years, or Bachelor's degree with 4+ years of relevant experience, or Master's degree with 2+ years of relevant experience or High School diploma with 8 years of experience in lieu of a degree. - Demonstrated experience with SQL and Python, including Python-based ML frameworks (e.g., scikit-learn, XGBoost, PyTorch, or TensorFlow). - Hands-on experience with MLFlow or equivalent tools for experiment tracking, model governance, and lifecycle management. - Strong understanding of SDLC fundamentals and experience with GitHub or equivalent version control. - Experience with distributed compute environments (e.g., Spark, Databricks) and cloud-native services. - Basic proficiency with Bash or shell scripting for automation and environment setup. - Ability to collaborate across multidisciplinary teams and communicate technical concepts to varied audiences. - Ability to obtain and maintain a Public Trust clearance. - US citizenship required or Green Card holder and must have been in the USA for 3 of the last 5 years. Requirements - Experience with MLOps practices including CI/CD for ML, containerization, feature pipeline automation, and model deployment frameworks. - Experience with Databricks E2 components (Unity Catalog, Feature Store, Delta Live Tables) and/or model serving and drift monitoring tools (e.g., Databricks Model Serving, Evidenly, etc.). - Experience with LLM frameworks (e.g., LangChain, LlamaIndex, Hugging Face Transformers) and familiarity with model explainability libraries (e.g., SHAP, LIME). - Advanced Spark performance optimization experience and/or API development using Databricks REST APIs. - Experience with healthcare analytics data (preferably Medicare or Medicaid) and familiarity with HIPAA or FedRAMP compliance constraints. - Experience building data pipelines in a Snowflake or Databricks environment. - Familiarity with orchestration tools (Airflow, Databricks Workflows). - Exposure to streaming data patterns using Spark Structured Streaming, Delta Live Tables, or Kafka. - Familiarity with environment reproducibility tooling (Docker, conda) and scripting (Python, Bash) to support automation and CI/CD tasks. Benefits - Target Salary Range: $80,000 - $128,000. This represents the typical salary range for this position. - Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. - Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay. Company Description Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers.

United States
$80K - $128K / year
Sigma Software Group logo

Senior Data Engineer

Sigma Software Group

We support enterprises, product houses, and startups with custom software solutions development and IT consulting.

Data Engineer2 days ago
Full TimeRemoteTeam 1,001-5,000Since 2002H1B No Sponsor

• Design, build, and evolve Data Warehouses, Data Marts, and enterprise data models to support analytics and business decision-making • Design, implement, and optimize scalable ELT pipelines and data processing solutions, ensuring reliability, performance, and maintainability • Drive technical decisions related to data architecture, platform evolution, data modeling approaches, and integration patterns • Establish and maintain data governance practices, metadata standards, data lineage, security controls, and access management policies • Ensure data quality, observability, monitoring, and operational excellence across the data platform • Evaluate and introduce technologies, tools, and best practices that improve platform scalability, efficiency, and maintainability • Support and enhance self-service analytics capabilities through Apache Superset and other BI solutions • Collaborate closely with BI Engineers, Business Analysts, and business stakeholders to align data platform capabilities with organizational goals • Mentor Data Engineers, conduct technical reviews, and promote engineering best practices across the team • Apply AI-assisted engineering practices to improve development efficiency, delivery quality, and platform sustainability

Ukraine

Title: Senior Data Engineer Location: Atlanta, Georgia, United States Job Description: Who are we? Optimized Payments is the only fintech firm purpose-built to find and unlock value wherever it resides in our portfolio’s payment ecosystem. We’ve assembled a team with deep expertise across payments specialties to develop a proprietary analytics platform that finds actionable insights. We are an Atlanta based 17-year-old, and growing, company looking for talented individuals who want to grow with us. Our client portfolio includes Fortune 500 firms such as Apple, Staples, Safeway, Priceline, AutoNation, and the U.S. Postal Service. - Deliver robust, secure, and scalable data solutions for credit card payments industry. - Assess merchants’ reporting needs and database infrastructure requirements. - Develop and maintain automation systems through scalable, API-driven, cloud-native microservices integrated with enterprise-grade monitoring and infrastructure management. - Automate data ingestion, transformation, and export workflows and integrate with client delivery systems. - Implement batch processing solutions to handle large volumes of data efficiently. - Participate in code reviews and ensure adherence to best practices. - Troubleshoot, debug, and resolve issues in a timely manner. Requirements: - Position requires a Master of Science degree in software engineering or systems & software, and a minimum of 18 months of experience as software or data engineer developing secure data workflows and reporting solutions for the payments industry. - Experience must include 18 months of backend development using Java and Spring Boot, automation on MS Azure platforms, Docker, Kubernetes and data optimizations using Snowflake and PostgreSQL. What we offer: For Full-time Optimized Payments employees, we’re offering the following benefits and perks - Competitive salary and benefits package. - Stock Options - 401(K) Plan - Generous PTO + Paid Holidays - Opportunity to be part of a dynamic, fast-growing company that will double in size in two years. - Hybrid work environment with flexibility to work from home 3 days a week. - A collaborative and inclusive company culture where your ideas are valued. - Free onsite covered parking and access to a full gym with showers. Employment Equity Optimized Payments strongly supports equal employment opportunity for all applicants regardless of race, color, religion, sex, gender identity, pregnancy, national origin, ancestry, citizenship, age, marital status, physical disability, mental disability, medical condition, sexual orientation, genetic information, or any other characteristic protected by provincial and/or federal law. Accommodations for candidates with disabilities are available on request during all aspects of the recruitment and selection process. If accommodation is needed during the recruitment and selection process, please contact us and we will work with you to meet your accessibility needs.

Georgia
Raymond James logo

Principal Engineer, Data Engineering

Raymond James

Raymond James is a diversified financial services holding company that was founded in 1962. The company provides financial services to corporations, municipalit

Data Engineer2 days ago

Title: Principal Engineer, Data Engineering Location: FL - Saint Petersburg - 880 Carillon Pkwy Tower 1 Job Description: Job Description Summary We are seeking a highly experienced and visionary Principal Engineer to provide technical leadership and drive architectural excellence across our enterprise data platforms. This role requires deep expertise in Python, Oracle database development, CI/CD, Kubernetes, and large-scale data systems, along with the ability to influence cross-functional teams and shape long-term engineering strategy. As a Principal Engineer, you will act as a technical authority and thought leader, responsible for defining architecture standards, driving innovation, ensuring scalability and performance, and mentoring engineering teams. You will partner closely with leadership, product, and operations teams to deliver strategic solutions aligned with enterprise goals. Job Description This position follows a hybrid work model, with an expectation to be in the office 3 days per week at the St. Petersburg, FL Corporate Office location. Please note: This role is not eligible for Work Visa sponsorship, either currently or in the future. Responsibilities Technical Strategy & Architecture - Define and drive enterprise-level architecture for data platforms, ensuring scalability, reliability, and performance. - Establish engineering standards, design patterns, and best practices across teams. - Lead system design for complex, high-impact initiatives across multiple domains. Engineering Leadership - Provide technical leadership across multiple teams, not limited to a single project or squad. - Act as a trusted advisor to leadership on technology strategy, trade-offs, and long-term platform evolution. - Drive alignment across engineering, data, and platform teams to ensure consistency and reusability. Solution Design & Development - Lead the design and development of enterprise-grade Python applications and distributed systems. - Oversee architecture and implementation of data pipelines, APIs, and large-scale data processing frameworks. - Ensure solutions are designed with high availability, fault tolerance, and observability. Data & Database Engineering - Define and enforce data architecture standards for Oracle and other data platforms. - Lead advanced database optimization strategies, including performance tuning, partitioning, and query optimization. - Ensure efficient data modeling, storage, and access patterns across platforms. CI/CD & Platform Engineering - Architect and standardize CI/CD pipelines using Jenkins and modern DevOps practices. - Drive adoption of automation-first principles across build, test, and deployment workflows. - Promote DevSecOps best practices and governance controls. Cloud & Containerization - Lead adoption and architecture for Kubernetes-based platforms and containerized applications. - Influence cloud strategy across AWS/Azure/GCP environments (where applicable). - Drive platform modernization and cost optimization initiatives. Performance, Reliability & Scalability - Establish frameworks for performance engineering, monitoring, and SLO/SLI definition. - Lead root cause analysis of critical production issues and define systemic improvements. - Ensure systems meet enterprise-grade resiliency and recovery requirements. Mentorship & Talent Development - Mentor senior engineers and leads, raising the overall technical bar of the organization. - Drive knowledge sharing, standards adoption, and engineering excellence initiatives. - Serve as a role model for engineering best practices and problem-solving. Cross-Functional Influence - Collaborate with product, architecture, data governance, and operations teams. - Contribute to enterprise-wide initiatives such as data governance, platform modernization, and integration strategies. - Influence prioritization and decision-making at the program and portfolio level. Documentation & Governance - Define standards for technical documentation, architecture reviews, and design governance. - Ensure compliance with enterprise policies, data governance, and security standards. Technical Skills - Expert-level proficiency in Python, Oracle database development, and distributed systems design - Deep expertise in CI/CD (Jenkins), Kubernetes, and containerization - Strong experience with data engineering, large-scale data processing, and data pipelines - Advanced knowledge of database performance optimization and data modeling - Strong understanding of cloud platforms (AWS/Azure/GCP) and modern architecture patterns - Experience in enterprise architecture, system integration, and platform engineering Leadership & Behavioral Competencies - Strategic thinker with ability to connect technical decisions to business outcomes - Strong influence skills across teams without direct authority - Exceptional problem-solving and system-level thinking - Excellent communication skills, including ability to engage with senior leadership and stakeholders Preferred Qualifications - Experience in Agile/Scrum at scale (SAFe or similar frameworks) - Background in enterprise data platforms, data governance, or financial systems - Relevant certifications in cloud, Kubernetes, database technologies, or DevOps tools Education Bachelor’s: Business Administration, Bachelor’s: Computer and Information Science (Required), Bachelor’s: Computer Engineering Work Experience General Experience - More than 15 years Certifications Travel Less than 25% Workstyle Hybrid The total compensation for this position includes base salary orwages, and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions. This position is eligible for a benefits package that may include medical, dental, and vision; life insurance; critical illness insurance and accident insurance; disability benefits; retirement savings; paid time off (including vacation, holidays, and sick leave); and parental leave. Eligibility for benefits and specific offerings may vary based on position and employment status. To view more details of the benefits offered, visit Myrjbenefits.com. At Raymond James our associates use five guiding behaviors (Develop, Collaborate, Decide, Deliver, Improve) to deliver on the firm's core values of client-first, integrity, independence and a conservative, long-term view. We expect our associates at all levels to: • Grow professionally and inspire others to do the same • Work with and through others to achieve desired outcomes • Make prompt, pragmatic choices and act with the client in mind • Take ownership and hold themselves and others accountable for delivering results that matter • Contribute to the continuous evolution of the firm At Raymond James – as part of our people-first culture, we honor, value, and respect the uniqueness, experiences, and backgrounds of all of our Associates. When associates bring their best authentic selves, our organization, clients, and communities thrive. The Company is an equal opportunity employer and makes all employment decisions on the basis of merit and business needs. #LI-SA1

Florida