We are a staffing and IT recruitment company based in Sofia, Bulgaria.
Senior Data Engineer, GCP, AI Platform
Location
United States
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer, GCP, AI Platform
nDeavour Consulting
• Build the Analytics Platform (Greenfield): Design and build our first analytical data platform on GCP (warehouse, ingestion, transformation, and orchestration). • Construct Data Pipelines: Build reliable ELT/CDC pipelines from production Postgres and .NET/C# services using GCP-native tooling (Datastream, Dataflow, Pub/Sub) and dbt for transformation. • Establish Orchestration & CI/CD: Set up workflows using Cloud Composer/Airflow or Dagster, alongside data CI/CD environments and automated testing. • Model Data for AI & Analytics: Create dimensional models and a documented semantic/metrics layer to serve dashboards, data analysts, and internal Claude agents with unified definitions. • Develop the AI Data Layer: Build and maintain the retrieval substrate, embeddings pipelines, and vector storage (RAG data plumbing) to keep internal and external agents grounded in fresh data. • Own Governance & Compliance: Implement data validation, lineage, observability, and PII controls appropriate for sensitive financial, donor, payments, and cross-border tax data. • Collaborate Across Teams: Partner with the AI Systems Engineer and the .NET backend team to instrument product events and ship customer-facing insights.
Job Requirements
- 6+ years of Data Engineering experience, including at least one greenfield warehouse/platform build you owned end-to-end.
- Expert SQL and deep PostgreSQL experience, alongside strong experience with cloud data warehouses (BigQuery is ideal).
- Strong ELT/ETL design using dbt and a modern orchestrator (Airflow/Cloud Composer or Dagster).
- Hands-on with the GCP data stack (BigQuery, Datastream, Dataflow, Pub/Sub, Cloud Storage).
- Proficient in Python for building data pipelines and custom tooling.
- Demonstrable LLM/AI data experience: Embeddings pipelines, vector stores (e.g., pgvector, Vertex AI Vector Search, Pinecone), RAG plumbing, or feature stores feeding production ML/LLM systems.
- Strong grasp of data quality, lineage, observability, and PII data governance.
Benefits
- Remote or Hybrid Work Options
- Private Health Insurance, including dental care
- Additional Holidays after your 1st and 5th year
- Sponsored Training & Certifications
- Employee Referral Bonuses
- Multisport Card – fully covered
- Fun Office Space with relaxation zones and free parking
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
Senior Platform Engineer
SHOP APOTHEKE EUROPEWe are now Redcare Pharmacy - follow our new channel under @redcarepharmacy to stay up-to-date.
• Design, build and maintain platform infrastructure using Infrastructure as Code (IaC) principles with tools such as Terraform. • Develop memory services, vector storage patterns, and semantic search capabilities. • Design secure access patterns for agents to governed enterprise data, including Databricks, and integrate guardrails for allowed tools and data sources. • Operate and evolve a Kubernetes-based platform for the Data & AI department, enabling deployment, management, and scaling of services following GitOps practices. • Build observability capabilities covering agent execution, performance, reliability, cost signals, and operational health. • Collaborate closely with other engineering, DevOps/MLOps, SRE, security, and product teams to define platform standards and improve developer self-service. • Participate in architecture discussions, propose improvements, and drive adoption of platform engineering best practices. • Stay current with emerging technologies in the cloud-native, AI platform, and agentic AI ecosystem to continuously improve the platform.
Collibra Platform Developer, Mid to Senior
Arch Global Services (Philippines) Inc.People are our Greatest Asset
• Responsible for the configuration, development, and optimization of the Collibra platform • Configure and maintain the Collibra platform, including asset types, domains, communities, and relationships • Embed the enterprise data governance operating model into Collibra • Translate governance and data management processes into platform capabilities • Integrate Collibra with enterprise systems and data platforms • Deliver platform enhancements through Agile sprints
Principal Platform Engineer
ASRC FederalASRC Federal, a wholly owned subsidiary of Alaska’s largest Alaskan-owned and operated company, the Arctic Slope Regional Corporation (ASRC), is a leading pro
Role Description We are seeking a highly motivated Principal Platform Engineer in Moorestown, NJ. As a Principal Platform Engineer, you will evolve secure, automated platforms powering an upstream Kubernetes-based virtual development environment that enables teams to deliver software using industry best practices. Solutions must deploy across air-gapped on-prem, secure private networks, commercial cloud, and regulated cloud environments using portable, repeatable, self-hosted automation (no SaaS). - Engineer and sustain upstream (vanilla) Kubernetes environments that enable reliable, repeatable software delivery environments. - Python scripting and Helm-based Kubernetes packaging to automate platform workflows and deployments. - Engineer secure-by-default Kubernetes platform capabilities, embedding security controls into automation, delivery workflows, and operational practices. - Translate platform capabilities into repeatable PaaS services that accelerate internal delivery and enable customer-targeted outcomes. - Operate container runtimes (Docker/Podman) and containerization to support CI/CD execution and cloud-native tooling deployments. - Develop secure end-to-end CI/CD pipelines and provide organization-wide CI/CD tooling expertise, guidance, and support. - Implement Kubernetes observability (logs, metrics, traces) and embed it into GitOps-driven automation to validate deployments, detect regressions, and accelerate incident response. - Partner with development and infrastructure teams to automate deployments and release validation, applying best practices in delivery, testing, security, performance, and disaster recovery. - Evaluate and adopt cloud-native OSS/COTS tools to meet platform needs, enable teams through knowledge transfer, and integrate new capabilities into standard workflows. Qualifications - Bachelor’s degree or higher (in Engineering, Computer Science, Math, Physics, or related field) or equivalent related work experience. - This position requires the ability to obtain and maintain a government secret clearance; U.S. Citizenship is required. - This position requires the successful applicant to obtain and maintain the required security clearance or other authorization(s) within the necessary timeframe required by applicable contract(s). - Minimum of 8 years of professional experience in Sr DevOps, Platform Development, Sr Software Engineering or Sr Systems Administration in both on-prem, air-gapped and cloud-based environments. - Understanding of core web technologies, including HTTPS, TLS/SSL, HTML, CSS, JavaScript, JSON, and common delivery components. - Experience with automation or development in C++, Rust or equivalent. Requirements - Competitive pay and benefits packages. - Benefits offered may include health care, dental, vision, life insurance; 401(k); education assistance; paid time off including PTO, holidays, and any other paid leave required by law. - The salary offered will depend on several factors including, but not limited to, relevant experience, skills, education, geographic location, internal equity, business needs, and other factors permitted by law. - Posted pay ranges are a general guideline only and are not a guarantee of compensation or salary. EEO Statement ASRC Federal and its Subsidiaries are Equal Opportunity employers. All qualified applicants will receive consideration for employment without regard to race, gender, color, age, sexual orientation, gender identification, national origin, religion, marital status, ancestry, citizenship, disability, protected veteran status, or any other factor prohibited by applicable law.
Role Description In this role, you will: - Build core capabilities for our SaaS Platform across multiple clouds - Drive development of functional enhancements for Data Discovery, Observability & Governance for both OSS and SaaS offering - Lead efforts around non-functional aspects like performance, scalability, reliability - Lead and mentor junior engineers - Work closely with PM, Customers and OSS community Qualifications - Over 8+ years of experience building and scaling backend systems, preferably in cloud-first or SaaS environments. - Solve complex technical and system design problems. - Strong software engineering fundamentals, with deep experience in designing distributed systems, APIs. - You are proficient in Java, and you write clean, well-documented code that stands the test of time. - Proficient in deploying and operating services on cloud platforms. - Experienced with CI/CD pipelines, version control workflows, and production-grade system monitoring. - You have a bias for action, comfort with ambiguity, and a track record of leading complex projects from design to production. - Build and drive observability, improvements and cost optimization. - Bonus: Exposure to the modern data stack or experience in metadata, governance, or AI-enhanced platforms. Benefits - Competitive compensation - Equity for everyone - Remote Work - Location flexibility - Comprehensive health coverage - Flexible savings accounts - Support for every path to parenthood - Time off that works for you


