Boomi is the platform for intelligent connectivity and automation. Connect everyone to everything, anywhere.
Senior Data Engineer – Agentic AI Engineering
Location
Colorado + 1 moreAll locations: Colorado | Florida
Posted
3 days ago
Salary
$138.9K - $173.6K / year
Seniority
Senior
Job Description
Senior Data Engineer – Agentic AI Engineering
Boomi
• Architect and build scalable, secure, and observable data infrastructure to power LLM-based agents, multi-agent systems, and tool-using AI workflows. • Design and operate robust batch and real-time data pipelines supporting embeddings, RAG systems, and agent memory frameworks. • Develop and manage vector database solutions to enable low-latency retrieval and contextual intelligence for AI applications. • Build data frameworks for training, evaluation, benchmarking, and continuous improvement of agentic AI systems. • Implement strong data governance, quality controls, lineage tracking, and PII/security compliance across AI data platforms. • Collaborate with AI/ML, platform, and DevOps teams to productionize experimental AI prototypes into enterprise-grade solutions. • Optimize data systems for performance, scalability, reliability, and cost efficiency across cloud environments (AWS, Azure, or GCP).
Job Requirements
- 5+ years of experience building and operating large-scale data platforms as a Data Engineer.
- Strong programming expertise in Python and SQL for developing scalable and efficient data solutions.
- Hands-on experience designing batch and real-time data pipelines, including streaming systems like Kafka or Kinesis.
- Experience with modern data platforms and cloud environments (AWS, Azure, or GCP), including tools like Snowflake.
- Strong understanding of LLM/AI data workflows, including embeddings, RAG pipelines, evaluation datasets, and vector databases (Pinecone, Milvus).
- Experience with DataOps/MLOps tools such as Airflow, dbt, Lavender, and MLflow for orchestration and lifecycle management.
- Strong knowledge of data quality, governance, and security, including PII handling, access controls, lineage, and ensuring data reliability.
Benefits
- An overview of our benefits can be found here.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Serve as the Owner's architectural SME and trusted advisor throughout planning, design, construction, and project execution phases. • Partner with internal stakeholder teams, design consultants, construction management firms, and general contractors to administer design documentation and ensure compliance with Owner standards and project objectives. • Provide technical direction and comprehensive reviews of architectural design packages with a focus on life safety and egress requirements, ADA compliance, signage programs, site planning, and core data center building design. • Develop, maintain, and enhance architectural design standards, campus planning guidelines, and prototype building templates to support consistency and scalability across projects. • Lead technical reviews of consultant deliverables at key design milestones, providing detailed peer-review feedback on Basis of Design (BOD) documents and 30%, 65%, and 100% construction documentation packages.
• Join a small, collaborative team defining questions for user research and experimenting with internal data. • Engage with internal and external users, and be involved in all phases of product development. • Work with Python, Databricks, Postgres, and occasional SQL to develop deep knowledge of the data in our catalogue. • Help set priorities for new data sources and partner with a data scientist and another software engineer for data transformations. • Collaborate closely with platform teams and write requirements docs and proposals.
Senior Software Engineer – Data Modeling
People.aiDrive Revenue Intelligence Across All Your Customer-Facing Teams
• Design, build, and maintain backend services, REST APIs, databases, and big data pipelines that power customer-facing insights and analytics. • Implement and maintain near-real-time stream-based data processing pipelines in collaboration with batch-oriented data refresh workflows. • Develop and evolve a query engine capable of answering complex, cross-deal/account questions and delivering actionable insights for sales managers and executives. • Scale data processing and insights generation pipelines to handle growing volumes of activity data (emails, meetings, transcripts, CRM objects) while managing infrastructure costs. • Collaborate with Engineering and Product teams to translate business and customer needs into robust, well-documented technical solutions. • Follow and promote software development best practices, delivering clean, maintainable, and well-monitored code. • Build internal tooling to enable customer support teams to investigate and resolve support requests in a self-service manner. • Ensure high-quality alerting, dashboards, tracing, and runbooks are in place for all production services.
• Lead technical initiatives for large-scale data modernization and migration. • Define data architectures using Databricks Lakehouse and Microsoft Azure. • Assess legacy environments and determine the best strategy for migrating, refactoring, or decommissioning workloads. • Design modern data pipelines, ETL/ELT processes, and orchestration strategies. • Establish architecture, quality, governance standards, and engineering best practices. • Ensure data quality and consistency throughout the migration process. • Collaborate with architects, Data Engineers, Databricks specialists, and client teams to deliver high-quality outcomes. • Act as the project’s technical reference, supporting architectural decisions and mentoring other engineers. • Contribute to automation initiatives and the use of Artificial Intelligence to accelerate migration processes.




