Founded in 1991, Agiloft is a computer software company that serves more than 3 million users from diverse organizations, including startups, U.S. government agencies, small enterp
AI Data Platform Lead
Location
Canada
Posted
29 days ago
Salary
0
Seniority
Senior
Job Description
AI Data Platform Lead
Agiloft
• Own the end-to-end data architecture for the Data Warehouse Foundation, designing for AI-first consumption across GPT assistants, AI agents, predictive models, and operational intelligence — in addition to BI and reporting. • Lead data modeling across all 11 departments, designing canonical enterprise data models that serve cross-functional AI and analytics use cases without duplication or fragmentation. • Design and implement the contextual intelligence layer — including RAG architecture, vector store strategy, knowledge base ingestion pipelines, and document and unstructured data processing — that powers Agiloft's enterprise knowledge system. • Build and maintain the agentic data integration layer: real-time and near-real-time data access patterns, agent memory and state persistence design, orchestration data requirements, and agent output integration back into the warehouse. • Own the AI/ML feature layer — feature engineering strategy and standards, training data pipeline design, feature store architecture, and model output integration — enabling predictive analytics across churn, pipeline health, and operational forecasting. • Design and govern the operational data and GPT context layer, including structured context feed design for GPT assistants, data freshness and access SLAs for AI use cases, and cross-departmental data reuse standards. • Lead the Data Warehouse Foundation build in partnership with the external consulting team — setting architecture standards, reviewing implementation against AI-first principles, and ensuring the five-wave build plan delivers a foundation that serves the full intelligence architecture. • Design and manage data ingestion, ELT/ETL, and orchestration pipelines across all source systems, ensuring reliability, performance, and cost efficiency. • Establish and enforce AI data engineering standards across the organization — prompt-adjacent data design, agent data access patterns, reusable pipeline components, and quality assurance processes. • Own data access policy design and least-privilege access controls in partnership with Security, ensuring data made available to AI systems is governed, auditable, and compliant. • Define data quality standards and monitoring processes for AI-consumed data, where quality failures have direct impact on model and agent performance. • Partner with the Principal Data and Integrations Architect on infrastructure design, ensuring data modeling and AI consumption requirements are incorporated into pipeline and architecture decisions from the start — not retrofitted after build. • Partner with the VP FP&A and Manager of BI & Data to ensure the semantic and metrics layers are technically sound and serve both AI use cases and reporting requirements. • Manage the AI Ops data architecture roadmap, translating business and AI use case requirements from all 11 departments into sequenced, prioritized technical work. • Maintain documentation and knowledge transfer standards for all data architecture, pipelines, and integration patterns — ensuring AI Ops-built infrastructure is reusable, auditable, and not dependent on any single individual. • Collaborate with the AI Agent Engineer and GPT & AI Systems Lead to ensure data infrastructure supports agent orchestration, retrieval-augmented generation, and multi-step reasoning workflows. • Define the roadmap for data science and AI data work in partnership with the VP of AI Operations — this role does not take direction from IT on resource allocation or prioritization. All roadmapping is managed within AI Operations. • Evaluate and recommend data tooling, frameworks, and platform components in alignment with AI Ops' technology-agnostic, build-for-leverage approach. • Other duties as assigned.
Job Requirements
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related technical field required.
- 7–10 years of experience in data engineering, data architecture, or a related technical function, with at least 3 years focused on AI or ML data infrastructure.
- Deep expertise in modern data stack technologies — Snowflake required; experience with dbt, Airflow or equivalent orchestration, and ELT/ETL pipeline design.
- Demonstrated experience designing data architecture for AI consumption — including vector databases, embedding pipelines, RAG systems, or feature stores — not only for BI and reporting.
- Strong data modeling skills across multiple paradigms: dimensional modeling, normalized models, and AI-optimized schemas for agent and model consumption.
- Experience building and operating real-time or near-real-time data pipelines for operational AI use cases.
- Proficiency in Python and SQL; experience with cloud data infrastructure on AWS required.
- Experience designing data access patterns and governance controls for AI systems, including least-privilege access, audit logging, and AI-specific data security considerations.
- Demonstrated ability to own cross-functional technical programs — translating requirements from multiple business domains into coherent, prioritized data architecture decisions.
- Strong communication skills with the ability to make complex data architecture decisions legible to non-technical executives and cross-functional stakeholders.
- SaaS industry experience required.
Benefits
- Medical, dental, and vision insurance
- Short term and long-term disability
- Life insurance and AD&D
- Supplemental life insurance (Employee/Spouse/Child)
- Health care and dependent care Flexible Spending Accounts
- 401(k) with company match
- Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non- overtime eligible) position.
- Paid parental leave
- Voluntary benefits including pet insurance
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Manager - Analytics Data Platform
ArityFounded by The Allstate Corporation in 2016, Arity is a mobility data and analytics company focused on improving transportation. We collect and analyze trillions of miles of driving data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.
At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Job Description Founded by The Allstate Corporation in 2016, Arity is a fully remote data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone. At the heart of that mission are the people that work here-the dreamers, doers, and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents toward transforming transportation. That's because at Arity, we believe work and life shouldn't be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don't just want you to see yourself here. We want you to be yourself here. Arity Analytics Data Platform Arity's Analytics Data Platform (ADP) team enables our analytics and data science teams to research, develop, deploy, and optimize analytics products that drive Arity's mission forward. The ADP team defines, provisions, and manages data pipelines, tools, platforms, and infrastructure to optimize analytics workflows and facilitate efficient collaboration with Arity's engineering teams to bring analytics products to production. We promote best practices for code and model management, reproducibility, scalability, and governance of the end-to-end analytics lifecycle. The team also plays a central role in the adoption and effective use of emerging AI-based development tools within the Arity Analytics community. The Role: You will lead a team of data and infrastructure engineers in the overall delivery of data solutions enabling advanced data science and analytics. This includes the development and management of cloud-based big data systems for ingesting, processing, and managing spatial-temporal and other types of data for analytics R&D; the implementation and operationalization of advanced data processing pipelines and AI solutions; identifying and integrating new data management and data analytics tools and ensuring best practices in their usage; and establishing and administering MLOps best practices in collaboration with Arity Engineering. The Senior Manager is responsible for the recruitment, selection, mentorship, and development of team members and for setting the strategic direction for the team in support of the business objectives of the company. This role is also accountable for building alignment with key stakeholders across Arity on the big data management strategy and execution. Key Responsibilities: - Manage and develop the Analytics Data Platform team and drive technical excellence. - Drive the analysis, design, and development of a roadmap and implementation plan to continuously modernize our analytics data and model management platform and improve operational efficiency in accordance with business objectives. - Implement data security measures and ensure compliance with data governance policies and standards. Engineer secure app patterns into cloud platforms. - Use your knowledge of cloud design patterns, cloud operations, and cloud cost models to identify and address performance bottlenecks, troubleshoot technical issues, and implement optimizations to enhance overall data & model management platform performance. - Be a subject matter expert in cloud computing & model management/MLOps to help data scientists and analysts work effectively in the cloud environment. - Work collaboratively with cross-functional teams, including data scientists, analysts, engineers, and business stakeholders, to understand data and ML system requirements and deliver effective solutions. - Be a technology thought leader and a key influencer on technical decisions and organizational strategy that have long-term, strategic impact on the business. Functional Skills: - Deep knowledge about public cloud architecture, cloud strategy, cloud operations, compliance, and related tools. - Hands-on experience in designing and delivering big data management and applications on cloud platforms using modern software development processes, methodologies, and tools. - Demonstrated experience in working with cloud-based ML frameworks, such as AWS Sagemaker AI, Google Vertex AI, Microsoft Azure ML, or Databricks, and in MLOps workflows, patterns and delivery objectives. - Proficient in system design or a programming language such GoLang, Scala, Python - Demonstrated experience in designing and supporting cloud-based data lakes/warehouses/lakehouses - Excellent collaboration skills and ability to work on a remote team. - Strong analytical, problem solving, and organizational skills. Experience: - 10 or more years of experience (preferred) Supervisory Responsibilities: - This job has supervisory duties. #LI-TE1 Skills Amazon S3, Amazon SageMaker, Amazon Web Services (AWS), Data Science, Google BigQuery, Google Cloud Platform (GCP), Machine Learning Operations, Vertex AI Compensation Compensation offered for this role is 151,700.00 - 221,675.00 annually and is based on experience and qualifications. The candidate(s) offered this position will be required to submit to a background investigation. Joining our team isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger - a winning team making a meaningful impact. Allstate generally does not sponsor individuals for employment-based visas for this position. Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component. For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance. For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance. To view the "EEO Know Your Rights" poster click "here". This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs. To view the FMLA poster, click "here". This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint. It is the Company's policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee's ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.
• Design, build, and operate highly scalable, low latency data platforms • Create modern data lakehouse architectures, real time data pipelines, and analytics ready data models that support trading, risk, reporting, and regulatory requirements • Collaborate closely with trading desks, product teams, AI/analytics teams, and architects to deliver reliable, secure, and high performance data solutions
Sr. Data Engineer
KalderosKalderos is a technology company working to revolutionize the business of healthcare by addressing challenges faced by the United States healthcare system. As a
About UsAt Kalderos, we are building unifying technologies that bring transparency, trust, and equity to the entire healthcare community with a focus on pharmaceutical pricing. Our success is measured when we can empower all of healthcare to focus more on improving the health of people. That success is driven by Kalderos’ greatest asset, our people. Our team thrives on the problems that we solve, is driven to innovate, and thrives on the feedback of their peers. Our team is passionate about what they do and we are looking for people to join our company and our mission. That’s where you come in! We are looking for a collaborative Senior Data Engineer. You have a strong inclination to work in rapidly developing and expanding organizations and possess the necessary background to do so. You are well-acquainted with the fast-paced, high-volume, and uncertain nature of operations in the organization, and perceive it as a chance to deliver significant outcomes. What You'll Do - Design and implement data models in partnership with product, analytics, and engineering teams so they are scalable, well-documented, and aligned to business needs - Collaborate with other Data Engineers to solve problems that directly impact enterprise customers - Build data transformations and data flows utilizing Python, SQL, DBT, Postgres and Snowflake - Build out automated ETL jobs that reliably process large amounts of data, and ensure these jobs run consistently and are well-monitored - Build tools that enable other data engineers to work more efficiently - Tune existing implementations to run more efficiently as they become bottlenecks, or migrate existing implementations to new paradigms as needed - Learn and apply knowledge about the drug discount space, and become a subject matter expert for internal teams to draw upon - Take ownership, lead decision-making, and mentor junior engineers What You'll Bring - Bachelor’s degree in computer science or similar field, or equivalent experience - 5+ years of work experience as a Data Engineer in a professional full-time role - Advanced knowledge of SQL and Python (along with data analysis libraries such as Pandas, NumPy, and others) - Strong data modeling experience (understanding of SQL, NoSQL, and other database types along with relational modeling) - Ability to learn new technologies and work in various components across the full tech stack - Experience with cloud native infrastructure (Azure preferred) - Experience with Container Applications (Docker) - Experience building ETL pipelines and other services - Experience with GenAI Tools and Workflows - Professional experience in application programming with an object-oriented language. Set Yourself Apart - Experience with DBT and Snowflake - Experience with event driven platforms - Experience with infrastructure as code tools like Terraform - Knowledge about the drug discount space and healthcare industry Highlighted Company Perks and Benefits - Medical, Dental, and Vision benefits - 401k with company match - Flexible PTO with a 10 day minimum - Mobile & Wifi Reimbursement - Commuter Reimbursement - Donation matching for charitable contributions - Travel reimbursement for healthcare services not available near your home - New employee home office setup reimbursement This role can be remote in the United States or hybrid in Chicago or Boston. Expected Salary Range: $145,000-$170,000 base + bonus What It’s Like Working Here - We thrive on collaboration, because we believe that all voices matter and we can only put our best work into the world when we work together to solve problems. - We empower each other and believe in ensuring all voices are heard. - We know the importance of feedback in individual and organizational growth and development, which is why we've embedded it into our practice and culture. - We’re curious and go deep. Our slack channels are filled throughout the day with insightful articles, discussions around our industry, healthcare, and anything else that interests our team! To learn more: https://www.kalderos.com/company/culture We know that job postings can be intimidating, and research shows that while men apply to jobs when they meet an average of 60% of the criteria, women and other marginalized folks tend to only apply when they check every box. We encourage you to apply if you think you may be a fit and give us both a chance to find out! Kalderos is proud to be an equal opportunity workplace. We are committed to equal opportunity regardless of race, color, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, or veteran status. Kalderos participates in E-Verify.
Data Architect
GFT TechnologiesAs a pioneer for digital transformation GFT develops sustainable solutions across new technologies.
• Lead the design, development, and optimization of enterprise scale data pipelines and architectures. • Build and maintain robust ETL processes, ensure high data availability, and support advanced analytics and business intelligence needs. • Collaborate closely with data scientists, analysts, product managers, engineering managers, TPMs, and architects to translate complex business requirements into scalable technical solutions. • Guide junior engineers, drive technical innovation, and influence enterprise data strategy.



