MLOps.community  cover image

The Future of Feature Stores and Platforms // Mike Del Balso & Josh Wills // # 186

MLOps.community

00:00

The Power of Context in Language Models and Feature Infrastructure

You don't need a complicated data pipeline to generate responses to user tickets. However, enriching the prompt with relevant information about your business, product, and user can improve performance. The same data supply chain used by feature infrastructure can be injected as snippets into the prompt. One key requirement in building LOM applications is the ability to support an offline development workflow for exploration and prototyping. The feature platform provides tools for backfilling and scoring historical examples to improve prompt effectiveness.

Play episode from 57:37
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app