LLM Ops: Turnkey Solutions for End-to-End Support

This episode features an interview with Saumil Shrivastava, Director of Product Management on the AI Platform team at Microsoft. 

In this episode, Saumil shares with us:

• The importance of community feedback
• How best to enable customers to build LLM apps quickly
• When products need to be scenario-based and domain-specific
• And much more!

Host takeaways:

Kyle: 

• Security and privacy are gravitating toward LLMs. When we look at LLMs for industries such as healthcare, we see the models become more vertical and specialized so we need to account for that in how we build.
• Strong PMs are good problem solvers. As PMs, we have to be able to solve complex problems at scale with technology. And since we love to do this so much anyway, it shouldn’t be a surprise. However, when the needs of the products we build change, it’s up to us to provide ideas for solutions.

Lukasz:

• We’re in an exploration phase. This also means that there are a lot of unknowns, so we’re often working off an instance-by-instance basis and not a generalized set of rules. The testing starts now and it might take longer than we thought historically.
• The obstacle is the way…sometimes. While I don’t believe every obstacle is the way, I do concur with Saumil that organizationally if there is pushback, it’s wise to push back further and ask questions as to why there are obstacles and then work to create effective solutions. Sometimes it’s time to explore different options and ways of doing things.

Segment Timestamps: 

*(00:31) - Ship it or Skip it

*(04:15) - PM Power Moves

*(25:52) - Host Takeaways

>> Connect with Lukasz Weber & Kyle Kolich 

>> Learn more about Zuora