AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Manage LLMs in Production
Pienzo is building a general solution and not like focused on particular industry or use case. The British way of signaling that you're unhappy with customer service is very different than the American one. How should companies think about using an existing LLM versus training from scratch? Also, how frequently should they fine-tuned? When should they use retrieval or winter generation? Can you talk about maybe guiding principles of managing LLMs in production?