"The Cognitive Revolution" cover image

The AI Email Assistant I've Been Waiting for, with Andrew Lee of Shortwave

"The Cognitive Revolution"

NOTE

Fine-tuning and Using Multiple AI Models in Production

The organization uses multiple AI models in production, including GPT4, GPT3 5, and a fine-tuned version of GPT3 5 for various features. Additionally, they utilize bespoke models like instructor XL for embeddings, a coding model trained on Microsoft's open-source data, and Mistral for summaries. The fine-tuned GPT3 5 is specifically employed for AI algorithms. The AI assistant streamlines the user experience by providing quality answers swiftly, enabled by the fine-tuned models that understand nuances. They fine-tuned the model by training it on their own emails, focusing on completing sections removed from the emails as responses. The fine-tuning process also emphasized email formatting, achieving a voice that matches the user's style. The autocomplete feature uses the fine-tuned model for drafting emails efficiently. However, the assistant provides slightly higher quality answers as it employs a more powerful GPD4 Turbo model and allows for regular searches, unlike the autocomplete feature that relies on previously sent emails. This additional functionality enables the assistant to perform arbitrary retrieval to enhance email writing capabilities.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner