Speculations on Future Hardware Use and Demonstration of Low Latency Technology

Show notes: https://thisdayinai.com/bookmarks/32-ep52
Groq Mixtral: https://simtheory.ai/agent/567-groq-mixtral-edition
Groq Llama: https://simtheory.ai/agent/566-groq-the-speed-oriented-chat-companion
SimTheory: https://simtheory.ai
====
This week we discuss Groq's LPU Chips and the implications of low cost low latency LLMs on custom hardware. We revisit our prank calling to see if Groq's low latency gives an advantage and see if we can improve Air Canada's chatbot. We discuss the launch of Google's Open Source Gamma 7B release and Magic's $148M fundraise for an AI co-worker who can reason. We also cover ChatGPT losing it's mind during the week.

If you like the show, please consider subscribing. Thanks for listening.

====
Chapters:
00:00 - Groq, Groq API and Retell with Groq
32:48 - Google Gemma 7B Open Source Model
39:04 - The 'Magic' Breakthrough on Reasoning and Context
50:19 - Sounds for OpenAI Sora Thanks to ElevenLabs Sound FX
51:59 - ChatGPT Goes Haywire