AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Last Week in AI
#151 - Copilot Pro, LLama.cpp, conversational diagnostic AI, secret AI diplomacy
Jan 21, 2024
In this episode, we discuss Microsoft's Copilot Pro subscription service, OpenAI's news publisher deals, and an unusual $750 million fundraise by Anthropic. We also cover a project called llama.cpp for deploying large language models, the generalizability of clinical predictive models created by AI, and the issue of scammy AI-generated content on Amazon.
01:36:10
Episode guests
AI Summary
Highlights
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Deploying the Llama model on a laptop using the open-source library Llama.cpp enables fast generation speeds and high efficiency for local machine training.
- Llama Pro, an expansion of the Llama model with specialized blocks, achieves better performance in general language understanding and specialized skills, making it a versatile and powerful language model.
Deep dives
Llama.cpp: Training Llama Model on a MacBook
Llama.cpp is an open-source library that allows the deployment of the Llama model on a laptop, achieving fast generation speeds. The library utilizes for-bit integer quantization and GPU explorations via CUDA. With Llama.cpp, the model can generate 1,400 tokens per second on a MacBook Pro, making it efficient and accessible for local machine training.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode