Latent Space: The AI Engineer Podcast
The End of Finetuning — with Jeremy Howard of Fast.ai
User's personalized AI podcast notes AI-generated based on their snips
AI-generated based on their snips
1. PhD programs didn't focus on practical skills like working with vision, data tables, recommendation systems, and text. After 30 years, there is finally a chance to make it happen.
2. The focus in machine learning shifted from zero shot and few shot learning to transfer learning using the ULM Fit approach, fine tuning on an instruction corpus, and RLHF fast classification.
3. Join active and engaging Discord communities like Luther Discord, Carper AI, Alignment Lab, and OS Skunk Works to build and learn from others.
4. Fast AI's goals can be expanded to make coding more accessible, eliminating prerequisite experience and addressing uncertainties in training models and fine-tuning.
5. There is limited knowledge about the capabilities and limitations of GPT-4, but it has shown promising performance in playing chess.
6. Recognize the diverse capabilities of people and embrace technology as an opportunity to improve humanity.
