This is a bit of a trend. We discussed a couple other stories last week about long context. There was also longnet and some other things. This one has a few notable good qualities. It works better than just standard fine tuning. It still works well on short term stuff. So yeah, it's another kind of example of really a lot of progress in scaling to long context.
Our 130th episode with a summary and discussion of last week's big AI news!
Co-hosted this week by Jon Krohn of the Super Data Science Podcast podcast.
Correction: Elon Musk's company is named xAI, not x.AI.
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/
Email us your questions and feedback at contact@lastweekin.ai
Timestamps + links:
- (00:00) Intro / Banter
- (07:30) Response to listener comments / corrections
- Tools & Apps
- Applications & Business
- Projects & Open Source
- Research & Advancements
- Policy & Safety
- Synthetic Media & Art
- (01:44:20) Outro