Amazon is training a 2 trillion parameter model called Olympus, which may be 2x bigger than GPT-4. They discuss the competition between Olympus and OpenAI's GPT-4, as well as Amazon's language model strategy and their motivation for creating their own model. They also touch on NVIDIA's development of chips for China, ScaleAI's AI safety lab, and upcoming AI safety standards and regulations.
Read more
AI Summary
Highlights
AI Chapters
Episode notes
auto_awesome
Podcast summary created with Snipd AI
Quick takeaways
Amazon is training a 2 trillion parameter model called Olympus, which could potentially surpass Google Gemini and OpenAI GPT-5.
The United States is imposing restrictions on China's access to advanced AI chips, pressuring companies like NVIDIA and AMD to limit shipments to certain areas.
Deep dives
Screen Actors Guild Strike Ends with AI Agreement
After 118 days, the longest strike in Hollywood history, the Screen Actors Guild reached a deal with studios. One of the major points of contention was the use of AI, with studios wanting to scan actors and use their digital likenesses without consent or additional compensation. The guild fought for provisions protecting actors from the threat of AI, securing an unprecedented agreement for consent and compensation. This strike highlights the growing importance of AI in the labor landscape and the need for regulations to address its impact on various industries.
US Efforts to Restrict China's Access to AI Chips Intensify
The United States is intensifying efforts to restrict China's access to advanced AI chips. Export restrictions have already been put in place, but loopholes existed through subsidiaries in other countries. The US is pressuring companies like NVIDIA and AMD to limit shipments to certain areas, including the Middle East, to prevent them from reaching Chinese companies. However, NVIDIA is reportedly developing power-moderated chips that would comply with US-mandated power restrictions and still cater to the Chinese market. It remains to be seen whether the US will allow these sales to proceed.
Norway's Sovereign Wealth Fund Utilizes AI for Investment Management
Norway's Sovereign Wealth Fund, with assets totaling $1.4 trillion, is employing AI to manage its investments. The fund aims to reduce trading by leveraging AI's capabilities and increase productivity by utilizing AI models to make portfolio adjustments. This application of AI highlights its potential in the investment sector, as it helps to optimize decision-making and boost efficiency. Other investors, including sovereign wealth funds and private market actors, will likely also explore AI's impact on investment management.
Sources are suggesting that Amazon is training a 2 trillion parameter model called Olympus. NLW looks at what it means for Google Gemini, OpenAI GPT-5 and more.
Today's Sponsors:
Listen to the chart-topping podcast 'web3 with a16z crypto' wherever you get your podcasts or here: https://link.chtbl.com/xz5kFVEK?sid=AIBreakdown
Interested in the opportunity mentioned in today's show? jobs@breakdown.network
ABOUT THE AI BREAKDOWN
The AI Breakdown helps you understand the most important news and discussions in AI.
Subscribe to The AI Breakdown newsletter: https://theaibreakdown.beehiiv.com/subscribe
Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown
Join the community: bit.ly/aibreakdown
Learn more: http://breakdown.network/
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode