The Retort AI Podcast

This week, we dunk on The Center for Research on Foundation Models's (Stanford) Foundation Model Transparency Index.Yes, the title is inspired by Taylor.Some links:The Index itself. And Nathan's critique.Anthropic's Collective Constitutional AI work, coverage in New York Times.New paper motivating transparency for reward models in RLHF.Jitendra Malik dunks on the idea of foundation models. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com

Tom and Nate discuss Marc Andreessen's Techno-Optimist Manifesto, exploring the AI discourse and long-term views. They analyze a document, compare it to another manifesto, and acknowledge its transformative nature. The advantages of markets over central planning are discussed, along with the connection between the philosopher's stone and AI. The transformative potential of AI is explored, and distinctions and controversies surrounding the manifesto are addressed.

Entrepreneur Sam Altman joins host Nate to discuss the history of the rationality movement, the influence of Harry Potter fan fiction, the challenges of navigating social hierarchies, the impact of Twitter on AI discourse, and the ethical implications of using human data.

This is a big one. Getting going on if LLMs should be more open or more closed. We cover everything, OpenAI, scaling, openness for openness sake (relative to OpenAI), actual arguments for open-source values in LLMs, AI as infrastructure, LLMs as platforms, what this means we need, and other topics.Lot's of related links this time from Nathan.Most recent article on Interconnects explaining how open-source startups may be deluding themselves."What is an open-source LLM" on Interconnects.How the open-source economy works on Interconnects. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com

Tom and Nate discuss a few core topics of the show. First, we touch base on the core of the podcast -- the difference between empirical science, alchemy, and magic. Next, we explain some of our deeper understandings of AI safety as a field, then that leads into a discussion of what RLHF means.Lot's of links to share this time:Tom's coverage on alchemy in VentureBeat, and an active thread on Twitter.As Above, So Below: a calling of alchemy,A NeurIPs test of time award speech on alchemy,A bizarre Facebook debate between Yoshua Bengio and Stuart Russell, This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com

The hosts discuss the challenges of automated systems and the impact of autonomous vehicles on public infrastructure. They explore cultural differences in driving styles and the value of education. The podcast also explores the ban and integration of chatbots in the NYC school system and the potential of AI in education. It emphasizes the importance of seeking meaning in life and explores the impact of technology on our lives.

Tom and Nate discuss some of the most dominant metaphors in machine learning these days -- alchemy and deep learning's roots, the Oppenheimer film and a modern "Manhattan Project for AI", and of course, a sprinkle of AGI.Some related reading on Interconnects: https://www.interconnects.ai/p/ai-research-tensions-oppenheimerThanks for listening! Reach out if you have any questions. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.retortai.com

This podcast explores the chaotic state of AI, the need for reflection, and the challenge of keeping up with advancements while caring for people in the field. It also discusses the subversion of scientific progress through a secondary market for papers and the origins of deep learning.