The Retort AI Podcast cover image

The Retort AI Podcast

Latest episodes

undefined
Oct 27, 2023 • 46min

Transparency (Tom and Nate's Version)

This week, we dunk on The Center for Research on Foundation Models's (Stanford) Foundation Model Transparency Index.Yes, the title is inspired by Taylor.Some links:The Index itself. And Nathan's critique.Anthropic's Collective Constitutional AI work, coverage in New York Times.New paper motivating transparency for reward models in RLHF.Jitendra Malik dunks on the idea of foundation models.
undefined
Oct 20, 2023 • 41min

Techno-optimism: Safety, Ethics, or Fascism?

Tom and Nate discuss Marc Andreessen's Techno-Optimist Manifesto, exploring the AI discourse and long-term views. They analyze a document, compare it to another manifesto, and acknowledge its transformative nature. The advantages of markets over central planning are discussed, along with the connection between the philosopher's stone and AI. The transformative potential of AI is explored, and distinctions and controversies surrounding the manifesto are addressed.
undefined
Oct 13, 2023 • 54min

Methods of Rationality in the Time of Hype

Entrepreneur Sam Altman joins host Nate to discuss the history of the rationality movement, the influence of Harry Potter fan fiction, the challenges of navigating social hierarchies, the impact of Twitter on AI discourse, and the ethical implications of using human data.
undefined
Oct 6, 2023 • 58min

Developing LLMs: Open, closed, or democratic?

This is a big one. Getting going on if LLMs should be more open or more closed. We cover everything, OpenAI, scaling, openness for openness sake (relative to OpenAI), actual arguments for open-source values in LLMs, AI as infrastructure, LLMs as platforms, what this means we need, and other topics.Lot's of related links this time from Nathan.Most recent article on Interconnects explaining how open-source startups may be deluding themselves."What is an open-source LLM" on Interconnects.How the open-source economy works on Interconnects.
undefined
Sep 29, 2023 • 58min

As Above, So Below: Alchemy, AI Safety, and RLHF

Tom and Nate discuss a few core topics of the show. First, we touch base on the core of the podcast -- the difference between empirical science, alchemy, and magic. Next, we explain some of our deeper understandings of AI safety as a field, then that leads into a discussion of what RLHF means.Lot's of links to share this time:Tom's coverage on alchemy in VentureBeat, and an active thread on Twitter.As Above, So Below: a calling of alchemy,A NeurIPs test of time award speech on alchemy,A bizarre Facebook debate between Yoshua Bengio and Stuart Russell,
undefined
Sep 22, 2023 • 50min

AI in public: education, roads, and institutions

The hosts discuss the challenges of automated systems and the impact of autonomous vehicles on public infrastructure. They explore cultural differences in driving styles and the value of education. The podcast also explores the ban and integration of chatbots in the NYC school system and the potential of AI in education. It emphasizes the importance of seeking meaning in life and explores the impact of technology on our lives.
undefined
Sep 15, 2023 • 1h 4min

Alchemy, Oppenheimer, and the quest for AGI

Tom and Nate discuss some of the most dominant metaphors in machine learning these days -- alchemy and deep learning's roots, the Oppenheimer film and a modern "Manhattan Project for AI", and of course, a sprinkle of AGI.Some related reading on Interconnects: https://www.interconnects.ai/p/ai-research-tensions-oppenheimerThanks for listening! Reach out if you have any questions.
undefined
Sep 6, 2023 • 6min

Teaser: Welcome to The Retort

This podcast explores the chaotic state of AI, the need for reflection, and the challenge of keeping up with advancements while caring for people in the field. It also discusses the subversion of scientific progress through a secondary market for papers and the origins of deep learning.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode