AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
AI is seen as a potential catalyst for a fundamental shift in society, but the realization of transformative AI may be slower than expected due to various challenges.
Robotics, specifically fine motor control, remains a major technical hurdle for achieving transformative AI, as current capabilities are far from being able to perform real-world tasks effectively.
The reliance on internet data and availability of high-quality data presents a challenge for AI progress, especially when deploying models in high-stakes settings and real-world environments.
The slow adoption and regulatory challenges associated with deploying AI systems in various sectors and industries pose significant barriers to achieving transformative AI.
The value placed on human performance, social experiences, and the uniqueness of human presence in certain domains, such as music and art, presents a significant hurdle for AI to replicate fully.
Historically, new technologies have diffused slowly, and it is uncertain how quickly society will adopt and accept transformative AI.
The challenges and limitations discussed in both the technical and social aspects of AI need to be addressed for transformative AI to become a reality.
The podcast discusses the concept of transformative growth and how it is impacted by various bottlenecks in different areas. The hosts highlight the importance of understanding these bottlenecks and the difficulties involved in achieving widespread adoption of new technologies. They provide examples of historical adoption rates of new technologies, such as tractors and electricity, illustrating the slow pace of diffusion. They discuss how growing regulation and competitive barriers can hinder the adoption of new technologies, and how social factors like trust and perception can also influence adoption. The hosts counter the argument that solving the process of innovation or science would lead to quick adoption of transformative AI, emphasizing the complexity and unpredictability of human affairs. They address objections related to the speed of technological progress, citing examples like Operation Warp Speed, but also point out the challenges of sustaining rapid growth in the long term. The hosts suggest prioritizing areas that are bottlenecked and neglected, and considering near-term risks and medium-term challenges over far-fetched scenarios. They encourage focusing on essential yet difficult-to-improve sectors and advise balancing concerns about AI risks with a realistic assessment of the obstacles and barriers to full adoption.
In episode 91 of The Gradient Podcast, Daniel Bashir speaks to Arjun Ramani and Zhengdong Wang.
Arjun is the global business and economics correspondent at The Economist.
Zhengdong is a research engineer at Google DeepMind.
Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at editor@thegradient.pub
Subscribe to The Gradient Podcast: Apple Podcasts | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter
Outline:
* (00:00) Intro
* (03:53) Arjun intro
* (06:04) Zhengdong intro
* (09:50) How Arjun and Zhengdong met in the woods
* (11:52) Overarching narratives about technological progress and AI
* (14:20) Setting up the claim: Arjun on what “transformative” means
* (15:52) What enables transformative economic growth?
* (21:19) From GPT-3 to ChatGPT; is there something special about AI?
* (24:15) Zhengdong on “real AI” and divisiveness
* (27:00) Arjun on the independence of bottlenecks to progress/growth
* (29:05) Zhengdong on bottleneck independence
* (32:45) More examples on bottlenecks and surplus wealth
* (37:06) Technical arguments—what are the hardest problems in AI?
* (38:00) Robotics
* (40:41) Challenges of deployment in high-stakes settings and data sources / synthetic data, self-driving
* (45:13) When synthetic data works
* (49:06) Harder tasks, process knowledge
* (51:45) Performance art as a critical bottleneck
* (53:45) Obligatory Taylor Swift Discourse
* (54:45) AI Taylor Swift???
* (54:50) The social arguments
* (55:20) Speed of technology diffusion — “diffusion lags” and dynamics of trust with AI
* (1:00:55) ChatGPT adoption, where major productivity gains come from
* (1:03:50) Timescales of transformation
* (1:10:22) Unpredictability in human affairs
* (1:14:07) The economic arguments
* (1:14:35) Key themes — diffusion lags, different sectors
* (1:21:15) More on bottlenecks, AI trust, premiums on human workers
* (1:22:30) Automated systems and human interaction
* (1:25:45) Campaign text reachouts
* (1:30:00) Counterarguments
* (1:30:18) Solving intelligence and solving science/innovation
* (1:34:07) Strengths and weaknesses of the broad applicability of Arjun and Zhengdong’s argument
* (1:35:34) The “proves too much” worry — how could any innovation have ever happened?
* (1:37:25) Examples of bringing down barriers to innovation/transformation
* (1:43:45) What to do with all of this information?
* (1:48:45) Outro
Links:
* Zhengdong’s homepage and Twitter
* Arjun’s homepage and Twitter
* Why transformative artificial intelligence is really, really hard to achieve
* Other resources and links mentioned:
* Allan-Feuer and Sanders: Transformative AGI by 2043 is <1% likely
* Hardmaru on AI as applied philosophy
* Davis Blalock on synthetic data
* Matt Clancy on automating invention and bottlenecks
* Michael Webb on 80,000 Hours Podcast
* Bob Gordon: The Rise and Fall of American Growth
* OpenAI economic impact paper
* David Autor: new work paper
* Pew research centre poll, public concern on AI
* Human premium Economist piece
* Callum Williams — London tube and AI/jobs
* Culture Series book 1, Iain Banks
Listen to all your favourite podcasts with AI-powered features
Listen to the best highlights from the podcasts you love and dive into the full episode
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
Listen to all your favourite podcasts with AI-powered features
Listen to the best highlights from the podcasts you love and dive into the full episode