Katja Grace

Katja Grace is a researcher and writer. She runs AI Impacts, a research project trying to incrementally answer decision-relevant questions about the future of artificial intelligence (AI). Katja blogs primarily at worldspiritsockpuppet, and indirectly at Meteuphoric, Worldly Positions, LessWrong and the EA Forum. We discuss: What is AI Impacts working on? Counterarguments to the basic AI x-risk case Reasons to doubt that superhuman AI systems will be strongly goal-directed Reasons to doubt that if goal-directed superhuman AI systems are built, their goals will be bad by human lights Aren't deep learning systems fairly good at understanding our 'true' intentions? Reasons to doubt that (misaligned) superhuman AI would overpower humanity The case for slowing down AI Is AI really an arms race? Are there examples from history of valuable technologies being limited or slowed down? What does Katja think about the recent open letter on pausing giant AI experiments? Why read George Saunders? Key links: World Spirit Sock Puppet (Katja's main blog) Counterarguments to the basic AI x-risk case Let's think about slowing down AI We don't trade with ants Thank You, Esther Forbes (George Saunders) You can see more links and a full transcript at hearthisidea.com/episodes/grace.

Katja Grace, an AI Impacts researcher, dives into the potential perils of advanced AI and the alignment problem. She discusses the skepticism around AI doom scenarios, weighing the real risks against the ineptitude of current systems. The conversation explores AI autonomy, ethical dilemmas with corporate AI use, and the potential societal impact of Universal Basic Income. Grace emphasizes the importance of transparency and ethical considerations as humanity navigates the uncertain terrain of increasingly capable, yet unpredictable, AI technologies.

Katja Grace, Cofounder and Lead Researcher at AI Impacts, shares insights from a comprehensive survey involving over 2,700 AI researchers. She discusses the diverse predictions about AI’s future and highlights concerns about safety and interpretability. The conversation reveals a trend of optimism among researchers but also addresses the complexities of forecasting advancements. Katja emphasizes the importance of understanding public skepticism and the need for clear communication around AI capabilities and risks.

Katja Grace, AI researcher and founder of AI Impacts known for forecasting and AI risk surveys, discusses why advanced AI could pose existential threats. She covers autonomy and emergent goal-directed behavior, evidence of deceptive agentic actions, the corporate Trojan Horse race to deploy agents, links between mass unemployment and larger risks, and challenges of forecasting AI timelines.

In this discussion, Katja Grace, a blogger and researcher specializing in group dynamics and AI safety, dives into the concept of being 'groupstruck' and how social pressures distort individual decision-making, especially during crises like the pandemic. She explores the delicate balance of conformity and personal judgment, offering insights on navigating group dynamics and fostering genuine relationships. Additionally, Grace critiques traditional decision-making models, emphasizes the value of qualitative factors, and introduces strategies for improved personal growth and decision-making.

Hamza Chaudhry, a national security and policy expert on AI governance, and Katja Grace, a researcher on long-term AI risks, join the conversation. They trace the three ingredients for AI catastrophe: powerful autonomous agents, misaligned goals, and weapon access. They discuss self-improvement, shutdown avoidance, real-world blackmail experiments, pathways to weapons, and policy fixes like testing and emergency off switches.

Katja Grace from AI Impacts discusses AI researchers' revised timelines, with views on AGI risks and benefits. Survey methodology, response rates, and concerns about AI-induced human extinction. Exploring evolving perspectives in AI, varying opinions on AGI progress speed and risks. Emphasizing AI safety research, potential impacts on society, and the need for informed policy decisions.

Katja Grace, researcher and blogger from AI Impacts, discusses the 2023 survey on AI progress showing a shorter time expected for human-level AI. They explore AGI vs superintelligence, job automation, GPT writing styles, and risks of advanced AI surpassing human intelligence and the need for caution in AI development.

Katja Grace, Co-founder and lead researcher at AI Impacts, dives into the future of AI and its inherent risks. She shares her journey into AI, driven by a desire for positive global change. The discussion unpacks an extensive survey of AI researchers, revealing evolving perceptions about AI capabilities and timelines. Grace emphasizes the importance of aligning AI development with human values to mitigate existential risks and advocates for a collaborative approach to ensure responsible technological advancement.

Katja Grace, Lead Researcher at AI Impacts, discusses the concrete concerns of AI risk and the concept of value fragility. She explores interpreting human values in AI systems and examines the ratio of cognitive labor for good and bad things. The podcast also explores biases in assessing AI risks and safety.