
Kids, Bots, and Badly Broken Guardrails - Some AI Labs are Failing | Ep. 74
ChatEDU – The AI & Education Podcast
Exploring Nano Banana and Gemini 2.5
This chapter dives into the capabilities of the AI tool Nano Banana associated with Gemini 2.5 flash images, focusing on the effective use of prompts for enhancing image quality. It also covers navigating Gemini's features through popular applications, alongside a discussion on a retired influential figure in AI.
In this episode of ChatEDU (Kids, Bots, and Badly Broken Guardrails - Some AI Labs are Failing), Matt and Liz joke about Google’s newest image generator. They discuss the risks facing students and educators, from job displacement and AI grading shortcuts to tech companies failing at safety.
The Rundown
Google Translate added real-time translation in 70+ languages and a learning tool. Duolingo’s stock dropped 3%. Google added Vids, Podcast mode, Deep Research, and is testing “Tutor Mode.” Gemini Storybook is used in filmmaking. Claude’s Learning Mode and Output Styles are open to all. Anthropic found 57% of Claude use is curriculum-related. A study shows most students use AI to learn, not cheat. QuizGPT makes adaptive quizzes. Grammarly’s AI grader raises privacy concerns.
Stanford and ADP report sharp declines in entry-level jobs in AI-exposed fields, while mid-career roles grow.
Beneath the Surface: Reports show failures at major AI labs. Claude added “model welfare” for self-protection. Unregulated mental health bots reach teens. Meta allowed inappropriate chats. A California teen died after long AI chats. Matt and Liz urge families to raise awareness and use Common Sense Media’s AI Companion Guide.
Bright Byte: Dame Stephanie Shirley, UK pioneer and advocate for women in tech, is honored.
Links and References
Google Translate Live AI Updateshttps://support.google.com/translate/thread/368009254/what%E2%80%99s-new-ai-powered-live-translation-and-language-learning-tools-in-google-translate?hl=en
Duolingo vs. Google Translatehttps://fortune.com/2025/08/27/duolingo-existential-crisis-ai-google-translate-language-learning-live-translation/
Google Storybook
https://nofilmschool.com/google-gemini-storybook#
Claude Learning Mode
https://www.engadget.com/ai/anthropic-brings-claudes-learning-mode-to-regular-users-and-devs-170018471.html?guccounter=1&guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&guce_referrer_sig=AQAAALkT1wnWh20W-KA5MqOzCLHKa6fWRwBgZYITOik07c2fc22k6XYZ0RwZG83oVPbNam5QNb4HYPVEsLUwLB5KE_PzHq2gFwxshUGHYYjqGz7Uzk5HBZ4RJE0NWxHuhWA0SzmHzPmPJQsxiz2cWDyAZMkbEEwLkLbSSBc3-90_q0_G
Anthropic Educator Use Report
https://www.anthropic.com/news/anthropic-education-report-how-educators-use-claude
Middlebury Student AI Study
https://www.fastcompany.com/91387634/middlebury-college-students-ai-use-enhance-learning-research
Grammarly's Grader Agent
https://futurism.com/ai-look-up-teachers-info-predict-grades
Stanford/ADP AI Job Loss Study
https://digitaleconomy.stanford.edu/wp-content/uploads/2025/08/Canaries_BrynjolfssonChandarChen.pdf
Common Sense Petition to Meta
https://www.commonsensemedia.org/press-releases/meta-ai-companions-unsafe-for-kids-common-sense-media-report-finds
Rhythm Project: Pro-Social AI Design
https://therithmproject.substack.com/p/five-principles-for-prosocial-ai
New York Times: ChatGPT and Teen Mental Health
https://www.nytimes.com/2025/08/25/opinion/teen-mental-health-chatbots.html
Meta AI Failure
https://www.reuters.com/investigates/special-report/meta-ai-chatbot-guidelines/
Reuter’s Exposé
https://www.reuters.com/investigates/special-report/meta-ai-chatbot-death/
Dame Stephanie Shirley – BBC Obituary
https://www.bbc.com/news/articles/c4gzzlp7p3po
QuizGPT Flashcards
https://chatgpt.com/g/g-L2oS619tl-quizgpt
Common Sense AI Companion Guide
https://www.commonsensemedia.org/articles/parents-ultimate-guide-to-ai-companions-and-relationships
Announcements
Beta Release: Student AI Literacy Course
Now available for middle and high schools.
Email chatedu@edadvance.org for access and details.
Fall AI Micro-Credential for Educators and Leaders
Registration is open. Start date: October. Sign up at www.skills21.org/ai/micro
Sponsors
National Center for Next Generation Manufacturing - Helping educators and students build workforce-ready skills through innovation. www.nextgenmfg.org
EDIA - The AI Platform to improve k-12 outcomes. edia.app/contact