
Counting What Counts: The Push to Measure AI Literacy | Ep. 76
ChatEDU – The AI & Education Podcast
NotebookLM Updates for Teaching and Learning
Matt and Liz review Google's NotebookLM new features like flashcards, quizzes, audio guides, and LMS assignments.
In this episode of ChatEDU (Counting What Counts: The Push to Measure AI Literacy), Matt & Liz start with a tech glitch & a visit with Aura, a Tesla voice model pretending to be a therapist. They shift to copyright lawsuits, student safety, & the need to define & measure AI literacy in schools.
Story #1: The Rundown
$1.5B Settlement: Anthropic agrees to pay authors for pirated training data. A major legal turning point. The court delays the deal & demands transparency & clear author rights.
Character.AI Report: 669 harmful chatbot interactions with kids found in 50 hours of testing.
FTC Investigation: The FTC opens a formal inquiry into AI companions & their impact on minors.
NotebookLM Upgrades: Flashcards, quizzes, audio guides, & LMS support added to Google’s AI study tool.
SETDA 2025 Report: AI is now the top state edtech priority. Device bans are rising, but so is investment in AI PD.
Curtin Disables AI Detection: Turnitin’s AI-writing detector will be turned off to support trust & modern assessment.
Detectors Still Struggle: Most AI detectors fail key benchmarks. Pangram is the only one showing strong results.
Open-Source AI Textbooks: A new tool lets educators build AI-powered textbooks from OER with no coding.
NYT Teen Contest: Students ages 13–19 can submit creative projects on life with AI. Due Oct 22.
Story #2: Social Learning in the Age of AI
A new study shows AI is replacing peer-to-peer learning. Students are skipping group study & turning to chatbots. The result is less collaboration, less creativity, & more isolation. Matt & Liz unpack the impact on student motivation & mentorship.
Story #3: Beneath the Surface – AI Literacy & the Measurement Gap
Schools are racing to teach AI, but how do we know students are learning what matters?
TeachAI ScenariosReady-to-use lessons that build source-checking & ethical use skills.
AI QuestA game-based platform from Google & Stanford where students train models & solve real problems.
ETS OpinionWithout shared definitions & measurement, AI literacy risks becoming a buzzword.
Liz shares how her new student-facing course approaches skills, reflection, & real-world prompts.
Bright Byte: Alter Ego
MIT’s new wearable lets users silently communicate with machines by detecting muscle signals in the jaw & throat. Built to support people with ALS & MS, this tool brings AI & accessibility together.
Links & Resources
NotebookLM
https://notebooklm.google/
AI Scenarios
ailiteracyframework.org
AI Quest
https://blog.google/outreach-initiatives/education/ai-quests/
ETS Opinion
https://hechingerreport.org/opinion-schools-cannot-teach-ai-literacy-without-a-way-to-measure-it/
Character.AI
https://www.ftc.gov/news-events/news/press-releases/2025/09/ftc-launches-inquiry-ai-chatbots-acting-companions
SETDA 2025
https://www.setda.org/priorities/state-trends/
Anthropic Settlement
https://www.npr.org/2025/09/05/nx-s1-5529404/anthropic-settlement-authors-copyright-ai
Judge Pushback
https://news.bloomberglaw.com/ip-law/anthropic-judge-blasts-copyright-pact-as-nowhere-close-to-done
Curtin Disables Detection
https://www.curtin.edu.au/news/oasis-news/update-on-turnitin-ai-detection-tool/
NBER Study
https://www.nber.org/papers/w34223
GenerativeTextbooks.org
NYT Contesthttps://www.nytimes.com/2025/09/05/learning/growing-up-with-ai-a-multimedia-challenge-for-teenagers-and-educators.html
Alter Ego
https://decrypt.co/338527/near-telepathic-wearable-communicate-silently-devices
Announcements
Check out the new Student AI Course for middle & high school. Email Matt & Liz at chatedu@edadvance.org
The Fall Micro-Credential is open. Join us for the educator & school leader course starting in October - skills21.org/ai/micro
Sponsors
The National Center for Next Generation Manufacturing. Explore their October 15–17 Summit in Rochester Hills, MI. www.nextgenmfg.org
EDIAThe AI-powered platform helping schools reduce absences & boost achievement edia.app/contact


