AI Education Podcast

News This week's news we rushed through includes "Study Buddy or Influencer?", the Australian Parliamentary Inquiry into the use of Gen AI in the Australia Education System  https://www.aph.gov.au/Parliamentary_Business/Committees/House/Employment_Education_and_Training/AIineducation/Report NSW EduChat has been extended for all teachers in all New South Wales Schools - https://www.innovationaus.com/nsw-teachers-to-get-time-saving-genai-tool/ Learn more about the NSW EduChat chatbot in the first episode of Series 9 Microsoft announced Copilot Wave 2 https://www.microsoft.com/en-us/microsoft-365/blog/2024/09/16/microsoft-365-copilot-wave-2-pages-python-in-excel-and-agents/ OpenAI's new model o1-preview came out - and it's much, much better and logical reasoning and maths Find out what people think by looking at what Ethan Mollick is saying about it (and, as I suggest on the podcast, keenly watch Dan Hart's posts as he's benchmarking it now in the context of EduChat) Google released a podcast-generator as part of NotebookLM, which turns any kind of paper/book etc into a short podcast. To find out what it's like I gave it the top research paper from the podcast last time and you can compare it versus me! There's a quick demo review by Ethan here and you can login and have a play directly here: https://notebooklm.google.com/ (it has two main uses, because on top of this autopodcast, it's original purpose was to allow you give it a pile of documents and it can work with all of them at the same time for q&a, summaries etc)   Research Here's the links to all nine papers we discussed in this week's episode: Generative AI in Real-World Workplaces https://www.microsoft.com/en-us/research/uploads/prodnew/2024/07/Generative-AI-in-Real-World-Workplaces.pdf  Can Large Language Models Make the Grade? https://dl.acm.org/doi/10.1145/3657604.3664693 PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection https://arxiv.org/abs/2406.16288  The global landscape of academic guidelines for generative AI and Large Language Models https://arxiv.org/abs/2406.18842  "Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline  https://arxiv.org/abs/2406.18512 Perceived Impact of Generative AI on Assessments: Comparing Educator and Student Perspectives in Australia, Cyprus, and the United States https://www.sciencedirect.com/science/article/pii/S2666920X24000729 Jill Watson: Scaling and Deploying an AI Conversational Agent in Online Classrooms https://dilab.gatech.edu/publications/jill-watson-scaling-and-deploying-an-ai-conversational-agent-in-online-classrooms/  https://dilab.gatech.edu/test/wp-content/uploads/2024/05/ITS2024_JillWatson_paper.pdf Integrating AI in College Education: Positive yet Mixed Experiences with ChatGPT https://arxiv.org/abs/2407.05810 The AI Companion in Education: Analyzing the Pedagogical Potential of ChatGPT in Computer Science and Engineering https://arxiv.org/abs/2407.05205    

This week's guest is Professor Phillip Dawson, who is Co-Director of the Centre for Research in Assessment and Digital Learning at Deakin University in Australia. In addition to Phill's website, we recommend following Phill on LinkedIn, or Twitter, where shares a lot of his work on the future of assessment, and also his passion project - The Peer Revue - where Phill combines his passion for academic research with his work in Improv Comedy. Every month he hosts a research who talks about their professional research, which is then turned into comedy gold by his improv team at The Improv Conspirancy Theatre (highly recommend keeping an eye out for this if you're in Melbourne) You can find Phill's research papers here on Google Scholar, and his LinkedIn feed has his books and his contributions to other advice and consultations in the education sector Phil mentions a number of researchers and their work in the podcast. Here's the links: James Reason's work on the Swiss Cheese model for failure of complex systems "The contribution of latent human failures to the breakdown of complex systems" You can either read the original research paper or this easier to grasp Wikipedia article "The Swiss Cheese Mode" Kiata Rundle's work on then applying this to academic integrity - you can find all of her papers on Google Scholar Alfie Kohn "Punished by Rewards" - https://www.mv.helsinki.fi/home/hotulain/Punished.pdf Phill mentioned Deci & Ryan's work, so here's a good place to start reading on Self-Determination Theory And here's a starting point if you need it for reading about Vygotsky's Zone of Proximal Development Then Phill mentioned the book Thanks for the Feedback, but Stone & Heen, which is on Amazon here  

Series 9, Episode 9 - Homework and Sex   News How do people actually use ChatGPT? How do people use ChatGPT? We analyzed real AI chatbot conversations - The Washington Post   Make AI tools to reduce teacher workloads, tech companies urged https://www.theguardian.com/education/article/2024/aug/28/make-ai-tools-to-reduce-teacher-workloads-tech-companies-urged     New AI in Teams - and it's all free https://www.linkedin.com/posts/miketholfsen_ai-edtech-microsoftteams-activity-7236817645625335809-08OC https://aka.ms/TeamsEDUAIQuickGuide   Research Papers   Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course https://arxiv.org/abs/2407.05216   Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classrooms https://arxiv.org/abs/2406.07571    Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam https://arxiv.org/abs/2406.09671    Generative AI Can Harm Learning https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4895486   ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering https://www.tandfonline.com/doi/epdf/10.1080/22054952.2024.2372154   How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence https://arxiv.org/abs/2406.14769   Analyzing Large Language Models for Classroom Discussion Assessment https://arxiv.org/abs/2406.08680    Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics https://arxiv.org/abs/2406.11858    ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor https://arxiv.org/abs/2406.14765    70B-parameter large language models in Japanese medical question-answering https://arxiv.org/abs/2406.14882    I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education https://arxiv.org/abs/2406.14871    Large Language Models in Student Assessment: Comparing ChatGPT and Human Graders https://arxiv.org/abs/2406.16510 

This week we hear from Professor Rose Luckin, from University College London and Educate Ventures Research  In the podcast, Rose mentioned the 1% project in Finland from 2020 - here's some reporting on it  Through Educate Ventures Research there are a range of AI consultancy and training services for schools, including the AI Readiness Online Course for teachers Rose also has a monthy newsletter "The Skinny on AI for Education" which has an extensive reading list every edition, on a number of AI topics, not just what's happening in education.

News   TEQSA's new paper on Academic Integrity & AI The evolving risk to academic integrity posed by generative artificial intelligence: Options for immediate action https://www.teqsa.gov.au/sites/default/files/2024-08/evolving-risk-to-academic-integrity-posed-by-generative-artificial-intelligence.pdf   State of Generative AI in the Enterprise: An Australian Perspective https://www.deloitte.com/au/en/services/consulting/analysis/state-generative-ai-enterprise.html     Research   A review on the use of large language models as virtual tutors https://arxiv.org/abs/2405.11983   Jill Watson: A Virtual Teaching Assistant powered by ChatGPT https://arxiv.org/abs/2405.11070   An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownership https://arxiv.org/abs/2405.13890   Intelligent Tutor: Leveraging ChatGPT and Microsoft Copilot Studio to Deliver a Generative AI Student Support and Feedback System within Teams https://arxiv.org/abs/2405.13024   Large Language Models as Partners in Student Essay Evaluation https://arxiv.org/abs/2405.18632   Grade Like a Human: Rethinking Automated Assessment with Large Language Models https://arxiv.org/abs/2405.19694    Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing https://arxiv.org/abs/2405.19691    Experiences from Integrating Large Language Model Chatbots into the Classroom https://arxiv.org/abs/2406.04817    Delving into ChatGPT usage in academic writing through excess vocabulary https://arxiv.org/abs/2406.07016    Understanding Students' Acceptance of ChatGPT as a Translation Tool: A UTAUT Model Analysis https://arxiv.org/abs/2406.06254 

BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per   haps we can share an untold story, or you can tell us yours! August  19 August - Melbourne - Ray Melbourne EdTech Summit Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities 21 August - Sydney - Ray - Free event The Future of Human AI - IATD If you're in Sydney, the Institute of Applied Technology has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom   23 August - Sydney - Dan AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world.   September 3 September - Online - Dan - Free event Build a Bot in Copilot Studio Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand.   4 September - Christchurch, NZ - Ray NZ Tertiary ICT Conference For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi!   12-13 September - Adelaide - Ray HE FEST 24 Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous"   16-19 September - Online - Dan and Ray - Free event Toddle's AI for AussieEd online event  The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording  

In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices. Amanda's LinkedIn Profile: Amanda Bickerstaff | LinkedIn AI for Education site: AI for Education AI prompt library: Prompt Library  Webinar archive: AI Webinars for Educators Free resources for teachers: Downloadable Resources 00:00 Guest Introduction: Amanda Bickerstaff 01:17 Amanda's Background and Journey 02:53 The Role of AI in Education 04:56 Challenges and Misconceptions in AI Adoption 06:05 Building AI Literacy and Addressing Fears 12:51 The Future of Personalised Learning 22:13 Exciting Developments and Final Thoughts 30:29 Conclusion and Closing Remarks

A researcher focused on the role of AI in education joins to discuss how AI is reshaping learning environments. They explore advancements in open-source AI models and their implications for assessments, classroom integration, and medical training. The conversation also highlights student perspectives on using ChatGPT, showcasing responsible approaches to learning. Additionally, the duo tackles the ongoing debate about equitable access to AI tools and the importance of supportive measures for educators, ensuring a balanced and ethical application of technology.

Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College, shares fascinating insights on AI's role in education. He highlights how AI can transform assessments to focus on ongoing learning rather than just final results. Anthony passionately discusses AI-driven personalized feedback for students and how it can ease teachers' workloads. He also emphasizes the importance of engaging parents in the educational process, ensuring they become active participants rather than passive recipients. Don't miss his upcoming speaking engagements!

In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat.    Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.   Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here   Some of the resources that the team talked about in the episode are below:   NSWEduChat landing page: NSWEduChat   NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)   NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)   Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.   Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.   Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.   Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.   Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.   Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book   NSW DoE Future Frontiers landing page: Education for a Changing World