A researcher focused on the role of AI in education joins to discuss how AI is reshaping learning environments. They explore advancements in open-source AI models and their implications for assessments, classroom integration, and medical training. The conversation also highlights student perspectives on using ChatGPT, showcasing responsible approaches to learning. Additionally, the duo tackles the ongoing debate about equitable access to AI tools and the importance of supportive measures for educators, ensuring a balanced and ethical application of technology.

Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College, shares fascinating insights on AI's role in education. He highlights how AI can transform assessments to focus on ongoing learning rather than just final results. Anthony passionately discusses AI-driven personalized feedback for students and how it can ease teachers' workloads. He also emphasizes the importance of engaging parents in the educational process, ensuring they become active participants rather than passive recipients. Don't miss his upcoming speaking engagements!

In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat.    Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.   Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here   Some of the resources that the team talked about in the episode are below:   NSWEduChat landing page: NSWEduChat   NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)   NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)   Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.   Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.   Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.   Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.   Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.   Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book   NSW DoE Future Frontiers landing page: Education for a Changing World

From AI Detectors to Heartwarming Help: Two Tales of AI in a school Series 8 Episode 11  In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview Martin O'Sullivan, a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's school—one highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education.  00:00 Introduction  02:32 Martin's Background and School  03:50 AI in Education: Martin's Journey 05:59 Challenges with AI Detectors 09:23 Emotional Impact on Students 11:45 Reflections on AI in Assessment We discussed two assessment topics that have been in previous episodes: Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in Series 8 Episode 2 The AI Assessment Scale research - in Series 8 Episode 7 22:34 Heartwarming Story: AI Robot for Student There's more reporting on this story on the BBC website 27:10 Conclusion and Final Thoughts

Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week   NEWS Victorian "Generative Artificial Intelligence Policy" for government schools. https://www2.education.vic.gov.au/pal/generative-artificial-intelligence/policy   Meeting the AI Skills Boom https://techcouncil.com.au/wp-content/uploads/Meeting-the-AI-Skills-Boom-2024.v2.pdf   LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made it https://www.latimes.com/california/story/2024-07-03/lausds-highly-touted-ai-chatbot-to-help-students-fails-to-deliver   A class above: UNSW Sydney uses AI to power personalised paths to student success https://news.microsoft.com/en-au/features/a-class-above-unsw-sydney-uses-ai-to-power-personalised-paths-to-student-success/     Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers? https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848#bib23   GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education https://arxiv.org/abs/2403.19148   Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concerns https://myscp.onlinelibrary.wiley.com/doi/10.1002/jcpy.1414   Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Framework https://osf.io/preprints/edarxiv/adxuq   How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses https://arxiv.org/pdf/2405.00970   AI Conversational Agent Design for Supporting Learning and Well-Being of University Students https://osf.io/preprints/edarxiv/w4rtf   The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities https://osf.io/preprints/edarxiv/y52ew   The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances https://osf.io/preprints/osf/qy8zd   The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Work https://osf.io/preprints/edarxiv/x3dct   Is ChatGPT Transforming Academics' Writing Style? https://arxiv.org/abs/2404.08627   Can AI Provide Useful Holistic Essay Scoring? https://osf.io/preprints/osf/7xpre Read the excellent article about this paper in the Heching Report   Best Practices for Using AI When Writing Scientific Manuscripts https://pubs.acs.org/doi/epdf/10.1021/acsnano.3c01544   A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305354

Dan Ingvarson, a prominent figure in AI education, delves into how generative AI can revolutionize assessment practices, offering personalized evaluations for students. The discussion covers challenges teachers face, the potential of AI in creating effective rubrics, and the importance of evolving curricula to incorporate advanced AI methodologies for enhanced student learning and teacher workload.

Content warning! This episode talks about an academic research paper titled "ChatGPT is bulls**t", and we've not edited the word out - in fact, we've gone to town with it, talking about the different types of it (in the strictest academic sense). So you may not want to play this in the car on your school run! The news item discussed is: Student crafts elaborate AI scheme to pass university exam, gets arrested https://cybernews.com/news/turkish-student-found-using-ai-arrested/   This week's papers discussed are: Developing evaluative judgement for a time of generative artificial intelligence https://www.tandfonline.com/doi/full/10.1080/02602938.2024.2335321   Prompting Large Language Models for Zero-shot Essay Scoring via Multi-trait Specialization https://arxiv.org/abs/2404.04941   Working Alongside, Not Against, AI Writing Tools in the Composition Classroom: a Dialectical Retrospective https://uen.pressbooks.pub/teachingandgenerativeai/chapter/working-alongside-not-against-ai-writing-tools-in-the-composition-classroom-a-dialectical-retrospective/   GPT versus Resident Physicians — A Benchmark Based on Official Board Scores https://ai.nejm.org/doi/pdf/10.1056/AIdbp2300192   Evaluating General Vision-Language Models for Clinical Medicine https://www.medrxiv.org/content/10.1101/2024.04.12.24305744v1   Re-evaluating GPT-4’s bar exam performance https://link.springer.com/article/10.1007/s10506-024-09396-9   Automated Social Science: Language Models as Scientist and Subjects https://arxiv.org/abs/2404.11794   Large language models cannot replace human participants because they cannot portray identity groups https://arxiv.org/abs/2402.01908   I also mentioned the article about the the Infinite Focus Group, which is here: https://www.ai-mindset.ai/ai-mindset-newsletter/the-infinite-focus-group   The impact of large language models on university students’ literacy development https://www.tandfonline.com/doi/epdf/10.1080/07294360.2024.2332259?needAccess=true   Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays https://www.sciencedirect.com/science/article/pii/S2666920X24000109   Feedback sources in essay writing: peer-generated or AI-generated feedback? https://link.springer.com/article/10.1186/s41239-024-00455-4   ChatGPT is bullshit https://link.springer.com/epdf/10.1007/s10676-024-09775-5?sharing_token=0CIhP_zo5-plierRq8kkDPe4RwlQNchNByi7wbcMAY77xTOWyddkW01qGFs1m5zuuoZGBctVlsJF8SbYqcxWi-XzgEYEPiw7xwWi4bMYXJ_1JARDrER9JGdWZOW-UGSkrk_tXPjPh-XWvFNoiFzNlnDUUUEBAztiX9PtP2p6jfI%3D

Wow, this week we have a bumper episode with more resources than a GPT factory!  Any time we get a guest making their second appearance, and therefore enter our Hall of Fame, then we officially dub them "Friend of the Show". And so this week, we've got Friend of the Show Leon Furze sharing his experiences and expertise.   Here are the links and posts related to our conversation with Leon around assessment.     Leon's blog - for all the updates and posts that he is working on  https://leonfurze.com/blog    Leons's free e-Book on assessment can be found here: https://mailchi.mp/leonfurze/assessment (free ebook on assessment)   Leon Furze Linkedin profile is here if you want to follow his stream of thoughts, and to connect with him: Leon Furze - Furze Smith Consulting | LinkedIn   The Artificial Intelligence Assessment Scale (AIAS) paper we discussed can be found here:  https://open-publishing.org/journals/index.php/jutlp/article/view/810    The online course around practical AI strategies: https://practicalaistrategies.com/p/practical-ai-strategies  And, even better, he's given listeners a discount code that will save you 25% of the cost. Just use the magic word 'AIPODCAST'   The blog post we mentioned a couple of times during the episode: https://leonfurze.com/2024/05/27/dont-use-genai-to-grade-student-work/   Leons new book and course can be also found on his main site here: https://practicalaistrategies.com/

This week we set the episode timer for 15 minutes, and managed to get through just five papers before the buzzer went off! So we have plenty more papers to discuss in future episodes... ENHANCING K-12 STUDENTS’ PERFORMANCE IN CHEMISTRY THROUGH CHATGPT-POWERED BLENDED LEARNING IN THE EDUCATION 4.0 ERA https://library.iated.org/view/ORTIZDEZARATE2024ENH   Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot study https://bera-journals.onlinelibrary.wiley.com/doi/pdfdirect/10.1111/bjet.13454   ChatGPT “contamination”: estimating the prevalence of LLMs in the scholarly literature https://arxiv.org/abs/2403.16887   Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews https://arxiv.org/abs/2403.07183   Large language models are able to downplay their cognitive abilities to fit the persona they simulate https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0298522  

Assessment - Chris Goodall In this episode of the AI Education Podcast, host Dan converses with Chris Goodall, the head of digital education at the Bourne Education Trust in England. They discuss the integration of AI into education, how it can be used to enhance teaching and learning processes, and the impact of personalized AI tools on students and educators. The conversation covers practical applications of AI, the ongoing need for teacher and student adaptation to new technologies, as well as ethical considerations and future possibilities for AI in education. Chris Goodalls Linkedin profile here: Chris Goodall | LinkedIn Practical Advice for embedding IT in school: Embedding AI use in school