The Learning Scientists Podcast

Discover the benefits of interleaving in studying, including improved comprehension and problem-solving skills. Learn how interleaving different paintings by different artists aids in learning and how it can be applied to subjects like chemistry. Explore the advantages of interleaving categories during studying, highlighting improved performance and understanding of basic properties in subjects.

This episode was funded by The Wellcome Trust.Show Notes:Over the past few decades, cognitive psychologists have found evidence for the following 6 strategies for effective learning:Spaced PracticeRetrieval PracticeElaborationInterleavingConcrete ExamplesDual CodingToday, we are talking about interleaving. Be sure to listen to our spaced practice and retrieval practice episodes, as those are the most important strategies!Interleaving is a learning strategy that involves switching between topics and ideas, which has been shown to improve long-term learning relative to blocking study of the same idea or topic (1). We recently spoke with a 12-year-old student in the UK, who described a similar strategy that he uses, and called it "jumbling it up". We loved this term so much, that we wrote a blog post about it!Early research in interleaving focused a lot on motor skills (2), but more recently there has been renewed interest in this strategy as it applies to problem-solving, for example in maths (3), as well as how it applies to music (4). In the podcast, Yana talks about an adorable concrete example of interleaving involving her 5-year-old daughter who was trying to interleave addition and subtraction problems.Interleaving might work because it helps students learn to distinguish between concepts and learn when to apply which strategy (5). Machine learning studies have also attempted to simulate the processes involved in interleaving (6). However, there is still much we do not know about interleaving! For example, while we know that it's not worth interleaving completely unrelated material from different subjects (7), we don't yet know exactly how related the interleaved material should be, or what effect interleaving has on attention. Yana recently submitted a grant proposal with Dr. Sophie Forster at Sussex University to explore these unanswered questions.  We hope you enjoyed this podcast! Check back in 2 weeks, when we’ll be releasing a “bite-size research” episode describe an interesting paper about interleaving. Subscribe to our Podcast!Go to our show on iTunes or wherever you get your podcasts.RSS feed: http://www.learningscientists.org/learning-scientists-podcast/?format=rssReferences:(1) Taylor, K., & Rohrer, D. (2010). The effects of interleaved practice. Applied Cognitive Psychology, 24, 837-848.(2) Shea, J. B., & Morgan, R. L. (1979). Contextual interference effects on the acquisition, retention, and transfer of a motor skill. Journal of Experimental Psychology: Human Learning and Memory, 5, 179-187.(3) Rohrer, D., Dedrick, R. F., & Stershic, S. (2015). Interleaved practice improves mathematics learning. Journal of Educational Psychology, 107, 900-908.(4) Carter, C. E., & Grahn, J. A. (2016). Optimizing music learning: Exploring how blocked and interleaved practice schedules affect advanced performance. Frontiers in Psychology, 7.(5) Rohrer, D. (2012). Interleaving helps students distinguish among similar concepts. Educational Psychology Review, 24, 355-367.(6) Li, N., Cohen, W. W., & Koedinger, K. R. (2012, June). Problem Order Implications for Learning Transfer. In ITS (pp. 185-194).(7) Hausman, H., & Kornell, N. (2014). Mixing topics while studying does not enhance learning. Journal of Applied Research in Memory and Cognition, 3, 153-160.

This bite-size research episode explores the effectiveness of elaborative interrogation in improving learning of science facts for middle school students. The study shows that elaborative interrogation works well for both independent and partnered learning. It compares different study strategies and finds that collaborative interrogation leads to the most learning. The episode also highlights the importance of considering students' background knowledge when implementing collaborative interrogation as a teaching strategy.

This episode was funded by The Wellcome Trust.Show Notes:Over the past few decades, cognitive psychologists have found evidence for the following 6 strategies for effective learning:Spaced PracticeRetrieval PracticeElaborationInterleavingConcrete ExamplesDual CodingToday, we are talking about elaboration. Be sure to listen to our spaced practice and retrieval practice episodes, as those are the most important strategies!Elaboration is a really broad concept - at its core, it just means connecting or adding information. "Elaborative interrogation" is a strategy within this broad idea, and it involves asking “how" and “why" questions and finding those answers (1). Students can do this independently, with the teacher helping, or in pairs of groups. Once they come up with the questions, students must also find the answers!For example, how might you learn about the physics of flying? You could do it by answering lots of fact-based questions, but you can also supplement this by asking and then answering elaboration questions, such as "why does a plane need an engine?" and "how does a plane take off?"Elaborative interrogation can be a tricky strategy to implement, because students won’t always focus on the right information, or have the content knowledge necessary to carry out the task effectively. In the podcast episode, we use lots of examples from younger and older students, demonstrating how hard it can be to pick out the right information to ask questions about, or even come up with “how” and “why” questions at all. Students may also produce incorrect explanations in answer to their own questions. Elaboration has been shown to help students who are more familiar with the topic, while those who are less familiar don’t benefit as much (2); some studies (3) have even found elaboration to be less effective than re-reading, when students are unable to produce useful elaborations (see this guest blog post). Teachers will need to guide students towards the right kinds of questions, and give feedback on explanations. Ideally, students would be able to describe and explain ideas from memory - that is, retrieval practice using elaborative interrogation!We hope you enjoyed this podcast! Check back in 2 weeks, when we’ll be releasing a “bite-size research” episode describing an interesting paper on elaborative interrogation. Subscribe to our Podcast!Go to our show on iTunes or wherever you get your podcasts.RSS feed: http://www.learningscientists.org/learning-scientists-podcast/?format=rssReferences:(1) Pressley, M., Symons, S., McDaniel, M. A., Snyder, B. L., & Turnure, J. E. (1988). Elaborative interrogation facilitates acquisition of confusing facts. Journal of Educational Psychology, 80, 268-278.(2) Woloshyn, V. E., Pressley, M., & Schneider, W. (1992). Elaborative-interrogation and prior-knowledge effects on learning of facts. Journal of Educational Psychology, 84, 115-124.(3) Clinton, V., Alibali, M. W., & Nathan, M. J. (2016). Learning about posterior probability: Do diagrams and elaborative interrogation help? The Journal of Experimental Education, 84, 579-599.

This episode discusses the benefits of spaced retrieval practice for higher order learning. An experiment showed that spaced retrieval practice improves performance on both factual and application questions. It also reveals that taking a review quiz after eight days is more effective than after one day. Spaced retrieval practice enhances memory and boosts performance on unpracticed questions.

This podcast discusses spaced practice as an effective learning strategy. They talk about the benefits of spacing out studying over multiple sessions and how it enhances learning. They also provide tips for helping students implement spaced practice and share their own experiences. Additionally, they explore combining spaced practice with retrieval practice for even better learning outcomes.

This episode was funded by The Wellcome Trust.Show Notes:This is our first bite-size research episode, where we briefly describe research findings on a specific topic. This week, Megan Sumeracki talks about retrieval practice.In our second episode, we introduced retrieval practice or bringing information to mind. We know from a century of research that retrieval practice improves learning. There are a lot of ways to practice retrieval, and this strategy seems to be very flexible and can be used in a lot of different ways.One easy way to implement retrieval practice in the classroom is to give students frequent low-stakes or no-stakes quizzes. But the next natural question is, what retrieval format should I use?The two most common formats are short-answer and multiple-choice formats. Some research shows that short-answer quizzes improve learning more than multiple-choice quizzes because they require the students to produce the answer (1). Yet often multiple-choice quizzes are easier to administer and to grade, and we know this is very important for busy teachers. So what to do? (Spoiler alert, based on my honors thesis and the work of others, the format does not have a huge impact on learning. The important thing is to make sure students practice retrieval in some way.)In 2005, Park (2) created a hybrid format to try to combine the benefits of short-answer and multiple-choice formats. Sixth-grade students would first try to answer a question in short-answer format, and then could click a "next" button for the multiple-choice alternatives to select the correct answer. The catch is that the multiple-choice alternatives only show up for a brief amount of time. So, the students really had to try to produce the answer before clicking next. Park found that the hybrid quiz led to a little bit more learning than a standard multiple-choice quiz after a few days.In 2008, I was really interested in quiz formats and decided to conduct my undergraduate honors thesis on this topic at Purdue University. In my experiments (3), students were randomly assigned to one of a few different conditions, and each condition was assigned a different retrieval-practice format. Some students answered multiple-choice questions, some answered short-answer questions, and others answered hybrid questions. Finally, some students were in a control group where they didn't answer questions at all. All of the students read a text, took a quiz (except the control group), and then read statements containing the correct answer to all of the quiz questions. One week later, we gave the students an assessment test.My thesis advisor and I found that retrieval practice, regardless of format, improved learning over the control group. Data from Smith & Karpicke, 2014 (3) Experiment 4 However, we also found that the type of retrieval format didn't really much matter. Across 4 experiments, any differences we found between retrieval formats were really pretty small. Data from Smith & Karpicke, 2014 (3) Experiment 4 At first, my advisor and I were really surprised by this! But after doing a very systematic review of the literature and conducting 4 experiments of our own, it seems that the retrieval practice format does not have a huge effect on learning. Others have found little to no difference between retrieval practice formats (e.g., 4, 5, 6). In another paper that was published after mine, researchers found that there weren't format differences among younger middle school students (7).Main Takeaway:Retrieval practice improves learning, and we can be pretty sure of this based on a century of research. However, the type of format you use is not likely to make a huge difference to learning. You can read a blog based on this research here. You can find the published paper containing my honors thesis experiments here. We hope you enjoyed this bite-size research podcast! Check back on the first Wednesday of next month, when we’ll be releasing a podcast about spaced practice. Subscribe to our Podcast!Go to our show on iTunes or wherever you get your podcasts.RSS feed: http://www.learningscientists.org/learning-scientists-podcast/?format=rssReferences:(1) Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007). Test format and corrective feedback modify the effects of testing on long-term retention. European Journal of Cognitive Psychology, 19, 528-558.(2) Park, J. (2005). Learning in a new computerised testing system. Journal of Educational Psychology, 97, 436-443.(3) Smith, M. A., & Karpicke, J. D. (2014). Retrieval practice with short-answer, multiple-choice, and hybrid tests. Memory, 22, 784-802.(4) Clariana, R. B., & Lee, D. (2001). The effects of recognition and recall study tasks with feedback in a computer-based vocabulary lesson. Educational Technology Research & Development, 49, 23-36.(5) Williams, J. P. (1963). Comparison of several response modes in a review program. Journal of Educational Psychology, 54, 253-360.(6) Gay, L. R. (1980). The comparative effects of multiple-choice versus short-answer tests on retention. Journal of Educational Measurement, 17, 45-50.(7) McDermott, K. B., Agarwal, P. K., D'Antonio, L., Roediger, H. L., & McDaniel, M. A. (2014). Both multiple-choice and short-answer quizzes enhance later exam performance in middle and high school classes. Journal of Experimental Psychology: Applied, 20 , 3-21.

This episode was funded by The Wellcome Trust.Show Notes:Over the past few decades, cognitive psychologists have found evidence for the following 6 strategies for effective learning:Spaced PracticeRetrieval PracticeElaborationInterleavingConcrete ExamplesDual CodingToday we’re introducing retrieval practice – in other words, bringing information to mind.How does retrieval practice help learning?Retrieval practice is beneficial in many ways. The more obvious way is that doing something like a practice quiz can help you figure out what you don’t know. That’s one example of an “indirect” benefit of retrieval practice: figuring out what you know and what you don’t know leads you to do something that causes learning.But, lots of studies have also shown direct effects of retrieval practice: the act itself of bringing information to mind makes it more durable. For more on the various direct and indirect benefits of retrieval practice, see this post. Later on in the podcast, you'll hear about how retrieval practice can be good for application of knowledge to new situations – not just fact learning. For more about how retrieval practice can help with complex and novel situations, see this post. Retrieval practice can also help with anxiety! (2)Do students practice retrieval on their own?The answer is no. While students often do use quizzes as a check of how much they've learned, very few of them list retrieval practice as their go-to study strategy (1). Why not? Well, it’s hard. While doing retrieval practice, it can feel like you don’t know much – and that feels bad. This leads students to be underconfident after practicing retrieval, compared to overconfident after re-reading. For more on this illusion, see this blog post about predicted and actual learning.Megan tells an anecdote about students who come to her office and say they studied and studied – why didn't they do well? It’s probably because they didn't use effective study strategies!Another reason why students may not practice retrieval as often as they should is that the benefits of retrieval are delayed. Retrieval is better in the long-run - it produces durable learning - but it might not feel like it’s “working” while students are actually doing it.How can teachers integrate retrieval practice into their classrooms?There are many different ways for students to practice retrieval – it doesn’t have to be with a formal quiz or test. Yana’s colleague, Dr. Miko Wilford, likes to play Jeopardy with her students to help them get ready for exams. You can also do starter or exit questions, which can be low or even no stakes. You can ask students to write from memory, answer open-ended questions, draw from memory, and even create concept maps from memory (3). Be careful with having students create their own questions, though – it may not be worth it (4). Prompting questions might also help – though not always (but at least, they shouldn’t hurt). See this blog post for Megan’s recent study on retrieval practice with prompts (5).Students actually really like frequent quizzing once they get used to it. Megan and Dr. Cindy Nebel (formerly Cindy Wooldridge) recently went to Columbus State Community College to talk to instructors there, and one of the professors, Felicia Smith, talked about giving daily quizzes in some of her classes, and how students who’d experienced this reacted when they took her other classes in which she didn’t use daily quizzing. It’s a good idea to tell students why you are including so many quizzes. This helps students understand that we’re not just doing this to be mean to them! Dr. Althea Bauernschmidt always tells students:"I quiz because I care."(For Althea’s latest guest post on our blog, see here).What about flashcards?Flashcards can be a good way for students to practice retrieval on their own, but they have to make sure they are doing it properly: actually trying to retrieve, rather than just flipping the card. A group of students in Yana’s class recently claimed that making flashcards rather than using them to practice retrieval was what helped them learn. You’ll have to listen to the podcast to find out what happened with that hypothesis! Image from Pixabay For a different twist on flashcards, see this method described by college student Rachel Adragna, which goes beyond using flashcards for retrieving key terms and definitions –encouraging students instead to think more deeply and in new ways about the information they’re trying to learn.One last thing: Students should not stop studying when they think they’ve learned the information. Repeated retrieval, even after retrieval success, is critical for long-term learning (6), (7).We hope you enjoyed this podcast! Check back in 2 weeks, when we’ll be releasing a “bite-size research” episode describe an interesting paper on retrieval practice. Subscribe to our Podcast!Go to our show on iTunes or wherever you get your podcasts.RSS feed: http://www.learningscientists.org/learning-scientists-podcast/?format=rssReferences:(1) Karpicke, J. D., Butler, A. C., & Roediger, H. L. (2009). Metacognitive strategies in student learning: Do students practice retrieval when they study on their own? Memory, 17, 471-479.(2) Smith, A. M., Floerke, V. A., & Thomas, A. K. (2016). Retrieval practice protects memory against acute stress. Science, 354, 1046-1048.(3) Blunt, J. R., & Karpicke, J. D. (2014). Learning with retrieval-based concept mapping. Journal of Educational Psychology, 106, 849-858.(4) Weinstein, Y., McDermott, K. B., & Roediger, H. L. (2010). A comparison of study strategies for passages: Re-reading, answering questions, and generating questions. Journal of Experimental Psychology: Applied, 16, 308-316.(5) Smith, M. A., Blunt, J. R., Whiffen, J. W., & Karpicke, J. D. (2016). Does providing prompts during retrieval practice improve learning? Applied Cognitive Psychology, 30, 544-553.(6) Karpicke, J. D., & Roediger, H. L. (2008). The critical importance of retrieval for learning. Science, 319, 966-968. (7) Karpicke, J. D. (2009). Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General, 138, 469-486.

This episode was funded by The Wellcome Trust.Show Notes:Welcome to the Learning Scientists Podcast – a podcast for teachers, students, and parents about evidence-based practice and learning.In this episode, the two of us – Dr. Yana Weinstein (UMass Lowell) and Dr. Megan Sumeracki (formerly Megan Smith; Rhode Island College) – introduce ourselves and tell you a bit about our backgrounds, how we came to start the Learning Scientists project, and what we’ll be talking about on this podcast.About UsYana was born in Russia, grew up in England, spent a bit of time in France, and moved to the US in 2008 – first to St. Louis, MO (to do a postdoc at Washington University in St. Louis with Roddy Roediger), and then to Boston 5 years ago to start her faculty position at UMass Lowell.Megan has lived in the United States her entire life. She grew up North of Chicago, went to Purdue University for her undergraduate education, Washington University in St. Louis for her Masters, and back to Purdue for her PhD. She then took a 1-year position at Utah State University Eastern, before settling into her position at Rhode Island College.So, we met at Washington University in St. Louis 8 years ago, but we didn’t really work together at the time. A year and a half ago, however, everything changed as we re-discovered each other on Twitter and launched the Learning Scientists project.The Learning Scientists projectOriginally, we started searching for students who wanted help studying. Did you know that once every few minutes, someone tweets asking “how to study”? See for yourselves! To learn more about how the project emerged spontaneously from our Twitter interactions, see this story.Make sure to follow us on Twitter @AceThatTest.  With the help of Samuel Sumeracki, a strategic communication expert – and now, Megan’s husband! – we started a website and blog. Our first blog post was called Communication Breakdown Between Science and Practice in Education. We got a variety of responses to this blog post, and in the past 18 months we’ve learned a lot and realized that we were somewhat naïve when we started the project and wrote that post. See here for our 1-year reflection post, where we elaborate on how the project evolved from that first post.The Lab to Classroom modelIn this first podcast episode, we discuss our experiences in the classroom, and debunk one of the myths surrounding cognitive psychology and education: that we only collect data in the lab. We do, in fact, start in the lab; but then, we build our way up to the classroom. For an example of the lab to classroom model in practice, see this blog post.Six Strategies for Effective Learning Image by Oliver Caviglioli In this podcast, we’ll be focusing on 6 strategies that have the most evidence supporting their effectiveness. Here are the 6 strategies, with links to our dedicated page for each strategy, where you can find posters, blog posts, and other free downloadable resources:Spaced PracticeRetrieval PracticeElaborationInterleavingConcrete ExamplesDual CodingFor more about the 6 strategies, see this blog post. Recently, we’ve been discussing these strategies with teachers and students. One of the 12 year olds we talked to in the UK even co-authored a blog post with us!For the next 6 months, we’ll be taking one of these strategies in turn and presenting research evidence as well as implementation ideas, and hopefully providing even more opportunities for teachers, students, and parents to interact with us.Speak to you soon!You can leave a comment here, on any of our blog posts, and join us on Twitter and Facebook. Also, check out the FAQ page and submit your questions through the form at the bottom of that page. Check out this digest for all the different ways you can get in touch with us. We’d love to hear from you.Subscribe to our Podcast!Go to our show on iTunes or wherever you get your podcasts.RSS feed: http://www.learningscientists.org/learning-scientists-podcast/?format=rss