Online Learning in the Second Half

In this episode, John and Jason talk about the ethics of AI, including how ethics are formed and a few scenarios like if it’s ethical to use Midjourney. Listen in to find out who says no! See complete notes and transcripts at www.onlinelearningpodcast.com Join Our LinkedIn Group - *Online Learning Podcast (Also feel free to connect with John and Jason at LinkedIn too)* Links and Resources: Article: Harvard Business Review Ethics in the Age of AI Series: Part 1, Part 2, and Part 3 Article: It's Not Like a Calculator, so What Is the Relationship between Learners and Generative Artificial Intelligence? Jason’s FAFSA Assistant GPT ”Right Choices: Ethics of AI in Education” - John hosts Jason in an episode of the School Leadership + Generative AI series John’s School Leader AI Bootcamp Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! Podcast Episode on AI Ethics - January 29, 2024 False Start [00:00:00] John Nash: Should we do the intro? [00:00:01] Jason Johnston: Yeah, let's do the intro. [00:00:03] John Nash: I'm John Nash here with Jason Johnston. [00:00:06] Jason Johnston: Hey, John. Hey, everyone. And this is Online Learning Podcast. The Online Learning Podcast. Let's try it again. [00:00:12] John Nash: I'm John Nash here with Jason Johnston. [00:00:14] Jason Johnston: That reminded me of do you ever watch The Office? My name is Kevin, because that's my name. My name is Kevin, because that's my name. So this is the Online Learning Podcast, the Online Learning Podcast. Episode [00:00:30] John Nash: I'm John Nash here with Jason Johnston. [00:00:32] Jason Johnston: Hey, John. Hey, everyone. And this is Online Learning in the Second Half, the Online Learning Podcast. [00:00:38] John Nash: Yeah, we're doing this podcast to let you in on a conversation we've been having for the last couple of years about online education. Look, online learning's had its chance to be great, and some of it is, but still a lot of it isn't. How are we going to get to the next stage, Jason? [00:00:52] Jason Johnston: That is a great question. Why don't we do a podcast and talk about it? [00:00:56] John Nash: That's perfect. What do you want to talk about today? [00:00:59] Jason Johnston: John, I've got some ethical questions for you. [00:01:02] John Nash: You do? [00:01:03] Jason Johnston: I've been wondering about the ethics of using AI for certain tasks. And maybe we'll get back to some specifics later on. But how do we form our ethics to begin with when it comes to AI and using AI these days when we think about education? [00:01:19] John Nash: I'm stealing your line from the intro. That is a great question. How do we form our ethics? I think they're formed by the values and the beliefs we bring to anything we do. You've had a longer background and thinking and considering about ethics, both in your professional life and your education life. What do you think about in terms of what sensibilities people bring to any task? [00:01:45] Jason Johnston: Yeah, I think so. I like where you started there because sometimes people start externally. They think ethics are clear, right? We're not supposed to steal people's cars and we're not supposed to, kill people when we walk in front of them or whatever. And, but it's not that clear when it comes to certain things. Certainly we can follow the ethics of a country or a city or institution, AI is something new. We haven't dealt with some of these questions before. And because of that, it does take some ethical reasoning. I happened to talk to a number of PhD students taking an instructional systems design course. I was asked to come in by one of our previous guests, Dr. Anilda Romero Hall, and to talk about ethics in instructional design. And where I started with that was this question of what do we bring to the table? If we can understand what forms our ethics, our beliefs, our positionality to begin with, then we can start to understand why we might have some knee jerk reactions to certain things. [00:02:49] Jason Johnston: And we might be more willing to concede on some things for the sake of the common good. And as we talk about ethics within a context or within a a group of people or a community or what have you. [00:03:02] John Nash: Do you think the ethics of the companies that are creating these models drive how people feel ethically about using them, or is it the other way around? Did the companies decide they needed to sound ethical because they knew people were going to clamor about whether these models might be used in unethical ways? [00:03:26] Jason Johnston: Yeah, this is a great question. Yeah, it feels like, to me they're aspects, if I'm reading down, like, and they've all got them, right? So you can look these up OpenAI, IBM, Anthropic. If you start to read down those ethics, typically you re, resonate with a lot of those ethics. They're good things, typically, about security And inclusivity and being non biased and private and so on, but then you've got to ask yourself what is really driving these companies to do what they do and what is not being said, right? What's between the lines here and what are missing? And this is where I think we need to go beyond what the companies are saying and think ethically about our own context. As educational institutions, I don't think we can just rely on these, do you think we can rely on these ethics to help guide our use of AI? Are they good enough, John? [00:04:19] John Nash: we rely on them? [00:04:21] Jason Johnston: Yes. [00:04:22] John Nash: To what extent? I think, of course, they're a good start. They're a start. I think maybe even good gets left off of that last statement. They're a start. They're certainly not unethical, what's been put out there. I don't think that, But the companies are no fools. They know that they're for profit companies and if they were to put out statements around ethics that didn't seem to meet with what general morally accepted principles look like, they would be derided in the marketplace. [00:04:50] Jason Johnston: So do you think these ethical guidelines are crafted by philosophers within their midst or marketing people within their midst? [00:04:58] John Nash: Certainly, I think it's more of the latter than the former. Many of them are Bay Area companies and there's ethos of the Bay Area and these guys and how they think. I think they probably want to be ethical. Google once infamously now said, "do no evil." And then of course later got into many different kinds of arrangements that were not unevil. [00:05:19] Jason Johnston: Yeah, you'd sent me an article a little while ago in the Harvard Business Review. They had a AI ethics series that I can put the links into the show notes here and where they looked at avoiding the ethical nightmares of emerging technology and questions about AI responsibility. And one of the questions was, what does the tech industry value? And it looked at some of the ideologies around the culture of speed. And so I think my question with some of these, if you look at it, any of these big companies, Google, IBM, Anthropic with Claude, OpenAI, they have a list of ethics, but I think we always have to ask the question, what's not there, that's driving them. And I think this is one of those, is this culture of speed and the fact that it almost seems like their guiding point is that we need to do this as quickly as possible and get out there in front of other people. And, and that guides them ethically in terms of the choices that they make. [00:06:22] John Nash: I agree with you. I think that they have two books of ethics, maybe, almost as though like a business that's got a second set of books. And so they've got the public ethics around keeping people safe and data safe and responses of our machines, that are very human like in their responses, the responses are safe. And then the other set of ethical books say we need to move on this like our board members want because shareholder value. [00:06:52] Jason Johnston: Yeah. Yeah. And because of that, they may be willing to let some of those guardrails down a little bit to allow for the speed. And some of these post humanists or transhumanists kind of people that are running a lot of these companies think about the, from an ethical standpoint, , they're taking a more of a teleological approach, which is just looking at this ends justify the means. If in my mind, this is going to improve society so radically that we're willing to let a few things slide here along the way. And I think that's where the speed comes in, is that if we can get there quicker, and we can improve society sooner, then we're willing to let a few, little ethical oversights go by while we're building whatever it is we're building. [00:07:42] John Nash: Yes, because if you take what Mark Andreessen recently said, there is a belief amongst some of these founders that they are actually saving the world, that these are technologies that are going to save humans. [00:07:56] Jason Johnston: I resonate with that idea of there being two books and we got to ask what the closed book, the secret book of ethics is, and what the open book of ethics is. The open book of ethics is almost always now talks about safety and inclusivity and privacy and these kind of things, whereas the closed book probably more things like like speed about having a perception of what the public needs in order to adopt it versus it actually being there. So, managing basically your market and managing what the market perception is of a particular thing is more important in these cases than the actual thing itself. [00:08:44] John Nash: Yeah, or what problem the thing is solving. We've not been privy to the real internal discussions at say Open AI when they said we will publicly release 3.5. I don't know what the problem was that they saw was being solved in the marketplace by releasing this. [00:09:01] Jason Johnston: Right? [00:09:01] John Nash: I don't know that there was one exactly, except that it's just, it's a fascinating technology and fun to play with and mind blowing. But that's about it. And yet they were able to monetize that because people wanted to, play with it and actually do work with it. Yeah, I don't, I think this was all, these were all products with solutions in search of a problem. [00:09:21] Jason Johnston: Yeah, it's strange. And this is what makes it really unlike a lot of other inventions. And I think because it's so open ended, it's so user driven, [00:09:30] John Nash: Yes. [00:09:31] Jason Johnston: And inquiry based that it doesn't need to be a solution to any one problem. That it's like an open ended potential solution, [00:09:41] John Nash: Yeah, unlike the sundial, or the scientific calculator, or the phonograph, or the chalkboard, or go on. Yeah. [00:10:05] Jason Johnston: On paper and in their heads, but you're right. We continue to press math forward. However, again, here's a piece of technology, just like you mentioned there, with a very specific use in mind, right? And it has certain limitations to it. I think AI is more like the internet where it's wide open or as a recent article I read said : it's more like electricity somebody told me this about their about their grandfather that lived in Eastern Kentucky, didn't have electricity and they're asking do you want us to run the lines out to your home? And he's like, why would I need lines? I don't have anything to run on the electricity. Which is true, right? It's an absolutely true statement. But electricity was almost like a, solution without a problem because as soon as you got it, then you figured out ways to use it. [00:10:51] John Nash: I've been wrestling in my head whether or not this is like a utility. I don't think it's necessarily a public good. And, but it is, people are paying for it like it's a utility, they pay a monthly fee, they pay for their electricity, they pay for access to chat, GPT 4. 0. And so, but is it in doing so, is it just creating a situation where people need to get a bunch of stuff or do things that they didn't necessarily need? [00:11:19] Jason Johnston: Yeah, I think my own use of it is probably a mixed bag. I sometimes come away and it feels like I've been on the internet and didn't get anywhere and then sometimes you go on the internet and you get some places, right? [00:11:30] John Nash: Right. [00:11:30] Jason Johnston: And you find the answers that you need or, sometimes you get lost and, a string of cat videos and you don't know how you got there. And I feel like because it has such a lack of focus, There's a lot of experimenting still to be done with it that doesn't necessarily give you helpful results for your time investment. [00:11:50] John Nash: What do you think about the ethics of all of the little GPTs that are getting built in the marketplace? Some of them are completely frivolous, some of them are a little malevolent, others could be useful. Do you think that the people who create a little GPT also need to have an ethical code? [00:12:12] Jason Johnston: Yeah, that's a great question. I think, and this could lead into some other discussions about more contextual ethics. I do think that one can rely a lot on whatever the bigger ethics are in the system that you find yourself in, or the community, or the organization, or the country. So they can rely a lot on those larger ethics, but typically those larger ethics are general enough that they cannot always be helpful to guide what you should and shouldn't do in the specifics. Does that make sense? [00:12:51] John Nash: think so. [00:12:53] Jason Johnston: So like, maybe somebody running a little GPT might be generally guided by a care ethic, or ethic of how this might respond about certain races or stereotypes or people or whatever. I think it behooves the person who's making that to ensure that's true and do enough testing and to think about enough use cases that it might be used to get around these kind of general ethics to help guide it to keep it on track. I really think a lot of people don't really start with ethics. When it comes to developing these things, I think it starts a lot with innovation, which is okay. I understand that, they're trying to, like you said, solve a problem. I've got a, this is a good time to plug my own GPTs, so people can ,use them. And I don't know, is this some sort of pyramid scheme? If I get people to use my GPTs or make GPTs, do I make money off of their GPTs? [00:13:47] John Nash: Yeah yeah, no, I don't think so. But I think you should, if you'd like, I would pose that to OpenAI to see if [00:13:54] Jason Johnston: really I'm trying to find certain solutions, so I made a GPT because I've got questions, my kids are coming of age, and I've got FAFSA questions, and so I made a FAFSA GPT that is trained specifically on the information from the government so that it could answer questions from a reliable source. And I think it was helpful for me personally. And so maybe it'd be helpful for other people, but honestly, I didn't really necessarily think of the ethics of that. It was just a utility. [00:14:27] John Nash: You did think about the ethics tacitly because you wouldn't punk your kids on the FAFSA GPT. [00:14:35] Jason Johnston: that's true. And I said things like, yeah, I think there would be maybe some specific ethics that we know, for instance, the, of the many qualities that GPT had, especially in the beginning, we still know that it can be very confidently wrong, right? And a lot of the other things it's grown away from, but it still can be very confidently wrong about certain things and it can hallucinate and so on. And so I told it specifically to only give truthful answers. If it doesn't know, then say it doesn't know, and those kind of things. Whether or not that works, I don't know. Sometimes it does, I think, sometimes it doesn't. But by guiding it to, only use these resources, bang, then hopefully it will provide what I was hoping for was a truthful answering of my questions for myself and hopefully for other people, so people wouldn't get steered wrong. So I guess you're right, yeah. [00:15:23] John Nash: Yeah. So what do you think our advice is for teachers as they think about how they might integrate ChatGPT, Claude, other large language models into their work routines, either as an instructional design assistant, which I use them for a lot. I use it more that way than I do as a tool for my students to solve a problem, for, students doing their work, or some hybrid of both, what if we're thinking about our notion of being human centered in our work, and encouraging others to be that way, what do you think we should say? [00:16:06] Jason Johnston: Yeah, that's a great question. I would say on the front end that whatever institution or community that you're in that we should be at the place where people should have some pretty clear ethical guidelines to help guide as a community things that some principles that were agreed upon from a number of stakeholders across the community, institution, whatever that could be more general. Like, I was very thankful to be part of the a committee that developed some of these principles at UT, which can be really guiding principles. And so there are things like "we use AI intentionally, it's human centered, it's inclusive, it's open and transparent, we engage with it critically" and so on. But then what I found when I'm working with my media team and my instructional designers, as we're talking about the use within our day to day work, I found that these guidelines were good, overarching guidelines for us that we could all agree upon. But then it came down to really specific kind of questions that we needed to talk about. For instance, do we use AI image generators, right? And if we do which ones do we use? Do we open handedly use them? Do we just use specific ones? Are we concerned about things like copyright? Are we concerned beyond copyright? What other questions do we have in our smaller community? Questions that didn't even come up around faculty around creative works, not just about whether or not copyright is taken care of, but is there work creep happening when this person who's not a graphic designer uses AI to create graphics where another human would have typically done that, right? And so it starts to create much more of a specific kind of context for principles. And we were able to come up and we're still working on some more guiding principles , that can help inform our day to day work within our team. [00:18:02] John Nash: Yeah, the graphic example is great because if you've got graphic designers, illustrators on your team, they take a brief from a client and they have to interpret that contextually and then they create an illustration, let's say. If they or someone else uses an image, generation model like DALI or MIDJOURNEY, they put in a prompt and it puts out something technically beautiful and maybe aesthetic, but does it hit the mark in terms of what the contextual interpretation was that was desired by the call? That's very different. And if that can be created and say it does hit the mark and it's created by someone who's an 18-year-old intern, let's say that you hire, you have a new power dynamic problem. If we're, now we're back to my original problem, right? [00:18:49] Jason Johnston: Yeah. [00:18:49] John Nash: you are usurping traditional power dynamics about who's supposed to do what. [00:18:55] Jason Johnston: And that's where it becomes so contextual, right? Because as you said, yeah there's a lot of ethical ways that you can talk about this, right? There's the copyright part of things. You can just lay it aside and say we're not gonna cross copyright laws and so we're just not gonna do it at this point or whatever. But there are other ethical considerations beyond that someone's livelihood, potentially there could be some power dynamics, there could be some lack of care and respect for people who have done this job for a lifetime, and they're trained to do this, and they have the tools, and then all of a sudden some idiot with a Midjourney account [00:19:28] John Nash: Yeah. [00:19:30] Jason Johnston: that they can make graphics better than they do, and it's just not, it's not kind, and so I think that there are many ways to do that. Now, there could be another situation where somebody has a one person shop, and they're doing tech, they're doing instructional design, they're doing a little teaching and professional development, and they're expected to do graphics on top of this, and they don't have the budget. They've been told you can't hire anybody else. You don't have the budget, whatever. , it may be in those situations that that the ethical thing to do could, be to go ahead and use those, um, graphics . [00:20:00] John Nash: you've hit the nail on the head. Context is everything. Because you're right. If you're a solopreneur who, say, makes logos for a living, then you are doing client development, you're doing billing, invoicing, and you're doing the creative work. I think you're probably using LLMs and image generation models all day long to help manage that process. But that's different from a general ethic of care for just understanding how to deal with humans in the context of an organization, and whether you usurp their work without talking to them. [00:20:32] Jason Johnston: Yeah. Yeah. Let's do one other thought experiment here. What if two, I'll do two thought experiments. [00:20:38] John Nash: A a 20 year old junior at university uses the LLM to critically examine the assignments given to them by a professor and writes back giving them a critique on how it doesn't really help them achieve the learning goals intended for the course. Or a parent decides to write the lesson plans for an English composition, 10th grade teacher. This sort of power still sits there. And so could a teacher's aide do the design work for a course instead of the teacher? Or should they? I think those are, leadership questions. Those are ethical questions. Those are organizational culture questions. [00:21:18] Jason Johnston: Yeah. , I liked how your sentence changed there because this is a great indicator that we're doing some moral reasoning. A great indicator that we're doing some moral reasoning, is when your question shifts from could to should, right? And so could that parent do that? Yeah, certainly can. Everything's there. Should they? That is the ethical question, and I think that takes some reflection. Probably takes some conversation, perhaps even to be able to work in empathy with other people. And so if we're trying to follow an ethic of care, then empathy is pretty high up there in terms of understanding. And I'll be honest, and I, and this is also this completely contextual. I'm not saying anybody else should do this especially, present company, but I canceled my Midjourney subscription. I, hands down, it's making the best AI images out there, without question. It was worth it to me from that standpoint, and so on. But I canceled it because of some of these conversations I was having with creatives, and it didn't feel good anymore to have it, [00:22:32] John Nash: Say more. In what context? Like, would you stop using DALL-E now? You could still make images with MidJourney without a subscription, right? And so, even if you can't, but I'm just curious, like, so you would never use it under any circumstances now? I guess is what I'm trying to understand. [00:22:51] Jason Johnston: in my current context the things that tipped me over, it was the, some of the copyright issues in terms of using artists work without their payment or their knowledge. Which didn't feel good to artists in general. The fact that I was paying for it as well, so somebody's making some bank off of this, right? And so it's not experimental. This is a business. And then really thinking about this idea of why and should I be, right? Why am I doing this? Do I really need to be making images of this high quality? If it's important to somebody else that I am doing this, is it that important to me that I'm doing it? So that's what was my reasoning around it. I'm not saying I would never for any circumstance but I, and partly a little bit of a statement, to be able to say, Oh, yeah, I just decided not to. It was an interesting experiment for a few months. And we have an Adobe Firefly subscription. They have an ethic that includes paying artists and only using works that they have full license to. And. It's not as good, but I'm willing to do that for now if I need to use AI. And to be thinking about if there is anything that somebody should be doing that has the skills, then to be thinking about what place do they have in all this? Should I be giving them opportunity and chance to do this? [00:24:20] John Nash: Fantastic rationale. You've, yeah. You've convinced me I need to think about dropping mine. [00:24:27] Jason Johnston: Again, I believe it's context. I think that people need to think about it for themselves. I'm not going to go around wagging my finger at people via LinkedIn about it. Although I have considered at least putting my thoughts out there. So maybe this will spur me to put my, some of my [00:24:41] John Nash: Well, you know, there's, There's nothing worse than a reformed anybody. [00:24:47] Jason Johnston: That's right. Nobody wants to talk to that person. Yeah. This has been good John. I feel like we've covered a fair bit of ground. We partly started talking about this because we did a video, which we'll also put in there, where you and I broke some general ethics down in about 15 minutes. You invited me to come talk to you, and this is part of a boot camp you're doing as well, tied in with that. Perfect. [00:25:12] John Nash: yeah, you and I had a chat in a series I've launched called School Leadership and Generative AI, all in about 15 minutes where we cover pretty big topics on the top of mind of school leaders, but we get to it as quick as we can so they can gain some ground on some of these bigger issues. I did one with Dr. Kurt Reese on data privacy with students. And then, yeah, with you on ethics and it's yeah, it's connected to my school leadership AI boot camp that I've got on Maven that people can enroll in, put a link to that in the show notes too. But yeah. This was a good conversation today, I think. I think made me rethink some things. Made me really think about context. I was going to say earlier too, maybe this, maybe we fit this into the other part of the conversation. There were some articles six months ago or so, maybe about a firm in China that was going to have its CEO be a generative AI bot, and it was going to run the company. And I don't know where that's landed since, but it made me think, could or should an AI bot run a school district? Could it even run a school? Could we have an AI LLM provost at a university? How difficult are those decisions anyway? That'll rankle some folks for me just even asking, but I think it's interesting to think about because this is the direction these are going. Already with the terrible news of deep fakes that are coming out around Taylor Swift and others, and then with the election coming up with malevolent actors using this, these tools in bad ways. I think we're on the cusp of seeing the same sort of thing happening for leadership in organizations and maybe not malevolently, but it's going to be there. We're going to have avatars that look very real, that'll get past the uncanny valley that will be driven by large language models that sound like they know what they're doing. So I think that we're another level of ethical discussions are coming around how badly do we need all these personnel? [00:27:15] Jason Johnston: Yeah. All of those coming along. I'm convinced more than ever that we need to be thinking ethically about these. We need to be not just thinking about it for ourselves. We're talking about it in our communities, coming up with standards that we can support one another with, and that we bring people, all kinds of people into those circles so that we can think about not just ourselves and those ethics, but how it affects the people around us. [00:27:39] John Nash: Yeah. [00:27:40] Jason Johnston: Yeah, this is good. thank you, John, for this great conversation. And all of you, if you want these show notes, of course, we're at OnlineLearningPodcast. com. And you can check out all of our podcasts there as well as show notes. Yeah. Thanks for listening. And as well, if you have a chance, if you find us on Apple podcast, you can leave us a review, send us a note there. You can always find us on LinkedIn as well. And connect with us there. We've got a community as well as you can just connect with us and we've got the links as well in the show notes for those. [00:28:10] John Nash: Is it ethical for me to say that we found out that the algorithms like it when people go on Apple podcast and rate us and leave a comment? Or is that just stating a fact? Am I just stating a fact without ethical considerations? It's okay to state [00:28:28] Jason Johnston: I think that if it's true, it's ethical. And the fact that we're being transparent about this, we would like you to leave comments, not just for our own egos, but also to help the algorithm so other people can find this podcast. So, yeah, as long as we're being transparent, I think that's ethical, right? All about the algo. Talk to [00:28:49] John Nash: Cool. Talk to you later. [00:28:51] Jason Johnston: you soon. Bye.. [00:28:53] John Nash: Yeah, fun. I'll talk to you soon. [00:28:55] Jason Johnston: Bye.

In this episode, John and Jason close off the 2023 Johns Hopkins University Excellence in Online Teaching Symposium with a live podcast recording, summarizing the day’s sessions and interacting with the audience around 6 Pillars of Humanizing Online Learning in the Second Half. See complete notes and transcripts at www.onlinelearningpodcast.com Join Our LinkedIn Group - *Online Learning Podcast (Also feel free to connect with John and Jason at LinkedIn too)* Links and Resources: 6 Guideposts - Slide Deck (via Gamma.app) Johns Hopkins Excellence in Online Teaching Symposium Jana Lay-Hwa Bowden, Leonie Tickle & Kay Naumann (2021) The four pillars of tertiary student engagement and success: a holistic measurement approach, Studies in Higher Education, 46:6, 1207-1224, DOI: 10.1080/03075079.2019.1672647 Peabody Institute and their “Path to Funding” guide Advancing Diversity in AI Education and Research Symposium - Stanford Dr. Michelle Miller Substack - Teaching from the Same Side and the idea of “same-side pedagogy” Theme Music: Pumped by RoccoW is licensed under a Attribution-NonCommercial License. Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! [00:00:00] Introducer: Welcome everyone. It's been a great day and we have. A very fun way that we're going to be ending today. So this is our final session. I appreciate everyone greatly for attending our inaugural excellence and online teaching symposium and we're going to be ending our session with a live recorded podcast. We have Jason Johnston and John Nash, go ahead and take it away whenever you are ready. [00:00:33] John Nash: Hi, I'm John Nash and I'm here with Jason Johnston [00:00:36] Jason Johnston: Hey, John. Hey, everyone. And this is Online Learning in the Second Half, the online learning podcast. [00:00:44] John Nash: Yeah, and we are doing this podcast to let you all in on a conversation we've been having and to let you be part of the conversation that we are having about online education. Look, online learning has had its chance to be great and some of it is, but there's still quite a ways to go. What are we going to do to get to the next stage, Jason? [00:01:05] Jason Johnston: That's a great question. How about we make a podcast and talk about it? [00:01:10] John Nash: That sounds great. What do you want to talk about? [00:01:13] Jason Johnston: Today I think it'd be great to continue our theme of how to humanize online learning in the second half and to do it with a number of our friends here. So today we want to not only do a podcast, but do a session here at the Johns Hopkins Excellence in Online Teaching Symposium, the first ever. Is this right, Olysha? We're on the first ever. [00:01:36] Olysha Magruder: That's correct. This is the inaugural symposium. So you're a part of the new wave. [00:01:43] Jason Johnston: We're so glad to be here. Thank you for the invitation. And this is exciting that we're here and we're doing a live session where we are recording. And we had the auspicious and difficult task of trying to bring a little summary to this day. It's been a good day, hasn't it, John? [00:02:01] John Nash: Yeah, it's been amazing. We've been in every session that we could attend. We split up and took some notes along the way about what the overarching themes were and where we see some opportunity, but we're so excited to see what you all think as well and what you took away. [00:02:17] Jason Johnston: Yeah, so here's how we are planning to proceed in the next little bit here. Our ideal as we were looking at the day is to try to give us some guidelines to talk about. We tried to pull a few quotes. We have a A little bit of an outline that will guide us, but first we thought we should probably introduce ourselves. John, you wanna go first? [00:02:41] John Nash: Yeah, sure. I'm John Nash. I am an associate professor at the University of Kentucky in the Department of Educational Leadership Studies, where I'm also the Director of graduate studies. We are an all online. Department and a graduate program offering master's and the doctorate at the EDD and PhD level, and I'm also the director of the laboratory on design thinking at the University of Kentucky, where we look at human centered design and its application in organizations and leadership in schools. [00:03:11] Jason Johnston: And I am Jason Johnston. I'm at the University of Tennessee, Knoxville. I'm the executive director of online learning and course production. So, my big thing here is helping to stand up online programs, and I do it with a fabulous team of instructional designers, some of which are here. That's not the only reason why I said that, but some of them. And media personnel who help to stand up online learning here at the University of Tennessee and do an amazing job of that. That's who we are. We also would like to just keep in mind that this is a recorded session. We would like to, as we go along, talk to all of you and hear from you as we proceed. Please feel free to, unmute your mic as you have something to say or questions. And to quote Dr. Olysha Magruder I'm not sure what's gonna happen. And this is this was her, this is her plug for our session today was that I'm not sure what's going to happen in that one. [00:04:13] Jason Johnston: We're not either, because part of this session is actually hearing from all of you, but we do have a few guiding ideas and guideposts that will help guide our discussion. John, you want to show our slides? [00:04:29] Jason: And those who want to follow along at home can find these slides in the show notes. [00:04:32] John Nash: And if the link that you got in the chat should track with what we're doing here today. And this document is made with the gamma. app. And so this document is a presentation deck. It's also a living document. It's a webpage and it's a handout. And so it's the new shimmer, if you will, of media. And if you get that, then I love you. So browse through it before and after the session, as we. grow in our conversation in this hour. Some of that material may show up in here and please reuse and remix because we want you to do that. And so yeah, we're not sure what's going to happen in this one, but I think it's going to go well. And we want to start to talk about being human to each other. The focus of our, podcast is to think about the second half of life for online learning. And we know it probably has much more life than we have in ourselves. But as we noted in the beginning, we think it's had its chance to be good, but we think that there's another chance here to be even better. This whole day has really been about that. And so as we go forward, we want to talk about what we picked up on today and also really hear from what you picked up on. So Jason, do you want to say a little bit about where to find our podcast after this is done and people can listen to this? [00:05:52] Jason Johnston: Yeah, onlinelearningpodcast. com. That URL actually will take you to our entire podcast. Not only is this session going to be edited and probably put out there, Maybe January, John but we just released on Monday, hot off the digital press a conversation with Dr. Olysha Magruder. And so you can go check it out and listen to that podcast. Had a great conversation. One of the reasons why we're here today is that connection. Please listen in, let us know what you want to hear about. Like this session, we want this podcast to be a conversation and to be talking with all of you. Yeah. And around the topics and subjects that you are interested in. And without further ado John and I were trying to think of some larger themes. We guessed at a number of them before this day begun by, by looking at some of the session titles, by thinking about some of the ways in which we're thinking about humanizing online learning. But we have these six guideposts, if you would, and I think I was thinking about guideposts because my home here in Knoxville. Pretty much every side of the driveway is a drop off and so there's a little turnaround that you know if you're somebody like me that drives a really cool car like a long, minivan There's a fair bit there's a fair bit of maneuvering to be done where I have to go into this turnaround And move forward what I did when I first got this place is to put in guide posts for myself so that I did not want to end up with a minivan in the ditch. My own ditch. of my own making and and so putting in guideposts, especially at these kind of key spots as I'm coming up over the top, coming onto the driveway and as I'm doing into this turnaround putting some that were lit, other ones that were just like those reflectors others that actually are barriers that don't permit me to go over some of the spots. And so today, if you, will walk with us, these six guideposts for humanizing online learning. Some of what was drawn from today, some from our podcast of this year and our own thinking. And how we're going to proceed in these is that we're going to talk about the guideposts, give a, maybe a little summary. Couple quotes that we found from today and then open it up for you for any other things that you heard, maybe particularly from today. So maybe a little bit of a focus on on today's session. My one request would be that we're now down to less than 10 minutes for each one of these guideposts. And just try to keep the comments fairly quick if you can, as we get there. Shall we go on to guidepost number one, John? Yeah, let's go [00:08:33] John Nash: to guidepost number one. And that would be this notion of being human to your students and yourself. And the two gems that I picked up on. from this came from Flower Darby, and it was this idea of sharing a little of yourself. And this idea of connection doesn't happen by accident. This, what did you think of these And particularly, I think really not just sharing a little of yourself, sharing quite a bit of yourself if you're comfortable as a model for students to be able to do that back with you. And the, that the connection doesn't happen by accident really feels like a a thread that went through almost all of the sessions today. If I. I remember I texted Jason in the middle of one of the sessions that the word intentionality is just coming up every time. Everything is, must be intentional. Nothing really happens with hope or or luck. And back to you all. What struck you as Flower was talking about these things and this idea of really being human to your students? come off mic and and think with us. [00:09:40] Jason Johnston: And if you would, when you come off mic, would you say your name and where you are right now, like institution? would be perfect. And then, whatever it is you have to say. [00:09:49] Jody: Okay, I'll come in, John. Joe DeBonis Dublin City University, or DCU. Loved the way Flower shared pictures of her family. It's something I would love to do, I just never thought it would be appropriate, but of course it's fine. So it's something I will do in future. [00:10:11] John Nash: I agree, Jody. I had not been so apt to do that kind of sharing at a level. I bring a, try to bring a level of energy and enthusiasm for the topic, but had not thought to talk about how my wife is an important thought partner and everything I do and an important critic, but I don't honor her the way I might that she has. And so I'm really going to think about doing that. And Austin is getting some love in the chat because I love this idea of that luck is the residue of design. It's almost like this idea of that luck favors the prepared mind. I don't know if you want to say more about that on Mike Austin, but I really love that comment. it's very tweet worthy. [00:10:49] Austin: Yeah, I appreciate that. I'm Austin Tremblay and I work at Johns Hopkins University in the Center for Learning Design and Technology. I just think it's one thing to think that results are purely contingent on luck, as if we have no agency in the matter, but. to think that we can, put plans in place and create our own results rather than relying on just, this passive act of being lucky. I think that's a nice way to think about it. [00:11:19] John Nash: Wonderful. And I just also want to give a shout out to Sarah Schunkweiler, if you want to say something, but this lovely idea of really going forward with an informal module that has intro videos with dogs in the background in real life. Do you want to add anything to that? [00:11:37] Sara: I'm Sarah Schunkweiler. I'm an instructional designer also in Olysha's group and I work with Austin, but I'm also a faculty member, so I record informal videos myself. So my engineering professors have started doing that also. And since having their kids walk in, having the dog there, the dog is there during office hours. So why not be there during the informal videos as well? And students are highly amused by the dog trying to get out of the office behind the instructor. [00:12:06] John Nash: That's great. Awesome. Jason, do you feel like you want to go on to number two? [00:12:10] Participant 1: Sure. Yeah, those are great. Thank you. Thank you for being brave all to speak out on this live recording. Number two, encourage students to be human to one another. We can set the tone ourselves. As teachers as well As we are setting the pace and the culture, and as Austin was talking about the design of the course, we can encourage students to be human to one another Joe said, , do you have a way to In the course to meet other students so you can help them and they can help you stressing the social pillar of engagement and then Flower Darby had talked about adding emotional presence to the community of inquiry framework of social and cognitive and teaching if you guys were in that session or you remember the three kind of concentric circles that overlap, and in the middle you have a learning experience where there's typically social, cognitive, and teaching presences within an educational setting. And Flower talked about how this emotional presence helps support the whole thing. And this is where it's not just encouraging student to student interaction. Help each other with your homework or student to student assignments, do this assignment together, but actual support, this emotional support where they can be human to one another, not just act like a, human. Any other thoughts on this one? What what other ways can we encourage students to be human to one another in our online classes? [00:13:39] Mike Reese: I can jump in if it helps out. This is Mike Reese from Johns Hopkins Center for Teaching Excellence and Innovation. I was in Joe's session and this idea of social engagement came from a model that he was presenting on four pillars of student engagement that came from an article by Boden Tickle and Nauman in 2021. And I think what was really helpful when he was discussing this was giving examples of how to engage both in synchronous and asynchronous environments and really stressing the importance of peer support, regardless of what the modality is and for students. to be able to support each other that requires them to have some sort of human connection. [00:14:24] Jason Johnston: That's great. That's a great resource talking about those four pillars. , very helpful. Thank you. [00:14:30] John Nash: That was good because the those pillars Mike, they, when he talked about the affect of emotional engagement, do you feel safe and welcome in class? Do you have an opportunity to do your best? Do you have friends or teachers that recognize and praise you for doing good work among other things? Those almost have to be preconditions for the part where you're saying, " do I have a way to meet other students? I feel good about meeting other students. And yeah, I really like that. Any other comments on encouraging students to be human to one another? [00:15:03] Andrea C: If I could, I've got two things. I'm Andrea Srevec, and I am the Director of the Office of Faculty Development and Advancement at the South Dakota School of Mines and Technology. One is setting ground rules for your class. So just that basic, you're going to respect each other. If we do any discussion boards, try to keep your comments on topic. But also I taught an asynchronous class for the first time. And, in engineering, they don't necessarily like to use the discussion boards. It's just not something that they're like, let me run some numbers and don't make me talk. But I told them before the class even started, you're going to have to be able to upload videos in this class. And you're going to have to upload videos of yourself in this class. So I had them do introduction videos. And they had to comment on each other's introduction videos. And it was just nice in a class where they were never pretty much going to be in the same room together or online together, to at least have them know who else was there, so that when they got back, because it was a summer class, when they got back on campus, they would know who was in their department. And it seemed to work pretty well. They were really quite good about responding and, oh, I play an instrument too, kind of thing. [00:16:13] John Nash: Beautiful. Thank you so much. [00:16:16] Jason Johnston: I was going to say before you go on to the next one, thinking about, and this kind of ties into another one of our, one of our guideposts is just thinking about the different contexts, right? We're all. In different domains, in different contexts, teaching in different kinds of classes, and what might look like a really good human thing to do in one kind of class may not be the same thing for another program or another class, and there may be different ways to approach that. That's great. John, number three? Sure. [00:16:44] John Nash: Number three is we should endeavor to create content that is human centric. And we heard this across several of the topics today. Flower talked about how engagement precedes learning. This is an important notion to keep in mind. And not as much AI references today. A lot of really just good ID stuff today. But Luke talked about how AI is a Kickstarter. I know you were in that session, jason I didn't go to that [00:17:13] Participant 1: one. yeah. Can I just say that the idea behind that is that. rather than letting AI take front and center and removing some of the human centricness of our classes, we use AI to help us be more human in the classes by our design, to be more thoughtful and to help spur ideas that are more human. I thought that was a great idea. Yeah, [00:17:36] John Nash: that is a great idea. And it's a strategy I've been using in my own courses to use AI as this Kickstarter for instructional design to create active learning environments and activities for my students, but the students never, really interface with AI. They just interface with the good learning that I've been able to create with the help of AI. And then Becky was talking about interface design impacting the learning experience. And so there's an aesthetic portion to this that really brings in learners. And then this idea of education happening in major and minor learning spaces where the interaction is taking place from learner to teacher, from learner to learner really good examples there. But how does this strike you all? We're talking about engagement, but we're also talking about AI. We're talking about aesthetic design and the importance of interface design to get us to a point where the content is really human centric. Does this strike you all as worthy? Great, please. Yeah, Caroline. [00:18:38] Caroline: Yeah, it certainly does strike me as worthy. My name is Caroline Egan and I am a program manager for the Center for Teaching Excellence and Innovation at Hopkins. And I think it's going to be an evergreen topic with digitally delivered content, whether that's asynchronous or synchronous. And, I think that having such concrete, such great concrete examples like Flower Darby's "show me a photo of yourself" is just an excellent way of taking small steps towards, encouraging that humanity and the digital interface. [00:19:11] John Nash: Nice. [00:19:12] Jason Johnston: Yeah, I think there are a lot of great examples today of that, like the flower derby example. One of the reasons why I thought that last quote was great, about education happening in major and minor learning spaces, is that it helped me rethink even the title that we put on this number three, which is creating content that is human centric. It could be creating learning spaces in general that it's human centric. It could be fill in the blank that is human centric, in terms of our interactions or ways in which we we structure our courses, our grading or our assignments. I think what helped me here is to get me out of thinking about online courses. And John and I we talk about this all the time, but there's such a knee jerk reaction to think about online courses as content. And I fully say that, yeah we were making these titles and we just didn't even really think about the fact that, our knee jerk reaction was to talk about, content that is human centric, but I would like to just offer that I think maybe we should move more into this idea of learning spaces So like the examples that was just given and so on it's about the interactions about the relationships about all of it that is human centered. [00:20:29] John Nash: It seems like the more we talk about this topic, the more we realize that, and I love your idea about content, that the online courses are not content. The online courses are experiences. And so in order to create a great experience, we have to thread in all of these other things with intentionality and that's aesthetics that is engagement that is authentic bringing our real selves and then having really great active experiences on the learning side as the learner goes through the journey. John [00:21:01] Mike Reese: and Jason, I, if I can jump in, this is Mike Reese again, there was a, you've got some great examples here. I heard them throughout all the sessions, but one of the best that I heard today. Was our colleagues at the Peabody Conservatory. They're leading a course that is essentially preparing artists to go out and take their talents into the world and teach them the business of being an artist. And it's not just about making money. It's really to ensure that these artists know how can they be entrepreneurs to advocate for themselves. so that their talents will be seen and heard by other people. And what was so exciting to me about this, and it really speaks to this third principle here, is that it's not about just simply creating an environment where it's human centric. But it is a curriculum that has been designed to allow them to go out and connect with others and really allow their talents to be shown by others. And one of the great things about this program that they've put together. is the course for the Peabody students has been so successful that they have gone on to share a open education resource, a book, that anybody can access to learn these same lessons. I just threw a link to it in the chat that any artist now can benefit from what they've developed at the Peabody Conservatory. [00:22:27] John Nash: That's fantastic. It's, what strikes me as you talk about what they're accomplishing there is that they're building agency within the learners to go out and tackle the world in real life ways with the skills they pick up in the course. That's wonderful. We've got that link and we'll put it underneath this topic here. So it's everybody can have that. Great. So let's go to four [00:22:49] Jason Johnston: Jason. Yeah. And this one is treating humans as individuals. So rather than just thinking about humanity as a whole becoming increasingly aware that there's a lot of different humans and that there are ways in which we can respond to all of humanity in the more individualistic kind of ways within online learning if we take the extra effort one of the quotes that I found was talking about learning styles aren't real, but we can use AI to guide us for various learning preferences thinking about adapting online learning to help with individual Activities and to meet the diverse needs and interests and so on of your students. So some of this is really about, adaptation as a instructor and thinking about that. We talk about here, some about, this idea that here, meaning University of Tennessee, the idea that, when you're talking to teachers about their online courses, having to remind them sometimes that this course isn't for them, right? It's for the individuals that they're there to serve and figuring out ways that we can adapt it to serve even within sub pockets within their own courses. What are some ways that you've either heard today or that you can speak from experience about how we can adapt our online learning to treat humans more as individuals? [00:24:20] Olysha Magruder: This is Olesha again, Johns Hopkins University. I wanted to mention. That Jodi from Dublin City University presented about the tool Flip, and I feel like this gives an opportunity for educators to have the students interact in a way that they prefer, so you can do a video, or you can do audio, you can comment with a video, you can do text, so it gives them an opportunity. And I know there's a lot of other tools that do that as well, but she demonstrated a really awesome way to do that I think that connects to this idea. [00:24:54] Jason Johnston: Yeah, I love it. Yeah, and almost a reverse in some ways of UDL thinking about multiple ways of representation. There's a Perhaps giving students multiple ways of responding, right? And so if they feel more comfortable with this particular way or that way or whatever in the minute it can respond to them depending on How they're you know tuned in and where their comfort level is. That's good. [00:25:18] John Nash: I think about taking a page from the p12 world where I've come out of a meeting last week here in the Commonwealth of Kentucky where all the superintendents of public schools were meeting talking about this idea of a portrait of a learner and in this effort, an attempt to individualize instruction on core topics that really can't change, so math, social studies, history, what have you, but the work that the student does is predicated on their own personal interests and what they want to do and what they are interested in. And so they're able to work cross curricularly, if that's a term we can use with the personal interest of the student. We woven into the curriculum. And the outcomes that are necessary for them to be successful in school. So that's I think about is treating humans as individuals. We're also learning about their personal interests what they really are wanting to do, what they like to do, and then how the content can be adapted so that they can apply those interests within the content. [00:26:27] Jason Johnston: Yeah, that's good. And we you and I, John, have talked about this concern about the industrialization of online learning, where it tends to mass market to the larger, swath. And I think that is a nice response to that thinking about , the more personalization. And yeah, that's good. Other comments on that one? [00:26:49] Mello: Hi. Hello. Can you hear me? Yes. Hi. Hi. I'm Mello. I'm coming also from the Center for Teaching Excellence and Innovation at Johns Hopkins. And I really like number four. It reflects on one of the. Sessions that I went to, and I think I see some folks, it was the one about equity. I see Sarah Shankweiler was there, Chris Sett was there, but basically they're talking about decolonial ways. Of engaging students and students with disabilities and basically the more, oh, and Rolando, thank you. The more we engage and allow people to embrace. Like their identities, the more this is like basically helping them live authentically. I feel like this is hitting at that core, just when you give students that space to be authentic and acknowledge like who they are and what their struggles are and what their joys are, then they would feel more human and they would share more of themselves. [00:28:02] Jason Johnston: Yeah, I love it. Yeah, that was a great session. And I agree. And I would say treating humans as individuals is maybe a first step. And we've got a couple other points that maybe even point to that. a little bit or encourage us a little bit more to be actively creating spaces for for inclusivity. And maybe John, you want to go on to number five and since that's a good lead into that [00:28:25] John Nash: yeah, absolutely. Which is this notion of making space for all humans. And we picked up on on four different things that struck us as supporting this idea. And of course, back to Flower Darby and thinking about this idea of excellence in online teaching is an equity imperative. And so when we think about people being their authentic selves and coming in with their own identity, then we can really create this culture of inclusion and really advocate, support, and empower faculty to as Sarah was noting. Nice thoughts around UDL and how do we make a meal for a lot of different people? You've got this sort of buffet, and so you have to be thoughtful and intentional again. This idea of intentionality is always coming up. And then this notion here from Rolando, which is being focused on teaching accessibility and supporting efforts to teach accessibly. Yeah, really nice. What do you all take from this this idea of making space for all humans? And I think Melo Really teed that up for us here thinking about that. What else strikes you as we try to make space for all humans? [00:29:39] Jason Johnston: Melissa, go ahead. [00:29:40] Mel R.: My name is Mel Rizzuto. I'm a instructional designer in the Center for Learning Design and Technology in the Whiting School at Hopkins. And I love this idea of making space for all humans. And in a session that I facilitated earlier with a few of my former colleagues, we talk about how we're going to how we developed a tool to assist faculty with evaluating their online teaching practices. And we were very careful to include a standard about immediacy and inclusion in that tool that we developed because we really wanted faculty to reflect on their own practices and, their strategies for fostering belonging for students and then also modeling communication and positive messaging for students. And so I think a lot of times we get caught up in just the design of the course itself. And we, I don't want to say we fail, but We neglect the professional development needed for faculty in the actual delivery of their instruction. And so I think we have to be mindful of that. [00:30:47] John Nash: Really nice. Mello, did you want to add something? Oh, no, [00:30:50] Mello: I totally agree. We're talking about students here, but faculty are also humans. Staff is also humans. We're thinking about training the students, but. We're also should train ourselves so that we can better train others. [00:31:07] John Nash: Yeah, we have a long runway in front of us as as instructional designers, as supporters of those who want to do good instructional design. There's a lot of faculty who want to do well, but don't have the tools. And I think that they should be considered part of our human set that we want to bring about here. [00:31:25] Kim V: I just want to. Add in this is Kim Vars. I'm an instructional designer at the Center for Learning Design and Technology at Johns Hopkins. And in the session just before this one that I moderated Chris Ryder and Pankaj were perfectly paired in a way that Pankaj talked about and even showed this perfect image of these really uncomfortable chairs, That you remember from sitting in during your childhood and in school and talking about how you're not just putting content up on the screen to get the content across. As if you were to hand off a textbook to someone, but instead Chris was talking about creating that space that is comfortable for students for all students to feel as though they have a place there that they can communicate. And I know as an instructional designer, I often think. Most about getting the space to exist and not necessarily ensuring that space truly is comfortable for everyone, which is like, everyone has been saying today, truly not an accident. It has to be intentionally designed in a way that allows all folks like Dr. Hobson was saying anybody who has any kind of learning or eating preference to be offered this buffet that that they can pick and choose from and craft their own perfect meal in their comfortable course. A lot of work to be done for sure. [00:33:02] John Nash: Yeah, definitely. Fantastic. [00:33:05] Jason Johnston: It made me think of as well. What Sarah Schunkweiler, who is here, talked about the steep steps, both perceived and actual barriers she spoke about in her session there that was alongside of those the visual icon of the classic education building with these big steps that went up and the pillars in between and so on, and how those that, whether they can manage that or not, When they perceive that, it becomes this visual icon for spaces that they maybe are Not welcoming, or if they were welcome, they're not welcomed enough that they could actually go into and made me think of probably the first story we heard of the day, which was Flower Darby talking about her Pilates class and finding this person who was lost in the hallway because nobody was in there. The lights weren't on. It didn't feel like a welcoming place. And so they didn't think that this is where they belonged. And I think all of this fits together for creating this. Good space for all humans. [00:34:10] John Nash: Good. Should we do number six then, Jason? Sure. [00:34:14] Jason Johnston: Yeah, sounds good. John and I were quickly Brainstorming and wrapping up right before this session, talking about today's wonderful symposium, and we had come up with a number of these before, but we wanted to create a space that was a bit of a wild card. What, what doesn't fit? And this was actually one that we just arrived on an hour ago, and we've talked about before, but it just fit well, in addition to creating inclusive space and treating individuals humans as individuals. Number six, recognizing that not all humans are present. So whatever space that you are in, wherever you're making decisions, whether they're design decisions or teaching decisions, Not all humans are going to be represented there, and it's important to be thinking beyond beyond those spaces and what we see in front of us. And John and I talk about this all the time. We're two, admittedly, middle aged. educated white guys, right? We have a very similar culture. We can talk about a lot of the same things, but one of the things we strive to do within our podcasts is bring other voices in because we recognize that we can't understand and we don't see all the corners and we need to be able to see outside of ourselves. So this was a great session, really was a mini session talking about neocolonialism first earlier in the day, Luke Hobson talked about how it's not just DEI, it's also about JB, justice and belonging, moves on beyond that Christelle Dacius was talking about the idea of the Northern Hemisphere versus the Southern Hemisphere and how too often that we are essentially using up the resources from the Southern Hemisphere, speaking as somebody that originally was from Haiti. And so she said, what is digital neocolonialism? Online education is another vessel of imperialist practice to gather human and biological resources through technological means. And she also went on to say resources are digital human data. We haven't taken the time to realize the impact data that is most likely being sold back as product. Anyways, I thought these were very heavy statements impactful for me because they were a different voice than than maybe we were hearing earlier in the day. And a voice that takes things a step further as, Represented in the title beyond beyond just thinking about the typical typical groups that perhaps that we're making these decisions in. [00:36:49] John Nash: Yeah. Part of this reminds me the conversation that's going on in parallel around the fight to reclaim AI and other things from big techs control. And you look at the story of Timnit Gebru, and the work to think about. How content moderation is going on in other corners and this is really affecting the mental health of moderators and all in the name of trying to keep the machine going as it were and so how do we think about what we do day by day as online instructors, online designers of experiences and keep the recognition in mind that not the way it's been presented to us may not be the best way it's been presented to us. I don't know. Yeah. I don't know if I put that so well, but I'm also appreciating Sarah Schunkweller's comment here that students who might be forced to use illegal means to access online education and that digital human data can be dangerous. How does this all strike you as we think about this last sixth point? [00:37:51] Jason Johnston: Yeah, thoughts on this. How does that strike you? What other ways can we be more mindful of this? [00:37:56] Austin: This is Austin Tremblay from Johns Hopkins University again, and I just thought this was fantastic to include because if you are establishing guideposts, but your vantage point doesn't include You know, the totality of the space you're designing around, and that's a dangerous way to design guideposts. So I think that this informs that idea of, the design of the course itself. [00:38:24] Jason Johnston: Yeah, you're getting a lot of head nods. We realize head nods don't really translate into podcasting, but yes. So we're giving you a, we got some amens here, Austin, on that one. Thank you for that. [00:38:36] Mello: Can I just I put something on the chat, but I feel like everything that. We've all been talking about here since the beginning of the hour. It's really like considering this DEI and justice and belonging in terms of AI education and maybe research. And I feel like this is all really relevant to a symposium that I'm a part of that I'm organizing, that I'm helping organize. And so I put the link in the chat, but basically it's a symposium with the AAI, and it's called Advancing Diversity in AI Education and Research. It's at Stanford in March, and I invite you all to submit something. It's due like in early January and even if you don't submit something, you just want to check it out you can also just attend for fun and education, obviously. [00:39:31] Jason Johnston: That sounds great. Thank you for that. And we'll make sure that we get these. Links in this chat and that we get these into our show notes. So if anybody's listening to the show and they would like to either know about that symposium or the submission, then we'll put those into the show notes, as well as these slides with all the quotes and all the people so that make sure everybody gets referenced that way. All those will be in the show notes. Thank you for that. We had a final quote that also I wanted to get this right. She had, Christelle had said something about humanizing and I didn't get the full quote. And so I wanted to get it right. And so Olysha connected with her and I was able to get this quote so that we get this right. But she said as part of her session, "humanizing happens when the instructor takes time to talk about how they got to the work and their personal influences. The intentional sharing creates a culture of genuine interaction. This empowers students to show up as their authentic selves. Share their own narratives and bring their funds of knowledge to the classroom to make learning more relevant and meaningful. And that's by Christelle Dosses. And I just thought this was a great quote to land on because it just seemed to wrap up so many of the, so many of the themes from today, the themes that we were finding and the thoughts around humanizing online learning and what that looks like with these different guideposts. It just wraps so much in there. John, other thoughts on that? [00:41:04] John Nash: I regret that I wasn't in that session and you're right. This this passage really captures what we tried to think about today throughout all the sessions from beginning to end. This idea of intentional sharing genuine interaction and then this empowerment to bring all our authentic selves to the table to the conversation. I think it's wonderful. [00:41:29] Mello: I was in that session and yeah this also really resonated with me. Especially actually when I teach a class, the very first session for the very first day, I always talk about funds of knowledge especially I'm with students who maybe they've never heard of that before, or they've never taken a topic about the class that I'm teaching, but I always tell them you're not a blank slate you're coming here with Your funds of knowledge from basically living your life and you're bringing something to the table. And I think that's really powerful, especially if you're suffering from like some kind of imposter syndrome, right? Just knowing that you're bringing something to the table. It's really powerful. And I don't know. I think I have Mike and Caroline took my class and I talked about funds of knowledge. I don't know if they want to say something. [00:42:22] Caroline: I can absolutely 100 percent reiterate that it was very helpful to me so that understanding that I brought a fund of knowledge to a subject matter that I thought I knew really nothing about, which was educational research my own academic training is in a different field. And Mello said, Oh, no, Caroline, you have funds of knowledge. And and it turns out that I did. So it's a great way of anticipating people's insecurities and reassuring them that they should be in the room with you. [00:42:54] Mike Reese: Yeah, I'll just add that Mello, when she first pitched what was, we would typically call a workshop, she described as an experience and it truly was that because of the way she engaged us and set up the activities throughout the event. To really allow all of us to be able to learn from each other based on these different founts of knowledge that we have. [00:43:21] Sara: Hello, I had a comment that went along with that. This is Sarah Strunkweiler again from Johns Hopkins. In Christelle of Rolando's of my presentation, we were talking about accessibility. So as an instructional Designer, I go to the 1st office hours for a lot of my engineering courses. And so we can talk about the accessibility features in the course. And we can talk about things like student disability services and student advocacy and speaking up for yourself. So we're empowering students. To show up in class and ask for what they need and I had a student reach out to me earlier this year, this fall, who was an engineering student from another country. She was new to the U. S. She was ran into some housing insecurity issues and because I had gone to that and we had normalized the conversation about asking for what you need, she reached out to me directly and the faculty and I and our support services work with her. And she told me later. That in her country where she came from, it wouldn't be normal. It would be culturally unusual to reach out for that support. So she really appreciated us making that available and opening that up that conversation for her. So it supported her as a student and it's supporting her as a working professional in the field as well. [00:44:43] Jason Johnston: That's great. This has been an amazing conversation. Thank you all for jumping in John This has been a great day of learning from all these different presenters as well as being able to wrap it up with These folks here. Thanks for jumping in. Thanks for being brave jumping into the arena and being willing to Speak up even if it's being recorded and we promise to, to hold all of you with respect and as we put this out just know that it's with our great thanks that you have jumped into this conversation with us. John, anything else? [00:45:20] John Nash: Yes, I think I've been struggling to think about how to put a point on all of this. And I'm reminded of Flower Darby invoked a quote from Michelle Miller today, and I thought of another one from Michelle Miller. If I think about the entire day and everything we've talked about, it goes to something that, it's a, Dr. Miller said in her substack, and we can put a link to it in the notes about this idea of "same side pedagogy" and so much of what we're trying to undo around an us versus them kind of approach to learning and what she was saying in her article was that if we come to a same side pedagogy where we're co designing with learners and we're seeing each other as students, equal partners in the same goal, which is to reach this sort of this learning destination, then things will really come together. And I think everything today were intentional pieces in this notion of us all being on the same side. Do you mind if I close it out? Please do. [00:46:22] Olysha Magruder: Just to go back to my the quote you quoted me on earlier, now I know what has happened, and it was all good. Very good. I want to thank everyone for participating in today's event. This is our, as we mentioned at the top of this hour that it's our inaugural excellence on online teaching symposium. We plan to have this every year going forward. We will be sending out a link for you all to give us feedback on this event so we can take that into consideration as we plan for next year. And yeah, I just really happy that we all came together today and it's pretty amazing. This final session you put together cause you. Really, we're able to connect all of the dots, which I feel like we don't get to do that much when we come together for things like this. I appreciate you all, and I appreciate everyone who participated and attended. Thank you. Thank you all. Thank you [00:47:14] John Nash: all. Goodbye, everyone.

In this episode, John and Jason have a “year in review” conversation with their podcast superfriends about why they podcast, the impact of artificial intelligence on education, the importance of human interaction in learning, and their collective efforts in forming a community of education podcasters. See complete notes and transcripts at www.onlinelearningpodcast.com Join Our LinkedIn Group - *Online Learning Podcast (Also feel free to connect with John and Jason at LinkedIn too) Links and Resources: Amanda Bickerstaff AI In Education Year 1 Timeline (on LinkedIn) Course Stories, Season 4, Episode 2: The AI Whisperer: Faculty and Students on ChatGPT Dialogues Planet Money Podcast: Can ChatGPT write a podcast episode? Can AI take our jobs? Book Recommendation: A More Beautiful Question: The Power of Inquiry to Spark Breakthrough Ideas Request to join the Network of Education Podcasters on LinkedIn (active education podcasters only please!) ASU Academic Dishonesty Risk Reduction Guide ASU Online Eventbrite Webinars Here’s a link to our original Superfriends episode: https://www.onlinelearningpodcast.com/e/ep-10-podcast-super-friends-crossover-episode-at-olc-innovate-23/ Our Podcast Superfriends: Josh Reppun What School Could be https://whatschoolcouldbe.org/ Bio: ormer chef, hotel manager and history teacher, Josh Reppun is the founder of Plexus Education, LLC, dba as Most Likely to Succeed in Hawai’i, a “movement” founded by extraordinary people dedicated to developing global public, private and charter school conversations around Ted Dintersmith’s film, Most Likely to Succeed and his book, What School Could Be. Josh is also the founder of Josh Reppun Productions. He is the host of the What School Could Be Podcast and the producer of two films: Ka Helena Aʻo: The Learning Walk and The Innovation Playlist, both about creative, imaginative and innovative educators and education leaders. Josh’s podcast, edited by the talented Evan Kurohara, with music by Michael Sloan, has now reached nearly 80,000 downloads in over 100 countries. Course Stories (from EdPlus at ASU) https://teachonline.asu.edu/podcast/course-stories/ Mary Loder Mary Loder is an Online Learning Manager at EdPlus, supporting Faculty professional development and training along with managing special projects in a variety of disciplines. She is also co-creator and co-host of Course Stories, a podcast where an array of course design stories are told alongside other designers and faculty from Arizona State University. Ricardo Leon Ricardo Leon is a Media Developer Sr for EdPlus and is a co-creator and co-host of Course Stories. He has developed a number of other podcasts and various other forms of instructional media. Tom Pantazes ODLI On Air Tom Pantazes, Ed.D. is an Instructional Designer with the Teaching & Learning Center at West Chester University who loves helping instructors integrate technology and robust learning pedagogy. His research interests include digital instructional video, extended reality, content interactivity, and simulations. If he is not cheering on Philly sports teams, camping or building Legos, you can catch him as a cohost of the ODLI on Air podcast. Specific Episodes: Generative AI in teaching Ram Poll gauging student opinions Lee Skallerup Bessette on LinkedIn All the Things ADHD Podcast https://allthethingsadhd.com/ Theme Music: Pumped by RoccoW is licensed under a Attribution-NonCommercial License. Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! EP 22 - Podcast Super Friends II Intro [00:00:00] Jason Johnston: Questions? Anyone? [00:00:02] John Nash: They're podcasters. They don't talk. [00:00:06] Ricardo Leon: We listen. [00:00:07] Mary Loder: That's right, intently. [00:00:09] Jason Johnston: That's right. It's going to be all questions, actually. The whole podcast is people asking each other questions. Start of Episode [00:00:15] John Nash: I'm John Nash here with Jason Johnston. [00:00:18] Jason Johnston: Hey, John. Hey, everyone. And when I say everyone, everyone that I'm looking at as well. This is online learning in the second half, the online learning podcast. [00:00:26] John Nash: Yeah, we're doing this podcast to let you all in on a conversation we've been having for the last couple of years about online education. Look, online learning has had its chance to be great, and some of it is, but there's still a lot that isn't. So how are we going to get to the next stage, Jason? [00:00:42] Jason Johnston: That is a great question. How about we do a podcast and talk about it? [00:00:46] John Nash: That sounds perfect. podcast and talk with a bunch of people about it? [00:00:50] Jason Johnston: That sounds amazing. We're so excited today to have our next episode, our super friends, podcast, Super Friends II episode with a bunch of our friends. So, Let's get into it and meet some of our friends. How does that sound? [00:01:04] John Nash: Yeah, let's do it. [00:01:06] Jason Johnston: All right. Let's have each one of you introduce yourself and the podcast that you represent, and maybe just a little something about where, maybe where you're located, your podcast, what you currently do. Starting with Josh. [00:01:21] Josh Reppun: Good morning, everybody. It's a little after 7 a. m. in Honolulu, where we are experiencing torrential rains here in at the end of November, the beginning of December. My name is Josh Rapun, and I'm the host of the What School Could Be podcast. And it's just an absolute blast to be on this episode today and to be with other podcasters as part of this conversation. So glad to be here [00:01:44] Jason Johnston: thank you. Lee? [00:01:47] Lee Skallerup Bessette: Hey I am Leigh Skallerup Bessette. I'm coming at you just outside of D. C. I work at Georgetown University where I'm the Assistant Director for Digital Learning at our Center for New Designs in Learning and Scholarship, also known as CANDLES. And I have a little podcast with a colleague of mine, Amy Morrison, up in Canada, and it is called "All the Things ADHD" it's called All the Things ADHD. Where we talk about neurodivergence in generally, but since we're both in higher education, more specifically in higher education. [00:02:20] Jason Johnston: Amazing. [00:02:22] Tom Pantazes: Hi everybody, I'm Tom Pantazis. Really excited to be here on the sequel of Super Friends and I am one of four co hosts of the "Oddly On Air" podcast that runs out of the Westchester University Teaching and Learning Center. [00:02:36] Jason Johnston: Amazing. Ricardo. [00:02:38] Ricardo Leon: I am Ricardo Leon. I am one of the hosts and producers of the "Course Stories" Podcast, which is produced through EdPlus at ASU, Arizona State University in Tempe, Arizona, where I am currently at right now. It's a little drizzly. Looks like the sun's coming out though. So we're doing good. But also in addition to the podcast, we also I'm part of a studio that runs quite a few things, including something that will be coming out in January of 2024 called "Space for Humans" it's a YouTube program about how we design futures in space that are accessible and inclusive. [00:03:10] Jason Johnston: Amazing. And Mary. Mary. Mary. [00:03:12] Mary Loder: And I'm Mary Loader and I am with Ricardo on "Course Stories." We created this about two years ago. Is that right, Ricardo? I think so. [00:03:19] Ricardo Leon: I don't know. I have no idea. [00:03:21] Mary Loder: That is a weird concept. But yeah, we're excited to be here. I'm the manager of professional development and training for Arizona State University's department called EdPlus on the team that Ricardo and I are on called Instructional Design and New Media. So there's three layers to understanding where we are at our very large university, but we're really excited to have been invited back. Thanks guys. [00:03:41] John Nash: I get say it, "And you guys work together." [00:03:43] Mary Loder: to my gosh you said that perfect [00:03:44] Ricardo Leon: yeah, [00:03:46] Jason Johnston: That's good. That's great. And John, I guess maybe we should introduce ourselves in case this is the first podcast that people are listening to. I'm Jason Johnston . I'm the executive director of online learning and course production at the University of Tennessee, Knoxville. And this is our podcast, online learning podcast, "Online Learning in the Second Half." John? [00:04:06] John Nash: Yeah, I'm John Nash. I'm an associate professor of educational leadership studies at the University of Kentucky and the director of graduate studies in that department where 95 percent all online instruction department, and I'm also the director of the laboratory on design thinking at the University of Kentucky. Yeah, this is fun. [00:04:26] Jason Johnston: This is fun. I love the fact that we're spread all over the place and we're coming from different institutions. This is yeah, I'm just really excited about this conversation. Starting off, I'm just curious about other than the fame and the fortune and the notoriety of doing podcasts. We all know, we all share in that. We all understand how all that works. But other than those, aspects why did you either start the podcast or why do you continue the podcast? What is your why in this situation? And just a few sentences for each of you. [00:04:59] Lee Skallerup Bessette: I'll go first. My co host Amy and I, we, there wasn't a podcast like that out there, like what we were talking about. Particularly with our context of two middle aged women in academia who got late in life neurodivergence diagnoses. And we thought, surely we can't be the only ones, but even if we are, it gives us an excuse to talk to each other for an hour once every other week or month, depending on when we can get our act together. And we keep doing it because it has resonated with so many people. And it is not just about our experiences, but our experiences as educators, how our diagnoses has shaped and reshaped our pedagogies and how we're thinking about these things. And just to help people feel less alone, less isolated, less weird in terms of the, maybe the experiences that they're having or the struggles that they're having, even if they're neurotypical and dealing with neurodivergent students or peers and those kinds of things. So the reception has been so positive and gracious, and that, that's really what keeps us going even when our lives are turned upside down and we have trouble finding an hour once a month to get together, let alone once a week. [00:06:10] Jason Johnston: That's great. [00:06:12] Ricardo Leon: This is flashing me back to the one time that I definitely lied in the interview when I came to plus they said, they make thousands of videos a year and he said, that's, it's a kind of a factory kind of a process. Are you, what are you going to do about getting bored? And I said, Oh, I'll find something. So I guess I didn't lie. Cause I did find something. And so there would have been some iteration of this, because I just can't help myself. I think podcasts are great. And I think that, it's a wonderful way to, to do that knowledge share that that what do they call it? When you go out and you share that knowledge as a, mary, help me out. What do they encourage us to do when we go to conferences? [00:06:50] Mary Loder: I don't know the term for it. I know [00:06:52] Ricardo Leon: There's a term for it. Yeah, Justin has something for it. Our boss. But, just that we're making a name for our institutions by the work that we're doing. And there's an easy way to associate us with those things. [00:07:03] Mary Loder: And I would say Ricardo's like the king of podcasting. I've literally said that on our podcast after correcting myself and calling somebody else the king of podcasting. But Ricardo's literally the king of producing podcasts. He's so good at it. And so we're really lucky that he one has capacity to fit this in where he does. Cause we have the same thing, Lee, like, where are we going to. Do this. We really want to do it, but when and where are we going to do it in our existing work? But the [00:07:26] Ricardo Leon: Thought leadership. Thought leadership. [00:07:28] Mary Loder: Yeah, thought leadership! Good callback good. Yes Yeah. Part of the reason we started this podcast was I was already having conversations with faculty on the things they were doing that were working. And it was like, okay, so it's great that I'm having these conversations and I can share with others when I meet with them, but what's an intentional way that we can package this to have a larger reach and impact. So a lot of the reason "Course Stories" exist is because there are lots of faculty doing amazing things. And a lot of instructional designers doing amazing things alongside them. And so being able to package that in a way that's funny, because again, Ricardo is really great at creating a podcast that's entertaining. But in a way that's actually meaningful to the work that we do was the reason that course stories continues and why we keep on trying to push it through. And we're lucky now we have a producer, Liz Lee, who's like amazing and helps us do all the things that became heavily tasked. Weighted. [00:08:23] Jason Johnston: great. I believe deeply in thought leadership. I believe I'm part of thought leadership. However, and I'm sorry if this offends anybody, if that is your second thing in your LinkedIn profile running your name, that you're a thought leader I may or may not accept that invite. I'm just putting it out there. I have a little bit of a, a thing about that, but I think this is what podcasting is about thought leadership. I think in a sense, that's what John and I were certainly about when we wanted to do this. We didn't feel like doing a, another paper together, but we wanted to quickly be able to disseminate not only answers, but also questions out there into the real world as we're talking about things that are happening in the online space. [00:09:04] John Nash: failed solo podcaster. And so I, I realized I needed a partner to work with. And that's where, because we each bring different strengths to the microphone, to the backend, to the production that are complimentary and don't really overlap too much. And then yeah, isn't it fair to say that you can't call yourself a thought leader? People have to decide you're a thought leader. And then, so [00:09:27] Ricardo Leon: you can have you can perform thought leadership. [00:09:30] Jason Johnston: Yes. Yes. [00:09:31] John Nash: Say that one more time, Ricardo. I'm sorry. [00:09:33] Ricardo Leon: Oh, I'm sorry. You can perform thought leadership. [00:09:36] Jason Johnston: Just don't put it on your t shirt [00:09:39] John Nash: I'm with thought leader. [00:09:42] Ricardo Leon: Thought boss. [00:09:43] Tom Pantazes: So for me, one of the reasons why I keep doing this, because we're in year two now, at this point is the joy that comes with being all in all the parts of the podcast. We started for the same reasons that Mary and Ricardo talked about in terms of trying to tell stories about the folks that work here at Westchester and the work that they're doing, that's cool and creative and different. But I just, Every time we reach out to somebody to say, Hey, you want to be on the podcast? And they're just tickled to even be asked, there's joy in that. And then you have this hour long opportunity to just sit and listen to them, talk about something that they're passionate about or that they like to do, or that they're an expert in. And there's joy that in getting to hear that story. And then as the producing side as well, the editing side of trying to take that. gift that they gave you and turn it around into less than 30 minute chunk of time to put it out into the world. There's joy in that part. And then the last part too, when it goes into the world and Derek Bruff likes and shares your social media posts about it, there's joy when you see that kind of thing going on. Thank you, Derek. You can keep doing that. Every part of it for me brings joy. [00:10:49] Josh Reppun: That's awesome, Tom. I agree. It is about the joy. It doesn't quite start out that way. It's very daunting in the very beginning, but for me, starting the What's Cool Could Be podcast, it, I actually work part time at Apple, which is where I get my health benefits from. And my podcast was launched in the back of the Apple store three years ago. Right when we were closing the store a tech geek here in Hawaii, Ryan Ozawa was sitting in the back customer messing with his phone and he and I started a conversation about just technology and immediately discovered that we both wanted to start a podcast. I had the mission and vision. He had the technical expertise. And we just went to a whiteboard space here in Honolulu and whiteboarded the thing out and launched it. So for me, very briefly, Ted Dintersmith produced the film Most Likely to Succeed in 2015. Then he went on his 50 state tour, which ended in Hawaii, and I was privileged to curate his visit here in May of 2016, and then he wrote his book, What School Could Be, and it was a real joy, Tom, to have a chapter at the back end of that book about his time in Hawaii. It's going to be the only time in my life that I'm listed in the index of a book. And so the podcast was born because I wanted to figure out a way to make that chapter longer and longer. Because I knew that Ted wasn't going to write another version of the book. And so now about to do my 117th interview, it's just an absolute joy to do this work and I'm very privileged. I sit in a privileged position because I'm underwritten by Ted. And that means that I can actually spend a tremendous amount of time researching my guests. And I know we're going to talk about this, Jason, a little bit later about the research process and all that but what a joy to do a two week deep dive into somebody's life and education and their life in general, and then to be able to craft that story and to, have an actual professional editor do the work. Evan Kurohara, he's amazing, super creative guy, audio engineer. And then you get this episode and and it's amazing. People actually download the darn thing and listen to it. Go figure, right? So yeah, very much about joy, Tom, very much. [00:13:06] John Nash: Josh was asking, did I see Amanda Bickerstaff's timeline that she put on LinkedIn the other day? Amanda Bickerstaff, if you don't know her, she's with AI for Education. She founded this group that does a lot of good work around thinking about applications of AI in mostly P 12 space. But she put up a great year-in-ChatGPT graphic and I keep reminding folks that we're now we're 53 weeks in which is wild. And and so it would be good time to ask as we think about year in review. Yeah. What have been the impacts of AI from your perspective and what do you think is going to happen next? Jason and I were talking about earlier we say, has anything changed? And I I surprised myself by saying no, I don't think much has changed, even though a ton has changed. But I'd love to, we'd love to hear what you all are thinking particularly from the, your perch of your podcast and your audience. Lee, do you have thoughts on this? [00:14:02] Lee Skallerup Bessette: In my job it's that same sort of thing. It's changed everything and also nothing in terms of just being able to say good pedagogy is good pedagogy. But been thinking about how that it could be an assistive technology. In particular, is thinking about it through the lens of disability and neurodivergence in terms of what students and even faculty and staff struggle with with ADHD, with autism, and, thinking through those sorts of possible applications for it. What's it good at? What's it not good at? And how can it be used as an assistive technology and thinking through all the ways that also we throw the proverbial baby out with the bathwater and a lot of times when it comes to new technological innovations for better or worse. Where it's horrific. And so we're in all of these kinds of ways. So we're just going to get rid of it, even though there is a definite benefit to certain subpopulations. In that sense, so there's, talking about the balancing act of like the horrific environmental destruction that goes through, but also could really help. Someone with ADHD gets started on a paper because that's notoriously something that people with ADHD have difficulty with. But is it worth all of that? Really taking a step back and being able to think through those things and thinking about specific populations and how it can have an impact. [00:15:28] John Nash: Yeah, I like that a lot. And this notion of take a step back. And of course, we're at the end of a calendar year now. And so everybody's doing kind of a year in the review or taking a step back. But I feel like even in the middle of this calendar year, say, in the summer, July, educators, people like ourselves were even saying, then how do we take a step back? Because how is this, different. How is this the same? Josh, that's a theme that you've been talking about the last little bit. And I know we're going to talk more about it next week, but this idea of taking a step back, what do you feel about that? [00:16:02] Josh Reppun: Yeah, Lee, I'm struck by first of all, I'm deliberately choosing not to get into the weeds with the folks that I'm interviewing, educators, education leaders around AI, because it feels almost a little bit too early. To do something like that, but I'm, I am conscious of our position as podcasters, as producers and hosts that we have an opportunity to, as John described, to lift ourselves up to that kind of hot air balloon level and be able to comment on what's happening. And John, you and I have had a conversation at a different time about how when EdTech emerged for all of us, in the mid 2000s, everybody just went gaga over the devices. And I remember I went nuts over the iPad. I thought it was the second coming. And then slowly, but surely the whole EdTech world righted the ship and went back to the pedagogy again. And I think it feels to me like AI is very similar. That we're all going. Bonkers about the bots and in indeed, even the individualized bots that can do things that are in the field of Neurodivergence. And this is what Amanda is doing at AI for Education, is that she's having these very specific conversations around AI and special ed, AI and this and that and the other. So, slowly over time. I think that we're going to go back to just thinking, what is the most engaging teaching and learning? What is the most learner centered, the most student driven and real world? And then we're going to look at the tools that are coming out of AI and say, how can we use them? And that's what I'm looking forward to in 2024 with my guests is to have those conversations that are both at the meta level and then in the weeds about how the tools are actually being used. Yeah, it's going to be an interesting year coming up for sure. [00:17:54] John Nash: For sure. And I like what you said there about you alluded to it as well, Lee, this idea of getting back to first principles around pedagogy. I certainly noticed when the pandemic forced a lot of our colleagues to move their courses online. It laid bare a myriad of instructional design holes in their approaches. And I think that to your point, Josh, it was a an awakening Oh, we just need to good instructional design turns out is just good instructional design back in early 2000s. I was hanging around people who were concerned about these horse race studies about whether online learning was better than in person learning. And, I think that's been settled. It's just all about good instructional design. But that sort of takes us to the online learning space. Mary, what are you thinking as we come 52 weeks into our friend Chad and Claude and Bard? How are you feeling? [00:18:48] Mary Loder: Probably overly confident, to be honest. So like you said, it exposed what was already there, right? So the fear laid within the framework of things that already really weren't working well. And it was probably a really hard shift for a lot of people. And so what we did at Arizona State University this summer is we created this course of teaching with generative AI, like really intentionally learning how to use it because that's the first step and then getting curious into what that means for your classroom and framing it around your learning objectives. And then how can you leverage it in interesting ways that not only help you be intentional in the inclusion, but help create a space for your students to be literate in the technology, right? Because that's probably a primary responsibility that the fear's not gonna help us with. So jumping in is a good thing and we've seen so many people jump in and we just celebrated over a thousand faculty registering for that course. So that's really good. We were at a place where people were intentionally avoiding generative AI last year to intentionally seeking out opportunities to improve their experiences to help improve their students experiences. So I'm feeling very confident because we have such good energy around it now in just one year. And it has been a journey for a lot of people, right? But some of them already were really excited too, because we're very lucky to work with some extremely innovative individuals who, like this summer, Andrew Maynard had a course where he taught students how to use ChatGPT, which is great, because if you're not taught how to use it, you might think it's not a great tool, but if you learn how to write a prompt properly, you've increased your efficiency in so many places. Riccardo, I don't know if you know this, but I'm going to try to figure out our podcasting timestamp-like issues with so many people by feeding all of our transcripts into ChatGPT and then asking it to do some things for me. But I think there's some major efficiencies that can happen when you know how to write a proper prompt. And by all the additional plus options, specifically in ChatGPT with being able to feed in websites or feed in PDFs or, whatever you need. And to what Lee was saying, like being able to reframe and redefine. education as a person who doesn't get it because of how it's being worded through a system like that, through a conversation. What an amazing opportunity for access for someone to really better understand the environment that they're in and then be prepared to interact in that environment. [00:21:15] Ricardo Leon: Oh, Mary, where can we hear more about this ChatGPT course? [00:21:19] Mary Loder: Oh, It's funny you should ask. Season four, "Course Stories", episode two, one? I don't remember. It's on our Teach Online page. Yeah. [00:21:29] Lee Skallerup Bessette: Put it in the show notes. Put it in [00:21:31] Mary Loder: Yeah, we'll definitely [00:21:32] Jason Johnston: It'll be in the show notes. It'll all be in the show notes, bit of it. [00:21:36] John Nash: I can vouch for that episode. I listened to it and it was great. Yeah. [00:21:41] Jason Johnston: Yeah, me too. I was quite interested in that. It was yeah, really interesting to hear the approach and what you're doing. Yeah. I was curious about those podcasting this year, John and I started our podcast this year in February in some of the fervor of ChatGPT really hitting the people hard. And so I think we had four podcasts where we said, "Oh, we'll move on to other topics next podcast." And then it kept getting stranger and more advanced. And we kept talking about it and talking about it. And then we dropped into kind of getting a little more organized about what we're doing. And so we started talking to people still with. AI as part of the conversation. I'm just curious about other people that were doing podcasts. I know, Tom, that you had a couple of podcasts this year that were more around the theme. Did you find it it ebbed and flowed this year or what were you finding? [00:22:32] Tom Pantazes: We actually stayed away from it for a little while, mostly because we were spending a lot of time trying to understand it. And it gets to what Mary was talking about. I found a great quote from Seth Godin. He said, "AI is a mystery to many, it's a threat. But it turns out that understanding a mystery not only makes it feel less like a threat, it gives us the confidence to make it into something better." So we spent some time just trying to get our heads around it. One example of that is Planet Money did a great three part series on " Can AI take our jobs?" I highly recommend that three part listen if you haven't listened to it yet. They, in the way that they do a great job of telling that story and exploring like what it might look like for AI to take their jobs as podcasters. And I'm not going to spoil the ending, you have to go listen to see what they ultimately settled on. But we did just recently, I think last week and the week before that, did our first episode with some of our local experts here about AI and got them to speak a little bit about how they've seen the impact happen in their, classes as folks who are going to be comfortable using it, and they found the students were mostly using it to ask questions about things that they weren't particularly clear about from class that they had experienced, which the instructor thought was pretty interesting, and he would love to get those chat logs as a way to better understand where his students were struggling. So that's where we've been. We haven't stepped into it too hard yet somewhat intentionally in order to get our heads around it a little bit better than we had in the past. [00:24:01] Mary Loder: I will say, guys, I loved listening to you guys try to figure it out in your first episodes. They were really entertaining, Jason and John. It was fun to listen to you guys figure out things that were working or Jason, I think you got kicked out because you were having a mental health conversation. There was just some really fun From parts of your episodes. [00:24:19] Jason Johnston: Yeah, ChatGPT broke my heart at one point. [00:24:23] John Nash: Yeah, it was fun working in that time period, particularly as Jason was noting. I couldn't believe we kept talking about AI. I thought we really thought we would move on. Surely there's more to online learning than this. And then it just kept pushing us into the breach as it were. [00:24:40] Josh Reppun: John, can I just, I'd love to share a quick story. A couple of weeks ago I attended our 16th annual Honolulu based Schools of the Future conference. And there were about, I think, 1400 educators and education leaders who were there at our convention center. And on day two, Our lunchtime keynote was Kevin Roos, who's the co host of the hard fork podcast, which I'm completely obsessed with. I, I listened to every episode. And lately, as with the whole business of Sam Altman going to Microsoft and coming back to open AI. Kevin was actually sitting at his table 10 minutes before his keynote and there were a bunch of us in a group chat iMessaging each other, and that's when the news broke that Altman was out, and Kevin was literally writing his column 10 minutes before he went up on stage to deliver this really broad and beautiful overview of the whole last year of AI to these, 13, 1400 educators. And it just really struck me that it must be bewildering for a lot of educators to look at the kind of national global landscape and wonder what the heck is going on here, right? Because it just seems very chaotic. And I know that's something, John, that I would love to talk to you about in our upcoming event that we're going to have just about the design of AI and how it's unfolding for educators and how it must be traumatizing in some way because it's just upset their normal procedures in much in the way that iPads did as well. Yeah. [00:26:18] John Nash: Yeah I'm wondering how many how many of the stripes of educators that are in a system have been affected and at to what level? I'm going to talk to some superintendents next week at their statewide convention. And some of my early forays into talking to those participants suggests that a lot of superintendents still really aren't using AI or have used it once or twice, and so they're not really thinking about it. So I think there also is a conversation to be had about to Mary's point. I think there's opportunities for leaders to be thinking about what they're doing with it as a leader, but also how are superintendents and others thinking about managing this change at the teacher level? I think it's, yeah, I think it's different. I think this is, this goes back to this point of so many things have changed, but yet some things are not changing at all. [00:27:09] Jason Johnston: I don't know if we explain this or not, but we did a previous podcast episode like this at OLC. You can look it up. Those that are listening in the spring of 2023, that we called podcast super friends. It's just a name that came about as we were talking about how this is like those crossover episodes where people are coming in. And so we're calling this Super Friends II. And these are definitely podcast super friends here. But one of the things I was thinking about was, how podcasting is a form of translatable research, as we're all dipping into these different fields and then coming together, and here we are coming together as this podcast, and I was thinking about getting divergent views. We had a couple podcast interviews that were side by side that really had different views about AI. We talked to Kristen DeCirbo from Khan Academy. Obviously they're pushing out this whole Khanmigo chatbot and they basically scrapped all of their plans for the next year to put their development efforts behind that. And then we had a great conversation with. With Brandice Marshall, who is much more of a, I don't know what you'd call it, maybe John have a word for this, but, or somebody else does, but we're almost like a-- even though she's deep, like she knows so much more about coding and about data and so on than we do, but she's almost like a reluctant technologist in some ways when it comes to AI, trying to take a slow approach to AI and being skeptical about its abilities and about what it is that we should be putting our hopes and dreams into here. Have other people found with their podcasting that they're able find divergent views or views that maybe have challenged you in this regard over the last year? [00:28:45] Ricardo Leon: I was going to keep quiet because I'm not a fan of those kinds of AI solutions. I think it's really not good enough yet to be using it as much as we're using it. Yeah, I just, I'm just not a fan of that. Mary's Oh, I'm going to use ChatGPT to do this or that. And I'm like cause already our transcripts are run through our editing software-- creates a really rough transcript. So Pedagogy is going to come up as "Purple Monkey Dishwasher." You know what I mean? And then we're going to use AI to, use that, to, to leverage that "purple monkey dishwasher" to create this or that. And, so that's, I think that there's there's been a lot more excitement or interest in AI rather than in human capital. I think that, sometimes you just have to do the sifting through and I know it's painful and it's time consuming, but I do, we just had a hack day where we look to solve a problem and at the end of it, you have a presentation. On my team, we had me and one of our designers, really great designer, Ron, and we were able to just put together a video with a, with an interface, aspect of it that was really well designed, and I was really happy with that, and I see some of the other teams, they didn't have that human capital they, and they're using AI to develop some of their slides, and I can see, the characters on the slides having multiple fingers, things just not-- so that's so distracting to me to see that, and maybe it's just in the creative stuff for me at least it just drives me crazy, it's not good enough, and I think that we rely on it way too much, and that, that really, of course we're gonna try to eliminate as much human capital as possible, but those are, I think, still really valuable things until we have these, perfect dream machines, I think it's great. It enables a lot to happen, it makes everybody a jack of all trades, but there's another half of that idiom that you're a master of none. And so I think that we're gonna lose out on a lot of that stuff if we rely on these technologies too much. [00:30:39] Mary Loder: We are the divergent views on the podcast. I'm just kidding. Actually, we don't usually disagree, but we do disagree there. I can't wait to prove you wrong with my amazing prompt. [00:30:48] Ricardo Leon: I can't wait for the "purple monkey dishwasher" podcast episode. [00:30:52] John Nash: Ricardo, I appreciate what you're saying, and it goes back to what Brendice Marshall wrote in Medium, which I still gush about, which is there are these things that are un-AIable, and I think, I was hoping you'd also say, was it a hack day, or what was it? Yeah. Did you win? Because I think those skills that you talked about are the ones that we still need in great measure to do great creative work that AI can't do. [00:31:33] Mary Loder: we'll know what timestamps go where. So he can quickly go timestamp to this one, timestamp to that one. Oh, that's the spot. That's the spot. And just like splice them all together. So I'm hopeful I prove you wrong, Ricardo, and we improve some of the experiences for you. Cause what you do is time consuming, although highly necessary and totally creative as well. [00:31:50] Tom Pantazes: So I'm running a little experiment right now where we did the recording already. I grabbed the transcript, threw it into Claude and said, where would you cut this down? Like, how would you bring it down? And then it totally butchered the timestamps, but I held on to that and I'm going to do the edit myself. I'm going to do the work I can normally do, but then I want to compare the two when I'm done to see if what it spit out actually would have helped me. And we'll see what we get. And I'll try to share back about that at some point. [00:32:17] Mary Loder: Yeah, please email me and let me know if it works. Maybe I'll hold off on writing my prompt till I see her outcome. [00:32:23] Lee Skallerup Bessette: But I think that this is where we have an opportunity, like I was saying, I've said this a lot that I think we not necessarily here in this podcast, but we within higher education and elsewhere having the wrong conversations. In terms of how we're free, how the discussions are framed. I'm going to use that passive voice. And then one of the things that I've really enjoyed is in in podcasting and talking about it is getting to have that reframing. Getting to say, okay we're talking about it like this, but why aren't we talking about it like this? Would it be more, would it be more beneficial? Would it be more generative and generous to talk about it in this kind of way, which is again, why I'm very. I've been very big on thinking about it as an assistive technology, because I think that's a way to reframe it in a way that it's it's not going to take over. It's not going to Grammarly is an assistive technology, right? My alarm is an assistive technology. My calendar notifications are an assistive technology. In what ways can this be an assistive technology? and say, and thinking about what is it good at, what is it not good at, and then if we think about those affordances, like any digital tool, right? We go through this with any digital tool that comes out. What are its affordances? What is it good at? What is it not good at? Then how do we use it in our teaching and learning or in our lives? And so to be able to use these conversations as opportunities for reframing and rethinking and, having those moments of friction. I think that's the real power of it because, even, and I'm a writer, I love writing, but there's an immediacy to the podcast that, putting something out on the web now, particularly with, the, what formerly known as Twitter has gone downhill. tHere used to be an immediacy in those kinds of conversations that I think is being picked up again in podcasts when, as you're saying, people want to come on and have these conversations, and listen to them as well, because there's an immediacy to it that I think is really unique generally about podcasts. [00:34:28] Josh Reppun: Ricardo, I, what you said really resonated with me. I, again, from a privileged position of having the time to do it, I spend two weeks getting ready for a guest, and I've developed a very kind of intricate Google Docs process of creating raw questions that come from information that's provided via an intake form. And then I, once I have the big giant bank of raw questions. I start to move them over into a final script that I'm going to use in the interview. And last summer I find that process extremely humanizing for me. It's I'm like a huge fan of Warren Berger's "A More Beautiful Question," the book and it's just such a beautiful process to go through creating a beautiful question and last summer, just on a lark, I asked ChatGPT to create a dozen questions based on a short bio of a guest that I was about to do, and it just 20 seconds. It suddenly did all the work that I would take two weeks to do. And I reared back from that like I just saw the devil. It was just horrible moment where I'm like, I'm not going there because it's going to take away from me my very human process of getting to know somebody. So what I think what you're saying is ,I writ large, I feel like we're in a moment where we have to have these conversations about where the humanity remains and where the technology becomes helpful to us. And in podcasting, it's just a great medium to be able to have those kinds of conversations. So appreciate what you said. [00:36:03] Jason Johnston: Yeah, I appreciate that as well. [00:36:06] Lee Skallerup Bessette: I think another thing that, that this also like in, in this moment that we're having is what are the systems in place that make it so We would want to use ChatGPT to save time, [00:36:20] Josh Reppun: Yeah. [00:36:21] Lee Skallerup Bessette: right? And that, like you were saying, the luxury of having two weeks to research and have those questions to be able to go forward. But there is still this pressure of time, of efficiency, of whatever there is that, you know, that If I have a choice between two weeks and going through this very humane process and humanizing process versus five minutes with ChatGPT what are the systems that are informing my decision to pick one or the other? This is pre tech, but when I was teaching at one point I got a TA and so the weekly quizzes that my students did, I could give that to my TA to grade. It was this huge class that was extraordinarily time consuming. The trade off was, is I didn't get to know my students very well that semester because that was the way I did it. But , I was a PhD student. I had a dissertation to write. And so ChatGPT again is exposing a lot of these inequities and these pressures that have always been there and it's just really highlighting them and bringing them to the forefront and again, it's that thinking of reframing the conversation around generative AI to be able to say, okay what is this telling us more largely about our work practices, about work life balance, about our strategies about our values about all of these kinds of things. And so that just to be able to blow that up and have again, those larger conversations about the society in which ChatGPT is growing and being adopted. And then also the nitty gritty of what is it good at? What can it do? Why is it doing what it does? And those kinds of things. So I think that there's that, that really great spectrum that we can hit on in this medium. [00:38:00] Josh Reppun: Lee, I would add, there's I'm becoming aware now that there's a company called Magic School which is experiencing explosive growth. And basically Magic School is a tool that saves teachers time through generative AI. Awesome, glad there's explosive growth, but what are you doing with that time that you're now freed up to experiment with? Like, how about you take, dip your toes into design thinking? How about if you dip your toes into real world assessments or deeper learning, assessments for deeper learning, right? That's the reframing of the conversation. If we give ourselves time, what do we do with that time? And that, that's what I think we can do as podcasters in 2024 is to start having those conversations with people about what they're going to do and how they're going to be more student focused. [00:38:49] John Nash: The AI doesn't know what else you could do with your time because you decided to use AI and that's part of the problem. And I'm also appreciating all y'all's comments about the tireless and, generout list of questions that ChatGPT can give you -- it robs you of that Process by which you've decided to ask the question And it's that thing that we're always talking about is like how do we better humanize what we're doing in the presence of all this technology [00:39:20] Ricardo Leon: And we're just this current generation of that too. I think about the students, the younger students who are coming along and this is just going to be. Ubiquitous. It's just, so that, that is really the, for me, the bummer is that the next generation of people where we're finding out ways to what are they going to be doing? It's, what is work going to be in the future [00:39:42] Jason Johnston: Yeah, my kids don't know a world without internet or even a world without cell phones. They will never experience what it is like to be wandering a country having to ask people for help. [00:39:57] Lee Skallerup Bessette: Physical maps. [00:39:59] Jason Johnston: or physical maps. It's interesting. It's... [00:40:01] John Nash: hitchhike! Can I throw that in there? They're not going to know what it's-- man, I had to hitchhike in Ireland because they're like, how am I going to get back? I don't know. Put your thumb out. Oh, [00:40:18] Jason Johnston: as we're seeing this kind of transition. And I think what intrigues me about AI is not. because I'm so enamored by it, but because I have a sense that this is a internet Gutenberg press kind of moment in time, there will be a before and afterwards and things are shifting in a way that we need to have our eyes open. , one of the things about talking to different people with different perspectives, and even I appreciate what you're saying, Ricardo, and within my own team my media, more creative types, have a different approach and thoughts about this and then my instructional designers do. And I appreciate hearing all of those and it's giving me pause for both what I'm chasing after but also the way in which I speak about such things because it's helped me hopefully at the end of the day and I'm still growing and learning, but hopefully at the end of the day, it's not just about using the thing, but it is about me being more human and me being more empathetic and understanding about how all of this is affecting everyone around me and the people that are within my own touch. [00:41:25] Mary Loder: I have one more gem to share from ASU. Sorry, Tom, I'm going to be fast. It's the Academic Risk Reduction Guide. So I'm going to give that to you to put in the show notes because we created that, and I don't say we, like me, I mean Deanna Soth, Tamara Mitchell, with the guidance of the Office of the Provost, created this awesome pedagogical guide. And it's not focused on generative AI, but it helps to address generative AI through just good instructional design and pedagogy. So I just wanted to put that out there. [00:41:54] Jason Johnston: Wonderful. [00:41:55] Tom Pantazes: I was just going to point out that what I'm hearing is the not least the human aspects in it. As we move into these generative AI tools and their use, and I am reminded of those things that I've seen floating around. I may have even been from John, you may have posted one of these, but they're like AI writes the questions and then the AI answers the questions and there's no human work or understanding or labor that takes place in that scenario. And I've seen lots of variations of that. So, how do we help folks, or at least in my role, how do we help folks create situations and scenarios where we're using AI as that? assist and not in a way that removes the humanity and the situations in the work that we do. [00:42:35] Jason Johnston: That's good. Yeah. And how do we work at our own communities, whether it's our podcasting community or working community to help, as you were talking about, Mary, bringing together some guidelines to, to help that we can form together. So it's not just one segment of the population. And as you brought up, Lee, which I so appreciate, we're thinking about how this impacts multiple kinds of learners and And also, Ricardo, in terms of different workers and different aspects of what our work looks like I firmly believe that we can form ethics that are objective, meaning that there are ones that we. We form together as groups of people and we can fiercely defend and fiercely move forward to help guide us during these times. And I think that if we can't do it in our educational circles, I don't know who's going to be able to do it really. So we can't depend on the ed tech folks to do it. We can't depend on the AI companies are not going to bring up black box transparency and things like this, right? So I think that we are some of the people that need to be doing that and as well using our platforms to help move that forward. They're [00:43:50] Josh Reppun: if I could add Mary to your comment I think one of the things that I've been thinking about partly as a result of all the work of doing these episodes over the course of 2023, which is a fantastic learning curve that any host would be on been thinking a lot about how maybe a little bit worried about the potential for uneven presentation of professional development around AI. Very similar to what happened in EdTech, very similar to what happened with project based learning. When that became a word or a phrase for people, there were lots of entities that jumped into the arena to offer professional development around project based learning, but a lot of it was really uneven, and a lot of it really wasn't student focused, and I worry a little bit now, and I think, is that going to play out with AI, and who are the entities that we really trust in this space who are going to deliver the professional development that is student centered and is focused on learner centered pedagogy. That's something that's been on my mind and something I'd like to keep on my mind as I go through episodes in the, in 2024. [00:45:01] Tom Pantazes: I trust these guys on this podcast called "Online Learning in the Second Half." [00:45:05] Josh Reppun: Good place, great resource. Absolutely. [00:45:09] John Nash: I've met those guys. They're not thought leaders. [00:45:12] Mary Loder: I [00:45:13] Jason Johnston: More question leaders than anything else. I think those guys have. fewer things to say and more things to stir up. Yeah, [00:45:20] John Nash: Yeah. [00:45:20] Lee Skallerup Bessette: But it brings up a good point though. And I think you're I think you're really right on this is that this is a space where I think podcasts can really fill a gap in that sense where it, I know, I'm at Georgetown now we are very well resourced, we are, our center is very well staffed, we are doing all the things to support faculty in teaching and learning with AI and a myriad of other things. I've also worked at regional comprehensive public institutions where there isn't a kind of robust support for faculty and staff around any of these things. I think project based learning again, I think that's a, that's an excellent example where, these podcasts like this become a way for. the dissemination of knowledge and the dissemination of discussions. And that was, it was one of the things that being at a regional comprehensive, I found most difficult was this sense of isolation. Who else is thinking these things? Who else is having these conversations? Nobody, again, the time factor, everybody's on 4, 4 or 5, 4 course loads. How are we, how can we deal with any of this stuff? And to be able to listen in on conversations, participate in these conversations know that other people are having these conversations and thoughtful ways that we'd hope to be having them on our own campus, being able to bring them to our colleagues and peers. I think again, that's one of the strengths of having podcasts like these and having these conversations is again, providing. prOviding resources and hoping those resources get to places where they wouldn't have typically gotten in the past. [00:47:00] Mary Loder: I mean, for instance, thank you for the ability to plug again. At ASU online, we have these webinars. They're open to anybody. They're free. So educators, please go to asuonline. eventbrite. com and join our instructional designers and our faculty in the conversations and presentations around learner centered pedagogy. [00:47:18] Jason Johnston: great. Yeah. And I think we're all in agreement. A hundred percent of the those surveyed, I think, say yes to what you're saying there, Lee, about the, some of the strength and purpose of podcasting. And at that, why don't we, why don't we spend a minute to go around and just let us know how we can find your podcast as we are wrapping things up here. Maybe starting with Lee, tell us how we can find you and listen. [00:47:41] Lee Skallerup Bessette: It's all the things ADHD. It is available if you just search all the things ADHD on just about every podcast distribution service. Wow. I can't even think of the word for that right now. What is it? Platform. That's it. Syndicators. There we go. Or you can go to allthethingsadhd. com where we also have every single one of our episodes. That's where the RSS feed is generated for all of the other platforms. And you can find me online as ReadyWriting on literally all the socials. I just went through and claimed it on all of them. And I'll, I also share the podcast there when we do actually get around to recording it every once in a while. [00:48:21] Jason Johnston: That's great. Mary and Ricardo? [00:48:24] Ricardo Leon: We are "Course Stories". Or you can listen to us anywhere that you find podcasts. Also I, like I said earlier in the episode we, I am producing a program called "Space for Humans," which can be found on YouTube starting in January. And that is a weekly show. It's about us designing it's a partnership with the Interplanetary Initiative. And we are talking about how we design space futures and that are inclusive and accessible. [00:48:51] Mary Loder: And if you want our show notes, which has like bios and all the links to all the things people share, that's at teach online forward slash podcasts forward slash course dash stories. We need a better website for that, but you can just go to teachonline. asu. com. And we're under podcasts. [00:49:09] Jason Johnston: And we'll put all these in the show notes as well. Tom? [00:49:13] Tom Pantazes: So oddly on air, oddly spelled O D L I when you're searching for it in your podcast provider of choice, but you can also catch our episodes and our links from our wcu -tlc. org website. [00:49:28] Jason Johnston: wonderful. [00:49:29] Josh Reppun: Yep. And so you can find the What School Could Be podcast and all of the podcast platforms, including Apple and and everything else. You can also go to whatschoolcouldbe. org and in the nav bar at the top, just tap on podcasts and that'll take you directly to my podcast website. And Mary, just feedback on what you said in terms of learner centered, student driven learning at whatschoolcouldbe. org. If you go to the NavBar and tap on Innovation Playlist, that's another awesome resource for student driven learning. It's really nice. That we're all working now a little bit more deliberately in these spaces where students are the center of the conversation. And Jason, I guess this is the right moment to mention that you and John and I have been working on a project here. Which is something called the Network of Education Podcasters. And when this episode goes live, there will be. An NEP group on LinkedIn, and we invite anyone who's podcasting, hosting, producing in the education space or related spaces to join us on LinkedIn, and we'll just keep this conversation going. Lee, I loved what you said about how, if we as podcasters are all talking to each other, there's no possible way that we can all listen to each other's episodes, there's not enough time in the day, right? But when we have these kinds of conversations, we actually can. Move the thought leadership forward over the course of the next couple of years. And I love that idea and it puts fuel on my tank and makes me want to just keep right on going. Network of education, podcasters on LinkedIn, join us and we'll start working together. [00:51:11] Jason Johnston: Sounds great. And we are found at onlinelearningpodcast. com. You can find all the show notes that will include all of these links, as well as information about each of these fine people that joined us today in our show notes. So please find us there or on LinkedIn. I think everybody's on LinkedIn. You could probably find us and hit us up there as well and make some connections because it's not just about for us. And I think all of you. It's not just about the one way dissemination of information, but also about creating community and connections and getting your questions and your feedback. We'd love to hear what you think about this podcast and others. So right. [00:51:46] John Nash: Yeah, absolutely. And I'm grateful to you, Jason, for helping us put this all together. It's like you're the Gary Shandling and I'm your Hank. I think that's how. [00:51:56] Jason Johnston: I have a vague idea of what that means, but not completely. [00:52:02] John Nash: Yeah, that's right. [00:52:03] Lee Skallerup Bessette: We lost anyone under the age of 40 just right now. That was it. Anyone under the age of 40 is I don't know what is going on at the moment. [00:52:10] John Nash: We'll put a Hank "Hey now!" Gif in the show notes. [00:52:14] Tom Pantazes: That would help me out. [00:52:17] Jason Johnston: It's a positive thing though, John. That was a positive thing? [00:52:20] John Nash: Yeah, absolutely. Yeah, you're, yeah, you're glib and interesting and I just go, "yeah, that." So [00:52:25] Jason Johnston: Oh, I see. So it was a little self depreciating. That's not the case at all. But yeah, for sure. Oh, that's good. Thank you, everybody. It was great to talk. This was a great conversation. Appreciate all of you. And we'll see you out there in the In the podcasting world someplace. [00:52:41] John Nash: Yeah, [00:52:42] Josh Reppun: Thank you, Jason. Thank you, John. [00:52:43] Ricardo Leon: Thank [00:52:44] Lee Skallerup Bessette: you so [00:52:44] Tom Pantazes: for having us. [00:52:45] Jason Johnston: Yeah. Outro [00:52:48] Lee Skallerup Bessette: I love how even when we record podcasts, we all wave like [00:52:51] Mary Loder: I literally, yeah, I couldn't even help myself. Yes, absolutely. 

In this episode, John and Jason talk about dangers and opportunities in the second half of online life, from their Online Learning Consortium (OLC) 2023 presentation and “live off the OLC floor” interviews. See complete notes and transcripts at www.onlinelearningpodcast.com Join Our LinkedIn Group - *Online Learning Podcast (Also feel free to connect with John and Jason at LinkedIn too)* Links and Resources: See slides from the full presentation here More about OLC here Theme Music: Pumped by RoccoW is licensed under a Attribution-NonCommercial License. Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! False Start [00:00:00] John Nash: I took a class from a professional in San Francisco for voice acting. I thought I wanted to be a voice actor. So yeah, that [00:00:07] Jason Johnston: and here you are doing a podcast. You basically are a voice actor, except you happen to be acting like John [00:00:13] John Nash: Like John Nash, not like Barney the dinosaur, or doing my Louis Armstrong imitation or something like that. Start of Episode [00:00:20] John Nash: I'm John Nash here with Jason Johnston. [00:00:23] Jason Johnston: Hey, John. Hey, everyone. And this is online learning in the second half, the online learning podcast. [00:00:28] John Nash: Yeah. And we are doing this podcast to let you in on a conversation we've been having for the last two and a half years about online education. Look, online learning's had its chance to be great. And some of it is, but, a lot still isn't. And so how are we going to get to the next stage? [00:00:43] Jason Johnston: That is a great question. How about we do a podcast and talk about it? [00:00:47] John Nash: That's perfect. What do you want to talk about today? [00:00:50] Jason Johnston: So John, would you call yourself a techno? optimist or a techno pessimist? Do you think we're, all of this is winding up into a better world? Or is technology taking us down this path of doomsday and destruction? [00:01:06] John Nash: If the left side is doomsday and destruction and the right side is optimism and happiness, I'm a cautious optimist. I'm, I think I'm a little bit to the right of a cautious optimist. I'm no Mark Andreessen who's recently come out with a tech manifesto suggesting that anybody who doesn't believe the bros in Silicon Valley can fix everything is crazy. I'm not like that at all. I do worry about my own critical thinking around technology and how it may be exacerbating environmental problems and social problems. Because I love playing with these tools so much, I think I'm clouded a little at times, but I'm, yeah , I'm right of center on if being right is optimistic I'm over there. [00:01:55] Jason Johnston: Yeah, I think I'm, find myself in the same space, not because I necessarily have a lot of optimism around technology. I do think it's pretty consumer driven and profit driven. And so that doesn't build in me a lot of optimism for its final outcome. However, I have an optimistic view of humanity, one that we typically work together towards our own survival when it comes down to it, and that there are a lot more good people in this world than bad people. And I think that maybe I'm an idealist and that I think the good will win out over, but not because I believe technology is going to save us by any means, but because there are a Usually enough good people that are helping to drive technology that I think we'll get to a better place. [00:02:46] John Nash: Yes. Yes, I think that's well put. I think I'm in the same space you are because we're both educators and we surround ourselves with other educators who are interested in applying the use of technology to help learners achieve their goals. I'm not on the side of thinking "the technology we need to have in place to save the world is that which puts billionaires in space." I'm not thinking that's the way to go, but you're right. I think when we surround ourselves with people who are interested in applying technology, particularly the technology that allows us to have online learning, and create more equitable, lower cost, high impact activities, then I think we're in a good place. [00:03:29] Jason Johnston: Yeah, I agree. . So you don't think you're going to climb into the next Mars shuttle to help expand us into a multi planet species? [00:03:37] John Nash: Now, I'm not in line for that. I'll watch the rockets leave earth. [00:03:40] Jason Johnston: Oh yeah. I will too. I would love to watch the rockets leave, but I don't have any interest in doing it nor do I think it's the best place. I think we have enough issues and good things to put our money towards here on this planet with these people that we have in front of us that I'm not really in line with that. [00:03:57] John Nash: Yeah, I agree. So where does that put us? We're both on the optimistic side of center here. But that doesn't mean we're not without some dangers. [00:04:08] Jason Johnston: That's right. And so today I would love to talk about our last OLC presentation, but around the theme of turning dangers into opportunities in online learning. Online learning in the second half. looking at the dangers, turning them into opportunities. How does that sound? [00:04:26] John Nash: Yeah, that sounds really good. And let's remind our listeners what OLC is. That's the Online Learning Consortium and they hold two major conferences every year, and this fall conference was in Washington, DC [00:04:42] Jason Johnston: Fall of 2023. If you're listening to us in the future, it's fall 2023. And also we're sorry. That's the other part. If you're listening to us in the future we really are trying our best, but I know we could have done more. That's all. [00:04:55] John Nash: That's right. So we had a presentation where we were able to talk with participants at the conference about the potential challenges that we have in front of us with online learning and really disambiguating those from the dangers that we might face. Also have in front of us. Jason, I think the word danger might sound a little alarmist to some of our listeners. Maybe we ought to put that into context. Also, [00:05:22] Jason Johnston: Yeah, and we found that as we were talking to people, so we roamed the snack area, basically, and accosted people with our microphone, asking them this big question, and I think a lot of times, "dangers" took them back just a little bit and say, danger, could I talk about a concern or a problem? And it was said, yes, but we're really looking for dangers. We're thinking about the big threats here, the big kind of more existential threats to online learning. What are the big things that come to mind? But we did talk a little bit about what "challenges" were versus "dangers," which challenges are more like the obstacles or difficulties, things that you could overcome with some effort and creativity and so on dangers, really these bigger challenges that potentially could pose significant risks or threats and have some harmful consequences if they're not addressed. [00:06:13] John Nash: Let's also put some more context on the danger and the things that we're concerned about. The people that go to the Online Learning Consortium meetings, there are certainly some vendors who supply tools and packages and other technology for institutions of higher ed and P 12 to do online learning, but It's also significantly populated with instructional designers and people who are really interested in bringing about higher quality experiences for learners in online environments. And so when we talk about dangers, we're really talking about what may be in front of us that could really threaten quality of learning experience. Is that fair? [00:06:56] Jason Johnston: I think so. I think most of the people that we talked to are well versed in building online classes, not just from a theoretical stance, but a practical stance of getting in there and making them happen from a quality standpoint. And so that certainly puts a particular context on this. Nobody was talking to us about the enrollment cliff or things like that. They tended to be around more of the issues that are apparent within the course and programs that are being delivered online. [00:07:29] John Nash: Yeah. [00:07:31] Jason Johnston: Shall we listen to a few quotes from the OLC floor? [00:07:34] John Nash: Yeah, absolutely. Let's get on the floor interrupt some some snack time that people are having and hear what they were thinking was a potential danger to online learning in the future. OLC FLOOR INTERVIEWS Yeah. My name's John Ruzicka. I'm with learning Sandbox. I feel like the greatest danger to online learning is overreliance on what I would call the shiny new object. So a couple of years ago at this conference, you might've heard a lot of talk about the metaverse. Today, it's all about generative AI, open AI. And so what will it be in the next couple of two or three years? It depends. I mean, of course, these are topical things we need to all think about and know about and experiment with, but I think the over reliance and over indexing on that new technology could be a distraction. My name is Carrie Kennedy. I'm here with the University of North Carolina at Charlotte, and I would say the biggest danger or risk that I'd like to make sure that my university avoids is being too slow to consider workforce impact and mobile pathways between non credit to academic credit. I think we're already a little bit behind in doing that and I think to, you know, keep up with demands of employers and skill gaps that we need to have those pathways in place. I'm Ellen Rogers with Penn State University. Big concern might be, if the faculty get too good at all this online learning and instruction, what happens to the need for instructional designers? Bill Egan, instructional designer of Penn State World Campus, one of the biggest threats play off. of that, what if we get rid of faculty, because we're using things like AI and other certain content experts to generate the content, which is one of the biggest obstacles from an instructional design perspective, is working with faculty, getting content on time, etc. So I answered a question with a question. I'm Cody House, I'm the Director of Academic Programs at George Washington University with the College of Professional Studies. I see the thing that most influences or should be challenging to higher education and online learning in the next few years is how slowly institutions are to accept change and to embrace innovations. You know, obviously I feel like to this question, most people have probably said generative AI. But I think even that conversation shows you how slow institutions are to figure out what their stances on changing. They're coming up with committees about committees to figure out nomenclature for new terms and new credential terminology. And so I think that institutions need to just figure out how to streamline processes and make decisions quicker to accept change and move on to the next thing. Jamie Holcomb, and I'm with Unitech Learning, and I think one of the greatest challenges for online learning coming up will be the disparity between the consumer experience and the online learning experience. And the expectations that consumers have for the quality of interactions that they have from other platforms where they engage with frequently. I think online learning is lagging there. So, to me, that's one of the greatest challenges we have coming up. I'm Carrie Brown Parker from North Carolina State University, and I guess I think the danger in terms of student work or student productivity maybe is AI tools, although there's also a great inspiration there for instructors to get creative and do new work with students. Caleb Hutchins instructional designer for the community colleges of Spokane. I think the greatest danger is probably commercialization, to be honest. I perceive that a lot of different colleges are moving towards standardized publisher content as much as possible. And I think that I think that more and more it's taking away instructor agency and instructor interaction with students. I think publisher content has its place, but I think that when it starts to become a replacement for the teacher, then we have a problem. My name is Dr. Sonja Dennis, I'm with Morehouse College. So I think the biggest threat would be the lack of in depth knowledge, or lack of in depth understanding where students have at their fingertip so much information, are they really having any deep learning occurring? MY name is John Moraine LaSalle. I am with Montclair State University. Specifically, I'm an instructional designer, part of the team. And I think that what could potentially be one of the biggest dangers While I want to say it's potentially artificial intelligence, it's not specifically that, but I think it's more so the growing danger of feeling isolated in the online environment, and I feel that artificial intelligence poses the risk of making it even easier for students to disconnect from each other. They're already struggling in the online environment sometimes with that. So that is what I think the bigger threat is from AI. Not so much, Oh, they could use it to try to get a solution or an answer, but how it could, it could basically almost like Pavlovian make them just immediately go, I'm going to go to chat GPT to figure out what is the best way to discuss the best way to find an answer or a solution than rather than your actual peers in this virtual environment with you. My name is Yingjie Liu. I'm the leading instructional designer from San Jose State University. I Would say We might, we might be too slow to catch up what's going on in the, in the world, especially like with, with XR with AI. Like we, we are slowly to integrate those into our teaching and learning. But I, uh, I'm wondering when the students are already using the technology like AI in their learning how we. Update our teaching, especially the, our pedagogy, best practice to catch up with what's going on and what students need, right? So the students might have different ways to learn, they might have different practices. Preference which will be different and we are, we are exploring that direction. Just hope we catch the speed of things evolving. My name is Vincent DelCassino and I'm at San Jose State University. That's a really interesting question. I think the potential for it to become so diffuse that it loses its center point. In the sense that anyone thinks they could get into the game, and it has the potential to lose the kind of engaged pedagogical value. That you sometimes see when, and I think one of the areas is in corporate in particular. Going out there and building courses and programs and thinking like, they've nailed what we haven't been able to deliver on. But some of the criticality, some of the other things like that can have a real impact on how people think and imagine what value higher ed brings. And we tend to move a little slower sometimes. But I would argue with a little more thoughtfulness. But I think that could be a risk for us in the future. END FLOOR INTERVIEWS [00:14:52] John Nash: Yeah, wow, so what'd you think of those, Jason? [00:14:56] Jason Johnston: Yeah, there were some parts that I was not surprised and some of the themes that were coming out, especially those around AI and institutional change quality and so on. But yeah, it was really interesting to talk to people just to get their initial reaction on the floor. [00:15:13] John Nash: Yeah, you never know where people are heading with what their concerns are going to be. We hear them talking about over reliance on new technologies, maybe slow adaptation to workforce needs, to redundancy of instructional designers. It's a conference of instructional designers, of course. AI is on everybody's mind. Will they be put out of a job? Will faculty be put out of a job? So I think that's, yeah, it's interesting. And then, of course the ever present institutional resistance to change. [00:15:44] Jason Johnston: Yes. Yeah, which, we talked about a little bit is, and we'll go through and talk about these individually, but is both probably to our benefit and to our demise in some ways, our resistance to change, right? How quickly we move into things like this, [00:15:59] John Nash: I think it's, yeah it's a risk to our demise. I think that the glacial pace of change in a lot of places is going to be a threat going forward. At the same time, I'm not advocating a move fast and break things approach, but I think we need to find a more middle ground. I think the institution's responsiveness to change through their leadership, to understand what expertise is need to be brought to bear to. Fix the problems in front of us is just not, it's not responsive enough. [00:16:31] Jason Johnston: But aren't you from San Francisco? Aren't you one of the bros? [00:16:33] John Nash: I am not one of the bros because I don't know how to code. I can write rudimentary HTML, but that's about it. [00:16:40] Jason Johnston: Okay. I thought everybody from San Francisco just believed in, in moving fast and breaking things and seeing what happens. [00:16:47] John Nash: Yeah I like to prototype things. And and I grew up in Menlo Park where all the VCs are. But but I am not a VC myself, nor do I really know any. [00:16:56] Jason Johnston: Huh. Interesting. As we were looking at this, we were looking at a pivot, listening to what people were saying from the floor, listening to what people were saying in our conference room, and thinking about how we could create this pivot of transforming dangers into opportunities. What are the top dangers? And then how could we pivot to opportunities? And we came up with this three part response and approach, which is to assess the threat level. Is it a real danger? How likely will this danger destroy a fundamental part of academic life? And then two, how could we simply survive the danger? What are the basic skills necessary? And then three, how could we then thrive within this danger or in response to this danger. Use it as an opportunity to create a better, in our case, in our theme, more humanized online Education. [00:17:52] John Nash: sort of level of discussion where we were talking about the threat level and is it a real danger was really important for folks we were talking to because it, it helps us start to disentangle hyperbole from real concerns. I mean, you get into a room with enough people and there's always going to be some kind of complaint about something that's going on, but is it going to be a real threat? Is what we're hearing in the rumor mill and the, in the world around AI. And right now we're, we are recording this at the time in which open AI's board has fired Sam Altman, their CEO. Is this a real threat to what we're going to do? No. So I think vetting those discussions in such a way that we think about what is the real danger, reframing it to something that's actually. Then taking it to a discussion where are we going to survive this? And then how can we actually thrive it? How can we flip it on its head? [00:18:46] Jason Johnston: And so that we could be specific, we tried to frame the dangers that we're going to present here as the danger of blank to the existence of blank so that we could actually be really specific. So it doesn't become just this just kind of nebulous danger that's out there, but what exactly, if it is a danger, what exactly is it a danger to? So our first one that was coming up over and over again, obviously a big topic of conversation, was around AI, but specifically, danger number one, AI threatening our ability to assess student learning in online courses. What do you think the threat level is for this? AI threatening our ability to assess student learning in online courses. What do you think the threat level is and why? [00:19:36] John Nash: I think the threat level is is in the middle there. If we're going from like a one to a five we're about at a three. I think that AI's threat to our collective ability as instructors to assess student learning in online courses is as large as the instructor's capacity to understand their ability to pivot and change what they assign. I'm going to go back to an, it's not the old adage because AI has only been around 51 weeks, by the way, at this point in time, as we record. And but it's an... [00:20:10] Jason Johnston: Happy birthday, [00:20:11] John Nash: you [00:20:11] Jason Johnston: AI. [00:20:12] John Nash: Happy birthday, GPT 3. 5. The adage is something as follows. If you're assigning work that can be done by AI, you need to rethink what you're assigning. And I think that's where the threat sits. So the question is then how do we survive across that but what do you think the threat level is there? Do you think that AI threatens our ability to assess student learning in online courses? [00:20:35] Jason Johnston: I think that, yeah, my answer is it's hard to give it a number because it depends, right? And so I think in short, I would say high for those that are inflexible to change and rethinking their assignments, but also high for people or programs where the typical assignment that is being assessed easily replicated by AI, meaning that it's not just about rethinking the process towards whatever it is that you're learning, but this final product is something that could be easily replicated by AI. So I think it has a high threat to those kind of programs and people and a more challenging threat, I would say. So how do we survive this threat then if we've assessed it and then we're looking to survive it? [00:21:24] John Nash: I think that one thing that instructors can think about to just merely survive is to start to communicate with their students the presence of AI and how they feel about it they meaning, how does the instructor feel about it and how do students feel about it themselves? And so there's this communication component that I think is going to be the lowest level threshold and highest impact thing at the surviving level. If you're not prepared to think about your assignments in terms of redesigning them or thinking about the way you assess the assignments that you give at least you could be talking about what it is you believe about this and why you also believe the assignments you give are the ones that you want to do. [00:22:07] Jason Johnston: Yeah. So taking an active communication stance, being transparent. We heard a lot of people talking about creating policies and principles, which I think are ways to survive, but not necessarily thrive, but they are ways to approach things. And that maybe comes in with some of your communication. Being in a place where you can really test out, figure out what AI is doing and how it affects. So it's not just this unknown boogeyman threat in the closet. And I don't know what it looks like, but you have a clear sense of, I've heard of instructors basically putting their assignments into AI to see what it would spit out. And that gives you a clear sense of really where this threat is at rather than this unknown nebulous kind of threat. [00:22:49] John Nash: Yeah. So what about thriving? How do we flip this on its head? [00:22:54] Jason Johnston: Yeah, one of the first things that we had talked about was our conversation with Dr. Brandeis Marshall on episode 18 about making assignments un-AIable. And I think that's one way to thrive is, as we've talked about beyond just the communication transparency, but actually reforming, re imagining our assignments under the influence of AI, in the age of AI, so that we could be thinking about how these assignments could not only help us really assess where the students are at, but actually prepare them for a future of work and life and scholarship within AI. [00:23:30] John Nash: Yeah, that's right. When we talked to Dr. Marshall on episode 18 that was really inspirational and it made me think about ways in which assignments could be turned into more public demonstrations of learning, more about oral defense of ideas. And a polite pushback to that might be that, that takes more time. If I'm gonna do an oral defensive ideas with every student and I have 200 students, that's may not be scalable. So I think we also have to be thinking as a community how we can support instructors at scale. [00:24:05] Jason Johnston: Yeah. All these ideas, not assuming that there's a one size fits all or a silver bullet. That's going to solve this for every single kind of program and class size and so on. We got to be thoughtful about this. That's right. Yeah, [00:24:19] John Nash: One way we might think about scale that could work in larger classes and inside a learning management system is, for instance, letting students cheat on purpose with ChatGPT or Claude or Bard and then ask them to rate the quality of that response to a prompt that you might ordinarily just give to students on their own. And so you start to get to this sort of metacognitive critical thinking lens going and you get ideas as instructor on what the AI can really do and also help students see the limitations of what AI can do. [00:24:58] Jason Johnston: That's good. And we talked a little bit about scaling online classes and humanizing those classes with Dr. Enilda Romero-Hall in episode 13. And within that thinking too, about how we might focus on skills and maybe focus on grading in those situations as well. And those are things that could be scaled because it's just a shift in what it is we're assessing and also just a different process in terms of grading, which it could actually turn into, let's say on the surface level, less work, not more work for the instructor when it comes to assessing where their students are at. [00:25:34] John Nash: Yes, and Dr. Romero Hall's presence in the classroom is really predicated on a community presence and with a feminist pedagogy lens bringing in student voice along the way. And so that could also be scaled to some extent through the LMS and through polling and questions and even discussion posts to say, how might we together consider how we want to address this learning goal in the presence of AI and with these kind of activities that we must get done? That could happen as a community. [00:26:08] Jason Johnston: Yeah, it reminds me of a quote that I ran into this last week by Paulo Friere and the quote is this, "the answer does not lie in the rejection of the machine, but rather in the humanization of man (or people)." This is from "Education of Critical Consciousness." And what reminds me of this idea of we, we just can't, we can't have large classes and actually humanize them. That may not be the case, right? We can think about our approaches even in the face of AI. We can think about our approaches in large classes that may be because of AI, it's forcing us to then think about the humanization of students within the context of these large classes in ways that we didn't have to think about before because we were just following what Paolo would also call "the massification of education." We're just following this incremental enlargement of the class size and without really critically reflecting upon what it means to continue to humanize the students in these contexts. [00:27:10] John Nash: And that's related to the webinar we did recently with the group from Inscribe, looking at the impact of AI on student connection and belonging. With AI,we are able to explore opportunities in large classes to help differentiate instruction, to help think about ways to advance belonging and large swaths of students. So I think that there's ways to get at this if you're thoughtful about it. [00:27:35] Jason Johnston: Yeah, absolutely. Oh, there's so much there. I just read a great article about belonging from a research with 26, 000 students across 22 institutions. Anyways, that's a whole nother episode. We should go there. We should find somebody that can talk to us about that. And let's do a whole episode on belonging online. Let's move on to danger to though. So this is what we saw from our group and from the floor of OLC, danger number two was institutional resistance to change in pedagogical approaches. So what do you think the threat level of this is? [00:28:07] John Nash: I don't know, maybe I'm too close to the mothership, but I feel like it's a little high. I'll give it a four out of five. [00:28:14] Jason Johnston: Yeah. Yeah. And I think it, for me, again I'm sorry for this big cop out, but it depends, right? I think there's certain units and certain programs that are embracing change. There are others that are quite resistant. And I think there's certainly ways in which a lot of people across units are wanting to hold on to the way we've always done things versus, versus adapting. So for instance, they want to just have, TurnItIn 2.0 so that it can detect AI versus rethinking the way that we're interacting with students around plagiarism detection and our relationship with students. [00:28:53] John Nash: Yeah, I mean, what I would hope for is that as institutions think they're responding to the need for change, it's not that they're bringing in new tools like the "TurnItIn 3.0," that's going to let us catch more cheaters, but rather they're thinking about ways to do capacity building that are akin to what we learned from Olysha McGruder's episode and what they do at Johns Hopkins in the School of Engineering, which is everybody who's teaching an online program has to go through the online instructional design process. And so my institution doesn't necessarily require that. I think that would be, that would raise the tide for all the quality across our institution if we did that and right now I think it's more akin to here are tools you can use and we hope you use them. [00:29:41] Jason Johnston: Yeah, which is probably some of the survival part of it is like we, we have provided you with some tools to use and give you some guidance around that, maybe surviving this threat level right now in terms of this change that AI is bringing about, this disruption really, AI is a disruptor it's not a calculator, I don't think. I've decided that's an interesting analogy about AI being like the calculator. It's not really like a calculator because it crosses so many boundaries of everything, it's a disrupter across every single discipline and so part of this survival is maybe giving people some ways to adapt and giving them guidance and so on. How would we thrive though in response to the danger of institutions resisting change? So how do we turn this into something that, that could really take us into a second half of online life , that we're imagining? [00:30:41] John Nash: I think that when institutions can become learning organizations and start to see the richness of the opportunity when they are able to build capacity amongst faculty, create environments where faculty want to learn, and also for Research-One institutions like you and I are at, incentive structures for faculty to be really interested in taking on that capacity building. [00:31:08] Jason Johnston: Yeah, that's good. And I think along with that too, that learning organization, capacity building, creating systems and positions that help us adopt and adapt to innovations. So creating pockets to test and educate and try out new things and help us with this transition of new technologies, I think is really important. I've heard more and more people getting assigned these kinds of roles, like a dean of AI and these kind of things to help move us in that direction, and I think that is really important because I think faculty are really busy, and they're just trying to make it through the semester and I think that they would welcome people who are taking the time to really dig into this and come from an institutional standpoint, guardrails up and think about how this change is affecting and should be affecting [00:32:01] John Nash: Yeah, there's a quote that came across my desk. Have you heard of the app Readwise? [00:32:07] Jason Johnston: Oh, yeah. Yep. Yep. [00:32:08] John Nash: One of my doctoral students recommended Readwise, and its connection the app, Notion, and I get a little push of everything I've highlighted on my Kindle. There's a quote from Daniel Priestley in his book, "24 Assets." And he says, "Systems aren't there to replace people, they are there to make your life easier." So I think thriving also means that institutions will put into place the resources to create systems that really work across the spectrum of services that we provide as faculty and that the staff do to make things go. [00:32:41] Jason Johnston: Yeah, that's good. Could you say that quote one more time? [00:32:44] John Nash: Yeah, "systems aren't there to replace people. They are there to make your life easier. Your teams, your customers, yours. Everybody's life." [00:32:53] Jason Johnston: That's good. So danger number three, increasingly low quality of online education. So the threat, the danger is low, increasingly low quality of online education. I'll say just from the top that, this seemed to really resonate with the people that we were talking to. Of course, we were with a bunch of instructional designers who were concerned about online education getting watered down, about it becoming a much more mechanized, much more shovelware. And I think I share that concern as well. That's probably a higher concern for me than a concern around AI taking over things. How about for you? [00:33:29] John Nash: Yeah I am concerned about that. And I think I want to frame our danger a little bit. because the way we've stated it here, "increasingly low quality of online education," suggests that we are on a downward trend. I think that the threat really is that there's a chance that we will see an increase in low quality of online education doesn't that sound like we're saying it's, there is an increasingly low quality of online education? [00:33:54] Jason Johnston: I think that is a danger is that online education will not get better. It's going to get worse. It's going to go lower and lower quality as we develop this out into this next next decade. [00:34:06] John Nash: And that threat manifests itself because of potentially crowded vendor marketplace, a potential run to make money in the space what have you. [00:34:16] Jason Johnston: Yeah. And tied in with the AI as well. I'm not a, [00:34:19] John Nash: yes. [00:34:20] Jason Johnston: I'm not a fortune teller, but I guarantee you a year from now, we're going to have thousands more online learning opportunities that have been created by AI as a subject matters expert. So we're not working with subject matter experts anymore on this. There are people just cranking these things out because the access to the information is there and there's an opportunity to get it in front of people and maybe make a couple of bucks or not. [00:34:47] John Nash: Yes, I think that's a part of that threat. And how do I feel about it? I was concerned that the level of quality of online learning that presented itself during the pandemic, which was horrid would bring people to a certain belief that this is what good online learning looks like, or I guess this is as good as it's going to get. And a lot of new people came into the space with not a lot of experience-- good teachers who had never taught online before, but then did not so great online. teaching and learning. And so I wondered if that was going to, and I posed that question to Dr. Olysha McGruder on episode 20, and she actually turned me around a little bit on that and said yeah, but you know what? Look at all the people who got exposed to teaching online and, that's more people than would have otherwise. And so at least we have those people knowing that you can teach online and that there is a, there's a light at the end of that tunnel where you can get better and better at it. [00:35:42] Jason Johnston: Yeah, and there are interventions that can happen to help us get there. And I guess talking about the surviving, would that be surviving or that was really moving into that thriving. I think surviving would be things perhaps like applying quality rubrics and continuing to bang the drum of we've got to continue to have quality online, for all the reasons that we should be building quality online. I think thriving into that, though, is really continuing to work heavily recognizing the importance of working with our instructors, not just to develop good online learning courses, but also have the right tools and approaches to, to make those courses good, to make them excellent, right? [00:36:27] John Nash: Yeah. I think that one thing that going online lays bare for new instructors in the space is that good instructional design trumps everything. And so there's a lot of things that you can get around and avoid when you're teaching face to face. You have that sort of context, but when you start to move online, you've really got to have quality rubrics, good instructional design have some professional development under your belt on how to really have a presence online. So yeah, I think you're right. [00:36:57] Jason Johnston: And of course, in our last episode we talked with Alicia Magruder about a Coursera course that she created about excellence. And teaching online. And the other cool thing is that on December 12th, we were invited to do a podcast wrap up session for their conference called the Excellence in Online Teaching Symposium. And this is just a, this is just a plug, of course, but a, also just an excellent moment to stop and say, yeah, we can always learn more, and this is how we thrive. in the face of the potential of low quality is by continuing to connect with peers, continuing to work the professional development, look for these opportunities to continue to grow and to learn and get better. [00:37:47] John Nash: Yeah, I learn best from concrete examples that I can copy and steal. And I think that, and I'm happy to do the same for others. I think that this opportunity with the Johns Hopkins School of Engineering showing excellent examples of online learning is a model for what we need to see more of. [00:38:05] Jason Johnston: So as we think about wrapping up on this OLC discussion around the dangers of future dangers of online learning what are your overall thoughts about our approach or about your optimism for what we have in the years to come? [00:38:22] John Nash: I think we don't want to come off as alarmist talking about danger, but I think we can take some time here like we did today to understand challenges versus dangers. Challenges are the hurdles that can be overcome with some effort and the dangers are significant threats that could have potentially harmful outcomes for the way we want to see online learning go forward. And so, I think by identifying some of these and then pivoting to opportunities is a great way for us to keep optimism in the mix of our conversations. Because I think there's practical strategies that we can take for a lot of these things. And it's just a matter of us working as a community to find out where they are, share those out, and then be kind and empathetic to those that are coming along. I think that there's a good opportunity here for online learning to be great. We just have to, be vigilant. [00:39:14] Jason Johnston: Yes. I agree. And I think OLC was a excellent example, again, of connecting with a larger community around these questions as well, so that it means that we're sharing these dangers, we're coming up with solutions together, we're maybe validating some of these or invalidating some of these, as the case may be, in terms of talking us down on the ones that we feel like might be a really, a big danger, but by specifying, we realize that maybe it's not as big as other things. And I also think like the ongoing community-- want to encourage people and welcome, have them to join us on LinkedIn as well. So they can connect with us there as well of our, as our community there as well. [00:39:55] John Nash: Yeah. [00:39:55] Jason Johnston: And we'd love to hear from you about, what you think about these top dangers, these top three that we talked about, but also if there's other ones that you want to talk about, or you have other solutions, just reach out and we'd love to hear more. And I think this will not be the last time we'd probably talk about this. Do you think John? [00:40:11] John Nash: No, we're never going to talk about AI again. We're never going to talk about online learning again. Actually we have to, that's the podcast, right? Okay. I'm actually looking forward to the balance of 2023 and talking to you more. I think we've got some good stuff lined up. A potential year in review. And maybe even a second Super Friends episode. [00:40:35] Jason Johnston: I think we might even try to combine those two maybe a year in review with our super friends. We'll see how that goes. [00:40:41] John Nash: Yeah. I think that would be a great idea. Let's do that. [00:40:44] Jason Johnston: Okay. That sounds good. This has been great, John. And again, as we said, connect with us on LinkedIn. Also, you can find all these podcasts at our website, OnlineLearningPodcast. com, as well as show notes. We'll put as many links as we can about the things we've talked about today in there. And anything else, John? [00:41:02] John Nash: You can catch the transcript of the podcast episode as well on our website. And yeah, do join our LinkedIn group. [00:41:10] Jason Johnston: Yeah. And we want to hear from you and the kinds of things that you want to talk about. And if you like what you hear, please review us on Apple podcasts. I understand that the AI likes that and will push us up to even more stardom and success. If real humans go in there. and review our show. [00:41:31] John Nash: So we have concerns about AI, but we still treat it with a cheerful tone, because one day when it does become sentient, it's going to remember that we were nice. [00:41:40] Jason Johnston: That's right. I always say thank you. [00:41:42] John Nash: Always say thank you. Thank you, Jason.

In this episode, John and Jason talk with Dr. Olysha Magruder about the future of online education, a three-pronged approach to faculty development including JHU’s Coursera MOOC Course, and time boxing to help achieve successful outcomes. See complete notes and transcripts at www.onlinelearningpodcast.com Join Our LinkedIn Group - *Online Learning Podcast (Also feel free to connect with John and Jason at LinkedIn too)* Links and Resources: Dr. Olysha Magruder is the Interim Assistant Dean in the Center for Learning Design at Johns Hopkins University and can be found here at LinkedIn Excellence in Online Teaching Coursera Course Johns Hopkins Excellence in Online Teaching Symposium Beth McMurtrie on Teaching: What happens to teaching after Covid? (Chronicle of Higher Ed Paywall) Theme Music: Pumped by RoccoW is licensed under a Attribution-NonCommercial License. Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! False Start [00:00:00] Jason Johnston: Any other questions for us before we get rolling? We'll do our normal kind of intro here, and then we'll get into the conversation. [00:00:07] Olysha Magruder: No, no questions. I hope I don't sound too goofy, but... [00:00:10] John Nash: No, we like goofy. [00:00:11] Jason Johnston: Yeah, you'll fit right in! . We decided on the front end. We're just going to let it roll in that way. And I feel like john people have appreciated that [00:00:18] John Nash: I even laugh at our own dumb intros because it's just, but yeah, we're not too stiff about it, but we have a serious topic here, but yeah, we're still humans. Start of Episode [00:00:27] John Nash: I'm John Nash here with Jason Johnston. [00:00:30] Jason Johnston: Hey, John. Hey, everyone. And this is online learning in the second half, the online learning podcast. [00:00:35] John Nash: Yeah, we're doing this podcast to let you in on a conversation we've been having for the last two years about online education. Look, online learning's had its chance to be great, and some of it is, but a lot still isn't. How are we going to get to the next stage, Jason? [00:00:49] Jason Johnston: That is a great question. How about we do a podcast and talk about it? [00:00:54] John Nash: I agree. Let's do a podcast and talk about it right now. What do you want to talk about today? [00:01:00] Jason Johnston: Wait, we are doing a podcast to talk about it. That's the weird thing about our intro. We're already doing a podcast [00:01:05] John Nash: Yeah. It's very meta. [00:01:07] Jason Johnston: a little meta that way. Yeah. Yeah today we are going to talk with Alicia Magruder. Dr. Alicia Magruder from John Hopkins Whiting School of Engineering. [00:01:22] Olysha Magruder: Hello, Alicia here. [00:01:25] Jason Johnston: Did I say all that right? [00:01:27] Olysha Magruder: tHere is one funny thing about the name of my university, which is it's named after somebody. who has a weird first name, and it's Johns. That was his name. It's very common to say John because it feels weird to say Johns, and in fact, when I originally applied for my position in my cover letter, I also said John. [00:01:47] Jason Johnston: Oh boy. [00:01:48] Olysha Magruder: I learned very quickly that, oops, it's a weird name, Johns Hopkins, but everything else, yes. [00:01:53] Jason Johnston: I'm glad you, you made it through that first that first test and they were kind to you, somebody not too long ago spelled Tennessee wrong on a cover letter, hard one to look over, easy to do though, easy to do, but also a little hard to look over sometimes. Yeah nice to have you here. So Johns Hopkins Whiting School of Engineering. [00:02:14] Olysha Magruder: Yes, that's right. Whiting School of Engineering. [00:02:17] Jason Johnston: Yeah. And tell us about what you do there. [00:02:21] Olysha Magruder: So I am the interim assistant dean of learning design and innovation, which is a somewhat new position not on the team, but for me, but I lead the learning design team of instructional designers and course support specialists. And we work collaboratively with our multimedia and instructional technology team to create online courses. So we have our main program that we I guess we could say service is a engineering for professionals program and there are 22 online master's degrees that we help support. So we run hundreds of courses at any given time. We have right now we have about 130 plus courses in development with our instructional designers and yeah, that's what we do. [00:03:09] Jason Johnston: Yeah. That's exciting. You've got a lot going on there though with with a hundred plus [00:03:15] Olysha Magruder: Yeah, [00:03:15] Jason Johnston: Does it feel like a lot? [00:03:18] Olysha Magruder: it does, but we've structured our team so that it's very collaborative amongst our instructional designers, faculty, the multimedia folks, the course support specialists. So we have what we call pods of team members and they work together for certain programs. And that way they can. Discuss the program specific needs, but because of that, we have a very nice workflow that we've created. So it is a lot, but it's manageable. So far. I haven't had any anybody tell me that they're ready to put their hands up in frustration. That happens occasionally, we get through it. [00:03:53] Jason Johnston: Yeah. [00:03:55] John Nash: Alicia, does every program that you just mentioned receive the benefits of your services or do some just still go on their own? [00:04:02] Olysha Magruder: They all go through us to create their courses. There are some, a couple of programs that have a slightly different approach that we accommodate, but eventually they end up with us. So everything that goes online through those master's programs through that one engineering for professionals is all the courses go through us at some point and we have a the course support specialists. We also have a quality assurance manager. They make sure everything is like accessible and, we have all these quality checks throughout the process. So that's by design. So all of those courses are vetted, reviewed, et cetera. [00:04:41] John Nash: That's wonderful. I know at my institution, there are online programs that do the best they can, and we have folks that can help us, but it's not as systematic as that. [00:04:52] Olysha Magruder: Yeah, we are somewhat unique and a part of that is because these big online programs, most of the faculty are by design people in the field. So they're super busy people and they're incredible people. It's pretty cool working with people who work at NASA or worked on the, asteroid destruction mission or are doing biomedical engineering things that you see on LinkedIn . And I don't even know half the time what they're working on, but then I see these posts and I'm like, whoa, they're like revolutionizing the medical field and. So they're super busy people, and so we've designed this to work with that particular type of person, and it's a longer, it's a very, it's a committed process, and it's a longer term process, but it works, mostly. [00:05:39] John Nash: Nice. [00:05:40] Jason Johnston: If we ever wondered whether or not online learning was important we now know that it is because we're training up the next people that will actually stop that asteroid from hitting the earth, right? The current people that know how to save us aren't going to be alive when the asteroids hit. So we're online learning is essential for training up the next generation. [00:06:02] Olysha Magruder: We actually had , one of the mission coordinator for the DART mission speak at it at a recent event, I don't think she teaches for us, but she's affiliated with one of our units. Anyways, she gave the whole awesome session on the DART mission, which was the asteroid deflection mission. She reassured everyone that it's very rare that's going to happen, that we have an asteroid that will hit that, We'll destroy the earth or what have you, but some of the statistics you put up there, she seemed reassured by, but I was like, oh my gosh, I don't feel good about these numbers. I know she does, but they still as any number seems a little bit, [00:06:38] Jason Johnston: right? If it's not zero, it still feels like something that could happen. [00:06:42] Olysha Magruder: Exactly, [00:06:43] Jason Johnston: Willis When you need them too, right? Because I, he's not going to be saving us. That's an Armageddon reference. I don't know if you've seen it. Have you seen that one, John [00:06:50] John Nash: I have years ago, 80s or 90s, I think. Yeah, but yeah, [00:06:55] Olysha Magruder: I'll have to look for it. I don't think I've seen it. [00:06:58] Jason Johnston: Yeah. It's an action movie where they're the ones that are skilled and determined to, to take care of this asteroid before it hits the earth. So I won't tell you how it ends. [00:07:09] Olysha Magruder: The good news is with the real life dart mission, they managed to hit not the big, I guess there are two, a big asteroid and small asteroid. This is all layman terms because [00:07:19] Jason Johnston: I don't know. [00:07:21] Olysha Magruder: but they managed to hit the small asteroid that was orbiting the larger one and they managed to change the time of it by 30 minutes. So it would, the orbit would take 15 hours and I don't know, I'm just gonna make this up, 50 minutes. But after they hit it, it's now orbiting at 15 hours and 20 minutes. And her point was like, this was just an experiment to see if we could, and we can, and so we can change the sort of, I don't know. It's wild. You can change space. We can change space. [00:07:54] John Nash: it is wild. It's as if they're playing a game of galactic billiards. [00:07:58] Olysha Magruder: Yeah. So all that to say, I get to work with cool people like that. We get to work with cool people like that and have to accommodate their extremely busy professional lives. [00:08:08] Jason Johnston: And it sounds like your approach, because as John was talking about, there's a lot of centralized units where their approach is a little bit more of a consulting approach. You come to us, if you need something, we're going to help you do a couple of things in Canvas or your LMS or whatever it is that you're in versus a, Let's walk you through more of a systematic process to really build this out. We're going to hold your hand through this. We're going to try to help this, um, happen in a reasonable timeframe and to a good quality and that kind of thing. So it sounds like yours is a lot of approach that more build out kind of approach, right? [00:08:46] Olysha Magruder: Yeah. We call it a high touch approach versus what you were saying, the consultant. And I was at an institution prior to this one where it was very much come to us. We will help you, but we only had three instructional designers for an entire college campus. So it wasn't a very one on one walk you through everything kind of situation. [00:09:07] Jason Johnston: Your team is also called it's Learning Design and Innovation. So what does innovation mean for you right now? I'm just curious about what things are on your plate. [00:09:17] Olysha Magruder: Funny you should mention that. No I am. I just, I wrote a dissertation about faculty development and getting faculty on board to adopt some things. And this was. A while back before I was at this institution, but I like to go back to my definition of innovation, which is something that is new to someone, basically, a pencil could be an innovative tool if one has never used a pencil before to keep it like super simplistic. So to me, innovation is what is new? Even if it's new to someone one of the things I'm interested in right now is I'm working on looking at bilingual programming, and if that's something that we can pursue, so I have some things in the works. Because, that increases the audience of people that could obtain this sort of education. That's one of the things. Obviously, AI is on everyone's mind, and we'd be... Not to include that in our innovative approaches. So we're looking at we have several of my team members are using a tool called Descript. I don't know if you've heard of that [00:10:23] Jason Johnston: We use it for our podcasts. So we are a little familiar and will put a link in the show notes for listeners [00:10:28] Olysha Magruder: cool. Yeah. So they're trying to use that to help with the editing of faculty videos. Because there are lots of ums and ahs and I hope that you will use that to help with this. [00:10:39] Jason Johnston: Oh yeah, we're there for that. Yeah. [00:10:41] Olysha Magruder: One thing I'm really trying to help is move away from, the typical PowerPoint video lecture kind of thing. And so we have team members working with different interactive tools to create material that. is I would say engaging in a different kind of way. sO yeah, that's, those are kinds of the things that specific things that we're working on that I think could be under the umbrella of innovation. [00:11:07] Jason Johnston: We actually connected at OLC Innovate this last spring, 2023 and. One of the things that was over some common people that we knew, but also around this Coursera course that you helped developed called excellence in online teaching. coUld you tell us a little bit of about that course? [00:11:33] Olysha Magruder: Sure. I'll start by sharing just. how it came to be because it was a cross divisional effort across the campus of Hopkins. sO within Hopkins, and I don't want to get too in the weeds with this, but they offer something called Delta Grants internally. And the Delta grant is the acronyms, digital education and learning technology acceleration. So it's pretty cool that Hopkins is invested in supporting, these kinds of initiatives. And so in 2021, I and other a few others. put together a grant for this project. And so we call it the online excellence and multi pronged approach to prepare faculty for excellence in online teaching and learning. So the three different, I like to think of it as like a spork perhaps has three different prongs or maybe a plug, an outlet plug. Anyway, one of them is this MOOC that we created. Another one is an internal certificate of completion for Hopkins folks. And then the third one is a conference or symposium that showcases excellence in online teaching. So the MOOC was the sort of most straightforward one to work on. So that's what we started with. So we Coursera relationships across the campus. School of Public Health has a really a lot of Coursera courses, uh, engineering as well. We've added a few to our portfolio there. So we had a relationship with Coursera already, so we were able to pitch this. They gave us a good idea of what we could expect in terms of enrollments and went forward. And then what we also wanted to do was to Like I said, it was cross divisional. So we had a an advisory board or committee created where we invited people from all over the campus to join us to talk about what should this MOOC hold, what topics, the MOOC and the Certificate of Completion program. So we worked with them to come up with the topics that made the most sense. And a big part of this was to actually focus on the faculty who are teaching online in our institution and to showcase them. So we recruited those faculty, we got the topics and put together the MOOC. So my one of my instructional designers on the team, Kimberly Barce, was the one who led the project and basically managed to get all these people together and do all these different recordings. And we do have studio recording spaces. on campus, but a lot of folks are remote. For example, I am remote. So we were flexible in terms of how the content was created. But essentially we have in the Coursera MOOC I think it's five modules and they cover some pretty broad topics. And then within those modules are short videos and lessons created by those faculty. And then, also the content gathered through that. So that's the structure. [00:14:40] John Nash: And is the intended audience is beyond Hopkins though, isn't that the case? Obviously I was looking at it today and so it goes pretty broad. [00:14:49] Olysha Magruder: yes, the intended audience is anyone who wants to pick up some general practices and ideas about excellent online teaching. And we really try to steer away from course design, because that's, A different ballgame altogether. We were talking more about the facilitation, the actual student interaction piece of online learning. [00:15:16] John Nash: Can I follow up on that? I think that's really interesting. And that may be for some who listen to this and others in our sort of colleague space as a distinction without a difference. Can you talk for a second about that decision? And what is the difference between the two? [00:15:30] Olysha Magruder: Sure, so from our perspective, and this is very much like from What my team does. When you speak of course design to us, that implies you're laying out the blueprint for the course. You're deciding, you're making these curriculum decisions. I also teach for the School of Education within Hopkins and I did the same thing with them. So what do I want to teach? What are the topics? How am I going to present this content? What are the resources I want to pull in? So there, that piece where it's the taking, it's like a flipped house, you're taking the structure and just making those design decisions. And then the other side of that is the teaching piece. So that's when you actually have The students in the house and they're using the rooms in the house and exploring and you're there to help them along. So that was just a really random comparison I came up with, but hopefully it makes sense. [00:16:26] Jason Johnston: I think it makes a lot of sense to me the building of it versus the using of it. The delivery as we define it out as we're talking with our faculty, we talk about. Design, development and delivery often with them with deliver being a complete focus on that teaching aspect. Ours we, we do internally professional development, both synchronous, asynchronous with our faculty and But we just focus internally selfishly of University of Tennessee. We just focus on our own faculty. What kind of took you to that decision of using Coursera as a platform. It was being used already there, but it's a public platform. Was there any conversation about the good and bad of this being in more of a public forum or was there an impetus there someplace to really make it public? [00:17:17] Olysha Magruder: That's a really good question. Well, there, I think I could say a couple of things to that. And the first is a really pragmatic comment, which is a part of the grant proposal was to have a sustainability plan. And as with anything, you need resources and resources means money. So we had to be creative about, okay, so if we're going to offer something. Campus wide or externally like this symposium, which I'll talk about later if you'd like, because that's coming up. But how do we actually pay for this stuff? So that's why we were like the MOOC will help. So with Coursera, there's a a share in the, in whatever income the course makes. It's not a whole lot. It's not like we're out here making a bunch of money off of people or something, but it's enough to feed back into the programming. And so we've worked it out with our institution where we get those funds put back into that sort of bucket that will then help us make these other things happen so that was one piece of it was, this could help us sustain this plan, and then the other piece of it was just, we internally know we have all these cool things happening. Is there a way we can showcase this and get More awareness around online learning at Hopkins. So it's just more of a, let's, let's shine some light on this and celebrate some of our faculty who are doing some cool stuff. So those were the two main reasons for choosing the MOOC. [00:18:48] Jason Johnston: Have you been happy with using the Coursera platform? I I've taken Coursera courses there. I've got, I probably have 20 that I started and haven't completed, is my guess at least. But were you happy with working within that structure? I've never made one there [00:19:04] Olysha Magruder: Yeah, Coursera has a really they've, they have a really good process set up for people developing. Materials you basically work with them. So our instructional designer, Kim, she worked closely with their processes and it was pretty easy for her now in terms of the platform itself. I agree. I tend to go into things and I don't always finish them. But the way I look at. This particular MOOC is that again, we tried to make things intentionally bite sized. We wanted you just to get a taste of some of these topics. And then if you're curious or interested, we have this symposium that we're setting up. To have a more alive presence to talk about these topics in more depth. So I think if you use a MOOC as a sort of a springboard for other things, it can be effective. Or at least for faculty development, that's my thought anyway. [00:19:59] John Nash: Innovation. You, one of the examples you talked about was getting past PowerPoint lectures and I was thinking of the term shovelware and in the Coursera course, there was a section that you have one of the modules, maybe on student engagement, and there's a video by your colleague, Mike Reeson there, and I could see several elements in that video that aligned with our Thank you. theme for this podcast, which is around humanizing online learning in lots of things around building relationships and community sharing personal experiences, this idea of explicitly centralizing climate some neat ideas in there. It made me wonder about your experiences and how you've navigated the challenges that come with transitioning faculty and instructors to online or hybrid models both as an instructor yourself and now in your administrative role. Are there specific strategies or tools or things you've found effective in fostering, belonging and active participation in online courses that help faculty who maybe have not really been there or have it in their head that's what they have to do? [00:21:05] Olysha Magruder: I'd say that's always an ongoing challenge, to be honest. It's. It's a definite mind shift because, as with face to face teachings, you walk into a physical space, people smiling, happy faces, or gauge their reactions to things and so then you go into this sort of online situation, and it can be, nerve wracking, I think, for people. How do I know how people are actually thinking or feeling? What we've done is really that instructional designer relationship with the faculty, the high touch model. We basically push some of these ideas. Maybe I shouldn't have used the word push, but it is like a matter of persuasion we, have a thing we call the course design matrix. Sounds really fancy. It's just basically the design document. And one of the things we asked them to lay out is what is your plan for interaction? What are your interaction plans? So upfront, we're having them think about it, and then throughout the development process, That is a key piece that is constantly reiterated and we have tools that can help interact. It's required that they have office hours. And I think there's one video in there. I can't remember which one, but another colleague, David Porter, who's amazing. He does really interesting office hours. So he talks about that in the MOOC. It's not just, I'm going to show up and if somebody shows up, cool. If not, I'm just gonna be sitting here emailing or what have you. He actually does an engagement piece where the students love to come to those office hours. And so we try to also share those things out with our faculty, celebrate them, put them at the center, give examples. We have a, what we call our cohort training program for the design of their courses. They have to go through this eight week process to build their document that's why we believe in that relationship between faculty and instructional designers because that's the ticket. [00:23:03] John Nash: Yeah, I can see that, and I get what you're saying about pushing, but you're advocates, you advocate for that, and you advocate and privilege it a little bit up front to to showcase its importance. Yeah, it's interesting. I think that there was a really timely article this week in the Chronicle of Higher Ed. It was Beth McMurtry's piece on thinking about how hybrid and online learning is just going to get bigger and larger, but there was a neat sort of discussion in there, the legacy from the pandemic and, the, these pandemic induced online learning courses really weren't representative of well prepared online, asynchronous teaching and learning. Do you think that lulled instructors into not taking online learning as seriously as they could? Part of me feels like this, the rush to online learning during the pandemic left maybe a slight negative mark in terms of perceptions and practices surrounding online ed. Do you have any thoughts on that? [00:24:02] Olysha Magruder: I see where you're coming from and a part of me also thinks maybe not because. Otherwise, what any of when many of these people have even tried it. And if let's just throw out some fake numbers here. Let's say we had it. I'm just going to make this all up. Please, if you're listening, this is not based on any reality. Just a theory here. Let's say we had 20 percent more faculty. Let's say 80% more faculty teaching online. And of those 10% bought into it and now are committed to quality online learning, I'd say we, we won there a bit, and even if 70% aren't buying in, they had experience with it. So at least they understand it. At least they know that there's an L M Ss and a thing called Zoom and a thing called flexibility for students. So I don't know, I'm gonna take that as a win personally. [00:24:54] John Nash: I like that view. I like that. Yeah. I think if you listen to our conversations over time, I'm, I'm a regular title series, tenure track associate professor at a research one and I have this sort of, jaded look at like how everything goes. And, I think. It is interesting in that same piece, McMurtry talks about how traditional age students are increasingly interested in online options. It's not just your father's Oldsmobile anymore sort of thing. And so I also worry about incentive structures inside research institutions like mine and yours where it may favor research over teaching quality. And so you kind of touched on it, I mean, for places that have a consultative model for instructional design support, is there a risk that we may still have a hard time getting a lot of instructors to do this work? [00:25:44] Olysha Magruder: Yeah, probably, but there are things that we can do. And so I mentioned I was at another institution before Hopkins and it was a state college. Mostly teaching faculty. So that's a little different than what you're talking about. But what I started there and I actually did a similar thing at Hopkins is creating this faculty development programs in which faculty go through it as students. I think any time that you can get. faculty to experience things as a student, then you're going to help increase awareness. And so we run that through our school through Whiting School, but it's called the Faculty Forward Fellowship. It's been going on for almost five years now, and I've had about a hundred faculty go through it across the campus, like we've opened it up to everyone. And that's one of the main things that we try to get through is. And it's actually a hybrid program. So we do meet face to face if they want to. It's very flexible. But we have four weeks of online modules. We want them to know how it feels, basically. We have a group project. We have weekly office hours. We use the tools and the LMS that we would recommend that they use. We show various ways of presenting content. We talk about Hot topic issues. This past one we did an activity with AI. So we're trying to situate them in the student perspective. And I think that really helps. Of course, they have to have an interest. And if they're not interested, they're not going to be interested. So we can't really do anything if they're not signing up for these kinds of things. So that's why I think it's probably always going to be a challenge. [00:27:16] John Nash: yeah, but that's lovely and having them walk in the shoes of students so that they can see what's going to happen on the other end. Do you get that kind of feedback when they're done? Do you ever hear about that? [00:27:27] Olysha Magruder: Yeah, definitely. They, I think there's a deeper appreciation for what students experience. And interestingly, on the flip side, we always have a deeper appreciation for what faculty experience because we're constantly dealing with Oh, this didn't work. Or why didn't you give me a score on this? Or, like we, we deal with all of those issues that faculty deal with on a regular basis. So for us, it's humbling as well. [00:27:55] Jason Johnston: Yeah, it's easy for us to say on a design basis oh, here, do this online discussion board, right? And without being in that place of actually trying to run one or run them week after week, right? You, we start to get a bit of a yeah, like you said, John, a walk a mile in the shoes kind of experience as we try to get busy faculty to engage into a professional development online course and do the same things that they might be asking students to do. Yeah, that's good. [00:28:27] John Nash: Were you also saying that when you put faculty in a course and the rules are reversed, you still find out that they're grade grubbers, just like undergraduates. [00:28:37] Olysha Magruder: Some, yeah, we actually did a book club, uh, I think it was in the spring of this past year and it was about ungrading. I don't know if you've read the book [00:28:47] John Nash: love that. Yeah. [00:28:48] Olysha Magruder: Yeah. we and in spirit of that, we took out all, Grading metrics in that program. And so now it's just more did you finish it or not? And we give you feedback or what have you. But before that, yes, things were scored and it was always like, this is just to show you how things can be scored or show you a rubric . And it was definitely, there was anxiety and, it's always, again, that's always like insightful from this perspective [00:29:17] John Nash: it is. Once a student, always a student, I say, yeah. [00:29:20] Olysha Magruder: yeah. That's true. [00:29:22] Jason Johnston: And I've felt the same thing about like we've we've tried a variety of different ways to go about professional development, as I'm sure that you have, to the fully self paced, to fully synchronous to now we are experimenting with kind of shorter and we're coming up with better language for this, but we're talking about self-paced but within a period of time, right? So it's asynchronous, but it actually is synchronous because we want you to do these assignments this week and then complete it. We'll do a two week kind of module for faculty and have certain things completed. Do you have a better name for that? Because it's not a, it's asynchronous, but we've got date constraints on it on either end, [00:30:08] Olysha Magruder: So we've done this before too, and I feel like we were in the same kind of boat where we don't, we call it self paced, but there are due dates or deadlines. [00:30:17] John Nash: There's a term that we'll use inside design sprints called "time boxing." I wonder if it's time boxed. [00:30:23] Olysha Magruder: Let's write that down. [00:30:27] Jason Johnston: I like that. If the three of us at three different institutions start calling this, middle thing, time boxing, just as this, everybody knows of course, we've got the fully asynchronous and then synchronous and then the time box, right? [00:30:39] John Nash: Nash [00:30:41] Olysha Magruder: Timebox course. [00:30:43] Jason Johnston: box. That's good. But I've found that like adding grades in, even if they're meaningless, really, like they're, these aren't going on your faculty transcripts or anything like that. They get a sense of a little bit of that stress and about feedback and so on. I've felt the same way about time, at least time boxing. Some of our now I'm using it as a verb, at least time boxing some of our assignments because faculty then also as adult learners will get the sense of what this means and also what it means on the other end if, "oh, I might need an extension on this. How does this work? Can I ask for an extension? What are the expectations? How flexible is my teacher going to be? How does this make me feel? How does this affect my own outcomes?" I think for the most part, it feels like Faculty appreciate things being time boxed because it helps them to prioritize and it actually does help them learn do it's accountability. It helps them do something. They've already decided that I want to learn this. I want to do this and I need someone to just tell me what to do and when to get it done so that it actually comes to pass. That makes sense. [00:31:51] Olysha Magruder: Sure. Yeah. And that program that I talked about, the fellowship program, we have taken off grades, but we still have a deadline based And then another thing we have always had journal coaches is what we call them. So there's like a self reflection journal throughout the program because reflection is, helps you in your practice. And What we did this past year, which I'm in love with, and we're going to continue is we actually took previous participants and they are now facilitating many pieces of the program. [00:32:23] Jason Johnston: Nice. [00:32:23] Olysha Magruder: So they became the journal coaches, they facilitate the discussions and they even helped with the live sessions that we had. But that was a fun thing to shift to. Now, we also have some people who are probably like many of students that where they put you off and they're, can I please have this and I still haven't finished it and it's always funny just to watch the spectrum of participants, but we have all kinds. [00:32:52] Jason Johnston: yeS, as we do. You had mentioned before, just shifting topics a little bit about the symposium, I wanted to give you a moment to talk about that, as like the, I like the Spork analogy, actually, because it gives you, you said like a three, like a trident, a three prong, but I actually like the Spork, because it's there may be something else you need to scoop up, right? You've got these three prongs, and Then you've still got that part of the spork where if you need it for something, you've got it there. Even if you don't have a little thing of mashed potatoes or something to eat with. [00:33:20] John Nash: you can stab it and scoop it. [00:33:23] Jason Johnston: and do it at the same time. Anyways, so the, but the symposium was one of the, one of the prongs. Tell us a little bit about the symposium. [00:33:32] Olysha Magruder: First I think I need to change the tagline to stab it or scoop it. [00:33:36] John Nash: That's my only job here. That's all I do is just I have little quips that might be useful. And then, [00:33:42] Jason Johnston: pretty good, John. You've got two now, Timebox and stab it or scoop it. [00:33:48] Olysha Magruder: Yeah, so the, it's the JHU Online Excellence Symposium, and at this moment, we still have the open for proposals, but by the time I think this airs, it will be closed for that. But, It's on December 12th of 2023, and it will be a virtual event. It's a half a day. We have Flower Darby, who is our keynote speaker, and she co wrote Small Changes and Online Teaching, I think is the name of the title. I don't have it right in front of me, but we love her, we think she's great, so she's gonna keynote. There is a small fee to attend. Again, that goes back to our sustainability piece. We need to feed it back in to help with our programming. I'm seeing people from all over, even from Ireland, which if you wanted me to tell you a little bit about why that is, I will, but we have people from all over the world submitting proposals. And it's just going to be a half a day 12 to 5 p. m. Eastern time of just learning about excellence and online teaching from people who are doing this on a day to day basis. [00:34:52] Jason Johnston: That sounds great. I'm putting it on my calendar for sure. Yeah, we'll put the link in our show notes as well. Tell us verbally how to find you though, just in case, because I fear that people don't go to our show notes as much as I feel like they should, but tell us verbally how one might search for you and find the name of this the name of this symposium. [00:35:14] Olysha Magruder: if You, I'm just doing it now to make sure. Yes, if you Google JHU Excellence in Online Teaching Symposium, you'll see there's a website, teaching. jhu. edu, and it has all the information on it. There's more to that web link, but if you get to that teaching. jhu. edu site, you'll find it. And it has all the information about registration and details and so forth. Yes, we'll definitely link to it. That would be awesome. [00:35:40] Jason Johnston: Yeah, that's great. And what kind of other topics are you hoping to come out of this? Did you have different tracks for the symposium or is it just a wide open whatever you want underneath the umbrella of excellence in teaching. [00:35:54] Olysha Magruder: Yeah, we wanted to keep it pretty open this year. We had talked about do we want to have, themes or tracks and since this was our first time trying this out. We wanted to be pretty broad so that if you feel like you have something to contribute in this area, we want to hear about it. And we Did say in the description, "the session should provoke conversation, spark new thinking, and advance the ongoing pursuit of online education excellence by actively engaging participants." So that was the the idea behind these proposals. And we have a little bit of a criteria but. Since we're still in the planning phase, we have yet to decide which proposals will be on, but excited by what I'm seeing so far. [00:36:37] Jason Johnston: That's great. Oh, that sounds good. Yeah. And we're here for all of that. I think that the conversations around all these things are so important. I think the more that we have them as as administrators and faculty, and even in this kind of context, which is really the reason why we. doing this podcast. It's just really an excuse for John and I mostly to get together to have conversations, but then to be able to talk to cool people like yourself, doing amazing things out there that really line up with the things that get us excited about the future of online education. I think it's looking up myself. Do you have a positive outlook for online education in the future? [00:37:17] Olysha Magruder: I do, because I interviewed for a position a long time ago at another institution. And they said, they were like, what do you think is the most exciting thing on the horizon? And I was like, this is not a very. I don't know. It may not sound very exciting, but blended learning. That's what that's where we're headed. And then this was like pre pandemic like this is a long time ago. And here we are. And I think no matter what happens, it's just becoming a reality, versus some of us don't some of us do it's like well students especially because even my son's in third grade like He's not taking online classes, but he's doing online stuff all the time. High school students are often required to take online courses. It's just an expectation that's going to be more and more prevalent. And we got to stay, we've got to stay up on these things. So I have a positive outlook of it too. And by the way, I was going to say, you all should submit a proposal before the end of the day to talk about your podcast. [00:38:21] John Nash: I just saw that, and I thought, Hey Jason, they're due today, want to try one? [00:38:27] Jason Johnston: It closes today. Oh, [00:38:29] Olysha Magruder: I'm sure I could get you an extension. [00:38:31] John Nash: It's only 300 words, surely [00:38:33] Jason Johnston: We could get there. [00:38:34] John Nash: Claude can write 300 words before we're done with the podcast. [00:38:39] Jason Johnston: Your short conversation with us, if you were to like a proposal from somebody like John and myself, what would this proposal perhaps be about? [00:38:50] Olysha Magruder: Just riffing here, but I think it would be cool if you talked about your podcast, but also the trends you're seeing or the things that you and your guests are talking about because it's all related to online teaching. So you could highlight some of your guests or you could even double up and record some of the audience for one of your episodes. I don't know. Throwing stuff out there. [00:39:16] John Nash: we could make it a live, yeah, we could do it as a podcast, yeah, [00:39:20] Olysha Magruder: Yeah. Why not kill two birds... Oh wait, that's not the term people like to use these days. [00:39:23] Jason Johnston: yeah, there's a list of non violent ones like that I can't remember what the equivalent is for that one, though, but I also try to avoid skin a cat, and I think it's I don't know what it is. [00:39:33] Olysha Magruder: Crack two eggs with one hand? I don't know. [00:39:35] John Nash: yes. That's it. We'll go into descript and we'll overdub some good examples in a minute. [00:39:42] Olysha Magruder: There you go. Thank you. [00:39:43] Jason Johnston: Yeah. [00:39:45] John Nash: thAt is interesting, though, and I think one thing that we could start to explore more, Jason, thanks to Olysha's good suggestion here is we don't really know enough about I'll just say rank and file, but we've been talking to a lot of experts, a lot of thought leaders and sort of thinkers from psychology and from instructional design. But just, yeah, the everyday instructor who wants to do well in this space. I'd love to know more and think more clearly about their concerns and worries and where their benefits, what benefits would accrue to them most. [00:40:18] Olysha Magruder: That'd be cool. [00:40:19] Jason Johnston: I think it's a great idea and kind of wrap up some of what, yeah, we've been learning this last year and to hear from other people that attend. Okay, you're on the challenge accepted. we're going to try we got a deadline now john. This, we've been time boxed. And we're gonna, we're gonna rise to meet your challenge. Even though we've probably have other priorities today because we've been time boxed, we're going to rise and meet this challenge. [00:40:46] Olysha Magruder: See, now you know how I operate. You invite me here thinking that you're going to get something, but I'm in fact getting something from you. [00:40:54] Jason Johnston: And here I've got more work on my plate. Come on. This is good. This has been a great conversation. Thank you so much for spending this time with us. And is there a preferred way for people to get in touch with you? We'll put obviously links in for the Coursera course, to the symposium. Are there any links or any ways that you have a preferred way for people listening to get in touch with you if they want to? [00:41:19] Olysha Magruder: Sure. LinkedIn I'm there. I know we've connected via LinkedIn. And then Olysha at JHU. edu. O L Y S H A. I keep it simple. [00:41:29] Jason Johnston: Okay. That's great. [00:41:31] Olysha Magruder: Reach out if you, if anybody wants to talk about anything pretty open. [00:41:35] Jason Johnston: Awesome. Thank you so much. This has been great and we appreciate you and the work you're doing and you just simply taking the time. And for those listening, please check us out online learningpodcast. com or you can find the same at LinkedIn. Just search Online Learning Podcast. We've got a group there you can ask to be part of. And yeah, feel free to connect with us on LinkedIn as well. That tends to be where we're hanging out more than other places that, that we're not completely out of, but we probably won't name because I'm not really at the other places that much anymore. [00:42:12] Olysha Magruder: same, but thank you all so much for having me. It's been a lot of fun talking to you all [00:42:16] John Nash: was a ton of fun. Thank you so much. [00:42:18] Jason Johnston: Yeah, that's great. END

In this episode, John and Jason engage in a discussion with Dr. Michelle Ament about the impact of AI on education, its role in reducing transactional tasks for educators, the significance of human intelligence and soft skills in an AI-driven world, how AI can be leveraged in professional development, and the potential future of AI-integrated, relationship-based classroom environments tailored to individual student needs. See complete notes and transcripts at www.onlinelearningpodcast.com  Join Our LinkedIn Group - Online Learning Podcast Links and Resources: Dr. Michelle Ament is the Cheif Academic Officer at ProSolve Michelle Ament on LinkedIn Jason's AI 4 Language Translation Video An intro to the Zone of Proximal Development Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! False Start [00:00:00] Michelle Ament: Thank you for having me this morning. I'm so looking forward to this conversation.  [00:00:04] Jason Johnston: Yeah, and we just wanted to get started just to understand a little bit about you and your background, where you've come from. Currently, you're a chief academic officer. And John Deletes Jason's Notes [00:00:14] John Nash: Oh, I did that, didn't I? [00:00:16] Jason Johnston: John just deleted all my notes. [00:00:19] John Nash: No, I didn't. I moved my notes and put them below yours. [00:00:25] Jason Johnston: I'll try again. [00:00:28] John Nash: Podcasting at its best. [00:00:31] Michelle Ament: This is fun.  Start Intro [00:00:33] John Nash: I'm John Nash here with Jason Johnston. [00:00:37] Jason Johnston: Hey, John. Hey, everyone. And this is Online Learning in the Second Half, the Online Learning Podcast. [00:00:42] John Nash: Yes, we're doing this podcast to let you in on a conversation that we've been having for the last couple of years about online education. Look, Online learning's had its chance to be great, and a lot of it is, but there's still a bit that isn't. And how are we going to get to the next stage, Jason? [00:00:58] Jason Johnston: And that's a great question. How about we do a podcast and talk about it? [00:01:03] John Nash: I love that. Perfect. What do you want to talk about today? [00:01:06] Jason Johnston: I would love to talk about online learning. How does that sound as a theme, overall theme, for our conversation today? But more specifically, I would love to talk with, we've got a guest with us, Dr. Michelle Ament. Welcome, Michelle. [00:01:21] Michelle Ament: Good morning. [00:01:23] Jason Johnston: How are you? [00:01:24] Michelle Ament: I'm doing great. Thank you for having me this morning. I'm so looking forward to this conversation. [00:01:30] Jason Johnston: We're really looking forward to having you with us. We just wanted to get started just to understand a little bit about you and your background, you're currently, the chief learning officer you've had a background in personalized learning technology and learning curriculum and design fifth grade teacher, one of my question for you today Michelle is how did you get to where you are today? [00:01:51] Michelle Ament: Great question. I think about why, where I, how I got to where I am today is I love the design of learning. So when I went into teaching, I was a classroom teacher. I've been in education 25 years. And like you said, I started in fifth grade and was an elementary teacher. And what I loved about teaching first was the daily interaction with kids, of course, but the design of learning. So it was all about, Yeah. learning, figuring out what learners needed, what were some of their strengths, what were some of their areas of growth, and then figuring out how to design really engaging learning. And so in the classroom, that's what fueled me every day. It was like a problem to solve. How could I design something that was really relevant, highly engaging? And authentic for kids. And then I went on to lead in that way and led in several different positions, like you mentioned, with technology and learning, with professional development, and a focus on personalized learning. And at that point, it really became what haven't I done? And the next step was really the superintendency. And I made a conscious decision to, at that point to think is this really where I want to go or do I want to look outside of the public education sector and decided to make the move to ProSolve, found this rapidly growing company who is really focused on learning design and focused on how do we create learning experiences that really are authentic for kids, relevant for kids. And so it fit with my background in design.  [00:03:27] Jason Johnston: And what do you do on a day to day basis? [00:03:30] Michelle Ament: What I do on a day to day basis is a whole lot of things. I don't know if either of you have ever worked for a rapidly growing company. When I started with ProSolve, there were eight team members, and now we have 35 over the year about 18 months. So that's rapid growth. I've done everything from design learning to lead customer success to run an amazing shipping department. Oh, there was a skill set I didn't know I had and really serving on our executive team and helping lead the company and and really have an impact on school districts across the country. And so I'm driven by impact. And I had an impact in my classroom and an impact in my school district, but now I get to have an impact nationwide on a whole lot of school districts and see learning really changing as a result of experiences that teachers are designing. [00:04:23] Jason Johnston: Great. And you're in ProSolve, just to understand it. It is really an organization that focuses on, is it mostly K 12? [00:04:33] Michelle Ament: Yes, we are focused K to 12. And what we're really all about is our we believe, and I think this will resonate with both of you, given what I know about your backgrounds. We believe that the education system has been really focused on knowledge dissemination. The educator, the professor, the instructor is just providing information to the learner. And so what we are really about is shifting that paradigm to more of an experiential based learning. an opportunity to create an experience that learners can reflect on and apply to their day to day world. And we just, we believe school isn't relevant for kids anymore. They, we've seen a decrease in attendance and enrollment, and now with the rise of artificial intelligence, they have all the knowledge at their fingertips, everything that they need to know they can find. They don't need the traditional classroom. So we believe it's we've got to change. We've got to figure out how to move more towards that experiential application based learning in our classrooms so that students find it relevant. But that's where learning sticks. It becomes sticky when you can apply it to something that's important to you. [00:05:46] Jason Johnston: Your engagement with school systems is on a, is it on a contract basis? Or do they buy, essentially, curriculum and packages from you to, to use? Or how does your engagement work with school systems and schools? [00:06:02] Michelle Ament: We have several different options. We do have a curriculum that we offer. We are focused on supporting schools with social emotional learning. And so one of the things with our social emotional learning curriculum is that it is hands on. students have an opportunity to be in a situation where I have to tell you about Quest. So Quest is this game that is part video game, part board game, part escape room. And so they are immersed in this experience where they all of the adults have vanished This from Sarabella Falls and they have to figure out what has happened to all of the adults and so they work as teams to solve challenges, collect food and collect reputation points and just move through this series of episodes in this experience and all the while doesn't that sound fun? Don't you two want to play right? [00:06:57] Jason Johnston: Yeah, for sure. And I was just thinking that's like you're starting with every kid's... Like fantasy that every adult has disappeared and we can just run run this place as we as we wanted to. [00:07:08] Michelle Ament: And they got to figure out why have the adults vanished, which yes, every child's dream, but also pretty like dystopian type genre, which is what kids are really interested in. And as they work in teams, they compete against each other and they have to collaborate. They have to make decisions together. They have to compromise. They have to communicate. They have to persevere. So all of those are real world skills, right? And they are developing them in an authentic context. And so that right there is different than any kind of social emotional curriculum in a K 12 market. Typically you are listening to the teacher tell about a scenario and you're Giving them the answers they want to hear and then nothing really changes and now our SEL time is done and we're moving on to math time and then we move on to reading time. So Quest, that's one of our services that we offer. We have a service learning solution where we help students That's where we leverage design thinking, which I'm really excited to talk to John about design thinking and how we bring that into the classroom. And then we have professional development. How do we make professional development look different? I'm sure you've all seen that meme where the teachers are falling asleep, falling out of their chairs with a traditional professional development. So we. We do things differently. We engage teachers in a, in fun experiences that really push their thinking and have them reflect on, okay, how do I do more of this in my classroom? How do I make learning different and more? I keep saying the word relevant on this podcast. You'll probably go back and count relevant and authentic. How many times I say it. But it's true, like, how do we just change what school looks like for for our learner, for today's learners? Those are our solutions, professional development, an SEL curriculum, and a service learning curriculum. [00:09:07] John Nash: nice. When we were talking a little bit on LinkedIn, we had a little back and forth thinking about. What we might talk about today with you, and you were thinking out loud a little bit about how human centered design and AI might augment or support all of this.  We see more and more people talking about the power of human intelligence now that AI is in front of us, although we've had this human intelligence. In front of us all this time, but now all of a sudden we're worried about it because AI is here. You were thinking maybe we could think together out loud because you said you hadn't fully formed your ideas on this, but you wanted to dissect the possibilities of how using AI makes us better humans. What are you thinking about that now? [00:09:52] Michelle Ament: iT as I think you're right on a couple of points you bring up like we have had human centered learning for forever, right? And we valued the soft skills and the four C's in our classrooms. But I think now that we see that more technical jobs will be taken over by repetitive tasks, I should say will be taken over by AI, our workforce is going to need to leverage those human intelligence skills even more than they ever have before. And so I think when I think about AI in our classrooms, I'm less focused on helping teachers use AI or teach students how to use AI. And I'm more focused on helping them think about how to build human intelligence. I think it's going to be crucial for our workforce to have really strong employees that are coming out of college and out of high school, knowing having those soft skills and being able to be on a team and being able to think critically and being able to collaborate. And a and I've heard you both talk a lot about ways that you've used chat, g p t and had to really be able to analyze what it was saying, making sure that there wasn't a hallucination present and that's that critical thinking. And so those are some of my thoughts about AI in education and why the importance of human intelligence. Before I talk about design thinking, I have a question. What. When I say human intelligence to you two, what do you think of? What comes to mind with that word? Cause we've been tossing that around. Is that the word we want to use to describe this? [00:11:30] John Nash: That's a great question. I think for me, I'll continue to promote the Brandeis Marshall piece she did in Medium , which is, what's un AIable, which are context, critical thinking, and conflict resolution. These are definite human intelligence skills or properties that AI can't really do well. It can only fake it.  And then the other thing I heard her say also is that, yeah, AI doesn't know when to shut up. And it will just continue to talk and talk as long as you let it. And so I think that's another thing that, that comes with the context bit is that AI, humans are here to be able to be thoughtful about when to speak, when not to speak, and what makes the most appropriate. response at any given time to advance resolution towards a challenge or a problem. [00:12:14] Michelle Ament: Yeah, I hear you talking about self awareness there. It's not really self aware. [00:12:19] John Nash: said. Yes. Yes. I think so. Yeah. [00:12:22] Michelle Ament: I love that AI proof skills or so do you like, does so human intelligence resonates with you then? [00:12:29] John Nash: Yeah. I think we've both been saying it. Yeah. And that, you bring up an interesting point is that as generative AI. Becomes more, I was going to say sophisticated, it's already sophisticated, but I think as generative AI becomes more interwoven into our work lives and our personal lives in more transparent ways, that you're right, that the work skills that we want people to do are going to be more on the human intelligence side. And so people will not necessarily be brought in to do tasks that AI can handle now. So they'll be expected to step up, as it were, a little bit in terms of having the ability to do these other things that we think are more important. [00:13:12] Michelle Ament: Definitely. And there's some really alarming stats out there that our workforce, when they go to hire, aren't finding employees that have those skills. And so I think while our K 12 system is really focused on college and career ready. I feel like we've been more focused on the college ready, the prepping, prepping our students to go to the the higher ed organs at college or university and be successful academically. I have a 22 year old who just graduated from university and he is brilliant. He's a double major in mathematics and data science, a triple major in computer science, mathematics, and data science. And he is struggling to, to get out there in the workforce and have those soft skills that are needed even in an industry like that. And so I'm curious. About you. Prob, I don't know if you wanna talk about how kids that you interact with when they come right outta high school, but I'm just not sure if we're, that we're preparing them for to be college or career ready using those soft skills that we're talking about. [00:14:19] Jason Johnston: Can I add one thing to on that human intelligence is you mentioned critical thinking. Which is a hard skill. It's a soft skill, right? And, but I like the, this idea of human intelligence and it reminded me another conversation I was having with a very intelligent person, my wife, the other day. We were talking about, AI in general. And she said , figuring out what is real will be the next big work for our kids and their generation. And I think that is a both a hard skill and a soft skill, right? There's a am I right on this? Is this? This is part of human intelligence is being able to take that higher order thinking of evaluating what is true. We're looking at some of these image And I just produced a video that I showed her where I spoke in four different languages. I don't know any other languages, and evaluation and critical thinking is a soft skill because it's not focused on, you can do this task, and this task. It's more focused on an overarching human intelligence that helps you manage and move forward any task. Am I on the right track here? [00:15:34] Michelle Ament: I think so. Absolutely. I think about. The five paragraph essay is that, educators right now are really concerned about kids using AI to write a typical five paragraph essay or any kind of writing. And I think that we're thinking about it a little bit. incorrectly. I think we need to be not trying to remove students or or I should say, I think, let me start over. I think instead of trying to figure out how to prevent students from using generative AI with their writing, it's about tasking them to think Critically about their writing. Maybe they all write something. Maybe they write two or three versions of something, and then they have a classmate or in a collaborative setting, they have to analyze which one feels more accurate, which one was written By the student versus by the by generative AI. I'm this is a very simple idea that I'm bringing forward, but I think the idea here is to think differently about how we design learning that in the face of having these. our students having these tools, what does, how does it look different and feel different? Instead of trying to think about, we want to do the same thing that we've always done and put restrictions in place or prevent kids from using these tools. I just, I think it, it's about critical thinking, as you mentioned, and how do we design with that being the outcome in the, in how they analyze or critically think about their writing versus producing a level of writing. [00:17:10] John Nash: Yeah. Can I ask you a question about your work to design experiential curriculum or experiential work with students? How do you gather insights from students and teachers and others to understand their needs and perspectives to build those experiences? And then Maybe we can talk after that. Actually, I'd just like to stop there with the human intelligence part, but also how maybe AI could help augment that design research process. But I come to you with this question with our overarching mission here, which is to humanize online learning. And when you bring your full suite of thoughts and tools and mindsets to bear on What do you do to gather those insights to make great experiential curriculum? [00:17:57] Michelle Ament: That's, yeah, that's a great question. I think it really is about getting to know your learners, asking some overarching questions, some essential questions that help them see what's important to them in the process. surveys, whether it is introduction, spending time both in an online environment and in the classroom, really building that community and understanding who they are, what's important to them, what drives them, what are curiosities that they have. And I think it's less about me as the designer. saying, okay, now you let, you're really curious about this idea, here's the task for you. And you're really curious about this idea, here's the task for you. And instead in the learning design, having it be more overarching or having a universal question that we are aiming for. And then we're having them connect their interests to that overarching question. And so then it becomes, I think That each learner can do have a path towards learning and understanding. And then the assessment is where you start to have a similar rubric or things that you're looking for in the assessment design is how you start to find the parallels between behind what every learner is researching or learning about. And then I think even with assessment, there is an opportunity to have some it. differentiation and how learners show you what they know. And so what does that resonate with you in terms of as you build your online communities and start to think about how to personalize learning? And I think You know, how does AI fit into that? I don't know. It's, there'd be a powerful way to, to have them even begin to use the tool to make connections to that overarching question or that principle. [00:19:54] John Nash: Yeah, quite possibly. We meet a lot of our peers and other instructors that I meet in the P 12 space who feel like they've been, Sort of their horses that have been brought to water and they don't want to drink in terms of to having to teach on the, you must teach online. Now, certainly the pandemic put a lot of people in a place to do online learning without really feeling like they had the tools or the capabilities or predispositions for it. And I love what you had to say there about that design. And those are the, that's the mission. When you approach new instructors who want to do well in this space, what are the kinds of practical advice that you give them, or might give them, to say, everything's going to be okay, you're going to do fine, I've suggested that you get to know your learners, now here are three things you could do that are low threshold, sort of high impact things that might get you going, to give you the confidence to do well. [00:20:48] Michelle Ament: I think first it would be giving those learners a suite of different tools that they might use. I think of Flipgrid as a video type tool. Maybe maybe it's as simple as make a slide deck that says you're going to show some images or some videos about three things, three, three overarching questions. Who are you? What's important to you? Where do you want to go with your life? I'm just really spit balling right now. But it could be something like that. And I earned my doctorate in an online education for Capella, completely online. And that was a fascinating experience to be in a really thought cerebral space and still trying to develop community. And I think we could have spent more time in that space building community. And then as we continued to go through the process, , then we have relationships and relationships drive learning. And so we could have even supported each other even more. So I think it's, simple video introductions. It could be a slide deck introduction. I think it's moving past the narrative when we see. See each other is when when it's most impactful. It could even be pulling people together in community forums like this and just having time and space to share a little bit about ourselves, share about things we're passionate about, questions we have, and just building those connections with one another. Because I think then once you start to have a re we're all relational and that's what. drives human capacity is that relationship having empathy for one another. And so creating situations where that empathy comes out, I think can go a long way than in learning, [00:22:28] John Nash: Really nice. I think that's a great point that the relationships drive learning because I've fallen into this trap and I think my colleagues do too is that I have so much to cover. I don't have time to do community building and I found that when I've taken the time to do it, it's paid off. In a big way on the other side where students become peer support for each other where we have a mission together, not as this divide between teacher and students, but we're trying to get somewhere together. I think then the learning becomes so much more powerful and easier to also carry out. [00:23:03] Michelle Ament: right, it becomes personal to both to everyone in the group or in the class. And I think once you start to do that it, you can deepen learning so much more quickly when it becomes, people are, it becomes personal, you become invested in both your own learning, but your peers your colleagues learning as well. [00:23:22] Jason Johnston: I've got a question. So a couple weeks ago John and I talked with Dr Kristen DeCirbo, who's the chief learning officer at Khan Academy. And they're conceiving of this AI chat bot that would be there for students, whether, first in K 12 and then in higher ed and how that student would always or that. Conmigo would always be there for that student to help them along anytime they have trouble move them forward when teachers can't be okay. So thinking about that, thinking about how we're trying to build human intelligence, and then this idea which I absolutely agree with that it's relationships that drive learning. What is it about relationships that you think really drive learning? You touched on a couple things, but what is it about relationships that you think drive learning within an online context that a AI bot would not do? [00:24:20] Michelle Ament: I was. When you were asking the question, one of the things I was thinking a lot about first, and then maybe I'll get to the online piece what I think, but I went into education, I told you both this, I went into teaching because I love kids, and I, there is an art of teaching, there's an art of being an educator. being relational, having, I have a deep sense of empathy for others. And I think that is part of why I was able to personalize learning and really understand the strengths and the areas of growth and what matters to that individual. And I call that the art of teaching. And I think we have seen our school system be so much more focused on the science of teaching. I believe strongly in standards alignment and I believe strongly in assessing what students should know and be able to do, but I feel like along the way our educators have lost that ability to show up with what they're really good at and that is the art of teaching. Understanding their students, having that sense of empathy. I think if you asked most educators, they would say They went into teaching because they love learning. They love students. And so I think that is an area that we need to really focus on bringing back that art of teaching. And I'd be curious in your online form, if you would agree that there has been a little bit of that loss of art of teaching in higher ed and more of a focus on the science of teaching. And what I'm seeing you nod. And would you agree? [00:25:52] John Nash: if I may, [00:25:53] Jason Johnston: Yes. [00:25:54] John Nash: no, if I may, perhaps I might even call it the art of teaching versus the transaction of teaching. I think I see us move. I would love more science of teaching actually in light of all the sort of transactional teaching I see going on, particularly in the online space and vendors don't help all the time in that way either. They've sold us packages that make us think that the teaching is a transactional act. I've got more on that, but I wanted to just add that. I think [00:26:23] Michelle Ament: I really, I do really like that because I think even in, in in the pre K 12 system there, it does become more transactional. And I think you mentioned, we just. Bring students to what we need them to know, and then we move on to the next thing, and the next thing, and the next thing, because we've got to cover everything and check off all the things. And I haven't, I actually, to be honest, haven't looked at Khan Academy's new tool. I've heard amazing things about it, and It feels though, all of a sudden in this conversation that could help solve some of that transaction, some of that place where learners could go there for information and then learners come to the instructor to, to really be in that relationship, be able to share ideas in a way that, and get feedback from the instructor and be in that relational setting. And what I think drives. Why learning is relational is because it becomes a part of who we are, like the times when I have internalized learning is because it mattered to me and it impacted me in a really here we go, relevant and authentic way. It was something that was important to me. And so I can think about times where just. being in conversation with someone has deepened that learning far more than reading an article or watching or reading a text on it. Now that helps me build my background, so then I can be in a conversation with someone. But there's that piece of being able to push each other's thinking and be in that cognitive dissonance. And that, doesn't come just because two humans are talking. It comes because of trust, because I believe you have good intentions in helping me by pushing my thinking or disagreeing with something I'm saying. And so I think as online educators, if you had the time and space to really build that trust, to be in those places, to talk about ideas, to push thinking, that could go a long way and having a more technical tool to support that transactional teaching. It, there's the possibilities are endless when I think about that. [00:28:27] Jason Johnston: I love that idea of trust, I think that could be one of our distinctions, a distinctive factor. I think there are a lot of things that these AI tickerbots can do. Khan Academy does not have any intention. They, Intentionally do not want these tutor bots to be a student's best friend or for them to have real relationship with these tutor bots. They intentionally move them over into this helpful, empathetic AI, but without this kind of, they don't think it'd be healthy for students to form attachments to these tutor bots, right? And I think attachments come through trust and I also think trust becomes a bit of a tether for students, especially those that are. That are struggling to help them, to help pull them forward in this journey of education. What do you think about that idea? [00:29:19] Michelle Ament: Yes, I think that having those AI bots to be able to take the load off some of the instructors work, the transactional work, and then be able to really foster that trust. And again, that's intentionality there, you have to be thinking about how do I, because trust is a two way street, how do you get the, your learner to trust you, but also how do you trust the learner too? And I think that I think teachers right now, there's like this, the sentiment out there with AI, and it doesn't promote trust. It is about cheating. It's about using it in inappropriate ways. And so I think we're onto something. We've got to be thinking about how do we, what's the opportunity here? So that we can, as educators, build more relationships, have more trust, bring back that art of teaching, and not be adversarial to what AI is bringing into our classrooms. And I'm saying very broad, brushstroke language here because I know there are a lot of educators, a lot of school systems that are embracing the use of the technology, but I, it's so new, we're just at the beginning of how is this going to change teaching and learning? And I think there's opportunity to focus the conversation on what are the opportunities that it will give educators in this ability to build human intelligence, to build relationships. To do what they've gone into education for, which is supporting the learning of their students in a relational way. [00:30:53] John Nash: I love the focus on trying to help improve professional development. We run a lot of dissertations through our department where students are looking at how to improve that, because it seems like it's a perennial problem that will never go away. When you stakeholder buy in and how key that is for any education initiative, How do you think AI might help model and predict the impact of a professional development initiative and build support for a change in a school? [00:31:32] Michelle Ament: I haven't thought about that yet, so this is fresh thinking. I think anytime we can build some background is a strong thing, is a good thing. I'm also thinking about As those leading initiatives in a school system, how do they really understand change management and how could the AI tool like if you were to put in I'd be fascinating, it would be fascinating to put into your, chat GPT. What is the initiative? What is the problem you're solving? And then what steps would it tell you that you maybe need to consider? What pitfalls might it help you anticipate? I would be really curious what it would tell you about because that then could help you in the planning, the design. I think my experience with professional development and change is that school districts They, they dive right into the next initiative. We're going to plan this great PD day and they're not really thinking about the long game. So what is the next three to five years look like change doesn't happen overnight. And so I think that's part of the pitfall there. and what we will do a couple of professional development sessions and then we're like, geez, nothing's changing. They're not implementing it with fidelity. There, things aren't really happening. It must be that. Let's go to this solution now. Let's move to this this initiative. And I think implementation science tells us that it takes three to five years for change to happen. And there has to be really intentional change management steps. And so for me, I wonder how the AI tool could help you in predicting what pitfalls you might have and what change management principles you might put in place. I also wonder about just in the design, how it could prompt and give you ideas to begin to work from. I know I've used, the AI tool in that way to get me started, it's when we work from a blank sheet of paper, sometimes that can be challenging using a tool to help us brainstorm, get ideas, might, might help, and especially if you prompt it to, to say, I want an immersive experience, I want something that is innovative, I want something, you give it some, you prompt it with some parameters, it might at least get you and your team started with the design. So those are, what do you think about? Are any of those resonating with you? [00:33:53] John Nash: Yeah, those are resonating with me. And I could see the tool, some of the things you mentioned at the start of that, which were ideas around giving designers, it could be even instructors in online programs. It could be designers of PD programs, the questions they should be asking. I think that the tool is very useful for brainstorming questions, if you give it the parameters around the kind of audience and some of the perceived risks that you see with what might happen with the initiative. You can get a good set of questions to ask your stakeholders, but prior to doing anything, I think it's also good for doing, you alluded to it, but it sounded like almost doing a pre-mortem. It's here's what we're gonna do and here's where we want to be. Now, what could go wrong here? And that could be fed back into a loop of asking questions and even doing scenario thinking with people before anything even starts and how likely do you think this is to happen? And how much do you think we have the bandwidth or the initiative to carry out these things? That can even tell you more about where the tailoring of the PD should be and things like that. [00:34:59] Jason Johnston: Yeah. And I think when you're talking about change management in the school as well, that predicting, as you said, John and Michelle, both kind of predicting where some of those pain points are going to be is a, it could help us. Yeah, it could help us think about some possible. Negative scenarios that would happen when we're so often, I think, optimistic about our change initiatives, right? We're optimistic about, oh yeah, this is the perfect plan. It's just going to move forward and so on. And I, and maybe AI would help break through a little bit of that optimism in a good way to help us be predictive, as you said, and be thinking about that. That's great. [00:35:36] Michelle Ament: John, one of the things you, I think you, we started to go down this path and I'd be curious to talk a little bit about how you think AI would fit with the human centered design thinking, because that, when we think about that, it is it, we don't want to lose the human centered nature of it. That is what makes design thinking marvelous. But have you thought at all about in, in leading people through design thinking where you might leverage the AI tools? [00:36:06] John Nash: I have been thinking about this and I think, Okay. There are a couple of places where I see it being pretty useful, and there are several places where I advise not using it at all. Let's start with where you wouldn't want to use it, and I almost alluded to it in the comments before about professional development. It's alluring for new users of the large language models to think that they can interview it. As a user and you shouldn't do that in my book. I don't believe that's that should ever be done because AI is not human. And so  it's gonna give a very authentic sounding response that seems like it's. It's you talking to the people that you want to serve and it's not. And so I think that's the place where you really shouldn't use it. I don't believe it should be used for initial brainstorming on challenges either. I think that's best left to humans. I think that in a true sort of air quotes here, we're on audio, but I have my fingers in the where you might do some empathetic need finding, and then you define the problem. And then you brainstorm on that problem and then select some things from that. It's this synthesis of all that data from all those interviews and the observations you do that I think should be done by humans, but then can be augmented by AI. So then let's talk about where AI could be useful in design thinking. I think it can be useful in making sense of a whole series of interviews. And looking at some themes and getting some themes up after the human design team has really thought also what they think that, so we can affirm those. I think in a in a brainstorm, I think it's really good for extending the brainstorm. So after a group has sat down and really thought through all the ideas to solve a challenge then I think you could feed those into the model and then get some extensions. I think it serves a pretty interesting... Role in potential prototype ideas. And and I'm in favor of people having really wild ideas to get to the tame, useful ideas. And so you can prompt the model to say here are some things that we're thinking about doing. Here's the solution. How could we, how could this show itself? I think it's also good for, we do a lot of storyboarding for prototyping and we use Pixar's story spine technique to tell a story of a user going through a problem and having a challenge. And then the solution that's been developed by the students comes into play and then their life becomes better. And I was just working with a colleague last week in their class on using the AI model to generate these quick stories of like how, what would be some scenarios that might happen when people are experiencing a solution created through design thinking. So that was a bit of a list, but those are my thoughts at this moment. [00:38:51] Michelle Ament: I, something that I was thinking about was during the empathize stage, definitely not using AI because yes, you would feel like it's empathizing with users, but it isn't the users you're serving. It isn't the users you're designing for. And I don't even like to say that word user. Because it feels impersonal, then, I've used design thinking a lot in my classroom and in the school district and then now with ProSolve, and it is about listening to those you're serving and hearing what it is their needs are. And AI would make it seem like you were, but you're not even talking to the people that you are designing for. And so I think that is for sure. I really liked where you were going with the prototyping, because I think, and I think again, starting with the human and then augmenting like how do we take this and see how do we make our prototype even better. So here's all the things we've thought of. What haven't we thought of? What are ways that we might improve this? Could go a long way. I think you could, sometimes it's hard for people to come up with , empathy questions at the initial stage. So my mind also went to, we were interviewing students. We want to understand about their school experience. What questions might we ask? And it might generate five really great questions and then even prompted a second time of we really want to understand how they're feeling like if all the questions come back very very basic to the maybe more technical, then you could prompt it and get some of those more deeper questions about getting a sense of how people are feeling about something, for example. So those are things that come to mind there. [00:40:32] John Nash: I work with a lot of, I'll call them novice designers, but they're sometimes they're teachers in our graduate class, sometimes they're undergraduates in the class, but they've not gone through a sort of a creative thinking process to creatively solve a an ambiguous challenge. And so when they get into the brainstorming stage or even at the the prototyping stage where they're thinking about how they might manifest their solutions, they'll run out of steam and we, my, we like them to live with the problem and think through the problem. But I'm seeing AI as a way to help them reinvigorate their thinking after they run out of steam because they're not accustomed to their brains thinking in these sorts of ways. I've also thought about it as as an adaptive tutor. And I stole an idea from Ethan Mollick, who was talking about deliberative practice and using ChatGPT to become a tutor. And I think it can be helpful in teaching students how to use open ended questions for empathetic interviews and give feedback on the quality of their follow up questions in a mock interview to get them accustomed to doing that. Without that, we usually will just have students we'll teach them the empathetic interview process and we'll give them a protocol and they'll go out and do it. But their first interviews really are just practice and they're not as strong as they could be. And I haven't tested this empirically, but I'm wondering if we did the practice first, if those first interviews might be stronger and they might get better data from those if they had an opportunity to practice first with ai. [00:41:58] Michelle Ament: I like that. I like where you're going with that because it starts to, there's two things. I do know that fatigue, I will, when leading design thinking, I'll say, okay, you've gotten all your ideas now do one more. And they look at me like, I don't have one more. And so that might be a way to just spark some of that creativity again and save time design thinking can be something that goes over a course, of weeks or or several class periods, for example, and sometimes we don't have that. And so I like that idea of practicing the interview with the chat might be a way to just build some capacity before they go in front of the people they're designing for. [00:42:39] Jason Johnston: And one thing I said there, Michelle, remind me of something you've said before, John, which is using it to try to get through roadblocks. So you don't maybe use it before you hit that roadblock. So I've got four ideas and I can't come up with any more. Maybe chat can help generate a few more ideas, if you've really worked through that and that's good. AS we're rolling things up here, we're wondering what you think about a future with ai. Our guess is that this is not going away. Online learning is not going away. We're gonna see more online learning, we're gonna see more ai. It's probably going to be more, uh, work side by side with AI and or ai even taking the place of some of the things that we traditionally do as teachers, as educators. What do you think the world is going to look like 10 years from now? What are some of the things that maybe excite you about that world? What are the things that perhaps concern you about that world? [00:43:39] Michelle Ament: I Think there are a lot of things that excite me, probably more than concern me. I think about, I think that our AI tools can become really great teacher assistants. How do we, I don't believe that, I don't believe it's going to replace any educators, the system at large. I think, how do we start to try different things now as educators? Maybe we're not even using them in the classroom. Maybe we're just personally trying things out, seeing what we learn. I think, because I agree with you, it's not going anywhere, and I believe our classrooms will become more where AI becomes an assistant, becomes a place where we can create efficiencies, but also be able to use it as a learning design, to be able to say, here's what I want to teach, here are a couple of different, things my learners are interested in, what are different ways to design the learning so that it is relevant. And I just, I go back to what we've already talked about. It's going to free up a teacher to go back to why we all went into education, to have that art of teaching, to build those relationships. Building that human intelligence in the classroom. So that's where I think the focus really it is opportunistic. I think if we approach it that way with a really positive mindset and also be aware of the cautions, the things we have to think about. A huge thing that I know that our school systems have to think about is just data privacy and the amount of information that that could be, that is potentially harmful for children. I'm not naive in that there aren't. anything, any cautions or things we need to be thinking about, but I'm trying to stay more of that glass half full mentality, like what are the opportunities and how do we envision a classroom where the, where what students are learning is really tailored to their needs? It's exactly at their zone of proximal development. It's very relevant to them and it has an opportunity to be applied to their day to day life and the real world and through, and teachers having the opportunity to build those relationships and foster that human intelligence. What do you two envision your classrooms to look like in 10 years? [00:46:01] John Nash: I'm so glad you took the question because I tend to avoid answering that because my answer lately is after what we've seen in the last nine, 10 months I can't tell you what the next six months will look like. But my hopes are that it is it's something that feels a little bit seamless, but still to Jason's point earlier about his conversation with his wife is that we're still able to really know what's real, what's artificial and what's human, but as it doesn't feel as I don't know, what's the word I'm looking for? RiGht now we have to decide to go and have a chat, right? You know, It's not text based, it's not going to be image based. Somehow it's all going to be integrated in some seamless way, and I think that will be interesting to see how that plays out. [00:46:44] Jason Johnston: my my answer is how about we do a podcast and talk about it, which is really kind of a veiled uh, like, yeah, I think, I think there's so much more in the conversation to, to to talk about. But yeah, I think those are great answers. I wish, you know, we talked about how this is not a video podcast, which it won't be, but I kind of wish it was a video podcast in part because I try not to interrupt, but I'm nodding a lot. So people can picture me nodding a lot when Michelle and John are talking because there's so many good ideas here. This is a great conversation. We're going to put links in our show notes for ProSolve and so people can get in contact with Michelle and her team if they wish to do that. As well as yeah, as well as we should have a transcript there and any other resources that we can connect you with, as well as please join us on our LinkedIn group, our our podcast is at onlinelearningpodcast. com, our LinkedIn group, if you look that up as well on LinkedIn, you should be able to find our group and feel free to send messages to John or myself or probably Michelle. Do you take messages on LinkedIn every once in a while, Michelle? [00:47:51] Michelle Ament: Absolutely. I love talking with people on LinkedIn. There's so many great ideas. And it goes back to a theme of this entire conversation is learning is relational. And so if I can build a relationship with people, I that's where the heart of learning happens. So certainly reach out to me and let's have some conversations. [00:48:11] Jason Johnston: That's right, that's good. Again, lots of head nods. [00:48:14] John Nash: Yes, lots of head nods. [00:48:16] Jason Johnston: this is why we're doing it and learn lots from you today, Michelle. Thank you. And as always, , learning lots from you, John. So thank you for this great conversation. [00:48:24] John Nash: thank you both [00:48:25] Michelle Ament: Thank you.      

Dr. Brandeis Marshall discusses the limitations of AI, the evolution of AI in education, controversy around training language models, challenges and diversity in AI, concerns about artificial general intelligence, and creating effective syllabi and engaging teaching strategies.

In this episode, John and Jason talk about current reading, recent seminars, and their upcoming OLC Accelerate Conference (2023) presentation in Washington, DC   Join Our LinkedIn Group - Online Learning Podcast Resources: John’s Book Recommendations:The Renée Ballard series by Michael Connely Kay Scarpetta series by Patricia Cornwell The Whistler and The Judges List by John Grisham  How to Make Sense of Any Mess, by Abby Covert Jason’s Book Recommendation:Everything is Figureaboutable, by Marie Forleo John & Jason’s Slides from the University of Tennessee’s 1st AI Symposium “Reimagining online assignments with and because of AI” John’s Slides from Sweden where he talked about the promise of AI and whether it can democratize innovation or dilute quality.  OLC Session 1: EXPLORING THE IMPACT OF AI ON STUDENT CONNECTION AND BELONGING IN EDUCATION (Thursday, October 26, 2023 - 9:30 AM to 10:15 AM) OLC Session 2: ONLINE LEARNING IN THE SECOND HALF: TURNING DANGERS INTO OPPORTUNITIES (Thursday, October 26, 2023 - 1:15 PM to 2:00 PM) Contact John or Jason through LinkedIn if you are an educational podcaster and would like to join them in a recording session! Transcript  We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions!   
 [00:00:00] John Nash: Do you smile when you talk? Did you know when you smile while you talk, it actually makes you sound like you're like. 
 funny. It  
 works. 
 [00:00:06] Jason Johnston: that's what they, that's what they told us to do in telemarketing. 
 [00:00:09] John Nash: That's right. Yeah, that's it. Yeah. I'm John Nash here with Jason Johnston. 
 [00:00:14] Jason Johnston: Now I'm laughing. I can't. Okay, I'll 
 try it again.  
 Intro 
 [00:00:19] John Nash: I'm John Nash here with Jason Johnston. Yeah, we're doing this podcast to let you in on a conversation we've been having for the last couple of years about online education. Look, online learning's had its chance to be great and a lot of it is, but a lot of it still isn't. How are we going to get to the next stage, Jason? 
 [00:00:42] Jason Johnston: That's a great question. And I've got an idea. How about we do a podcast and talk about it? 
 [00:00:48] John Nash: I love that idea. Let's do it right now. 
 [00:00:50] Jason Johnston: good. Today, I wondered if we could talk just a little bit about the road behind, the road ahead, what we've been doing lately what we will be doing next, we've got some exciting events that we're doing together in the next little bit. 
 [00:01:03] John Nash: We do.  
 We do.  
 [00:01:04] Jason Johnston: First I was wondering about have you been reading anything these days, John? 
 [00:01:09] John Nash: I've been reading my usual kinds of journal articles and other things , but 2023 has been a little different for me in terms of the topic of reading because the funniest thing happened to me in January of this year. I started reading electively non academic. books, novels. And I don't know how it happened, but I just did. I was I was on a work trip to Honolulu and I found, I discovered that you can check out books from your public library and put them on your Kindle. 
 I didn't know about Libby, the app Libby. 
 [00:01:45] Jason Johnston: Libby's amazing. 
 [00:01:47] John Nash: Yeah, it's amazing. I'm running around my friend's house in Honolulu going, Hey, do you know you can do this? As if, just split the atom or something. And yeah. And so I've been reading I read a bunch of Michael Connolly novels. About a female detective in Los Angeles contemporary of Bosch's, and I liked those a lot, and now I'm on like book 12 of the novels about Kay Scarpetta, the fictional and famous Virginia chief medical examiner it's a longstanding series written by Patricia Cornwell.  
 [00:02:20] Jason Johnston: Is this like a secret desire to be a detective and solve crimes for a 
 [00:02:24] John Nash: Yeah, I don't know, but I do, I'm drawn to these novels because I don't know, I guess I like the technical aspects of these novels with Kay Scarpetta as the protagonist, because they do get pretty technical about some medical issues related to examining the dead and help having the dead speak. 
 Actually, there's a UT Knoxville tie in, they talk about the body farm a lot in these novels. Yeah. And for those who may not know the body farm is the outdoor laboratory outside University of Tennessee, Knoxville, where bodies decompose and they study them. 
 [00:02:57] Jason Johnston: And as part of that body farm as I understand they're actually buried under the field at Neyland Stadium. So if you watch a UT Vols football game the bodies are buried underneath that field. , last. Fall, my son and I were at a game just right around Halloween. 
 And the band at the halftime did thriller, and then they spelled out body farm. So it's all part of the lore there. That's great. 
 [00:03:22] John Nash: Yeah. Yeah. 
 [00:03:23] Jason Johnston: You know what book I just started that was on your recommendation, is Everything is Figureoutable. 
 [00:03:31] John Nash: No, I don't remember recommending that to you. Yeah. That sounds like a great book. 
 [00:03:36] Jason Johnston: Yeah maybe. 
 [00:03:38] John Nash: I think you just recommended it to me. 
 [00:03:41] Jason Johnston: Oh, that's funny. It's so funny because I've all throughout this book, like I'm only, three or four chapters in, but I've been thinking this is such a John Nash book. I can totally see why he enjoys this, from a design thinking standpoint and the person is witty and pretty terse and just to the point so easy read, really easy  
 [00:04:00] John Nash: I'll check it out. 
 [00:04:01] Jason Johnston: Oh, good. I'm glad I could 
 [00:04:03] John Nash: hilarious. I might have recommended it to you. The older I get, the more I say stuff that I don't remember ever saying. 
 [00:04:09] Jason Johnston: But you haven't read it, right? Is that  
 [00:04:11] John Nash: No, I don't think I've ever read that book. 
 [00:04:14] Jason Johnston: That's funny. That's a great phrase, isn't it? Everything is figured out. 
 [00:04:18] John Nash: Yeah. Yeah. I know. I'm just looking at, I just brought onto my desk here, How to Make Sense of Any Mess, which is the one that I'm, I do recommend by Abby Covert. 
 [00:04:26] Jason Johnston: Oh, I bet you that was it. I think that was the one you recommended, and somehow I ended up on this book. Probably some sort of loop off of 
 [00:04:35] John Nash: It's got a similar cadence to the title. It's Oh, this must be the book you recommended. 
 [00:04:39] Jason Johnston: Yeah. But this last weekend, it was a great story. I served for a number of years at a small boarding school in Eastern Kentucky, called Oakdale Christian Academy great school. where people from all the world and from all sorts of different contexts, often students that are. Not making it in their current context and they needed a, another opportunity for them and lots of great students, lots of great staff. 
 So I was there for six years and this last weekend they were decommissioning a hundred year old chapel, just this kind of small chapel. It was like it was maybe 30, let's 30 by a hundred and something feet, right? There's this kind of one room. Chapel. They were decommissioning after about a hundred years. 
 Anyways, somebody got up and told the story who he was born in 1935 and he was a teacher there in the 50s, okay? And this relates back to the book, but also the kinds of things we talk about. There was a teacher there in the 50s, and so one summer, after, school was over, he and another teacher, their job was to move the chapel. The president came to them and said, we got to get this chapel moved, it's too close to the road, they're expanding the road, and we got to move it down here to the creek about, maybe 500, 600 feet or something like that. And just figured it out. They'd never done this before. 
 They had no engineering background, but this is just what you did in the 50s. It was like, okay, and so he told this story about using some old telephone poles. to put underneath the chapel and move inch by inch as they pulled it with the school bus down to where it currently sat for 70 years until now finally the whole thing is, it's a big wooden building, the whole thing is coming apart and so they were decommissioned. But I, but it's funny because I started this book like the day before and then heard the story. And then I was talking to the outgoing president of the school. And I was like, isn't it amazing what teachers can do and have done, Like when you don't realize, especially, and he was joking about the fact, yeah, they just, they didn't really even conceive of the fact that they'd never done this before. 
 Weren't asked whether or not they did this before and they just figured it out.  
 [00:07:04] John Nash: I love that. Yeah. I guess the, I'm already thinking like, what would I do? I don't have an engineering background, but we could probably figure that out. You just have to be careful that you lift at the same time everywhere at the right time, and everything's level and nothing's going. 
 Yeah, everything's battened down and then we go slowly and watch and tweak, right? 
 [00:07:25] Jason Johnston: Go slowly, take it easy and think about what you're doing. And but I also thought about the fact that I'm afraid right now, if somebody asked me to move that chapel. I would just say I, I can't do that. It's not within my scope of doing. Why don't we hire somebody now? 
 I could maybe, help you find somebody that could do it. We could hire. Maybe I could help you raise some money to get a proper moving company in to move it from here to there. But I'm just so inspired by their their tenacity just to take it on.  
 [00:07:58] John Nash: It reminds me of a show that my wife and I powered through seasons and seasons of it. We were somehow addicted to it. It's called Homestead Rescue. It's on the Discovery Channel. And there was an episode where. This family of homesteaders who are really good at it, save other homesteaders from themselves who have gotten themselves into a difficult time after trying to go off the grid. 
 And they found a, an old school, a one room schoolhouse that a family on a compound didn't want or need anymore. They donated it to this new family, but they had to move it. And they didn't have any professionals, they just got the homesteaders out there and some logs and a long trailer and a truck and moved this structure intact all the way, several miles. 
 It was fascinating. Yeah, I was Batia was like we don't have anybody to hire. We're going to have to do this. 
 [00:08:48] Jason Johnston: And I guess that's what you do, too, when it's yeah we are the solution, and so let's figure this out, and everything is figureoutable.  
 [00:08:55] John Nash: Yes  
 [00:08:56] Jason Johnston: . So John, also on top of our reading we've been doing a few other things together and also wanted to talk about our OLC sessions coming up, and then you were just out of the country, but first back in, I guess it was the end of September. 
 We talked at UT's, University of Tennessee, Knoxville's first AI symposium  
 [00:09:17] John Nash: Yeah, we  
 [00:09:17] Jason Johnston: re imagining online assignments with and because of AI. 
 [00:09:23] John Nash: Yeah, that was a great symposium day long. And it was great to do that session. And I also got a lot out of the student session that they held. 
 [00:09:34] Jason Johnston: Oh, that was great. 
 [00:09:35] John Nash: That was great. I'm finding more and more that as the institutions and schools start to think about AI and they have these kinds of symposia whenever they include the students, those are the most enlightening, Because they really get at how students are using these things, how they view professors and instructors attempts to use AI. 
 And I think it gives us a lot of it gave me solace in thinking that we're going to be able to get through this in a good way. I don't think the issues with cheating are as bad as we think. And I think the students are just as circumspect as. The adults are in terms of thinking through how and where and why generative AI can be useful in our lives. 
 [00:10:20] Jason Johnston: Yeah, that's great. And we'll put up the link to our slides if you're interested in learning more about what we were talking about, but I, as well with you, I learned a lot throughout that day. It's a great point about making sure that students are part of this conversation. 
 I think often, we're the ones up in the ivory tower talking AI things and how they're going to affect students without actually bringing them in on the conversation and I think that's really important. Yeah, that's great. And John, you just also just came back from Sweden. 
 [00:10:51] John Nash: I did I was at the conference called innovation by collaboration put on by the group in Sweden, that is the professional organization of university innovation advisors and IP transfer folks. And so we were in Halmstad, Sweden in the West Coast. And I gave a talk on AI. 
 We talked about the the promise of AI and whether it can democratize innovation or dilute quality. And it was a great conversation because The interest in use of generative AI and particularly chat GPT is very high amongst folks in Sweden. I've talked to industry folks in Stockholm, then we went to the conference in Halmstad and talked to people across a wide swath of university institutions, startup culture folks, incubators. 
 And the use of generative AI is high. And equally the concern of how privacy rights will be perceived and equally how privacy rights will be respected how the use will potentially dilute the ability of people to teach across areas that are important and was it an opportunity to really underscore some of the things we've already been talking about, Jason, and with some of our guests around what's un AIable and forthcoming episode with Brandeis Marshall talking about critical thinking, context, conflict resolution. 
 So it was a nice. Chance to affirm that we're on the right track and the ways we're thinking about things and also learning where we in the US have tools in our hands that aren't quite yet in the EU. For instance, Claude is not out in the EU right 
 [00:12:32] Jason Johnston: Oh, interesting. 
 [00:12:33] John Nash: And and so talking about the variety of tools and the companies that put these out and what their interests are. 
 Those are very important issues I took away from what my Swedish colleagues want to know about is how is this going to be ethically fair and socially minded going forward? 
 [00:12:50] Jason Johnston: Yeah those yeah, those sound like some significant concerns, things we've been talking about for a little while here, and also leads us into thinking about our next couple of sessions we're going to do that I'll just say briefly. First, we're going to do one in coordination with the company company Inscribe, Inscribe. 
 talking about navigating the impact of AI while cultivating a sense of belonging. I'm really excited about talking about this. We're going to do this at OLC Accelerate in Washington, DC. And that panel will be talking on that Thursday morning. 930 to 1015.  
 And then in the afternoon, we'll be doing our own session, which I'm really excited about. Can you believe they let us use this title, John? I probably shouldn't say this out loud. They may not let us do this again. But it's actually called online Learning in the Second Half, Turning Dangers into Opportunities. 
 [00:13:42] John Nash: can't believe they let us have that title on two fronts. First of all, we stuck the name of our podcast in there as the title of the session. And then the stuff after the colon is a little ominous, turning dangers into opportunities. 
 [00:13:56] Jason Johnston: We figured that they probably had five zillion AI requests and they probably will have five zillion AI requests. Sessions, which is great. This is where we're at. I'm going, I'll be there for all of those, right? I'll be at everyone. But I also thought this was an idea to broaden our thoughts beyond AI, I'm sure will be part of our conversation, but broaden our thoughts in terms of thinking about some of our hopes and challenges for online learning in the second half as we move forward. 
 [00:14:26] John Nash: Yeah, I agree. And so we're going to get to talk about a lot of the things that we love to talk about in this series, which is inclusivity, authentic assessment, engagement, and personalization. I think that this is going to be really important for us to think about as online gets more prevalent than it Is now hard to believe, but it's going to. 
 And with AI, and I think all the instructional designers want to know how they can stay on top of that too. 
 [00:14:57] Jason Johnston: Yeah. And I'm planning to use our podcasts as research. I hope to quote as many people as possible, but just even think about the conversations we've had since February about these two things dangers, opportunities, and what the very, very smart people we've been talking to about this. 
 And as we've had different conversations about our, Yeah. experiences. Yeah, so looking forward to that. So please, if you're going to be at OLC, we'll put the link in the notes, OLC, Washington, D. C. Please join us. You can always reach out to us on LinkedIn as well, if you have questions about that. We're also going to try to do a podcast meetup. 
 So if you're an educational podcaster out there someplace. Please reach out. We're going to do a meetup and maybe do another Super Friends episode if we can. So I've already started to reach out to a couple podcasters, but if you'd like to do that, I won't say where it is at this point but if you just reach out to us, then we can hopefully connect. 
 [00:15:48] John Nash: Yeah, we had a really successful Podcast Superfriends episode in Nashville at the last OLC, and I would love to repeat that. I think that there's a great opportunity to have a conversation here. 
 [00:16:00] Jason Johnston: Yeah. Thanks, John. It's good to catch up with you a little bit and looking forward to seeing you in D. C. next week. 
 [00:16:07] John Nash: Yeah. Next week. Hard to believe. 
 [00:16:10] Jason Johnston: know, it's next week. 
 [00:16:11] John Nash: Yeah. Yep. All right. See you soon. 
 [00:16:14] Jason Johnston: Okay, we better get going right after this call. It'll be ChatGBT. Make me some slides. 
 [00:16:20] John Nash: Make me some slides. Make me smart. 
 [00:16:24] Jason Johnston: Make me smart. 
 [00:16:25] John Nash: See ya. 
 [00:16:26] Jason Johnston: All right, see ya.

In this episode, John and Jason talk with Dr. Kristen DiCerbo about how Khamigo was born, how it works, and how it might help transform and humanize online learning.  Join Our LinkedIn Group - Online Learning Podcast Resources: Kristen DiCerbo Check out the Khanmigo page Khan Academy / Canvas Instructure Press Release where they announce their partnershipVideo from Instructurecon More information about the ICAP Framework Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions! 
 Pre-Banter 
 [00:00:00] Jason Johnston: Was Khanmigo able to join us on the call today? 
 [00:00:04] Kristen DiCerbo: Khanmigo right now does not have text to speech, so we'll not be on the podcast. 
 [00:00:09] Jason Johnston: All right, probably too busy. There's a lot of people to support out there. And they're a bit of a rock star. So they're probably at the White House or something  
 [00:00:17] Kristen DiCerbo: Most likely, yeah exactly. Some world leaders. Yes. 
 [00:00:20] Jason Johnston: Leaders guiding policy across G20 or something like that. 
 [00:00:25] Kristen DiCerbo: yeah, exactly. 
 Start 
 [00:00:26] John Nash: I'm John Nash here with Jason Johnston. 
 [00:00:29] Jason Johnston: Hey John. Hey everyone. And this is Online Learning in the Second Half, the Online Learning Podcast.  [00:00:34] John Nash: Yeah. We're doing this podcast to let you in on a conversation we've been having for the last two and a half years about online education. Look, online learning has had its chance to be great and some of it is, but a lot of it still isn't. And so how are we going to get to the next stage?  
 [00:00:50] Jason Johnston: That's great question. How about we do a podcast and talk about it? 
 [00:00:54] John Nash: Perfect, what do you want to talk about today? 
 [00:00:58] Jason Johnston: Well, I'm very excited about our guest today. We're going to be talking with Dr. Kristin DeCerbo, the Chief Learning Officer at Khan Academy. Welcome Dr. How are you? 
 [00:01:11] Kristen DiCerbo: Good, good. And please call me Kristen. It's great to be here today. 
 [00:01:14] Jason Johnston: Well, it is great to have you here. And we just wanted to start off by just getting to know you just a little bit. Tell us a little bit about your current role at Khan Academy. 
 [00:01:25] Kristen DiCerbo: Yeah, so a chief learning officer can mean lots of different things and lots of different organizations. So, At Khan Academy, I lead our content team, our product management team, our design team, and our community support team. So most of what you see, on the Khan Academy site is built and created by a lot of the folks that are on my team. 
 And I do not lead the engineers, they're a whole 
 [00:01:51] Jason Johnston: Okay. That's good. 
 [00:01:52] Kristen DiCerbo: group, not them. But I come from an educational psychology background. So my PhD is in educational psychology, and so I don't have the traditional kind of product background that some educational technology folks who lead those kinds of teams do. 
 And instead, I bring a lot of, you know, experience and insight about how people learn. And we try to build that into then the articles, the exercises, the videos, and all of the experiences students have on the site.  
 [00:02:24] Jason Johnston: And so, you mentioned about your education, you've got a PhD in educational psychology. Is that what you said? 
 [00:02:30] Kristen DiCerbo: Yes. I actually thought when I went to grad school that I was going to be a school psychologist. And so did a research practitioner program where I was doing. All of the work and training to be a school psychologist and doing all of the work on how you diagnose learning difficulties and all of that and did a whole bunch of research and kind of fell in love with that side of things too. 
 But then did end up being a school psychologist in a school in Arizona where I live. One of the schools I worked at had 1, 200 kindergarten through third graders, if you can imagine in a school, 
 [00:03:05] John Nash: No, I can't imagine. 
 [00:03:07] Kristen DiCerbo: And 80 percent of them had a home language that was not English which makes them figuring out why are kids struggling to learn quite a challenge , but also really drove home for me some of the Potential for education technology and could see, you know, there's, we have all of these kids who need extra support and extra help and all different levels in a classroom and how does a teacher help start to differentiate all of those. 
 So that was a bit of my first thinking about how do we, how could we use technology to help support these kids? 
 [00:03:44] Jason Johnston: So you got a lineup of kids waiting to see you at the school. And then did you just think one day, man, I'd like to learn more about doing this through a computer or through online or how did you get into Khan Academy? 
 [00:03:55] Kristen DiCerbo: Yeah, so it's a little bit of a winding road. So at first I was, after a couple of years, was thinking I was going to make a career change, thought I might go be a professor and did academic job applications. In that process, I got back in touch with someone who had been one of my statistics professors at Arizona State and he had gone to work for Cisco, the networking company, which sounds crazy, but Cisco has something they call the Networking Academy Program, where they create curriculum and assessments that they give away to high schools and community colleges for free to help students learn computer networking skills. 
 And so I got in touch with him to write me letters of recommendation for these academic jobs, and he said, of course, I'll write you those letters, but you should think about coming to work here. We're doing this online learning thing. And we have a whole lot of engineers that are starting to, you know, help us write this curriculum. 
 But we need some people who know about learning and assessment to think about this. And I was like, huh, that's kind of interesting. And the kind of the kicker is, and you could create these things that touch hundreds of thousands of learners every year, and really have that kind of impact on the world. 
 And so I was convinced and. So went to Cisco and spent a good amount of time doing some really interesting things around simulations and simulation based assessment, because it turns out that the high school students would practice on this expensive networking equipment, and they'd break it, and they didn't know how to fix it, so we said, well, let's create some simulation tools so they can configure this and try those crazy what if questions in a low risk environment and work through those. 
 And then we said, wait. We are, by doing this, we're capturing all of the information about how they're configuring these devices. Why are we giving them a multiple choice test about networking when we can actually see them doing the skills that we're trying to create? And so, got into performance based assessments and thinking about how we can use that digital data to understand what students know and can do. And from there, I was presenting on some of these ideas and some folks from Pearson approached both me and my mentor, who was the one who brought me and said, Hey, we're starting something called a Research and Innovation Network at Pearson. 
 And would you like to take some of these ideas you've been playing with and try them out in domains other than computer networking? And, you know, think about how this might fit across K 12. And that was pretty enticing. And obviously Pearson also has big reach and big opportunities. So went there and spent a good amount of time there in a research role. 
 And then gradually over time, as big companies do reorganizations and changes ended up leading a team of learning designers and researchers who were working closely with product teams to. building based on what we know from the learning sciences into some of the products and places things that offerings that were being released at Pearson. 
 And then about, oh, three and a half years ago or so, I was thinking about what my next step might be. And I was talking to some friends and said, I think I want something smaller. I think I want to go in the nonprofit space. And I think, you know, I was a VP at Pearson. I think I'm going to go like something like a chief academic officer, chief learning officer. 
 And three weeks later, this job that I have now was posted. And I said, this is what I was just describing and it all worked out. And so that's how I got to Khan Academy. 
 [00:07:36] John Nash: Did it feel, going back to your experience developing performance based assessments, and that was in an online environment, did that feel different and kind of exciting? Because that seems like that would have been a little cutting edge at the time. 
 [00:07:51] Kristen DiCerbo: it was. So yeah, we're talking like 2006, 2007 at this time to date myself. And it was, and it still feels like I still look back on some of that stuff we were doing and was like, this is still kind of cutting edge. And in terms of what's going on in the world. So it did feel that way at the time. And I still, You know, I'm still hoping there's a place for some of that. 
 And then at Pearson, I also was doing part of this group called Glass Lab that was a collaboration with EA, the makers of SimCity, the big gaming group. And EA gave us the code to SimCity and said, make a game based assessment. in SimCity, which was super fun. 
 [00:08:37] John Nash: I bet. 
 [00:08:38] Kristen DiCerbo: And we learned a lot and made, so we made SimCity EDU, which if you Google it, is no longer in existence and has some issues and never really got to large distribution, but was a lot of fun to make and a lot of fun to think about the issues around that. 
 [00:08:53] John Nash: Yeah, that's cool. So you sought something that was maybe non profit. Okay, check. Maybe smaller, maybe not check. 
 [00:09:02] Kristen DiCerbo: Well, so Pearson has like 30, 000 employees and Khan Academy has 250. 
 [00:09:07] John Nash: fair, very fair. But certainly a footprint of goodwill in the place. What's it like working at Khan Academy? 
 [00:09:14] Kristen DiCerbo: it, I have never been someplace where everyone is there. For the mission, a free world class education for anyone, anywhere, like that, people, lots of people who work there can be doing other things to, you know, make a lot more money to be in those space, but everyone is there thinking about how can we help. 
 Kids learn more. And what does that look like? That's exciting and motivating to come in every day, keep things going. And now that we've, I don't want to foreshadow the rest of our conversation, but now that we've kind of jumped in with both feet into this AI space, it also is kind of exciting because it feels like we're a bit on the cutting edge of in the technology space, which is a fun place to be too. 
 [00:09:57] John Nash: it is. And no, you foreshadow away. I'm dying to dive into that part. Yeah. Yeah. 
 [00:10:02] Jason Johnston: Yeah, and I was thinking about that this morning in anticipation of our conversation, just how impactful Khan Academy was from the standpoint of the flipped classroom. And obviously Sal Khan is a huge personality and just incredible story. But, even as I was a high school teacher and technologist for a while and using Khan Academy and all those kind of things. And the reorientation of what a classroom could be for my students was in part because of Khan Academy. So it actually, it really surprises me that there's 250 people there because there are many ways and no disrespect to Pearson because they're huge in its own way, but Khan Academy has had a lot more impact on my life and my teaching life and my kids lives and my students lives than Pearson has so far. 
 [00:11:03] Kristen DiCerbo: I think the phrase is, we punch above our weight. 
 [00:11:05] Jason Johnston: Yes, like that. 
 [00:11:07] Kristen DiCerbo: As you know, as a nonprofit, we get a lot of funding from philanthropists. And one of the things that our head of philanthropy says a lot is that for the budget of a large high school, we reach tens of millions of students every month. 
 [00:11:18] John Nash: That's a fantastic tagline.  
 So, let's talk a little bit about Khanmigo. Can you briefly explain what Khanmigo is? 
 [00:11:27] Kristen DiCerbo: Yes, so Khanmigo is an artificial intelligence tutor for students and assistant for teachers. So, for those who haven't been part of the big AI conversation for the last year, last November an organization called OpenAI released ChatGPT, and that is what, in the artificial intelligence world, is a generative AI model, or a large language model. 
 So, it, goes and trains on a whole, Enormous set. Basically, if you can imagine all the information on the internet, like that's a good proxy for the kind of what they either trained on and what they do is, as most folks know, they've played around with chat GPT is you can have a dialogue with it and it's producing text. 
 You input text and it produces text back to the user. So that was last November. If we go back from there, last September, so just about a year ago from when we're recording this, Sal and I got to see what at the time was the model they were training that they called G P T four. What they released in chat G P T at the time was G P T 3.5. 
 And so they were training their next version of it. Bill Gates had said to them, Don't come back to me and show this until it can pass the AP bio exam. So they needed a bunch of AP bio questions to keep testing it on. And we at Khan Academy have a whole bunch of AP bio questions. So, that was the impetus for them reaching out. 
 But as we started talking and Sal, they gave Sal and I access to a Slack bot so we could talk to this new model over Slack. And we were blown away by what it could do. And said, okay, let's talk more broadly. Yes. We'll give you those AP bio questions, but let's talk about how we might be able to use this as a tutor and think about what it could be. 
 [00:13:21] John Nash: Hey, can I be nerdy for one second? Cause that, I kind of got goosebumps with that. So in last September, you're having Slack conversations with GPT 4. 0 and fellow nerd, Jason Johnston and I are wigging out about 3. 5 and you're already, you're just going like, you guys wait. Is that kind of how it was for  
 [00:13:42] Kristen DiCerbo: Yes. We had this super strict NDA, so we couldn't talk about it at all. So then chat GPT comes out and everyone's, Oh my God. And everyone wants us to comment on what we think it's implications for education are, and we can't say like, just wait till March. 
 [00:13:58] John Nash: I know, you're like, "it's okay." 
 [00:14:02] Kristen DiCerbo: "Seems interesting." 
 So yeah, it was definitely a challenge to keep our mouths shut and not talk too much about what we knew was coming. 
 [00:14:11] John Nash: That's something. 
 [00:14:12] Jason Johnston: So how quickly did you move into kind of more formalized talks? Because I'm guessing, I don't actually know this for a fact. So I hadn't looked this up, but I know that Khanmigo is different than chat gbt, but I'm guessing that there is some basing upon that language model. 
 [00:14:33] Kristen DiCerbo: Yeah, so, so I'll tell you kind of how Khanmigo works a little bit under the hood. So it is based on GPT 4. So what happens is when a student is on Khan Academy and working, say, on a math problem, they have access to Khanmigo. Icon, you go icon you know, can pop up and then the student can talk to it. 
 And what happens is they might type in, say, "I'm stuck." And what happens is then the what we send, we take what the student sent. And then we add in the problem that they're working on. And then what's called a prompt. So about, in our case, it can be three to 500 words that tell the model how to act. So in our case, we'll say something like you are an uh, an empathetic Socratic tutor, you will do these things, you will not do these things, like you will not give the student the answer you will do these things, and we know from So you will the literature on what makes a good human tutor, the kinds of things that good human tutors do, so we prompt it to do those things. 
 So all of that gets sent to GPT 4, and then, and that is the input to the model, and then the model sends back, "Okay, what do you think the first step in this problem might be?" Or some similar response to what's going on. So we are absolutely linked to GPT 4, but, That prompt that we have that tells it how to act like a tutor or the other activities that we've created based on how students learn. 
 One way that we put a lot of guardrails in that if you just put that same problem into chat GPT, it'll just give you the answer. Like, it'll work through it and say, here's your answer. Whereas ours is going to act like a tutor and say, well, how do you get the variables on both sides of the equation or whatever that, you know, what that might be. 
 We also have some things, for example, we store chat transcripts, which for students, if they had a good conversation yesterday, they can go back to it and review it. But they're also visible to the teacher or parent if they're under 18. And so there's another place where if teachers or parents are concerned about what they're saying to GPT, there's all that record there. 
 And we have set everything that the student sends, we actually send through also a moderation API, so it goes into another... AI that's checking for instances of things like violence, hate, self harm, and sends up a flag. And for students, if something gets flagged, an email gets sent to their parent or teacher, and it's indicated in that transcript that there's a flag there. 
 So there's some more safety in terms of what the conversations are that we're doing. So in terms of the, you know, how did that all come about? After Sal and I had seen this model, We coincidentally had a at Khan Academy, we have a tradition of hackathons. And they aren't just engineers. 
 The whole company for a week takes on problems that aren't part of our everyday roadmaps. So, any team can work on something for a week and do something. But we pulled in about 25 people, convinced OpenAI to open our NDA to 25. People. And so we had a mix of our content creators, our engineers, our designers, our product folks, and Just spend a week like what could this be? 
 How does that look? And so this is still like the last week in September of 2022 and those weeks can be pretty like you get a lot of stuff There's a thousand flowers that can bloom and try a bunch of things And then from there started, you know, okay, this will work. This doesn't work. 
 Let's see if we can get this to work and Then we basically threw out our product roadmap for the rest of the year and said, all right, we're going to do this. And let's see what we can get done by March. 
 [00:18:30] Jason Johnston: Amazing. There's actually so much there we could talk about. Thank you for that. I really appreciated your clear description of what it was as well for those that are listening that haven't necessarily seen it as well as kind of letting us see under the hood just a little bit in terms of the guardrails and the safety that's going on. 
 So there's a lot there we could talk about. I'm curious to jump off of one of the things that you said. So the, okay. teachers are able to see these chats going on, which is a very unique feature. I hadn't really thought about that. Versus a teacher maybe sending them out to ChatGBT or to another chatbot, or even some, you can make some chatbots, but without potentially the way to see what's going on. 
 And I also saw within the Khan Academy, because we've been checking out Khanmigo from a teacher side, as well as a student side, I really thought this class snapshot was interesting. Do these chats get put into that class snapshot? Cause I haven't been able to use this in a real world situation yet. 
 [00:19:35] Kristen DiCerbo: Yeah. So right now they we have chat summaries, which is actually a separate piece. Sometimes we're moving so quickly sometimes I forget what's still in beta and what's actually launched, but so the chat summaries allow you then instead of having to read the whole transcript, it'll provide summaries of what were the big questions that students were asking and what did those look like. And then the class snapshot right now is Okay. pulling on the data from students interactions with the exercises and articles and videos and gives summaries of how much time have students spent. Our, one of our big metrics is skills to proficient, which in Khan Academy, we have a mastery learning framework. 
 So the goal isn't to get a high score, it's to master skills. And so in our system, you go from familiar to proficient to mastered. And our research shows that if you get to proficient, we see the skills that students. Students who get to more skills to proficient show greater growth than expected on a lot of norm reference tests. 
 And so, so we want to encourage students to get to proficient, encourage teachers to work to get those skills to proficient. It's better, in fact, better to get even fewer skills to proficient than more skills, just a familiar so that we're reporting to teachers in that in that class snapshot for how many students are getting to proficient with that looks like. 
 But then we also want to give teachers things like, hey, what students, might be struggling on this particular skill, what students might get a "congratulations, good job" because they're moving quickly and what that looks like. So that we're pulling together that data. It's still, we're still, you know, nothing's ever as good as there's always opportunities for improvement. 
 So when I look at it, I still think there's opportunities to even give teachers more help about and you could do this with them and you could, make suggestions for things for teachers, but at least we're summarizing the data for them and it can, and then the teacher can have a conversation with Khanmigo and ask some, detailed questions about what's going on in the data. 
 [00:21:44] John Nash: and I forgot all of the hats you wear on the CLO side, but you've got everybody but engineering, I guess it sounds like. And so, if Khanmigo is what one might call a GPT 4 powered solution what kind of pain points did you discover amongst teachers that Khanmigo addresses that say Core GPT does not? I mean, we've talked about some of these features, but as you, as we think about the jobs to be done that teachers are trying to do, what did you discover out there? 
 [00:22:13] Kristen DiCerbo: Yeah, so the first thing I come from the, you know, the learning background is what are the learning problems that teachers struggle with? So if I'm in a K 12 space, I'm in high school, I've got 150 students across my five classes, you know, that I'm trying to work at, and really difficult to give that individual attention to students. 
 So I was in a classroom actually here in Phoenix that was doing some testing with Khanmigo and they're actually in our, Howard College Algebra work. So we have a partnership with Howard University and National Ed Equity Lab where students work through and get mastery on a college algebra course on Khan Academy, take the Howard midterm and the Howard final, and then get , three college credits from Howard for doing that work, which is a whole other podcast we could talk about. 
 [00:23:04] John Nash: That's cool. 
 [00:23:07] Kristen DiCerbo: But so there's one teacher and there's all these students and they're doing a lot of independent practice on Khan Academy. So what happens, of course, is they get stuck on a problem. And so they raise their hand and they're sitting there waiting, and Ms. Alvarez is doing as much as she can going from student to student, but you know, wants to give each student that she's with enough time. 
 And so what happens is the students were able to Ask the question to Conigo. Wait I'm not getting to the right answer here. I don't understand this. How do I subtract, you know, two from both sides? All of those kinds of things. And so it's that piece when students are working, we go way back to, you know, our friends and talking about zone of proximal development. 
 That, that place where you're most learning is a place in between where you can do things independently and where you need a lot of support. You like, you're really learning if you're working in a place where you. Just need a little bit of support to get over. And Khanmigo can really be that individual support right at that place where students just need a little nudge to get on to where they're, where they need to go. 
 So that's a big use case for us in thinking about that. There's also some other things, just we know teachers are always asking me about how do I motivate my students, how do I keep them going, and so there's some things like we have an activity that's called Chat with a Literary Figure, and so you can of course go and read a Wikipedia page about Jay Gatsby, but if you can have a conversation with Jay Gatsby, That's, more engaging and more interesting and keeps some of that motivation and interest there where students are. 
 So we're trying, a lot of those things, like chat, do that. We have a debate activity where students can debate with Khanmigo on a bunch of different topics that we have set. And all of those things are things we're trying out, seeing how they work, seeing how students react to them, how teachers react to them, and what that looks like. 
 But so, there's certain, there's the individual, individualized tutoring piece, and then there's the engagement piece, I think, are two big problems that we think this can solve. 
 [00:25:07] John Nash: That's really fascinating and I think they're overlooked use cases when so much right now in the spaces that I think Jason is in and I'm in and around LinkedIn and our colleagues who are doing well and at our universities trying to socialize professors and then I teach teachers to become principals, but it's, let's get used to chat GPT and here, maybe it's a, prompt workshop, or maybe it's just thinking about how you're going to reset your assessments in the wake of GPT, but it's all about core GPT use and not these powered solutions. 
 I see some of these popping up and mostly in the P 12 space for teachers can go and get like, help me write a letter of recommendation. I click a button and then it's a Khanmigo like and sort of, you know, I fill in some blanks and it writes that. Do you foresee. These GPT 4 powered solutions evolving more and core GPT use or whatever's next diminishing what's your thought on that? 
 [00:26:06] Kristen DiCerbo: Yeah, I think that it's a lot to ask to turn every teacher into a prompt engineer. And so I think these solutions from people that can generally understand the problems of teachers and students are going to be the way that this technology can actually get into the hands more widely into the education space as a, and so the, all of these solutions that are powered by these large language models, I think are going to be the way to go as opposed to raw. Raw GPT. 
 [00:26:40] John Nash: Right, right, right. Yeah, 
 [00:26:43] Jason Johnston: I'm looking at some of the activities that you have listed under Khanmigo, and, you know, I was just thinking about how helpful, as you call them, powered solutions, John, and basically to describe for those of you that have not seen it out there. There's a menu along the left. And you can chat with Khanmigo in the middle as a teacher. 
 But the menu starts with kind of my classes. And then that's where we already talked about the snapshot and summarizing chat history. And then it gets into teaching aids with a number of things about developing a lesson plan and lesson hook and learning objectives and rubrics and so on. And then a tutor me. 
 Math and Science and Humanities Refresh, Practice My Knowledge, which was a nice way to, to put it for teachers. Refresh 
 [00:27:31] Kristen DiCerbo: Well, and we also know there's teachers that are out there that are being asked to cover classes for the sub in, that they haven't taught that in who knows how long, and like, oh, I need to brush up on this, or I haven't taught this in 
 [00:27:45] Jason Johnston: all the 
 [00:27:46] Kristen DiCerbo: there's lots of things where you just need a quick brush up. 
 [00:27:49] John Nash: that hadn't struck me yet. The, what value this has for a sub coming in to maintain continuity with what's been going on. And yeah, that's, yeah, that's good. 
 [00:28:01] Jason Johnston: Then the rest of the activities are Write, Crafting a Story, Debate, Chat, Play, and then extra things like Ignite My Curiosity uh, Navigate, College Admissions and Financial Aid, which I thought was great. And I mean, I mean, seriously, it's a mess. And. any kind of help to navigate this, you know, my my kids are a few years out still and we're already stressing about all of this, right? 
 Getting all the forms right at the right time and getting through this and then academic and career growth and personalize my interests. So I think this is a really fascinating menu that I'm assuming will kind of grow, but probably some concern about making this menu too long as well. 
 [00:28:46] Kristen DiCerbo: yeah, and what I actually see happening is that some of these activities will end up embedded in our courses. So if you go to a traditional Khan Academy course, there's videos, articles, and exercises, and I can imagine, so, think about, the particular math topic, maybe you're doing Pythagorean theorem there could be and then an activity, actually in the course, it's like, talk to Pythagoras something that where they actually then they're not just hanging out by themselves, but are more embedded into the activity of the courses and then so some of those would come off that activity and the new ones that we're trying would come on to this activities page and land there and see how they go. So that's kind of what I'm seeing right now. They're separate, but I'm imagining in the future they actually become more embedded into our courses themselves. 
 [00:29:39] Jason Johnston: Yeah. I love that idea. One thing that we wanted to talk about before we ran out of time was. Because both John and I are in the higher ed space we're you know, at the University of Kentucky University of Tennessee, we're both Canvas institutions, so Instructure Canvas. This summer at InstructureCon, it was announced that there would be a partnership with Khan Academy. There hasn't been a lot more details about that and even searched before this conversation to see, and there's really not much else except for that press release to talk about that. It kind of sparked our interest and actually part of the reason why we're contacting you. 
 You know, we're fans of Khanmigo as well, but because this hits home in terms of our own context here. What else can you tell us about this or what are some of your hopes and dreams for this partnership? As I know it's just kind of in development stage at this point. 
 [00:30:35] Kristen DiCerbo: That's right. So it is early days and we are working with Instructure to define what that, what we're actually going to create and when. So that's our, I have two meetings this afternoon about this very topic. So, so I can't tell you anything concrete about what we're doing, but I'm happy to say, you know, we can imagine, we know that Canvas is where a lot of teachers, professors, students are, and if some of these tools can be available on Canvas, it can make things then a lot easier for people to use them. They don't have to go to ten different places, everything is right in one central location. What does that look like? So, some of the things that are on our what if list, or could we do this list are, one, things like including these teacher assistant kinds of tools, and what would that look like? Second is thinking about, you were talking before about what is kind of the conversation around GPT, and a lot of it we know is around cheating and plagiarism and all of that. Well, what if you could use Khanmigo to help you draft and write your essay, would but that all is recorded, like, in the transcripts that we have, and so it's clear what the student did and what the model did and how that fits together, and we already have the rubric creation tools, can we then help the teacher create the rubric that they want to use to score this, and maybe even suggest to teachers, hey, we think this is a three on organization and a four on tone and voice and a five here, go ahead and, you know, review and create your own score.  
 So, we think there's a lot of potential for some kind of a writing solution to help address a lot of the concerns that we hear around using these tools to just write your essay for you. So we'll see how, we'll see how that goes. 
 And then, of course, there's a tutor. So, is there, you know, a Tutor Me in STEM and a Tutor Me in Humanities that could be part of Canvas? So, again, none of that is guaranteed, that is not an announcement, a product, that is the things that we've been thinking about. 
 [00:32:48] Jason Johnston: Yeah, that's, that sounds very exciting and interesting. And I would expect that Canvas was a good choice for you all. And I'm not sure who approached whom, but because they're actually pretty 12 space as well. 
 [00:33:06] Kristen DiCerbo: right, they have both the K 12 and the higher ed folks that are on their platform. And so that's a good piece. I will say my sister's a high school math teacher in Massachusetts. And when we were thinking about this I say, Hey, what learning management system do you use? 
 Oh, Canvas. I was like, great. We're gonna maybe do something for you there. So, yeah, I think it's a good potential partnership behind both sides. 
 [00:33:32] John Nash: Nice. I have a thought . I get the sense that Khan Academy and you, Kristen and Jason and I, we're kindred spirits, at least around this idea of where Khanmigo comes from as being an empathetic tutor, we're on a bit of a march to try to humanize online learning. And so as you start to think about the ways in which Khanmigo has been positioned as a support for teachers, and also I'll be honest, I mean, Jason and I are not really pleased with the level and quality of the instructional design that most people Professors bring to their online experience. Learner input is really not a part of course design as much as we would like. I'm not saying it doesn't exist, but as you think about our mantra of humanizing online learning and then thinking about potentials where Canvas and Khan Academy could come in, what are your hopes for that, and how do you see your tools helping advance that? 
 [00:34:35] Kristen DiCerbo: It's a good question, and there's I have a number of thoughts. We'll see if I can get them out clearly here. So first is, there's a lot of research in the ethical aspects of AI about not anthropomorphizing it, and making it clear for someone that they are talking to artificial intelligence. 
 They're not talking to a human and being careful about that. And we've done a number of things in our language is very careful with Khanmigo. It's never said. And things that make it seem too human and it doesn't have a human name on purpose and you know, some of those pieces. So we don't want the AI to become your best friend. 
 Like that's not a healthy relationship. But what we do hope is that it can do some of the things that let the humans do the human part. And so if the classroom teacher or the professor isn't spending all the time on some of the things that Khanmigo can help with, can they do more of that? Help understanding the student as an individual, understanding what they need, understanding their goals and their progress towards those goals and working with the students on those kinds of things. 
 That then can help the student actually build that relationship with a person as opposed to the AI. And, I mean, we know in the K 12 research world that if a student has someone that they think really cares about them in the school, their graduation rates are significantly higher, their going on to college is higher. 
 So, having, being able to free the humans up to do the human things seems like a really important goal. 
 [00:36:18] John Nash: Yeah, I think I would concur. I think that's the, and that's the conversation I've been having with other educators as they think about how to present even just raw chat GPT is what's the value proposition beyond just, Oh my God, how do I keep them from cheating? And it's sort of that it's how do we advance the human intelligence side of things and free up time for that with the artificial intelligence models. 
 [00:36:47] Kristen DiCerbo: right. 
 [00:36:48] Jason Johnston: I was at a tour of a Toyota plant in Kentucky, and they were showing us the robots, and they were very clear about emphasizing that the robots are here to assist humans, not to replace them. Which I agreed. I mean, I think that they believe that and I want to believe that, but then I also looked down the rows and I saw a lot of robots. How do we move forward with this to make sure this idealism that I believe that you believe what you're saying, but how do we move forward with this, that this idealism continues to ring true. 
 [00:37:29] Kristen DiCerbo: Yeah, I think we can't be idealistic to the extent we don't see the potential problems. And you can absolutely imagine a future where, hey, the AI can do this, that human stuff, it's not that important. We don't actually need that many humans. To do all of this. That's on all of us together to push back on that and to say, no, the human part is the important part. 
 And we do need that many teachers. And that means we need to support paying that many teachers and all of the things that go in that policy sphere, which is. It's not out of my realm of expertise, but I think because what we're doing has the potential to have impact there, we would be remiss if we weren't thinking about how we need to make sure that we are maintaining those commitments to how important all of those human things I was just talking about are, otherwise they're going to get pushed to the side. 
 In favor of technology. So we all have to continue to hold hands and agree that, yes, these are important things that are worth pushing for committing to as the technology advances. 
 [00:38:40] John Nash: Because Khanmigo is a G P T four powered solution, and if it arrives in a classroom to help a teacher in a busy situation where students have their hands up, that implies that generative AI has landed in that classroom. Have you or your colleagues been having conversations with schools or districts about their own guidelines for AI and whether they should use it at all? 
 [00:39:06] Kristen DiCerbo: Yeah, as you can imagine lots of people want me to come talk to them. And so, we've been having a lot of that. We also are part of a coalition called Teach AI, which is Code. org, us, ISTE and ETS. The World Economic Forum are kind of the steering committee, and we have a whole bunch of... 
 Other folks on the advisory committee and our charter is to think about how to teach about AI and teach with AI and a lot of the first things we're doing are setting out and will be, stay tuned, releasing some guidance for school districts on what should policy look like around this and whether some examples that folks might use if they're looking for those or just some guiding principles to, to work with Thank you. 
 How those fit together. So we definitely are hearing that. And then we also have the past spring we were working with a couple of districts to pilot Khanmigo and then continuing this fall. And so those districts that are working. closely with us specifically on Khanmigo are also, giving us a lot of feedback on how it's working, what's working, what's not working, and how, what can we continue to build and change, and how are they developing their policies. 
 So that's been really informative for us to see what happens when this is tried out in classrooms. 
 [00:40:25] John Nash: Yeah. Really nice.  
 [00:40:27] Jason Johnston: So what do you, what are you hearing from either classes and or Konamigo because it's in the pilot right now and I'm assuming a full rollout will happen in the next. 
 [00:40:39] Kristen DiCerbo: We're kind of waiting 
 [00:40:41] Jason Johnston: Okay. 
 [00:40:42] Kristen DiCerbo: to see Before we release, we say, yes, this is, you know, releasing what the other piece we haven't talked about this much. The other piece that is a concern and that we need to continue to work on is the cost of this. Because GPT 4 actually costs, and so right now for Khanmigo, we are working on this through our district programs, but it is a cost add on to what we have, or individuals can get it for 9 a month or 99 a year, but you know, we would like that to come way down and be able to offer this to as many people as possible at as low a cost as possible, but that involves The cost of the computing power to come down, which everyone forecast will happen when GPT 4 got released. 
 The cost of GPT 3 went way down. So we're hoping to see, you know, those similar kinds of patterns, but we shall see sorry, that was a little tangent to the question of, 
 [00:41:42] Jason Johnston: that's helpful. Yeah. 
 [00:41:43] John Nash: No, it was good. 
 [00:41:43] Kristen DiCerbo: . So in terms of what we are seeing now from districts, there's some things around just specific features. 
 So when we talked to district administrators, they said they actually wanted to also be copied in on those flags I was talking about on moderation. So they go to the teacher now, but the district said, you know what, if there's violence or hate or threats of self harm, we actually want to get those warnings too. 
 So things like that. Okay. Let's. Yeah, make that happen. And how those work. We heard from teachers when we first released for teachers. We just had a couple of activities and was really through talking to teachers who said, Hey, could this help me unpack a standard and make learning objectives? Hey, could this help me write a rubric? I can never figure out how to differentiate level two and level three in a rubric. Could it help me with that? I said, sure, let's give it a try. So a lot of what you see now in the teacher activities are the results of some of the early feedback we were getting from teachers that then we turned into new activities that they could do, which is fun. 
 And then we look at, for the students, we are doing, we do student interviews and all that. We also look at our data and we see which activities are the most used activities, which Tutor Me STEM is far and away the most commonly used activity. But craft a story does pretty well too, which is set up so that the AI writes two sentences and the student writes two sentences and the AI writes two sentences and you write a story kind of together like that. 
 And students seem to. catch on to that one quite a bit as well. 
 [00:43:17] John Nash: I was playing with the teacher version this morning before we met and I did notice that Khanmigo asked me to put the standard in when I was going to do some outcomes work. And so I think that's a nice aspect for teachers because they're so wed to that, but then how do they know they've really tied things in? 
 And so that just handles that. 
 [00:43:37] Kristen DiCerbo: Yeah, absolutely. It is the case that if you just put in the standard code, so in, for instance a state standard usually has some code that's, you know, MA. 3. 2 for a math. 3rd grade thing. It does not do a good job of just reading those codes and does not seem to have those. So, we do ask that you type in, put in the whole standard language. 
 So there's some things that are, you know, the models still don't do well and we need to work around. 
 [00:44:07] Jason Johnston: One of the things I really like, too, about Khanmigo versus just directly working with ChatGPT is this kind of prompting you forward. And so, if you started down the road, like, say, by, creating a lesson around a particular standard. It continues to prompt you forward to help you, help guide you, give you some example of some next prompts that you might do, might ask some questions about what you want to do next, or how about doing this next. 
 And I really I appreciated that kind of guided Inquiry that you don't get with all the other LM and LLM models. Unless you pre prompt it to be that kind of model. So... 
 [00:44:48] Kristen DiCerbo: yeah, that is definitely something we've designed into it. I refer a lot to this framework by Mickey Chee and Ruth Wiley, who are at Arizona State. Not just because I'm an alumnus and appreciate people from ASU. But it, they call it the ICAP framework. And basically, as students move from passive to active to constructive to interactive activities, learning increases. 
 But it's the same for all of us as we're designing lessons or what that is. And so constructive is, you know, when you're creating something yourself, but the interactive is when you're actually working with, the research is on people, so it's research with another person. When you're working together and both of you are making constructive contributions to that final product, that actually leads to the better product. So it's not trying to do it itself, it's not asking the user to do it themselves, it's actually trying to collaborate. 
 And that's what we've designed into the prompts that are those prompts behind the scenes is asking it to ask another question to finish with a question to lead you, the user along in whatever you're working on in the activity. 
 [00:45:54] Jason Johnston: I manage a number of instructional designers at the University of Tennessee, and I mean, I've got a great instructional designers, and that is what great instructional designers do, right? They prompt, they guide, they help things move along they're listening, but they're also co constructing. 
 And that makes for a really exciting dynamic, and I think that there's some space for that with a a chat bot or with a a chat GPT kind of tool like Khanmigo. 
 [00:46:27] Kristen DiCerbo: absolutely. That is definitely what we're going for. So I'm glad that came across. 
 [00:46:31] Jason Johnston: Yeah. You know, I've got a, I've got kind of a final question here. You know, Khanmigo is super cute. They're... Always there for you. Helpful, supportive, smart. What's Khanmigo like in real life? I mean, you've got the inside scoop. Is this really all there is to Khanmigo? Or is there like, you know, what are they like? 
 [00:46:56] Kristen DiCerbo: Khanmigo is whatever you make Khanmigo to be. And so 
 [00:47:01] John Nash: Wow. 
 [00:47:01] Kristen DiCerbo: this is an important point. We are. are still in control of the machines. 
 [00:47:07] Jason Johnston: ha. 
 [00:47:08] Kristen DiCerbo: we are telling Khanmigo to act that way and to interact that way. So it is driven by the personality that we at Khan Academy have given to Khanmigo and that's a, it's definitely important to know that that's because of the work we have done, not anything Inherent in the large language model. 
 [00:47:30] Jason Johnston: Yes. Well, that's good. And I think it's another great distinction about what makes Khanmigo different than just sending your students to chat GBT, certainly on any level. And I think certainly, I think as a student gets older, I think they're going to need to figure out ways to wield that wide open space, right? 
 But as they're younger, there are lots of ways in which you want to guide it a little bit more and make it a safer space. And I really appreciate I appreciate that. And I appreciate that approach. 
 [00:48:04] John Nash: I do too. I appreciate the, I've just even in this call, I mean, I've come to appreciate more the effort going into what do we call it, Kristen? It's a multi layered prompting scheme that's going on in the background to bring back those responses, but it's the, some of the best. prompts I've seen in sort of raw GPT use for say, guiding teachers interactively to set a clear measurable learning intentions and then create activities to do that, they're four page prompts. They're long and they work, but they're really beyond the realm or scope of most teachers to think, Oh, I need to put in this four page prompt and then go through this process. Whereas you guys have built in the four page prompts. I don't know how long. I don't know how long all that is back there, but to bring really high quality and interchanges between learners and in the machine, but also between teachers and learners, 
 [00:49:04] Kristen DiCerbo: Yeah, absolutely. And yeah, some of the prompts are pretty long. And sometimes if they get too long, the model stops reacting to all the parts of them. So we do have to do some things. Called prompt chaining and some fancy new things that are, were develop, you know, just being developed. But yeah, all of that is the idea that the teacher doesn't have to be an expert in all of this. 
 I do think in the future, as you were saying, that people are gonna have to learn some prompt skills. But it takes a lot. It has taken us a lot of experimentation to get to where things are. That's not something your average teacher has the time to do. 
 [00:49:40] John Nash: right? 
 [00:49:41] Jason Johnston: That's great. Well, Kristen, thank you so much for this conversation. We will in our show notes online learning podcast. com, we'll put in links to Khan Academy, of course, and Khanmigo and where you can sign up and give it a whirl. And yeah, we just really appreciate you taking the time to talk with us about this. 
 This has been a great conversation. 
 [00:50:03] Kristen DiCerbo: My pleasure. Thanks for all the good questions. 
 [00:50:07] John Nash: You're welcome. 
 [00:50:08] Jason Johnston: Yeah. Thank you. And for all of you listening, I hope you jump in with us on the conversation on LinkedIn and we'll put that link in as well. We'd love to hear what you think about this episode and what else we should be talking about and thinking about in regards to this. Thank you so much. Thanks, John. 
 Thanks, Kristen. Great talking to you. 
 [00:50:26] John Nash: Thanks, everybody. . 
 [00:50:28] Kristen DiCerbo: bye.


In this episode, John and Jason talk about a letter for teachers sincerely from ChatGPT.    Join Our LinkedIn Group - Online Learning Podcast Resources: Click here to read the full letter (and prompt) for teachers from ChatGPT, as well as letters to higher ed administrators, principles, provosts, edtech vendors, instructional designers, and students.  Ethan Mollick on LinkedIn Teaching with AI recommendations from OpenAI AI Educational Video Series from the Warton School Transcript We use a combination of computer-generated transcriptions and human editing. Please check with the recorded file before quoting anything. Please check with us if you have any questions!   [00:00:00] John Nash: That's what they've done. That's Conamigo's Other value proposition. You can forget using a zillion AI tools. Hey, now I only pay for  [00:00:08] Clicking: two,  [00:00:10] Jason Johnston: right? Me too. Now  [00:00:13] John Nash: three now, actually three. I paid for three. I went to Claude. I paid for Claude last night. And Oh, you did. Yeah, I decided to. Oh, now you're on to four  [00:00:21] Jason Johnston: then. What's the fourth? Oh, I thought maybe you had mid journey. Oh yeah, I do. Shoot. Huh.  [00:00:28] John Nash: Yeah. Yeah. I pay for mid journey. Chat  [00:00:31] Jason Johnston: for Conmigo mid journey.  , it's like streaming services. It all started with Netflix. It was like, ah, this is great. I cut the cable. Now I only have Netflix. And now I've got  [00:00:43] John Nash: six of them. Intro [00:00:44] John Nash: I'm John Nash here with Jason Johnston. [00:00:47] Jason Johnston: Hey, John. Hey, everyone. And this is Online Learning in the Second Half, the online learning podcast. [00:00:52] John Nash: Yeah, we are doing this podcast to let you in on a conversation we've been having for the last two and a half years about online education. Look, online learning's had its chance to be great, and much of it is, but there's still some that isn't. And how are we going to get to the next stage? [00:01:09] Jason Johnston: That is a great question. How about we do a podcast and talk about it? [00:01:13] John Nash: That's perfect. What do you want to talk about today? [00:01:17] Jason Johnston: I would love to talk about Back to School, Part Two. It sounds a little bit like an 80s comedy movie or something. Back to School, Part Two. [00:01:25] John Nash: That's right, except Rodney Dangerfield's not in it. [00:01:27] Jason Johnston: I'm glad you got the reference exactly. No, no respect here comes to Dangerfield but yeah, let's talk about Back to School, Part Two. I wanted to throw out one thing to you here. So I asked the chat, GPT to write a letter to teachers for this fall. What advice ChatGPT would you give. Teachers this fall as they, they enter the new school year. And so I wanted to read this letter from ChatGPT okay. And wanted to get you to respond from a professor teacher angle to see what you what you think of this. So here it is. I don't know. What's a ChatGPT voice? I'll just use my normal voice, so I think it might be too much. It's  [00:02:13] John Nash: you're chat  [00:02:13] Jason Johnston: G p t, Jason,  but it feels sincere, so I'll use a sincere voice. Sure. I think that's right. Yeah. Yeah.  Letter: Dear Teacher  [00:02:19] Jason Johnston: Dear Teacher, I hope this message finds you well. As an AI language model, I wanna share three ways in which I can contribute to your classroom experience. Firstly, I can help you create engaging lesson plans, offering diverse content, ideas and activities tailored to your students' needs and learning styles. Secondly, I can assist in generating interactive assignments and assessments, fostering a dynamic learning environment that encourages student participation. Lastly, I can provide additional explanations and resources to support struggling students and enhance their understanding of challenging concepts. To make the most of our collaboration. I suggest utilizing me as a versatile tool for creativity, interactivity, and personalized student support. Sincerely chat. G B T.  [00:03:13] John Nash: I think that's, I think that's pretty good. It was, and I how was it that ChatGPTwas so scoped and succinct in these things?  [00:03:23] Jason Johnston: Yeah, that's a good question. I, it wasn't a complex prompt by any means. I did ask it for three things, and I asked it to be encouraging and to be sincere. There you go.  [00:03:33] John Nash: I think it's a, I think it's a fair introduction to teachers who may not already be thinking of using it in their daily work. And I think those three things, lesson plans, generating interactive assignments and assessments and helping to think through explanations and resources of complex topics. The response the letter says you can help support struggling students, and I've done some work with Amanda, bigger staff and a webinar we did over the summer on differentiation of lessons for students in schools and how ChatGPT can do that with mixing some design thinking style prompts into that. So I think that these are good. And I think we know that fewer teachers than we think have really played with ChatGPT or even try used it. They're aware of it, but is it part of their daily work? Probably not by the majority. Yeah, I like it.  [00:04:30] Jason Johnston: Yeah, I thought it was fairly impressive. Now, of course, it's generative. I think that it's also been, ChatGPT I think has been reading the same things we've been reading probably. Yeah. But maybe not, I guess this is based on 2021 and before, 'cause it's chat four. So perhaps it's really ChatGPT's own ideas about the fall.  [00:04:52] John Nash: Let me ask you this, about this letter to the teacher, Jason. Is it a hundred percent true?  [00:05:00] Jason Johnston: Yeah. That is the one thing that we still know about ChatGPT is that it can be confidently wrong. And while this is more a matter of opinion, so it's not necessarily stating any kind of factual kind of things however I wince a little bit when when one mentions learning styles without any context around that just because more modern approaches-- not that there aren't different kinds of learners, but sometimes that prompts this kind of idea that these kind of Specific learning styles and a student is gonna slot into each one of those learning styles is still a thing.  [00:05:44] John Nash: Did I read recently somewhere that learning styles have been debunked? [00:05:49] Jason Johnston: Yeah. Yeah. A couple years ago now, actually. Not that students, people have different ways of learning, but you can't say, oh, this student is a kinesthetic learner, so they have to have tactile things to, I'm a visual work and manipulate all the time. I'm vi I'm a visual learner, so I can, can't listen to it. I can't listen to anything you say because I'm visual  [00:06:08] John Nash: "...and this podcast is crap because I'm a visual learner." [00:06:11] Jason Johnston: So that's in terms of untrue. I would say that's the only thing in there that kind of just grabbed me a little bit of a red flag. And then beyond the untrue,, sometimes it feels kinda like we know that it is it's predictive language model. And but we are predictive language model sometimes if people ask us yes, if people ask us an opinion about something, it's very easy for us to drop into teacher speak. Yes. And generating interactive assignments and assessments sounds like teachers speak a little bit. It's very easy to talk about. "Oh yeah. So I'm highly into engaging students in my class." It's, whereas when we start to unpack that, let's talk about really what that means, "engaging students." "I'm very dynamic in my 50 minute lecture."  Yes. Yes.  "...and that's my engagement, my student engagement" So, maybe not.  [00:07:06] John Nash: "I utilize constructivist approaches." [00:07:08] Jason Johnston: Yes. So generating interactive assignments and assessments felt a little, it feels a little teacher speak. And I would wanna unpack that a little bit before, before just jumping on board with what an interactive assignment particularly means. By default, I think a, an assignment is interactive because it forces a student to actually hand something in. So they have now interacted, they have now read something and they've responded to it. " What do you mean by interactive as assignment?" A writing prompt is an interactive assignment.  Yes, absolutely. " What do you mean by actually interactive?" And is there back and forth going on here? Are they interacting with other students? Are they interacting with the teacher and the content or just the content?  [00:07:51] John Nash: Yeah. Nice analysis. I think that the letter is nice, but I think it also risks oversimplifying what can get done and in, for instance, yeah, if it, "oh, it can assist me in generating interactive assignments and assessments. Interesting. I will put that in as my prompt. 'Please generate interactive assignments and assessments for my fourth grade math class.'" That prompt may generate a lot of stuff, and that's semi-interesting, but it's a little broad and and again, lacks context. Yes. And  [00:08:22] Jason Johnston: I think, and we may fall into that pit of algorithmic bias, whereas there are a lot of teachers out there that maybe think something is interactive that's not really the next level interactive. And so it just produces this thing that a lot of teachers already think out there about what interaction looks like. Yeah. Yeah. That's good.   I wonder if that answer in generating interactive assignments and assessments is that predictive nature of ChatGPT where it sounds good. It's oh yeah, that sounds fantastic. And then it's what is it? What is it actually talking about interactive assignments, like I could imagine some things, but I don't think it knows really. It's just putting something together that sounds should be the top of the list, right?  [00:09:12] John Nash: Does. Yeah because a user could say, please assist me in generating interactive assignments and assessments for X. Is that sufficient to, so in what role do. Should that kind of prompt be used? For me, I would think it would, I would advise teachers to use it as a starting point for a brainstorm based upon their own expertise. 'cause what we know about using these models is that they are most beneficial when they are used in the context of something you already know a lot about.   Yeah.  And so if I was, maybe a new teacher or, yeah, I wouldn't wanna rely on just what it spit out the first time there. I'd want iterate, talk to it about what it meant or give it more refined information. This a recent tweet that I archived from Mollick talks about, I think it's quite clever actually. Treating ChatGPT and other models for practical purposes as though it were a very smart, somewhat naive, slightly alien, well-educated gig worker. And so you give it this. Context. Context so that you have a conversation with it about what you want to achieve, not a one shot hey, generate some interactive assignments, assessments for me, for a research class or a math class.  [00:10:30] Jason Johnston: Yeah, I think that makes a lot of sense. I saw somebody post just a little bit of negative pushback about Ethan M , which is the first I had seen. Most of us have been praising his name for the last six months.  What did you see?  And it was in the space of they thought that he overemphasized the creative abilities of ChatGPT and the person that was responding had posted something because OpenAI has PO has posted a suggestion page for educators, and it included some very long prompts from Ethan Mollick. But your example about it being a sophisticated gig worker does not assume that this is a creative worker for us. It assumes that it is more like an assistant Yes. Or a TA or a, somebody who's going to only gonna be able to move forward with some good directions. In a little bit of maybe defense of Mollick, I feel like that his his examples kind of point more towards that. A lot of direction.  [00:11:36] John Nash: Have you ever used this online service Fiver? Where you for an inexpensive fee, depending on the range of the task, you can hire a stranger to do some kind work. Yeah. Maybe creative work. Yeah. What kinds of things did you hire people on Fiverr to do?  [00:11:50] Jason Johnston: I've did a quite a while ago when it was first going, I was, I'm a very novice programmer and I had some P H P that I needed somebody to help me with on a website. And yeah and they were able to achieve the goals I was looking for, essentially in terms of this one page I just couldn't get to fit correctly. And just to be able to say, Hey can you fix this for me? And without having to hire a full programmer for my website.  [00:12:23] John Nash: When you went to go get that work done, think back to how you had to prompt that, right? Yeah. Person. How, was it a one shot or did you have to be thoughtful about what you wanted to have them do?  [00:12:37] Jason Johnston: I seem to recall that I treated it like a one shot, but I was thankful that with the, at least with the person that I was working with, they didn't just do it. They asked good questions about what it is that I was really looking for, because I didn't quite, I didn't know, quite know, I think what I was asking for. I knew what I was asking for, but I didn't know the language that I needed to use.  [00:12:57] John Nash: Yeah, I think that's where we're at .; And so last time I went on Fiverr was a couple of years ago, but as an elective project before I went to a conference I was the the head of a sig, a special interest group. And I wanted to bring some fun posters for our membership to take home with them. And so I had some graphic designers on Fiverr, designed some posters that I could print on our 11 by 17 color printer and then take them to the conference. And that was a lot of fun. But yeah, I had to describe the tone that I wanted, the messaging that was behind the theme of the conference. And you're right, it was a back and forth a little bit. Some of the offers amongst the workers on Fiverr were very clear about what kind of information they needed so that there wasn't a lot of back and forth. 'cause that can raise the price, for instance. If you have changes or you weren't clear in the way in which you asked for your product, they have to come, they make it. And then you look at it and you go, ah no. Good. So they'll even limit the number of revisions you get, which I think is an interesting thing with large language models. They're tireless and they'll redo the revisions forever. But to this idea of thinking about how to help our education brothers and sisters out there, as they start to use this language it's like thinking about how you task someone to do these things on Fiverr. You have to be really clear. Or if you have a teaching assistant or a speech writer or whomever that's gotta be explained if they've never really hung around you before or is it kind of making sense across  [00:14:28] Jason Johnston: Yeah, it makes sense to me. Yeah. Yeah. And there's a joke among creatives right now that even with the AI coming on, they're like, we're gonna be fine, because the client still needs to explain what they want. Yes.  This is the, this is both the job of the creative, but also the great frustration sometimes of creatives is that the client often has a very difficult time explaining what it is exactly that they want. And so a good creative that knows how to work with clients, knows how to prompt, get the conversation going, to ask the good questions, to specify exactly what's going on, which is, something we run into over and over again here as we're developing courses to really get a clear idea of what it is the instructor is trying to accomplish, figure out that scope, and then try to move forward on whatever it is that and that we're trying to accomplish together. [00:15:26] John Nash: But if you do one shot then I think you, the system will presume that whatever problem you have is the one that you must solve and needs solving.  [00:15:34] Jason Johnston: Let me ask you this question then, and maybe this will get us back to what this directly, what this podcast is about, which is how does that then relate to teachers approaching classes, say this fall. For the first time in, in full light of OpenAI ChatGPT large language models.  [00:16:03] John Nash: Instructors don't know what they don't know yet about these models. I've run across some very interesting and compelling prompts written by Pedagogues that are very powerful at helping instructors think about whether their learning objectives are any good or just even if they put in what they want to achieve in a course, that can take you through a very intelligent conversation to help you set up better learning intentions, high impact activities to hit those intentions. And I'm not sure that's really hit out there, that kind of sophistication exists and is in within reach, very easy reach to use. So I think that's one of the implications. I think as we hit the fall and more and more instructors get exposed to the way in which you can create a lesson plan or, do some explanations or give some resources. It can actually be a very helpful assistant in making much more active human-centered activities that learners like and want to do that will help you hit your learning goals.  [00:17:06] Jason Johnston: Yeah. Yeah. And I think you're right in terms of they just don't know what they don't know. And I wonder if it is likened to are, Pedagogical approaches, there are instructor approaches to any technologies on the first pass. You think about what we're talking about here, which is online learning. Our kind of first pass is oh, look at how I can just stick a bunch of stuff up into the LMS. This is exciting. Next pass is let's get a little more organized and let's put it together in this kind of way. Third pass might be, okay, how do we really take this to the next level? Make it interactive and make it human? And that might come through. Stripping down some things that might come through, finding some specific things that are really working well and expanding them or scaffolding them or breaking them apart , or figuring out a thread that kind of maybe can go through your whole course. So I feel like I, I feel a little bit like. That we're at the first pass right now for many people. What do you think? Yeah,  [00:18:08] John Nash: I think that's a great analogy. And I think that all this, our conversation right now about instructors not knowing what they don't know may be much ado about nothing because six months from now or a year from now, the models will be very different in terms of the way we interact with them or what capabilities they have. So I, yeah, I don't know. I think you're right. And so maybe we'll iterate on what you're suggesting is there'll be another first pass coming or the next generation of instructors that decide to go into this because they didn't take it up this year they'll be engaging these models in a different way than we are right now. [00:18:47] Jason Johnston: Yeah. And I think about too, just even in terms of my own learning and we've been talking about Ethan Mullikin will share some links. Obviously both of us follow a lot of his postings. They've got, he's got some great videos. I don't know if you've taken a look at those videos that he, and I'm assuming as his wife put out from the Wharton School just to try to get people up and going for this fall. But he's six months down the road with his prompts. So he's trying to explain this to people. And so we're, it's like my first attempts at ai, art, it's "make this," and that's the whole prompt. And now, through a variety of means, I'm getting a lot more specific. I figured out what language I. It responds to and how it can do certain things, and the tool's gotten more sophisticated as well. And then there are other tools out there that actually help me with my prompt, get my prompt better when I go back to mid journey to, to create the art that I'm looking for, whatever. Yes. So I think that, yeah, I think in terms of this kind of first pass that in six months is probably gonna look really different for a lot of a lot of instructors I  [00:20:01] John Nash: I don't know what sort of the short hit is on that, except that you're right. The prompts are you're learning over time how to make your prompts more sophisticated because you're happy to do that out of necessity. I take it because you're not satisfied with the quality of the output from the model. So you have to continue to have the, continue to have a conversation with it. Correct it, modify it, guide it, push it, just like you would a sophisticated, semi-intelligent assistant who was a human. Yeah.  [00:20:31] Jason Johnston: Yeah. And I wonder about how, like this Hattie bot now does mean that. You and I don't have to come up with a Hattie bot, somebody else has come up with a Hattie bot. Really. Even if it's just a matter of putting the prompt or creating a, some sort of a chat. Yeah, a pre-program chat guided guard, railed chat bot for us to as a Hattie bot to jump into. And I think that we will, I think that we will find our ourselves in some various places for putting in original kind of prompts and just that kind of open-ended kind of relationship. And then also in various Levels of interaction with these bots that are, that have been highly tuned and programmed for us and for teachers that really don't either have the time or interest to really get that deep into something just like we have templates already for, for whatever it is that we're trying to do in Canvas or in, in with our syllabus or anything else. [00:21:36] John Nash: I, yeah, for a couple of decades now, teachers have been googling how to do stuff and it's less contextualized. Yeah. That's more of a treasure hunt than it is a a directive to develop new content. But it's similar, isn't it? Yeah. Gonna be going out to look for stuff. Yeah.  . Jason, this was a great conversation across these two back to school episodes A lot of changes in front of us. I'm making a lot of changes. And I think that the AI models are going to make a lot of changes. [00:22:09] Jason Johnston: Yeah, and teachers be looking for your letter, sincerely chat GPT coming into your mailbox soon. I'm sure chat will be writing a letter with some a little bit of guidance for this fall. So be looking for that. We'll put the, that letter. We also had chat, write a bunch of other letters to various people in education. And so we'll stick those in the notes and I'll link out to them so people can read them and respond if they would like to check those out. But yeah, and check out online learning podcast.com. You can see the notes from this podcast and links out to various things.  [00:22:47] John Nash: What I'm concluding here is that a lot has changed over the summer particularly with generative AI, but a lot has not changed, and in a good way. Teachers are still gonna have to bring their best game to the classroom, and we need great teaching. We need great instructional design and that will trump AI every time. And I'm looking forward to figuring out how to be a better teacher in the face of AI, and also think about how AI can support. Us in doing that work. [00:23:21] Jason Johnston: Yeah. And as we think about it, really any new technology that comes along so much of it is. is being reflective about it, having a plan, trying things out, making mistakes, getting feedback from your students, all the things. It's really no different this fall except that we've got, large language models trained on trillions of pieces of information, backing us up and pushing us forward. [00:23:44] John Nash: That's right. Otherwise, nothing's [00:23:46] Jason Johnston: that is it's business as usual in this back to school time, right? [00:23:50] John Nash: That's right. Yeah. [00:23:52] Jason Johnston: And join us at our LinkedIn community as well. Just look us up online learning podcast. And feel free to drop us a message on LinkedIn. We'd love to hear from you. Thanks And good luck out there to all the teachers. Go get them. [00:24:05] John Nash: Yeah. Go get 'em.  End of Episode