In Their Own Words

Do you struggle to meet your goals or targets? Find out how you can change your thinking about goals and your process for setting them so you can keep moving forward. In this episode, John Dues and host Andrew Stotz discuss the first five of John's 10 Key Lessons for Data Analysis. TRANSCRIPT 0:00:03.0 Andrew Stotz: My name is Andrew Stotz and I'll be your host as we continue our journey into the teachings of Dr. W. Edwards Deming. Today I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. This is episode two of four in a mini-series on why goal setting is often an act of desperation. John, take it away.   0:00:32.3 John Dues: Hey, Andrew, it's good to be back. Yeah, in that last episode, that first episode in this mini-series, we talked about why goal setting is often an act of desperation and I basically proposed these four conditions that organizations should understand prior to setting a goal. So it's not the goals in and of themselves that are bad, but it's with this important understanding that's often lacking. So those four things that organizations should understand, one, what's the capability of a system under study? So that's the first thing, how capable is the system or the process? The second thing is what's the variation within that system or process under study? So that's the second thing we talked about last time. The third thing is understanding if that system or process is stable. And then the fourth thing was, if we know all of those things, by what method are we going to approach improvement after we set the goal, basically? So you gotta have those four things, understanding the capability of the system, the variation of the system, the stability of the system, and then by what method, prior to setting a goal. And so I think I've mentioned this before, but absent of an understanding of those conditions, what I see is goals that are, what I call it, arbitrary and capricious.   0:01:48.8 JD: That's a legal characterization. You look that up in the law dictionary. And it basically says that an "arbitrary and capricious law is willful and unreasonable action without consideration or in disregard of facts or law." So I'm just now taking that same characterization from a legal world and applying it to educational organizations and accountability systems, and I just switched it to "a willful and unreasonable goal without consideration or in disregard of system capability, variability, and/or stability." And we see these all over the place for education organizations, for schools, school districts, teachers, that type of thing.   0:02:31.6 JD: And so what I tried to do in the book and tried to do here in my work in Columbus is develop some sort of countermeasures to that type of goal setting and develop the 10 key lessons for data analysis. An antidote to the arbitrary and capricious goals seen throughout our sector. And this process behavior chart tool, looking at data in that format is central to these lessons. So what I thought we would do in this episode and the next is outline those 10 key lessons. So five today and then do another five in the next episode. And in the fourth episode of the series, what we would do is then apply those examples to a real life improvement project from one of our schools. It's helpful, I think too, to sort of, to understand the origin of the key lessons. So there's the lessons that I'll outline are really derived from three primary sources.   0:03:36.0 JD: So the first two come from Dr. Donald Wheeler, who I've mentioned on here before, a lot of Deming folks will, of course, have heard of Dr. Wheeler, who's a statistician in Tennessee, a colleague of Dr. Deming when Dr. Deming was alive and then has carried on that work to this day. The two books, two really great books that he wrote, one is called Understanding Variation, a thin little book, a good primer, a good place to start. And then he's got a thicker textbook called Making Sense of Data, where you get in really into the technical side of using process behavior charts. So I'd highly recommend those. And then the third resource is a book from a gentleman, an engineer named Mark Graban called Measures of Success. And I really like his book because he has applied it, the process behavior chart methodology, to his work and he's really done it in a very contemporary way. So he's got some really nice color-coded charts in the Measures of Success book and I think they're really easy to understand with modern examples, like traffic on my website, for example, in a process behavior chart, really easy to understand modern example. But all three of the books, all three of the resources are built on the foundation of Dr. Deming's work. They're, you know, Graban and Wheeler are fairly similar and I think Graban would say he's a student of Wheeler.   0:05:00.4 JD: He learned of this mindset, this approach to data analysis by finding a Donald Wheeler book on his own dad's bookshelf when he was in college and starting down that path as a young engineer to study this stuff. And basically what I've done is take the information from those three resources and make some modifications so they can be understood by educators, basically. I think it's also worth noting again that process behavior chart methodology is right in the center of this, really for three reasons. One, when you plot your data that way, you can start to understand messages in your data, I think that's really important. Second, you can then start to differentiate between special and common causes, special and common causes, translate that into regular language. I can translate between something that I should pay attention to and something that's not significant basically in my data. And then in so doing, I know the difference between when I'm reacting to noise versus when I'm reacting to signals in my data, so I think that's really important. So the process behavior chart is at the center of all this. So we'll go through five of these lessons, one by one, I'll outline the lesson and then give a little context for why I think that particular lesson is important.   0:06:25.4 AS: That sounds like a plan. So capability, variation, stability and method. You've talked about Donald Wheeler, excellent book on Understanding Variation, that's the one I've seen. And of course, Mark Graban's book, Measures of Success, very well rated on Amazon and a podcaster himself, too.   0:06:49.6 JD: Yeah. And if I was a person studying this and wanting to get into process behavior charts and really knowing how to look at data the right way, I would read Understanding Variation first because it's a good primer, but it's fairly easy to understand. And then I would read Measures of Success 'cause it's got those practical applications now that I have a little bit of a baseline, and then if I wanna go deep into the technical stuff, the Making Sense of Data, that's the textbook that drives everything home. Yeah. So we'll dive into the lesson then.   0:07:19.5 AS: Let's do it.   0:07:20.0 JD: Yeah. Okay. So the first lesson, and I've talked about this in various episodes before, but lesson one, the very first lesson is, "data have no meaning apart from their context." So this seems commonsensical, but I see this all the time where these things aren't taken care of. And what I'm talking about is answering some basic questions. So for anyone looking at my data, they should be able to answer some basic questions, very simply, anybody that looks at my data. First thing is who collected the data? That should be apparent. How were the data collected? When were the data collected? Where were the data collected? And then what do these values represent? So oftentimes I see data either in a chart or in some type of visualization and almost none of those things are known from looking at the data, all important questions.   0:08:18.6 JD: The second question would be, well, that first set goes together. The second question is what's the operational definition of the concept being measured? So we have to be on the same page about what it is exactly being measured in this data that I've collected. I also wanna know how were the values of any computed data derived from the raw inputs? That's important. And then the last thing is, have there been any changes made over time that impact the data set? For example, perhaps the operational definition has changed over time for some reason. Maybe there's been a change in formula being used to compute the data.   0:09:05.4 JD: So an example would be, from my world, high school graduation rates. You know, 20 years ago there was one definition of how you calculated a high school graduation rate, now there's a different definition. So when you compare those two sets of data, you've gotta be careful because you're actually, you're actually working from different definitions and I think that happens all the time. More recently here in Ohio, what it means to be proficient on a state test, that definition changed about 10 years ago. And so if you look at test results from 2024 and try to compare them to 2014, you're really comparing apples and oranges 'cause there's two different definitions of proficiency, but no one remembers those things a decade later. So you have...   0:09:52.3 AS: And then a chart will be presented where the different methodologies are shown as one line that says...   0:10:00.8 JD: Yes.   0:10:00.8 AS: That no one's differentiated the fact that at this point it changed.   0:10:04.6 JD: Yeah, at this point it changed. So first lesson, data have no meaning apart from their context. Second lesson is we don't manage or control the data, the data is the voice of the process. What we control is the system and the processes from which the data come. There's a difference there. Right? So I think this is one of the key conceptions of that system's view, that system's thinking in an organization. When we wanna make improvements in our schools, we need a few things in place. We need the people working in the system. So that would be the students for us, they're working in the system, people that have the authority to work on the system, so that'd be teachers if we're talking about an individual classroom, at the school building level, maybe we're talking about the principal. And those two things are, at least the teacher principal thing is usually in place, the students being a part of improvement projects, definitely less so, but maybe there are places where that's happening. But the third thing is someone with an understanding of the System of Profound Knowledge, I'd say that's almost always lacking in the education sector, at least. And I think the reason the System of Profound Knowledge becomes important, 'cause that's really the theoretical foundation for all the things that we're talking about when we're looking at data in this way.   0:11:38.8 JD: If you lack that conception, then it's hard to bring about any improvement, because you don't understand how to look at that data, how to interpret that data, you don't understand how to run a plan-do-study-act cycle. Because what you're gonna ultimately have to do is change some process in your system and there's some knowledge that you're gonna need to be able to do that, and that's, that third component of an improvement team has to be in place to do that. But I think the most important thing is that we're not in control of the data, we're in control of the processes that ultimately lead to the data. It's a distinction, maybe a fine distinction, but I think it's an important one.   0:12:17.5 AS: The idea of the System of Profound Knowledge and understanding what to do with the data and really understanding the whole thing, I was just thinking what would... An analogy I was thinking about is rain. Everybody understands rain as it comes out of the sky, but not everybody understands how to use that to make a pond, to make an aqueduct, to feed a farm, to, whatever that is. And so having that big picture is key, so, okay. So number...   0:12:57.8 JD: Yeah. Well, and a part of that is something really simple is constantly understanding data is the voice of the process. And so when you're looking at data, what often happens is I'm gonna walk into a meeting with my boss, and I'm looking for some data point, maybe we just got some type of performance data back or survey results or something. I'm gonna pick one of those items where the plot, where the dot from last time has improved when we look at it this time, and I take that and say, "Look how we've improved in this thing." And you need someone to say, "Well, wait a second, while there is a difference between those data points, if I look at the last 12, things are just moving up and down." And there's gotta be someone in the room that constantly points back to that, constantly. And that's where that person with the Profound Knowledge is helpful in improvement work.   0:13:54.5 AS: So the voice of the process is a great way of phrasing it that's been used for a while now and I think it's really good. I remember when I worked at Pepsi as a young supervisor, I saw some problem on the production line and I raised it to the maintenance guys. And they kept coming and fixing it and it would break and they'd fix it and it would break, and I basically got mad at him and I was like, "What the hell?" And he's like, "Bosses won't pay for the things that I need to fix this permanently, so get used to it constantly breaking down."   0:14:33.4 JD: And that's the best I can do.   0:14:34.0 AS: That's the voice of the system, here's what I can produce with what you've given me to produce.   0:14:40.8 JD: Yep. Yep. Yeah. Those guys had a very keen understanding of the system, no doubt in that example. Yeah. Yeah. And that kind of thing happens all the time, I think. That was lesson two. Lesson three is plot the dots for any data that incurs in time order. So a lot of people in this world know Dr. Donald Berwick, he started the Institute for Healthcare Improvement. He was a student of Dr. Deming's, he's done a lot of work in this area. He has a great quote where he says, "Plotting measurements over time turns out, in my view, to be one of the most powerful things we have for systemic learning." And that's what really plot the dots is all about, it's all about turning your data into a visualization that you can learn from. And the National Health Service in England has this #plotthedots. And I think the whole point is that plotting the dots, plotting the data over time helps us understand variation and it leads us to take more appropriate action when we do that. So whether it's a run chart or a process behavior chart, just connecting the consecutive data points with a line makes analysis far more intuitive than if we store that data in a table.   0:16:03.6 AS: Yeah. And I was thinking about if you're a runner and you wanna compete in a marathon, plotting the dots like that is so valuable because you can see when changes happen. For instance, let's just say one night you didn't eat and then you ran the next morning and then your performance was better. Was it just a noise variation or is there something that we can learn from that? And then just watching things over time just give you ideas about what... Of potential impacts of what something could do to change that.   0:16:42.0 JD: Yeah. And we can start with a simple run chart, it doesn't have the limits, it's just a line chart. And then once we have enough of the data collected, enough plotted dots, then we can turn it into the process behavior chart.   0:16:56.3 AS: Some people don't even want to see that, John, like when we looked at your weight chart, remember that?   0:17:03.0 JD: I do remember that. Yeah.   0:17:04.0 AS: So for the people out there that really wanna let's say, control your weight, put a dot plot chart on your wall and measure it each day and just the awareness of doing that is huge.   0:17:18.7 JD: Yep. It is huge. It really is huge. And that works for any data that occurs over time, so almost everything that we're interested in improving occurs in some type of time order, time sequence. So these charts are appropriate for a wide array of data. But the bottom line is that... Oh, yeah, sorry, go ahead.   0:17:33.5 AS: The bottom line?   0:17:35.0 JD: Well, I was just saying the bottom line, whether you're using a run chart or a process behavior chart, it's always gonna tell us more than a list or a table of numbers, basically.   0:17:44.5 AS: I was gonna explain this, a situation I had when I was head of research at a research firm, a broker here in Thailand. I, my goal was to get more output from the analysts, they needed to write more and we needed to get more out. So what I did and I had already learned so much about Deming and stuff at that time. So what I did is I just made a chart showing each person's, what each person wrote each week, and it was a run chart in that sense where people could see over time what they wrote and they could see what other people were writing. And I purposely made no comments on this chart and I'd never really discussed it, I just put it up and updated it every week. And one of the staff that worked for me, an analyst, a really smart Thai woman asked, she said, she went to... She said, "I wanna see you in your office." I was like, "Oh, shit, I'm in trouble." And so she came to my office and said, "You know I went to, so this was maybe six months after I had put that chart up, she said, "I went out to lunch with my counterpart, my competitor, and she's writing research just like me on the same sector, and she asked me how many research reports do you write in a week, and I told her my number, and she was like, "Oh my God, that's a huge number."   0:19:16.6 AS: And she said, "Oh, I didn't really even think about it. But okay." And then she says, "What is Andrew's goal or target for you?" And she had naturally had thought that I had set a target of that amount, that's where she said, "I think I really figured you out." And I was like, "Well, what do you mean?" She said, "You just put that chart up there and you didn't give us any goal, but you knew that we were looking at it, and then it would provide us information and incentive and excitement, and the fact that you said nothing about it, got us to probably a higher level of production than if you had said, "I want everybody to read my reports."   0:19:57.9 JD: Right. Yeah, that's great.   0:20:01.0 AS: The magic of data. What's number four?   0:20:02.4 JD: The magic of data. Number four, so two or three data points are not a trend. So the first thing is, as soon as you've decided to collect some set of data, plot the dots, that should start right away. And again, this really includes all data that we're interested in improving in schools. And I know before I understood this way of thinking, this way of data analysis, I often relied on just comparing two points, that's the most common form of data analysis. What did last month look like, what does month look like? What did last year look like, what does this year look like? What did last week look like, what does this week look like? So that limited comparison is the most typical form of data analysis, especially when you're talking about something like management reports or board reports, revenue over time, those types of things. What was revenue last January? That type of thing. But the problem with looking at just two or three data points is that it tells you nothing about trends, it also doesn't tell you anything about how the data varies naturally.   0:21:17.5 JD: I remember looking at attendance data at one of our schools, and they had up... Last month was 92%, and then had gone up to 94%, but then I just said, well, what did it look like... January is 92, February is 94 in this particular school year, and I just said, well, what did it look like before, and then when you plotted it, what saw very quickly is there was no improvement, the data was literally going like this, up, down, up, down, up, down, up down, right? But no one had that picture, because all you could see was, Here's January and here's February, just numbers written in percentage form, that's almost all the data that I see in schools is in a similar format.   0:22:02.7 AS: On this one, in the stock market, my area of expertise. People always see the up data, the people who have made a lot of money in the stock market, and they see that as evidence that they could make money in the stock market, or they attribute that to skill of that particular person as we want to, with Warren Buffett as an example. And I have, in fact in my class, I asked the students, "Do you think that Warren Buffet outperformed, underperformed, or performed in line with the market over the last 20 years?" And the answer to that is, he performed in line with the market, and I proved that by doing a demonstration through a website that I can do that with, but it was shocking because obviously he's gonna end up with the most amount of money because he let his money compound, and he made huge gains in the beginning years, which compounded over many years.   0:23:02.0 AS: And still he's doing very well, but the point is, is that... The reason why I say this, I also tell the story of, if you had 10,000 people in a stadium and you flipped coins, and asked them if they flipped heads consecutively or tails consecutively to remain standing, and you're gonna end up with 10 people at the end of 10 flips with 10,000, and if you've got a million, you can end up with 20 or 30 or 40 flips that could potentially be heads consecutively or tails consecutively. So my question is, given that long streaks can happen through just plain probability, what if two to three data points are not a trend, can we definitively say, what is a trend?   0:23:50.9 JD: Well, not with certainty, but what this type of data analysis does is it gives you some patterns in the data to look for that are so mathematically improbable that you can be reasonably assured that some changes happened.   0:24:09.4 AS: Right so this is enough of a trend that I'm gonna go with the assumption that there's something significant here.   0:24:21.9 JD: Yeah. I mean it's...well, think back to that attendance example that I just used, so if I went from... If I'm writing this up on, let's say a whiteboard that's in a teacher work room, it says, this month and next month, or last month and this month, and I write those attendance rates up and remember, it's a dry erase board, and I'm gonna erase the last month to put this month's up and so I'm not gonna be able to see that one anymore, I'll have two data points and I'll erase the old one, and so in that example, I used where they went from 92%. It was actually like 92.4% to 94.1%. So it wasn't even two full percentage points. And then you celebrate that as a win, as an improvement, but like I said, you didn't know what happened before, and then you didn't chart after, so you don't really know how things are just bouncing around naturally versus if you had it on a run chart and you did see, let's say, eight points in a row that are above the average attendance for that school, that's one of the patterns that suggest that something different has happened. So you just have increased mathematical probability that there has been meaningful improvement.   0:25:39.4 AS: So it sounds like what you mean in this number four is a little bit more on the end of, Hey, just a couple of data points doesn't have anything, you need to get more rather than somebody looking at a lot of data and trying to understand what is a trend or not?   0:25:56.9 JD: That's exactly right. That's exactly right. And that actually is a segue to Lesson 5, which is "show enough data in your baseline to illustrate the previous level of variation," basically. So this is gonna get a little technical for a second, but the non-technical thing is, we talked about when you have a run chart when you're starting and you have, let's say, three or four or five, six data points at a certain point, you can now have a process behavior chart, which is the addition of that upper and lower natural process limit that defines the bounds of the system, so the limits are not a part of the run chart.   0:26:34.9 JD: In making sense of data what Donald Wheeler basically says is that if you're using an average line, the mean for your central line, then those limits, you begin to have limits that solidify when you have 17 or more values, and then if you're using a median for that central line, that solidification starts to happen when you have 23 or more values. So there's a mathematical theory behind that. But the point is, at a certain point, you start to get enough data to be able to add the limits and feel confident that those limits actually represent the bounds of your current system. But that's getting fairly technical and what Wheeler does go on to say is that, in real life we often have fewer data points to work with.   0:27:31.4 JD: So you can actually compute limits with as few as five or six values, and they can still be meaningful, now they're gonna be not a solid, meaning that each individual data point for a while that you add could potentially shift those limits more than you'd like, because there are a few data points that the limits are based on. But once you get to 17, 18, 19, 20 points, they start to solidify pretty good unless there's some significant change, like one of those patterns I talked about in your data. But an important thing to keep in mind is, is we're using a process behavior chart for continual improvement, so we're taking improvement measurements, not accountability measurements. I'm not trying to paint a certain picture of what my system looks like, I'm not trying to write a fiction about what's happening in my system, I'm actually trying to improve, so I don't really care what the data looks like. I'm not worried about being judged or rated or ranked, it's not an accountability thing, it's an improvement thing. And so I'm just trying to represent the system accurately so that I actually know that what I'm trying is working or not working. It's a completely different mindset. That whole sort of like trying to look better is completely removed from the picture through this type of mindset.   0:28:55.7 AS: I'm just picturing some sort of process where there's a measurement of temperature and the temperature keeps rising, but the worker says, "Boss there's a fire." And the boss said, "There's not enough data yet to confirm that." It only seems like a small fire right now, so I need more data points. Well, sometimes you have to act without thinking about the data and make an assumption that you may be wrong. You turn on the fire sprinklers, boom, and it wasn't a fire, but the damage of letting that go for long and saying I need more data doesn't make sense.   0:29:34.1 JD: Yeah, yeah, that doesn't really work. But the idea with the baseline is, basically, if you wanna improve something, the first thing you do is before you try anything, just gather some baseline data first so you can understand the current conditions. And in that attendance as an example, maybe you don't wanna wait for monthly attendance data, maybe wanna look at daily attendance day, what you have in a school, and just plot that over 12 days, 15 days, two or three weeks, and you can start to get a sense for what this looks like on a daily basis, and then you could try to improve it and see if that improvement has an impact on the data over time.   0:30:15.6 AS: Good, well, let me summarize this, but I have to start off with... My grammar is not particularly great, and since you're more of a school teacher than I am, I may need help with what you said. I think what I got correctly was data have no meaning apart from their context.   0:30:33.6 JD: Yeah, what did I say? Let me see.   0:30:38.5 AS: I always get confused if data is plural or singular.   0:30:41.8 JD: Yeah. Well, it can be either. So in this case, I was using data as a plural, so that's my point. I think technically the singular of data is actually datum. Obviously, nobody uses that 'cause it sounds really weird, but data can be plural, I think so.   0:30:57.4 AS: That sounds awfully Latin of you, alright. Number two, the data is the voice of the process, and that we control the process, not the data, and number 3 we plot the data in time order. Number four, two or three data points are not a trend. And number five is show enough data to illustrate the baseline. Anything you need to say to wrap all this up.   0:31:20.4 JD: Yeah, I just think that... I've mentioned this multiple times. I think when you're talking about continual improvement, primary tool is that process behavior chart, it allows you to visualize your data in a way that makes sense, and then the skill set that you have to learn is how to interpret the process behavior chart. How to use them effectively, how to create useful charts and then underlying... Understanding that underlying logic of process behavior charts. There's other tools, obviously in the improvement tool kit, but I actually think that that particular chart is the most important in my view. And I think with those charts, that tool in hand, we can avoid then those arbitrary and capricious goals that are so pervasive in our sector, basically.   0:32:10.6 AS: Well, that's exciting, and I'm excited for our next session when we talk about the final five. So John, on behalf of everyone at The Deming Institute, I wanna thank you again for this discussion, and for listeners remember to go to deming.org to continue your journey. And you can find John's book, Win-Win: W. Edwards Deming, the System of Profound Knowledge and the Science of Improving Schools on Amazon.com. This is your host, Andrew Stotz and I'll leave you with one of my favorite quotes from Dr. Deming, "People are entitled to joy in work."

In The New Economics, Deming said “The individual, transformed, will perceive new meaning to his life…” (3rd edition, page 63) But are we ever completely transformed? Discover why Bill Bellows believes that transformation is an ongoing process and how you can keep your learning journey going. TRANSCRIPT 0:00:02.2 Andrew Stotz: My name is Andrew Stotz, and I'll be your host as we continue our journey into the teachings of Dr. W. Edwards Deming. Today, I'm continuing my discussion with Bill Bellows, who has spent 30 years helping people apply Dr. Deming's ideas to become aware of how their thinking is holding them back from their biggest opportunities. And the topic for today is, in this episode 17, Diffusion from a Point Source. Bill, take it away.   0:00:29.6 Bill Bellows: And the title coincidentally, was the focus of my Master's thesis. We'll look at that later.   0:00:37.1 AS: It wasn't a rock and roll song. Yes, correct.   0:00:39.9 BB: No, not a rock and roll. [chuckle] Actually, Diffusion from a Point Source. Was that Mick Jagger or Keith Richards? Maybe it was Taylor. Maybe it was Taylor Swift. Okay. So some opening remarks, and then we'll get to today's feature. And I mentioned in the past, I go back and listen to the podcast, read through the transcripts, and it's very much like “Production Viewed as a System” - is to talk with people that have listened to it, listened to it myself and ask, have I... Are there holes in the explanation? Can I add some more clarity to it? The process I use for these podcasts is, some title comes to mind. I've got a long list that we started with at the very beginning, and then some other topics come up for any of a variety of reasons.   0:01:35.3 BB: And we'll have a title, have an outline, but then as we get involved in the conversation, something I say leads to something that you say leads to something that's not on the list. And sometimes some of those ad-libs, I go back and listen to and say, "Well, I don't know that sounded right. I just wanna add a little bit more clarity". Another thing I wanna say at the outset for those listening, is [chuckle] there is... Somebody posted somewhere on social media that one of the sessions was a total waste of time to listen to which I think is unfortunate. But what I like to say is, where I'm coming from to support The Deming Institute, as your ambition is as well, is to help individuals in respective organizations learn about Dr. Deming's ideas, try to apply them, deepen their understanding, explain them to others, and that's the target audience.   0:02:48.0 BB: So, for those who find that boring, well maybe this is not the podcast for you. And so, and the other thing I wanna say along those lines is, for the majority of my time at Rocketdyne, I had the responsibility of being a transformation agent or transformation person was part of my job. Now, I was brought in, I didn't have that job to begin with. The job I had to begin with was to lead the effort to provide training, facilitation of applications of Dr. Taguchi's ideas. And what I've shared in these podcasts is a lot of what I was doing early on was helping people put out fires.   0:03:38.2 BB: And that's not what Dr. Taguchi's ideas are about. His ideas are about improving the robustness of the performance of a product or service. Whereby what robustness Dr. Taguchi means is "it performs as an athlete incredibly well in spite of differing weather conditions." So the ability of a marathoner to run very consistent fast times in spite of the weather, in spite of the altitude. And so you're getting consistently high, or consistently faster and faster times. That's what Dr. Taguchi meant by, means by, his work means by "robustness."   0:04:16.2 BB: And what I was doing was using tools and techniques associated with his ideas to fight fires. And then, I got frustrated by that. And that led me to Dr. Deming's work, led me to revisit Dr. Deming's work. I had met him in 1990 and The New Economics came out in '93, and I had a couple of years of this frustration. The exciting thing was solving, getting involved, working with some really exciting people, and solving some very high visibility issues. But it wasn't breaking in as much as I would've liked into the, into the robustness piece. And when I came across Deming's work, I started to understand, it gave me a lot of food for thought as to why that might be the case. Now what is meant by transformation? And Dr. Deming uses that term, an individual transformed.   0:05:07.8 BB: And I had asked people that were close to him like, what is his operational definition of transformation? And when I explained it to them, I said, this is what I think he means this. And typically people say that's, they agree with that. And so my simple explanation of what I think Deming meant by transformation is as simple as, me saying to you, the professor to the student, “Andrew, how did you do on the exam?” Whereas I've said in the past, that makes me an observer of your learning to changing the question to how are, how did we do on the exam, where I become a participant? So I look at, so to me, the transformation Deming's talking about is that I no longer look around at things and see myself as separate from them. I look at myself as connected to them, and others being transformed or likewise seeing themselves as integral to what's going on, not watching it go by. Another reason I wanna bring that transformation agent piece up is part of my job, not part of my job, so I went from being mostly about Taguchi's work to mostly about Deming's work because I felt it was far more vital to focus on what Deming's talking about, the transform, how the organization and transform how the individuals operate. Another thing I wanna say there is what I think is interesting, if you look at the forward to Out of the Crisis and The New Economics.   0:06:48.1 BB: In Out of the Crisis, which I think was 1986 or so timeframe, Deming talked about the aim of this book is to help transform organizations. And then in The New Economics, he talks about the aim of this book is to help transform individuals. So he went through, he's shifted his focus from I'm trying to help organizations to I'm trying to help individuals. And that's what I'm hoping to do, interacting with you in these podcasts. So, on the one hand, I'd say to those listening, I don't know what your role is. If you're a transformation agent, that's one role. You may be an individual contributor, a senior software person, a marketing person, which means your job title does not include transforming the organization.   0:07:37.8 BB: So, what does that mean? It means some of what we're talking about may not apply to you. You may be personally excited about the Trip Report and, but it may not be your job to hold seminars within your respective organizations and go off and explain that to people. You may alienate people who think that's their job. So, I just wanna say, ask people, to be careful about what your role is in your organization. I've mentored many people and I'm used to going in and being the transformation person. And, one person I was working with, and she was all excited to wanna go share the Me-We Trip Report with her peers in this company doing software. And I said, "You can't do that". And she's like, "Well, why?" I said, "It's not your job". I said, "One is if you call a meeting to talk about transformation of the organization, or you get into that territory. I said, you're stepping on the toes of people who have that responsibility, perhaps. Or somebody's gonna say, wait, I thought we paid you to be a software engineer. Now you're over here. So, now you sound like you're astray, you're a loose cannon".   0:08:56.8 BB: Now I said, to this person, I said, now if you... There may be a place for you to say, "Hey, I wanna show you this neat solution.” If you think they're interested, ideally they ask you to show you how you did that. So, I think there's a difference when it comes to implementing these ideas, I would just advise some caution to people to not overstep their bounds and what it means to bring these ideas to the organization. So, I just wanted to say that.   0:09:32.4 AS: Yep. I just wanted to highlight the word transformation for a second. And the dictionary definition says, "transformation is a thorough or dramatic change in form or appearance. A transformation is an extreme radical change." And that's interesting, 'cause they say in form or appearance that you could have someone do a facelift that dramatically changes their face and the way they appear. But, has it been an internal transformation? Maybe, maybe not.   0:10:10.9 BB: Well, what's funny is, I mentioned that in previous podcasts, 'cause once a month for 17 years, I hosted an Ongoing Discussion where there'd be... I could have you on as a Thought Leader on a topic near and dear to you. And we send the announcement out and people would call in and it took a few years for Russ to agree to do it. And then, he eventually did, and he did it every January. Typically people would, every month be somebody different. But once I saw Russ's excitement by it, then I said, "Russ, every January we're gonna have you", we did it for four years, and every January I'd fly out to Philadelphia and be with him. So, the last time I did it with him, we were in his apartment. We were sitting pretty close together over the small desk. And in the sessions, the term transformation came up. So, the last session ends, we did four one-hour sessions over two days. The last session ends. And I turned off my recorder. And I said, "Russ, it just dawned on me that you and Deming, you and Dr. Deming both talk about transformation".   0:11:26.8 BB: And I said, "Dr. Deming talks about a personal transformation - I see the world differently.” And Russ looks at transformation as an attribute of a solution. That “we used to do it this way, now we do it this way.” And so, his is not transformation of an individual, but transformation of a solution. And I said, I just... I threw it out as I just, "You both used the word, but you use it differently". And I said something like, now I was waiting to see what he would say with that. And he looks at me and he says, "I see no value in that conversation", which followed by "let's go get lunch."   [laughter]   0:12:22.8 AS: Exactly.   0:12:24.0 BB: And so I thought, oh, I was really looking forward to exploring that space with him. And I shared that conversation with one of his peers later that night. And he said, "He said that?" I said, "Not only did he say that", he said, "You know what? I really wasn't surprised". 'Cause Russ was... It seemed to be a little bit too abstract for him. Anyway, but it's, but he would've put it, "What is this transformation stuff?"   0:12:51.0 AS: That, it's interesting because sometimes we talk about the why isn't Deming more widely accepted and that type of thing. And I think one of the things is that he's driving for transformation versus I think majority of people are providing information and here's how you do Lean, here's how you do this, here's how you do statistics or whatever, and here's all the information. And then you use that to to make better decisions. I think Dr. Deming was never about being better in our decisions but about how do we transform the way we think.   0:13:33.9 BB: Yes.   0:13:34.8 AS: And also the second part is that the idea of shifting from transforming an organization to transforming an individual. I guess an organization doesn't transform unless the leadership has already transformed or is in a process of transformation. So, therefore targeting the individuals for trying to help them get a transformation ended up being the most important or first step, I'm guessing.   0:14:00.2 BB: Oh yeah. No, I thought it was just so neat to see that shift. I don't know if we've talked that much in these podcasts about transformation. I'll have to go back and check. But what we were doing within Rocketdyne to help differentiate, 'cause language is so important. What do we mean by transform? Because it's a very casually used term and I was trying to, you know, with colleagues at Rocketdyne trying to differentiate what Deming's use of that term. 'Cause we liked the term but the challenge became if we used it did it adopt a meaning that he didn't have in mind in which case we're off to the Milky Way.   0:14:48.8 BB: But what we did was try to differentiate physical change from mental, a physical shift from a mental shift. I guess to me a big part of what he is talking about is going from seeing parts to seeing systems to seeing things as being connected to start thinking about as Edgar Schein would as Peter Senge quoted Peter Schein, Peter Senge quoted Edgar Schein, "Culture are the assumptions we cannot see".   0:15:21.5 BB: And, so I was focusing on is we talk about, there's culture, culture comes from the assumptions. The assumptions come from beliefs and that's associated with our thinking. And that's the space that I think has... is the space to be to really believe, to really implement what Dr. Deming's talking about for all those benefits we've been talking about. And so the word, so in the training we were doing in our InThinking Roadmap, we differentiated reforming and we said "reforming is a physical change. Giving things a new name, adding more steps to the process. It's change you can, it's rearranging the deck chairs on the Titanic." And there's nothing wrong. You can move people together to be closer physically but that doesn't move them together mentally. So, there's a sense of we want everyone to be in the same room physically but they're... But you can hear they're in separate rooms mentally.   0:16:22.7 BB: And we've talked about this in a Me Organization I hand off something which is good to you and if it's not good, you give it back to me. If it is good, you say thank you and I'm separated. I am physically and mentally separated and there's nothing wrong with being physically separated I have to hand off to you. But how about an environment where I am mentally, we are mentally connected because we're thinking together. So if you come back to me and say, "Bill I'm having trouble getting these things together". And I say, "Well, hey I can, I..." not only do I understand that I caused that but I can possibly do something about that. That's the mental transformation piece. So there's... I look at it as there's nothing wrong. I look at it as there's a place for transforming, reforming, moving things to be closer, minimizing number of steps. Nothing wrong with that. But that's not what Deming was talking about. He was talking about transforming which is a change of how we see the world. How we hear the world.   0:17:25.3 AS: Yeah. And when I look at the System of Profound Knowledge and we look at Appreciation for a System, look at Knowledge about Variation and Understanding the Theory of Knowledge and then Psychology, I would say the one you mentioned about Appreciation of a System is the one that brings true transformation because we are taught to look so narrowly. And when we start to look at the bigger system it just blows your mind.   0:17:58.9 BB: Well, it's...it... No, I absolutely agree. I can remember in the early ‘90s I had met Dr. Deming once and I thought that's fascinating. And, I put it aside and got buried in the Taguchi stuff and then began to see the issues as I had mentioned in previous podcasts as well as today. And I started thinking there's, there's something missing. And, in the Taguchi school it was, we need more tools, more advanced tools. That's not about transformation. There's nothing in Taguchi's work that was about the transformation that Deming's talking about. And I'm not aware of that mindset. Well, I've not come across that mindset in many places. I don't see it in all the...a lot of the traditional improvement techniques whether it's Lean or Six Sigma or Operational Excellence. I don't see that, that focus. I agree.   0:19:07.6 AS: And, I bought this book Guide to Quality Control by Kaoru Ishikawa.   0:19:11.2 BB: Yep, yep.   0:19:12.6 AS: I got it in 1990. And, but it's a great example of, the objective wasn't a transformation. The objective was understand these tools and maybe that leads to a transformation, maybe not. That wasn't what he was aiming for. He was saying, "Here's the tools and here's how you can apply them".   0:19:32.2 BB: Well, I used to debate with some co-workers and his, one co-worker in particular. And his mindset was, focus on the tools, and the language, in the conversation we're having, his theory was, "Get people to apply the tools and the transformation will eventually happen". I had the same thought.   0:20:00.1 AS: If that was the case, we'd all be transformed already because we're all applying tools every day.   0:20:04.7 BB: And 'cause we, I had heard a comment, I was at a Taguchi conference and I heard a comment. And as soon as I got back to my office, and this gentleman we're both at work really, really early, we'd go down and get coffee at a quarter to six, go back and sit in his office for a couple hours and just have some great, great, great conversations. And I shared with him, I was at a Taguchi conference and somebody said, the reference was, "You wait for the... " It was something, "The journey begins after the transformation starts". And as soon as I said that, he said, "I think it's the other way around", that the transformation happens after. And I thought to myself, I knew you'd say that, because that was his attitude. Get 'em to use the tools, get 'em to use the tools, get 'em to use the tools. And I kept looking at it as, no, that does not. Yeah. I mean it doesn't mean you don't do it, you don't do something. But I think when you begin to see the world and hear the world differently as we're trying to convey, to me that's when the rubber really begins to hit the road. That's when you move. And again, as we talked, there's nothing wrong with tools and techniques, but tools and techniques are guided by your understanding of the system and the other things. And it's just not enough to be a tool head.   0:21:48.7 BB: Other things I wanted, oh, okay. [laughter] So let's go back the cloud model from number 16. And what I did not reference again, 'cause I went back and looked at it and there's what we shared, but what I wanted to add to it was, one is the idea learned from Barry Bebb that you're an individual contributor trying to get ideas up to the cloud, the cloud being the executives in their meeting space, and the idea of handing off to somebody above you. And then the idea that that transfer is going to take a few times from person to person to get someone in the cloud transformed with an appreciation. And relative to Deming's work, it involved the transformation.   0:22:34.9 BB: If it involves trying to get Dr. Taguchi's up to the cloud, ideas to the cloud, manner involve what we're talking about relative to Deming's work, fine. But the other aspect that I then neglected to mention is what Barry's talking about is, is once it gets to the cloud, then what rains down on the organization is the beginning of, in our case, transforming the organization. That's the raining down. So the cloud is not just that place on high that things get up to, but the idea of a cycle that things then start to flow down. And so, I mentioned, you know, I got back from that very first meeting with Barry and went into my boss's boss's office and that I had had that meeting, and little did I know what I was gonna learn from Barry.   0:23:26.8 BB: And learning from Barry, you either go back to... You have to be in your organization, find somebody higher, and immediately I thought I wanted that person to be Jim for his influence. And so I would meet with him on a regular basis. And, and what I was looking for is, what could he and I do together? Because some things take time and some things can be done tomorrow. So I would go into him once a month with some ideas, give him some status of what's going on. So one time I went in and I had an idea, I'd mentioned to him that after every launch of a rocket with a Rocketdyne engine, there'd be a loud speaker announcement. And the loud speaker announcement might say, "Congratulations to the Space Shuttle Main Engine team for a job well done.” Congratulations to the Delta team for the engines made for the Delta vehicle or to the Atlas program.   0:24:24.3 BB: And what I shared with Jim is that I had mentioned that loud speaker announcement to a friend in facilities who was a manager in facilities. And I said, "How does it feel when you're in facilities and you hear that announcement?" And her comment was, "You get used to it."   [laughter]   0:24:43.9 BB: You get used to being ignored. Well, I mentioned to a friend in HR, and he shared with me every time he would hear that announcement in HR, he said he and the guy on the other side of the cubicle wall would stand up and give each other a high five and say, "Way to go", 'cause they were not in the announcement. So I went in to see Jim and I said, I mentioned the woman's name. I said, she said, "You get used to it." And he looks at me and he says, "I want everyone in this organization to identify with every launch." He said, "I don't care if you're in janitorial services cleaning the restrooms." He said, "I want everyone to identify." Well then I said, "Well, that announcement doesn't." And I said, "Could we change the announcement?" And he was about to write it down and he says, "Well, we can do that right now." I'm thinking, "Oh, baby." [laughter] So he calls up the Director of Communications who sits across the hall from him and says, "Would you mind coming to my office for a minute?" Okay. So the person comes into the office, he says, "Do you know Bill?" And the person said, "Yeah, I know Bill". And Jim says to this person, "Could we change the loudspeaker announcement to say from now on, "Congratulations to Team Rocketdyne?" And she goes, "Sure, Jim, we could do that." [chuckle]   0:26:17.9 BB: And so, I had a Taguchi class later that afternoon, and somehow I mentioned the announcement. I didn't mention what I had done, but I somehow made reference to it. And people were used to that. And I remember saying to them, so what if you aren't on one of those teams? And people just said... This is how we operate. It's part of the culture to celebrate those individual teams. And I remember saying to them something like, "Well, if that announcement ever changes, call me," or something like that. It was something like that. And sure enough, when the announcement was made within a week, but I felt it was something, I was looking for things that I could do to influence the culture. Little things that ideally could be, and you know, I was also appreciative of what could Jim do? Now, several years later, the announcements went back to what they were. I'm not quite sure why, Jim had moved on. For all I know the programs were tired of “Team Rocketdyne” where, Team Rocketdyne, it's Team Space Shuttle Main Engine. And so some of the people complained to me that the announcement had shifted, and I turned to one of them and I said, "You go and fight that battle". I said, "If you want it to change, you go, go let the communications person, you go fight for it". And the thing I'd like to, a couple other things I want to point out before we get into the features is...   0:27:55.9 AS: Just so you know, we only got, we got less than 10 minutes, it's a tight show today.   0:28:00.7 BB: Alright. Let's jump. Let's jump to Diffusion From a Point Source, Andrew.   0:28:04.2 AS: Yep.   0:28:05.4 BB: So my Master's thesis back in the, was right around the time of Three Mile Island, I was writing my Master's thesis. And for those who may not recall, Three Mile Island and somewhere in the hills of Pennsylvania was a nuclear reactor that nearly melted down and diffused. [chuckle] If things had gone worse, it would've diffused a lot of bad radioactivity downstream from a stack, from a point. And so, my Master's thesis was looking at diffusion, how very much like that. And what was funny is I would explain to aunts and uncles and family members, "What is your thesis about?" And I say, "Well, remember Three Mile Island? I said, what I'm trying to do is model how it is, how does that radioactivity spread out downstream? How does it go wider and wider and higher and higher? How does it spread like smoke does if you blow out a match and how does that spread?" That's diffusion from point source. And part of what I had in mind with that topic for the audience is for each of us being a point source on our respective organizations and how are we diffusing what we're aware of within the organization, which in part has to do with being a transformation agent or an agent of, playing a role in the organization.   0:29:32.7 BB: The other thing I wanted to point out is in, in my engineering studies, and the equations that we would use about diffusion, um, has a role here. And if you think of a bathtub, so I imagine you're in the bathtub, you've got hot water coming in and the heat from that water coming in. And I'm trying to think, yeah, imagine the water is lukewarm and you're laying in there and you want it to be warmer, so you crank up the temperature. And then you can begin to feel that hotter water hitting your toes and then spreading it - diffusing. And there are mathematical equations I was studying that have to do with that. And what the equations are about is how does the temperature at any point in the tub change, and how does it change throughout the tub? So there's two aspects of change, at a given point, how is it changing over time? And then how is that change spreading until it starts to fill the entire tub? And so it could be you've got a 100 degree water coming out or 120 degree water, and in time the entire bathtub is 120 degrees, in time, which means the diffusion has stopped because it's all the same.   0:31:04.0 BB: And then, a couple hours later, it's all about the room temperature. Well, the analogy I wanna make is imagine going off to a Deming seminar all excited by what you've learned, and you go into your organization and you try to diffuse these ideas or, or another way of looking at it is, I would be invited into an organization and present Dr. Deming's ideas. It's kind of a point source. And so the ideas come out and people feel that spread across the organization. But what tends to happen is within a week, everything's back to room temperature.   [laughter]   0:31:47.8 BB: And that's, and that's the idea being, Deming's ideas come in or whatever the ideas come in, and then they're spreading in space and in time, and then we're back to where we were before. What I was very excited about, most fortunate about, and what we were doing at Rocketdyne is that what's missing from that equation that I just explained to you is a point source. And so when you're modeling, when you go back to the thermodynamics laws that I was modeling, if in the bathtub, there's a... If you've got a source of heat, you're generating energy in that environment, then the bathtub's going to get hotter and hotter and hotter and hotter and hotter. But without that point source, that source of transformation, which is constantly going on, everything goes back to room temperature. So what we were trying to do at Rocketdyne was, how do we take the ideas we're given, integrate them with Ackoff's ideas and Taguchi's ideas and try to create...   0:33:04.1 BB: Not let things go back to room temperature, but what would it take in conversations amongst ourselves and sharing that with others, that we had a constant source of energy, which gets things hotter and hotter and hotter and hotter and hotter. When it comes to Three Mile Island, the point source was an out-of-control reaction. But what we were trying to do is create a, have an environment where a lot of energy was being created, and that led to rethinking what these ideas are about, bringing others into the room, whether it be Ackoff or others. And I find without that, eventually things just go back to normal. And so what is...   0:33:50.8 AS: And what is that back... The back to normal thing, is that, like if we think about gravity as a law, it's naturally gonna pull things back to Earth.   [chuckle]   0:34:04.7 BB: If you go back to room temperature, you go back to where you were.   0:34:09.3 AS: What is it that brings humans back? Is it the...   0:34:12.2 BB: Well, you end up, you go back to blaming the willing workers for the red beads. You go back to all the things that Dr. Deming's trying to pull us away from, and there's this natural force to pull them back to that, you end up with a change in management. Dr. Deming's 14 points of lack of constancy of purpose. And so what we're talking about with Deming's ideas is a source of ideas, energy to transform. And what we're fighting is, individually that we stop learning, individually we stop sharing, individually we stop doing something with it. And so you just unplug the point source and you'll be back to room temperature pretty quickly.   0:34:55.5 AS: So how would you... What is the main message you wanna get across to the audience about this as we wrap up?   0:35:03.0 BB: Message is, find a peer group that you can discuss these ideas with. And that's what's missing is find people you can discuss, listen to the podcast, pay attention to DemingNEXT, find people to share the ideas with, and out of it will come more energy. And, but the idea is that don't stop learning. Don't stop sharing. I am very fortunate that every day I have conversations with people around the world, and it's causing me to reflect on things that happened. And to me, it's helping me stay engaged, keep rethinking what the ideas we're talking about. And so the idea is that I think without that, then individually we go back to room temperature, we go back to where we were before we started exercising. And, but I think what I would like to think is that people listening to this podcast can find again peers to share it with and on a recurring basis. And so again, I'm talking with people around the world every week, and to me that's, part of this is what we're doing at Rocketdyne with these monthly phone calls is just staying engaged, staying in the game, staying in the game, staying in the game. So that's the diffusion from.   0:36:24.7 AS: And to bring it back to the beginning of our conversation, I think that, I guess transformation is when you don't go back to room temperature.   0:36:36.0 BB: It's an ongoing transformation. And this is... There's very few things Deming said I disagreed with. One of them is, and [chuckle] he said, "An individual transformed will create an example". I don't think there's any such thing as an individual transformed, I would say an individual, once their transformation begins but I don't... But thinking in terms of, "once transformed," and I think I mentioned on the podcast, 'cause I had a student in Northwestern years ago, and they're doing presentations at the end of the course on how the course hass impacted them, taking notes from their daily journals. And there were a group presenting that night. The other group was gonna present the next night. So one was anxious, one was calm, and I went up to one of the calm students and I said, "Yeah, so what's new?" And he turned to me and he said, "I'm fully transformed".   [chuckle]   0:37:34.3 BB: No, what we're talking about Andrew, is there's no such thing as... Because there's, if you understand the point source concept, there's no "fully transformed."   0:37:43.1 AS: Yep, that sounds...   0:37:44.6 BB: So then the question becomes, how do we enter and individually stay in that group?   0:37:51.4 AS: So transformation is an ongoing journey. Bill, on behalf of everyone at The Deming Institute, I wanna thank you again for the discussion. And for listeners, remember to go to deming.org to continue your journey. And if you want to keep in touch with Bill, just find him on LinkedIn. This is your host, Andrew Stotz, and I'll leave you with one of my favorite quotes from Dr. Deming, "People are entitled to joy in work.”

In this episode, John Dues, part of the new generation, discusses healthy goal setting through a Deming lens. He challenges the desperation behind typical goal setting in organizations and emphasizes the importance of understanding process, variation, and stability before setting goals. The conversation delves into the complexities of goal setting in education, system design for improvement, and analyzing data patterns for system stability.

Bill Bellows, a seasoned expert on Dr. Deming's philosophies, dives into the intricacies of organizational transformation. He discusses the 'Cloud' as a metaphor for corporate hierarchies and emphasizes the need for ideas to penetrate this top layer. Bill argues for collective responsibility over individual blame in addressing human error and highlights how anyone can inspire meaningful change. The conversation also touches on mentorship, effective communication, and the role of music in fostering innovation and empowerment within teams.

What does it mean to "commit" to transformation? What does "transformation" mean? In this episode, John Dues and host Andrew Stotz discuss Point 14 of Dr. Deming's 14 Points for Management - with John's interpretations for educators. TRANSCRIPT 0:00:02.2 Andrew Stotz: My name is Andrew Stotz, and I'll be your host as we continue our journey into the teachings of Dr. W Edwards Deming. Today I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. This is episode 20, and we are continuing our discussion about the shift from management myths to principles for transformation of school systems. John, take it away.   0:00:31.1 John Dues: Hey, Andrew. It's good to be back. Yeah, we're on principle 14 today, which is Commit to Transformation. So I'll just start by outlining the principle itself. So Commit to Transformation - "clearly define top management's commitment to continual improvement of quality and its obligation to implement the 14 principles, plan and take action to put everyone in the organization to work to accomplish the transformation. Transformation is everyone's job. Start with education for all and positions of leadership." So, basically, we've been through these 14 principles, and the final one is, put it into action, basically. So I think a good place to start is just remembering or recalling what does Deming mean by transformation? And he's saying transformation is a change in state from one thing to another. So we're going from one thing to something completely new, and there's these 14 principles that help us get us there.   0:01:34.9 JD: And of course, when Deming was talking, he was talking about the prevailing system of management and changing into this new system of management and about this sort of, older version, this prevailing style from 30 years ago, which still is the prevailing style today. He said something that was really interesting. He said, it's a modern invention that cedes competition between people, teams, departments, students, schools, universities. And so when... What he is really saying is that when you transform your organization, you work together as a system. And he is advocating for cooperation and transformation. And I think of course, people are gonna say, yes, absolutely, we need to cooperate. And that's, that's the way that everybody wins. But in reality, I think that's not always what's happening in organizations because I think what you need in order to go about this switch is what Deming called Profound Knowledge.   0:02:41.5 JD: And most people don't have an understanding of, of what that is. So what happens I think is that the prevailing style of management, it's rooted in those management myths we've talked about before we started the principles. And it's sort of this false foundation for your organization. But that's where I think most people, people are. And so part of this commitment is then if we're gonna commit to transformation, there's some things that leaders have to realize, and then there's some steps you have to take if you're gonna sort of go down this path. I think the things that you have to realize as a leader, and these are things that are true for me as I continue this process and my organization is number one, there's gonna be a struggle. There's gonna be this struggle over every one of the 14 principles because it's so different from what we're doing today.   0:03:39.1 JD: I think another thing we're gonna have to realize is that this can't be one or two people at your organization. The entire leadership structure at your organization, it's gonna have to be educated in this new way of thinking, and then you're gonna have to bring along the entire organization. And this can be a challenge because if you are the person doing this at your organization, you very well may be fairly new to this new way of thinking, this new philosophy yourself, unless you've brought in someone externally to help you through this. And even if you do that probably for a good portion of the time, you're gonna have to be leading this before you may be feeling like an expert yourself. And that was definitely true in my case. But I think the emphasis in this initial introduction is that you gotta get that system's view and you have to help people understand the theory of variation.   0:04:43.0 JD: So that has to be sort of initial part of that introduction. And then of course, you have to take your organizational context into account and so how this sort of rolls out or plays out, it's certainly gonna vary by size of organization, by organizational type. But the good thing is, is regardless of size or type of organization, industry, sector, whatever, Dr. Deming offered several steps to get started in this process. So I think maybe as a start to how you commit to the transformation, if you wanna go down this route, it might be helpful to sort of outline those steps first.   0:05:24.8 AS: Definitely. And it just, the idea of everybody, being committed to the transformation, like this isn't something where you can say, well, maintenance department doesn't wanna do it. [chuckle]   0:05:36.4 JD: Right.   0:05:38.3 AS: Or the third grade teachers don't wanna do it, but the sixth grade do. So that's... Of course things can start in kind of piecemeal as they they go, but it is a true transformation. The other thing that's interesting is if you have a situation where you have been through a transformation as a unit at a school or as a company, it's also possible that a new person could come in and destroy that transformation real fast. And I have an example of a company that I've experience with where they had implemented the Deming principles to an extreme level, and the CEO resigned eventually. He was older, a new one came in and he said, I'm not in that school, I'm not in that camp. I got a new idea. I got a different idea. And it went right back to the prevailing system of management.   0:06:35.9 JD: Wow. That's really interesting. On the first point, I think, you're not necessarily gonna get all the departments or everybody at once. Obviously it's gonna be a process. On the second point, I think that actually is a good segue into step one because basically what he says, and I've translate this for education environment or education audience, but he basically says the school board and the superintendent have to study the 14 principles. Understand them, agree on a strategic direction, and then make a deliberate decision to adopt and implement the new philosophy, so why bring this up now? As I follow on to your comment there is that it seems to me that well, assuming that this was a company that had a board, then what that board should have done is include something about the System of Profound Knowledge and the job description for the new CEO. That's interesting that they didn't make that a point of emphasis.   0:07:41.5 AS: I think what's fascinating to me about it is that I think on the one hand, cooperation and working together and not living in an environment of fear is kind of our normal state, I would argue, but society just pushes us in so many different ways, that all of a sudden you find yourself in a very different state. And another example of that is how KPIs have taken Thailand in particular by storm, and now all of a sudden you have people who have been very cooperative in the way that they work together, all of a sudden pitted against each other, and it's so painful for them, because it's not the way that they naturally operate.   0:08:33.5 JD: Interesting.   0:08:35.3 AS: And so yeah, it's just... I think you gotta work. And I guess the thing you're saying about the board is that you really gotta work to make sure that this is something precious, and you could lose it in a blink of an eye if you don't...   0:08:52.4 JD: Yeah, yeah, and I'm not hiring a CEO obviously, but I have started including... I don't use System of Profound Knowledge, I don't use that terminology when I write job descriptions for people on my team, but what I do say is, what we're looking for is someone that can think in systems, understand variation and data, run small experiments to find out what works and do that with sort of like while working with people in a cooperative fashion, so I've sort of incorporated the four elements of the System of Profound Knowledge in the job descriptions for people that I'm hiring on my team, so then when I actually do use System of Profound Knowledge, describe the elements once they're on board, it's not a surprise 'cause it was a part of that hiring process. And part of that, even the job description itself, but step one basically is so that, you know, if you do have it at your organization, it includes both board and sort of the senior leadership being bought into that philosophy and that's not a guarantee, but at least if both components have that then if that CEO moves on, maybe it's more likely to continue on in your organization.   0:10:10.4 JD: That's step one. Step two is interesting, Deming basically said that the board and the senior leader or the school board and the superintendent in my case, must feel he said a "burning satisfaction", sorry, "burning dissatisfaction" with past procedures and a strong desire to transform their management approach, so it's almost like you almost have to be hitting your head against the wall, you have to be looking for something, because what he goes on to say is that you have to have the courage to break with tradition, even to the point of exile among peers, as you're going through this transformation process, because from an outsider looking in, if you're adopting the Deming philosophy, much of the stuff is gonna look so different that people are gonna be asking you, what exactly are you doing? And this has happened repeatedly. Not, not, I don't think that to that extent that I've been exiled, but for sure people will be like, well, I don't understand why you're just not setting a goal, just tell people what the goal is and then let them get out of the way and let them achieve it. That's not the approach with the Deming philosophy. So you have to...   0:11:33.2 JD: Again, for me, it wasn't exile, but constant pushback, questioning, why are you saying this, why are you operating in this way? I don't get it, why don't we just tell departments what their goals are and let them all meet them, those types of things, the typical way of operating, and it does take a lot of time and energy to explain that, but that's a part of the process.   0:11:55.1 AS: It reminds me of working with alcoholics and drug addicts, generally, they don't turn around until they've hit a bottom.   0:12:04.8 JD: Yeah. Yeah.   [overlapping conversation]   0:12:05.4 AS: And they have a burning desire.   0:12:05.6 JD: Learning to satisfaction. I think that's right, and I think from the standpoint of someone that's really motivated to look for something new, look for a different way of doing things, that's not all together a bad thing, that they've sort of hit rock bottom. Step three is, again, it seems common-sensical. But even here, even as I was going through this, it was sort of a reminder of a number of things that I need to do on a regular basis, and one of the things he said in step three is that once that sort of senior leadership team, the board, the superintendent, whatever that make up is that your organization is that then you have to go out and explain, whether it's through community meetings or seminars or whatever to sort of a critical mass school system staff, he said, students, parents, why you're going on this transformation, why you're... This change is necessary. And then actually educating your people across the organization, what is this philosophy, what is the System of Profound Knowledge? What are the 14 principles? What are the typical ways that we work? Why are those management myths don't work.   0:13:36.4 JD: You gotta go out and do all of these things. It's gonna be a completely new language, a completely new operating for most people, and it has to be a part of the process, bringing people along and this... I think this isn't an overnight process, obviously. Deming said no instant pudding. He generally said, I think transformation was a five to 10 year process, depending on the size of your organization, but I've definitely found that to be true. There's fits and starts, there are some things that you seem to be able to sort of put in place pretty quickly, and then there's other things where there's a couple steps forward, a couple steps back, and you gotta bring people along, people turn over, you gotta re-educate those types of things. So it's a process. It's definitely a process.   0:14:27.4 AS: I was thinking about. I can't remember whether I heard Dr. Deming said that or whether it's somebody, or I read it or somebody told me, but that somebody asked him, "How long has this transformation take?" And he said, "Well, it can take as long as 10 years or as short as 10 years."   0:14:49.8 JD: [laughter] Yeah, so no matter what. It's a significant amount of time. There's no doubt about it. Step four, he basically says that every job and every activity within the school system or your organization is a part of this process that can be improved. And he talks about using flow diagrams for important processes within your organization so that people can see that this is about optimizing that whole system, and not the individual stages. But he really wanted people to see visually, even if it's just a simple sort of flow diagram, how one stage connects to other stages for us, maybe it's the teaching and learning process going from kindergarten to first to second to third grade.   0:15:37.3 JD: That again, seems obvious that that should be how the system works, what I think is less typical and common is actually doing activities from a systems thinking lens, where you are making sure people understand that the kindergarten teacher is also serving the first grade teaching team in addition to the students and families in their classroom and simple things like we have two elementary schools, two middle schools, do the middle school principals leave their school at some point and go to the elementary schools on their side of town and introduce themselves to the fifth graders, so things as simple as that is what I'm talking about.   0:16:28.8 JD: There are lots of other things. For sure. But how often does that happen? In some places, it may be fairly typical, in other places, it's not happening at all, but in the case, even where it's happening, do you explain why it is that you're doing this activity. Are people making that connection that they're part of a bigger system. I once consulted at a very small rural school district here in Ohio, and when we talked about systems, they just had two buildings, they had a sort of an elementary building and then a seven through twelve building. And talking to people, they said, I've never been to the high school - an elementary teacher, I've never been to the high school. And so people may say, Well, that seems strange. But when you were in the school system, it is very difficult sometimes to get out, so you actually have to make it... The leader has, or the leaders have to facilitate this, bring this about... There has to be some coordination of efforts, so that's step four. I think step five is you have to teach and then utilize the Plan-Do-Study Act cycle. You have to use it as a procedure to learn how to improve the organization's processes.   0:17:48.1 JD: I think that we've talked to your... And the Deming community is familiar with the Plan-Do-Study Act cycle, PDSA cycle, but most people aren't. Most people don't have this... Some people might call it sort of like a scientific thinking approach to testing ideas and see if they work, but most people don't approach change like that. They just try something, there's no system for collecting data, a lot of times it's just sort of a mass implementation, there's no process for testing on a small scale, seeing if it works, getting feedback on a short time frame, like a week or two weeks or three weeks, and then trying that next test. So that's, that's in terms of putting the Deming philosophy into action, I think that's a critical part using the PDSA cycle.   0:18:44.0 AS: Yeah, I'm just thinking about my Valuation Masterclass Bootcamp, and we're just about to start our round 13. And so having taught it 12 times before, but part of our PDSA, part of our process of understanding the cycle is that, at the end of every bootcamp, every single student gives us their recommendations for improvement. And we do it through a survey where they're all excited at that moment in time, because they're at the end of the process, but they've gotta go through the survey. And they give some great ideas, and then we capture all that into a document, and then we go through it and we see there's some ideas that just seem like obvious we should have implemented that a long time ago, or we knew. And then, so we say, okay, how do we implement this? But then there's others that are also a question. Right now, one of the ideas is to do one of our class sessions per week as a live session.   0:19:52.4 AS: And it's the feedback session where students get feedback, and in that case, people from outside can watch it. And it has some benefits. There's a marketing angle to it for us, but also, there is the excitement of showcasing your work and all that. But on the other hand, it could be terrifying and it could be that it doesn't do what we think. So in the end, we asked what is it that we think we would want from this as an outcome? And then we said, why don't we just try it one night in week four? And so we've set up that we're gonna do it on one night, we're gonna prep them ahead of time, and we're gonna see how it goes. And if it produces the effect that we want, which is, we think it's gonna up the intensity in, all of that, that it's gonna work. But if not, then we'll abandon it. And so that's a little bit of our little PDSA thinking on how do we test out an idea and see the result of it?   0:21:00.5 JD: Yeah, I love that. I love that because it's not... We're gonna just do this new thing in our course. We got this feedback, we're gonna just do it. We're gonna actually test it on a very short cycle, one session and get the feedback back right away to see if this works. And if it does, we're gonna do more of it. And what's likely gonna happen is you're probably gonna learn something, and you're probably gonna have to sort of change the approach a little bit, and you're gonna do it again and again and again until this is... Assuming the feedback is positive, then you'll do more and more of it. And, you know, if it doesn't work, then you'll learn that in a very quick, easy fashion and you'll know not to do, you know, more of that thing in your course.   0:21:44.2 JD: So I think that's the exact type of thinking that Deming was trying to get us to do, to improve our organizations, versus this sort of plan, plan, plan. We're planning these grand changes, then we put them in place, and then they don't work out like we thought, and then all of a sudden, we've had this significant investment in time and/or resources and sunk costs. And maybe we even keep doing it because we feel like we can't make a change at that point. So that sounds...   0:22:12.1 AS: Iterate, iterate.   0:22:12.2 JD: Iterate. Yep. Small, small, small test of change. So that was step five is use the PDSA cycle. Step six I really love, he says, Deming says, "Transformation is everyone's job." So no matter who you are in the school system, student, staff member, parent, you have to play a role in this transformation. And one of the ways that this can be set up is that you have these cross-functional teams on which parents, students staff members from various departments can be set up to work together on a problem. And one thing that we're doing right now, we have a new position in our network called Network Medical Coordinator. We're very fortunate. We actually have a pediatrician that's on staff, and one of the projects she's working on is critical care. So basically, when students require some type of critical care at school for something like, let's say diabetes, that's not something schools are used to sort of dealing with or maybe don't typically have the internal expertise to deal with. And in this case, there's a team of people figuring out the best approaches for various critical care areas.   0:23:35.3 JD: And this includes the Network Medical Coordinator. It includes one of the operations managers at one of the schools. It includes a parent and some outside partners, a pediatrician from a local hospital, for example. So you have this cross-functional team that's coming together in a way that's not super typical in a school system, but for a very important reason, it includes these various functional areas. And I think the outcome, what comes out of this project is gonna be better because it's not just the doctor saying, this is what we're gonna do. There's the parent, there's the ops manager that understands like how the office works, and how kids come to the office to get this care and things of that nature. And so you have this sort of cross-functional team working in a way that's gonna improve our system. So transformation is everyone's job, putting everybody to work for the transformation is step six. And there's various ways to do that a cross-functional team is one of those areas or one of those ways of bringing that to fruition.   0:24:37.1 JD: And then step seven is interesting. He basically said to deliberately construct your system for quality with certain percentages of staff understanding continual improvement at different levels. And sort of the way we've characterized that is sort of everybody, the goal is to have everybody have sort of like a basic level understanding of continual improvement. And by basic level, everybody knows what a run chart is in our network. The goal was, so everybody can sort of put one of those together. That's a pretty simple chart. Everybody could put together a process map to understand how do we map out, how a process unfolds at one of our schools. So everybody sort of gets that basic level of understanding.   0:25:28.8 JD: And then there's this sort of next level, we call it intermediate level understanding. And basically, this centerpiece of this level of understanding is, this is maybe 25% or 30% of the people really understand the process behavior chart. They really understand how to construct a chart, interpret a chart, and understand data over time and how to use that as an improvement tool. And then at the advanced level, that's something we're still working toward. Maybe you have one or two people. We have about 120 staff members. We have one or two people that have an advanced level of understanding. And so an example there would be, someone knows how to run design of experiments, basically something you may use on a limited basis outside of like an engineering sort of setting. But it would be good to have some advanced understanding. But I think the biggest bang for the buck is at those first two, that everybody has a basic level understanding of certain tools and techniques. And then you have this intermediate group that really has an understanding of how to use the process behavior chart to drive change and bring about improvement in your organization. Those are sort of the seven steps. So sort of concrete advice on how to bring the 14 principles to life.   0:26:53.1 AS: How would you... We've gone through so much stuff in this series. How would you wrap it up? How would you... I guess the first thing is like, what is the core takeaways? And the second thing is like, what would be your advice to the people who've made it to the end of this, who are by this time in their own process of transformation at various stages. So maybe the sum up of kind of what's the core concepts you want people to know? And then the second thing is, how would you advise people to continue their journey?   0:27:29.4 JD: Yeah. I mean, I think, just like, I think step one was this does require study. But what I found is, reading the 14 principles is really helpful after you read about the System of Profound Knowledge, because the 14 principles are sort of a logical extension of the System of Profound Knowledge, and give you a little bit more sort of concrete sort of...it's not a list of do's and don'ts, it's not a recipe, but it's some concrete stuff that you can start to understand, okay, and this is how you actually put the System of Profound Knowledge into action. I think it also again, not a recipe, but the 14 principles do paint a picture for what a healthy work environment looks like. So I think that's really helpful to understand those things. They're not a checklist, they're not... The 14 principles aren't completed in sequence. Rather, they're this interdependent mutually supporting sort of set of guiding principles for system leaders that do help make that transition to the Deming philosophy a bit more concrete.   0:28:52.5 AS: And so for someone who's on their journey, they've been following this. What words of encouragement or words of wisdom would you provide for them?   0:29:11.4 JD: Yeah. It's like a two-parter. There's like, I just sort of reiterated, the study is important. This takes study. You're gonna have to dedicate time to this. You're gonna have to commit to understanding this first yourself, and then starting to sort of dip your toes in the water in terms of talking about this approach with other systems leaders in your organization. And that's sort of the long term play. On the short term, there are things you can do just to start to put the System of Profound Knowledge into action. And I think to me, that's also a good way to learn that doesn't take years and years. And I've said it before, but I think pick one thing that you wanna improve, let's say that thing is attendance rates in your classroom. And just start plotting those rates on a line chart over time. Just see what happens. Plot it over two weeks.   0:30:13.3 JD: So two school weeks is 10 days. Look at those points over the course of two weeks, and start thinking about what you learn when you see that pattern of your data, the ups and downs. Anybody can do that. Anybody can make a simple line chart. And for two weeks, just jot down, okay, on day one, 94% of the kids in my class came to class that day. On day two, it was 91%. On day three, it was 95%. I can start looking at that data over time. And then at the point where you've gathered that baseline, simply draw a vertical line and say, I'm gonna try something to improve this problem. I'm gonna plan it, I'm gonna do it. I'm gonna study what happens when I try this one small change, and then I'm gonna decide on the next thing to do, and I'm gonna do this with the students in my class. I think that's a way to put, basically combining that data over time with this small change, what I call a PDSA cycle, basically an experiment, that's the System of Profound Knowledge in a nutshell. And I think anybody can do that. And I think that both the long-term study and putting some of this into action right away are both sort of important ways that people can continue on this journey.   0:31:40.3 AS: I'll, I'll end on with little story. When I was 20 something, maybe 23, my grandfather passed away and my father and I, and the family went to the funeral, and it was my father's father. And we were in the car driving there, and I was sitting in the front seat with my father. By this time, my father and I had had, begun to have a really good relationship, a deep relationship. And I asked my father, "Dad, why is it that I haven't seen you cry when your dad died?" And he said, "I cried 30, 40 years ago when I lost him." And what he was explaining to me was something he never told me. And that was, that his father treated him in a lesser way. He just didn't pay attention to him. He didn't give him time. My grandfather was kind of a famous guy in the world of architecture and history, and I don't think that he disliked my father, his son. I think he just was so busy, he just didn't give time to him and he didn't really show that he cared.   0:32:56.1 JD: Interesting.   0:32:57.5 AS: And what I respect the most about my father was that, he made a conscious decision not to treat his children that way. He married a woman who believed that you don't treat people that way, but he also made a conscious decision, and it took effort. And it wasn't until as we started getting older that the fruits of that effort started to pay off. But I can say that my dad created a trusting environment. And when my dad was close to his death, I asked him, what was your biggest proudest moment in life? And he could have said my best golf game I ever did which he was, he was almost a professional golfer or the great accomplishments, he had in work and life and whatever. And he just looked at me and said, "I created a trusting family."   0:34:00.4 AS: And I think about when you're going into this world of Deming, you're going into a world of chaos, of grading and scoring people, and blaming and all of this crap that goes on in schools and in businesses. And Deming is providing us a way to think differently and provide a more of an environment that drives out fear and sees the potential of humans. And funny enough, you're gonna have to work hard to create that environment. And you're also gonna have to work hard to protect that environment.   0:34:37.5 JD: Yeah.   0:34:39.4 AS: And my dad was an example of somebody where I learned that you can do it, and you can change. And so that's my words of inspiration for everybody listening. You can make a major change and make it a lasting change.   0:34:54.5 JD: Yeah, that sounds like transformation. It sounds like he had the psychology component down too. He sounds like an incredible guy.   0:35:00.9 AS: Yeah. So, John, on behalf of everyone at the Deming Institute, I wanna thank you for taking this time to go through all of the stuff that we've been through over this time that comes from your book and your work, and your experience. It's very valuable. And for listeners, remember to go to deming.org to continue your journey, and you can find John's book Win-Win, W Edwards Deming, the System of Profound Knowledge and the Science of Improving Schools on amazon.com. This is your host, Andrew Stotz, and I'll leave you with one of my favorite quotes from Dr. Deming. People are entitled to joy in work.

In this episode, Bill Bellows and host Andrew Stotz talk about where and how to start using your new knowledge when you're learning Deming.  TRANSCRIPT 0:00:02.1 Andrew Stotz: My name is Andrew Stotz, and I'll be your host as we continue our journey into the teachings of Dr. W. Edwards Deming. Today, I'm continuing my discussion with Bill Bellows, who has spent 30 years helping people apply Dr. Deming's ideas to become aware of how their thinking is holding them back from their biggest opportunities. The topic for today in episode 15 is Start Where You Are. Bill, take it away.   0:00:25.0 Bill Bellows: Thank you, Andrew. And for our audience, you may notice there's a different background. This is not a green screen. This is actually a bedroom at my in-laws in upstate New York. Hey, Andrew, I've been listening to some of the podcasts, and I've collected some data on each of them. Would you like to see it?   0:00:53.0 AS: Yeah, definitely.   0:00:54.2 BB: I've got a control chart, I've got a control chart for each of the 14 sessions for how many times I say, holy cow.   0:01:02.9 AS: Holy moly.   0:01:04.4 BB: In each episode. Yeah, and the process is stable. [laughter] So I say holy cow, I think the average is 2.2, and the upper control limit is... I'm just kidding.   0:01:25.4 AS: You're a sick man.   0:01:27.7 BB: But I think outside of this podcast, I don't know if I use that expression. And I don't know where it comes from, I just, it must be...   0:01:37.7 AS: Did you grow up around cows? You said you're near where you grew up.   0:01:44.4 BB: Yeah, I am staying at my wife's sister's place. And my wife's father, when I met her, had cows in his backyard. And we used to chase the cows. When they got out, we would chase them. And let me tell you, they move fast. [laughter] And I came down several times, severe cases of poison ivy, trying to herd this one cow that was always escaping. And I thought, oh, I'll tell my father, let me go out and I can scare this cow back. Now, no the cow got the best of me. I got covered with mud and went home with poison ivy. Those things, they move fast. So that's my only personal experience with cows. [laughter]   0:02:33.5 AS: Did the cows ever go to a nearby church?   0:02:38.9 BB: No.   0:02:39.2 AS: To become holy.   0:02:40.1 BB: That's a good point? I don't... Yeah, how do those words tie together? I don't know.   0:02:43.4 AS: I don't know.   0:02:45.4 BB: I have to go find out who I got that from. So what I thought we'd talk about today is this, Start Where You Are, Start Where You Are. And first share where I... One context for that expression was the first time I saw Russ Ackoff speak, well, first where I met Russ. I had seen him speak before at a Deming conference, but I didn't get a chance to talk with him. But I saw him a few years later, and he was doing a one-day program in Los Angeles as part of a management series that he would do around the country. And there are about, I don't know, 150 people in the room, 25-30 from across Boeing sites in Southern California that I had invited. And at the end of the day, with about an hour to go, Russ says, okay, I'm going to give you a break. I'm going to give you time to formulate some questions and we'll spend the last hour discussing wherever you want to go. Well, I took the time to go up to Russ and ask him a couple of questions. I had met him earlier in the day. He knew that most people in the audience were there from across Boeing and that I had arranged them.   0:04:06.3 BB: And so I had a chance to talk with him. So I went up and said, I said I've got two questions for you that are not relevant to the audience, but I'd like to ask you one-on-one. He said, sure, go ahead. Well, no, I said knowing that you've known Dr. Deming for, since the early '50s, I said, over that period of time, what do you think he would say he learned from you that would stand out? And vice versa, what did you learn from him over those years that you would say stands out? And he looks at me and he says, well, I don't, I don't know what he learned from me. Then he says, then he answers the question and he says, he says, I think Ed, and he liked to say Ed, 'cause he liked to brag that, yeah, everybody calls him Dr. Deming. I call him Ed. I've known him since 1950.   0:05:05.2 BB: But Russ, by the comparison, if I ever introduced him to you as Dr. Ackoff, he would say, Andrew, call me Russ. So he says, relative to what he learned, what Dr. Deming learned from him, first he says, "well, I don't know what he learned from me. But I think his understanding of systems is very implicit and I helped him develop a better explicit understanding." And I think that makes a lot of sense. I think Dr. Deming's understanding of systems is a lot of what he talks about in The New Economics is what he learned from Russ. It's a very, I think you know when Dr. Deming shared the Production as a Viewed as a System that flow diagram in 1950, he always talks about systems, what comes around, goes around. But Russ was a master at systems from an academic perspective, and that was not Dr. Deming's forte. Now, when it comes to variation, that was Dr. Deming's academic forte. And that's where I would find Russ's understanding of variation, I would find to be very implicit, whereas Deming's was explicit. But anyway, he said he thought it gave him a better understanding of systems, that it was very implicit, very intuitive, and it helped him develop a better, a more academic sense of it. So I said, okay, so what did he learn... What did you learn from him? And he says, "well, I never gave that much thought to the whole quality movement.”   0:06:38.7 BB: “But he... I got a better, a warmer feeling of it." Russ would talk about quality of work life, and there's parallels with what Russ has talks about quality of work life that resemble Dr. Deming's work very well. And I'll give you one short story which ties in well with the Deming philosophy. Russ says he was at an Alcoa plant once upon a time, and he happened to be there on a day in which two workers were honored on stage in front of a bunch of coworkers with an award. Now, we both know what Dr. Deming thinks about giving people awards. So, but the fun part of the story is, Russ says he went up to these two guys afterwards, after they came down off the stage and he says, hey. And he says, and Russ was so precise with language. I mean, he walks up to these two guys and he says, ready Andrew? He says to them, I caught them at their point of maximum puffery. I mean, have you ever heard anyone use the word puffery...   0:07:56.7 AS: No.   0:07:57.1 BB: In a sentence? So he says, I walk up to these two guys and I said, I caught them at their point of maximum puffy. Right? And then he punctures them with the following question. "For how long have you two known about that idea that you were awarded for?" And they looked down at their feet and he said, "Come on, for, for how long have you had that idea before you shared it with management?" And they said, "20 years." And then Russ says, why did you wait so long to share it? And Russ says, he says to him, "Those sons of bitches never asked."   0:08:51.8 BB: And so, and Russ would talk about that as a quality of work life issue. Now, I've heard him tell that story many times, and I once asked him, I said, so what was the idea they came up with? And he said they would take these four foot wide rolls of aluminum foil off a machine, and these are the types of rolls that get used to make aluminum cans. And the roll may be, you know, so it's four foot tall. It's a, it could be easily a foot in outer diameter. And he said when they, when they're taken off a machine, they stand them on the concrete floor. And then to move them, the workers would tilt them back a little bit and then roll them.   0:09:43.9 AS: Which damages...   0:09:47.0 BB: The edge.   0:09:47.7 AS: Yeah.   0:09:47.8 BB: Exactly. So their idea was to, instead of putting them on a the concrete floor, to put them on a piece of plywood. So, what Russ saw was, which very much resembles a... The prevailing system of management where you're gonna wait 20 years before somebody asks you a question, until there's a program, until there's an award, then I'll come forward. All right, so let's go back to the audience. So I went up and asked Russ those questions, and now he is fielding questions from the audience. And one question really struck me and he says, Dr. Deming, not Dr. Deming, the guy says, "Dr. Ackoff," he said, "what you're talking about all day makes a lot of sense. And most organizations have little understanding of it, where you're just talking about, you know, managing interactions, the system, whatnot." He says, "but don't we have to wait for senior management to get on board before we do something with it?   0:10:54.2 BB: Don't we have to wait?" Right. And I'm listening to this, and I don't know what Russ is gonna say, but I'm hearing where the guy's coming from. And Russ turns right at him and he says, "Andrew, John, Sally, you have to start where you are." And I told him later, I said, I could've run up and given him a big hug, because if you're gonna sit back and wait for your management to get on board, you know how long that's gonna take? And so I just love that perspective of starting where you are. Now, let's flip to Dr. Deming, and a great quote that I like to use with students and clients with his work is "The smaller the system, the easier to manage. The bigger the system, the more complicated, but the more opportunities." Right? Now we'll go back to Russ.   0:11:54.0 BB: Russ would say, if you're a school teacher, like our daughter's an eighth grade teacher, start in your classroom. Why? Because you're not gonna start at the elementary school level or the junior high's, that's bigger than you. You're not gonna smart start smaller than that because then that's minimizing what your impact could be, but start where you are and then expand. Now, what that also means is it may be that when you start where you are, as you expand the size of the system, you might need to go back and change what you did now that you're looking at a bigger system.   0:12:37.8 BB: And so that's a great likelihood that what is optimum for you in the classroom may not be optimum when you're starting to think about the elementary school. But even if you start at the elementary school, what is optimum may not be optimum if you have the school district. So there's, no matter where you start, there needs to be an appreciation that in hindsight, what you did before may not be what's best for the bigger system. And the same thing applies when you're talking about integration. You know, Dr. Taguchi's loss function and the ideal value of a given characteristic, well, what I tell people is the ideal value depends upon the size of the system. And so if I'm designing two things to come together and I'm looking at the clearance between them, well, there's a clearance that makes it easy for these two things to come together if you're Andrew doing assembly. But let's say downstream of you is somebody who's using that product, you know, where that clearance is important, so the clearance that makes it easy to go together may not be the clearance that improves the functionality.   0:14:00.2 BB: And that will always be the case that you, that what is optimum where you are, may not be optimum when you expand the size of the system. So you have a few choices. One is, don't do anything. You know, for fear of making it worse, do nothing. Or, run a small scale experiment, use the PDSA model, try some things. But, that is still not a guarantee. 'Cause that small scale experiment still could be with me in my classroom and I run that experiment for a month, two months, three months.   0:14:44.4 BB: So even if I use that model, I can't know everything. And that's the... I mean, those are the complications of viewing things as a system, is to know that the system is not closed, it's open. I met a professor years ago at a conference and he had a model in his presentation that was very much a closed system. You know, they're working within this model, looking at these factors and these factors and these factors. And he went up after us. And I said, yeah, there's factors outside of that system. And he says, "Well, yeah, but we're just looking at this in scope." I said, "You have to frame it to a given size, but you know there's always the possibility that what's outside [chuckle] that you're not including, could haunt you for some time to come." And I didn't get the impression... I mean, it was almost like in engineering we talk about a free body diagram where you take whatever is your list you're looking at and you draw a line around it and you say, "That's the system I'm analyzing."   0:15:58.1 BB: But there's always a system which is bigger than that. And then again, bigger. So no matter where you start, again, and I look at the options are, if you're fearful of not including everything, well, then you're gonna do nothing. And that's easily what Deming and Ackoff were not saying. What they're saying is start where you are. Run experiments. Now, what I expect to be the beauty of a Deming-based organization, a "we" organization, is flexibility.   0:16:29.9 BB: And the flexibility is when things don't go as planned and we learn something, that we have the ability to reflect, note what we've learned, share it with as many people that we think could... would benefit from that. Get back on the horse and try again. I've worked with groups who were quite willing to do that. I worked with groups that were quite... They wouldn't get back on the horse. We were running some experiments dealing with hole machining of some small drills, you know, like on the order of a 16th of an inch, very small. And the experiment was, let's say eight... Seven different factors at two values each, eight experiments. And I don't know, they might've been machining in each experiment, 10 holes, say. And I wanted them to measure diameter of the top and the bottom of each hole, something like that.   0:17:29.3 BB: And I get the data prior to meeting with them. They sent me the data and I had enough experience running fractional factorial experimentation using Doctor Taguchi's ideas that upon first blush looking at the data, I either get a warm feeling or I get a queasy feeling. So in this case, I get a queasy feeling and there's... I'm looking at the data and immediately I knew this is... But I didn't know why. I just knew that, I'm not... And I'm wondering how am I gonna say this to them in the meeting? 'cause they're all excited. For a couple of them it wasn't their first study; they had done this before with great success. So I'm in the meeting and I'm listening and then one of them says, you know, in the experiment we're looking at starting each experiment with a new drill. And the experiments we're looking at different speeds of the drill, different cutting fluids, different parameters associated with machining these holes. And one of them says, they didn't... In hindsight, they didn't use a brand new drill for each experiment. So now I'm thinking, okay, say some more.   0:18:50.0 BB: Well, the drills we used in the experiment had all been used before and were resharpened to be like new, I mean, not new, but like new. And I said, "So say more." And then he said, "Well, when they looked at them under the microscope, the very tip of the drill was not in the center of the drill." 'Cause if you look at a drill, there's a cutting edge on the very top, you can say that near the left side or the right side. And those two cutting edges weren't the same length. So when the drill is cutting, it's not... The hole is not gonna be round, it's gonna have an oblong... So now I'm thinking, kind of explains the data. So he says, one of them say, "Can we salvage the data?"   0:19:45.3 BB: I said, no. And they said, why not? I said, because the assumption we had was that that the drills were reasonably the same. I mean, of course, even eight brand new drills are not identical, but now what you're telling me is the biggest source of variation is in the drills that we thought were the same. And that is wiping out the variation that we introduced. That's the issue, is that the signal coming from the drills that we didn't ask for is bigger than what we asked for. "So you mean we have to run all the experiments again?"   0:20:26.9 BB: And now they're, and I said, well, let me ask you this. So here's the good news. The good news is we didn't spend more time than we did on this experiment. That's the good news. I said, the good news is, we now know that the sharpening process needs to be relooked at. And as it turned out, probably the biggest thing we learned in the experiment, was that it ain't worth resharpening the drills. At that size, throw them away. But what I was hoping is that they would get back on the horse and go back to what we originally planned to do with eight brand new drills. It never happened. But we learned something, but what we learned is not what we had planned to learn. And that gets me to what I would tell people, is if you don't look, you won't find. But then you have to be willing to take the existing system and what is...   0:21:39.3 BB: Do anything, but that just means it stays the way... So if you don't look, you won't find. And if you do look, there's no guarantee. So that was a situation where I was very bummed. And every time, I mean, what I, one of the things I learned early on was preparing management and the team for such situations.   0:22:02.6 BB: That everybody was expecting, you know, a grand slam every single time. I said, no, that's not the way it works. In the real world, you try, you fail, you try, you fail, you learn, hey, you learn what we did here is that the sharpening process doesn't make sense. Had another experiment where, and I don't know which is, which was the bigger disappointment, but in the other one, there were 18 experiments with a lot of hard work, oh my God, and incredible precision as to how each of 1080 holes would be machines. So there were 1080 holes in a ring that was about eight feet in diameter. So there are holes about three tenths of an inch in this ring. The holes were all numbered one through 1080. Every hole had a different recipe. Somehow, the machinist wasn't informed of that.   0:23:08.5 BB: And the manufacturing engineer went to a meeting and he came back only to find out that the instructions, so machinists didn't know. And I said, "So, so what'd you learn?" He said "I learned not to go away to a meeting." So these things happen. Another thing I say in terms of starting where you are, my boss at one time knew I was involved in half a dozen to a dozen different Taguchi studies. And he calls me in one day and he says, "So how many studies are you working on?" I said, half a dozen to a dozen. He said, "Which of them is gonna have the biggest improvement?"   0:23:55.8 BB: So like the biggest... So I said, "So you mean like the biggest percent gain?" He says, "Yeah, which one's gonna have the biggest percent gain?" I said, "I guarantee you that we'll be smarter about everyone after we're done, I guarantee you that." He says, "But which one's gonna have the biggest percent improvement?"   0:24:17.2 BB: I looked straight at him, I said, if I knew the answer to that question, would I be working here? I'd be doing what you do, Andrew, I mean, financial forecasting. But he's like, "Well, don't give me that." I said, "I don't know which is gonna have the biggest gain, but I know we're going to be smarter. And I know all the things we try that don't have an improvement, we're smarter about it." But I said, "if you don't look, you won't try." So you have to start where you are. Another thing I want to point out is, and I wrote an article about this for the LEAN Management Journal, and if any of our listeners want a copy of the article, they can reach out to me on LinkedIn, and the article is about the, gosh, pragmatism. And viewing things with pragmatism.   0:25:15.3 BB: And I uh, and the possibilities of pragmatism, anyway, there was a lot of alliteration at the time, there was a lot of P's, 'cause what started dawning on me is this need to be practical, pragmatic. And I've got a dictionary definition, "pragmatic, dealing with things of sensibility, and dealing with things that are sensible and realistic in a way which is practical rather than theoretical," right? And where that comes from, in terms of starting where you are, is...   0:26:04.2 BB: Everyone is right. And there's a philosopher years ago that came across this. He says, everyone is right. And so everyone works in an organization where they believe, firmly believe that what they're doing is right, is practical, is pragmatic. And so in a non-Deming organization, would you work on things, Andrew, that are good and going well, that arrive on time, would you spend any time on those things, Andrew?   0:26:33.0 AS: No.   0:26:33.8 BB: And why not, Andrew?   0:26:37.0 AS: If it ain't broke, don't fix it.   0:26:42.1 BB: And that's very practical and pragmatic of you, isn't it?   0:26:46.6 AS: Exactly. I've got limited time. I gotta put out fires.   0:26:51.2 BB: Yeah. And that started to dawn on me, is that in a non-Deming "me" environment, working on things that are good doesn't add value. And so I thought, I mean, how do you argue with that? Now, in a Deming organization, it'd be pragmatic to work on the things that are not broken to either prevent them from breaking or to improve integration. And to not do so would not be practical. So there's two different environments of practicality depending on how you see the world. Um, oh, and last time I named the company, this time I'm not gonna name the company. So I was in an environment with a very well-known consultant.   0:28:00.6 BB: I was invited to travel with this consultant several times over a few years. I could take notes, I was given access to a lot of information on how these ideas were being used in the organization, but I can't talk about where it was, what they were doing, but it was really cool. So in one of the first scenarios, a team came in, led by this guy, and he presented to the consultant over the course of two hours a situation that he was dealing with. And teams would come meet with a consultant for a couple hours. This is one of the very first meetings, so that the engineer came in and said, here's where we are. We've got this issue. And the issue involved a commercial product with a... Let's just say, something about the product, how the customer interacts with it was very laborious. Let's just say like banging it together.   [laughter]   0:29:08.7 BB: It was very laborious. And the resulting warranty claims were on the order of $10-20 million a year in warranty claims. And the solution was kind of like giving the customer a bigger hammer, and actually along those lines. So that scenario was presented and that 10-20 billion at that time was a fraction of the total warranty claims for the company, which was on the order of 2-3 billion. So this was not the biggest issue, but it was a lot of $10-20 million issues. So the engineer proposes a solution, which I would paraphrase as: Spending, hiring someone to manage the variation in the parts that went together to mind the gap. And his theory was that if we minded the gap, we could make these things go together as the customer used it and get rid of all those warranty claims. So I'm thinking, hiring the person to collect the data because it definitely involved hiring someone to give them responsibility. Let's just say putting in place the use of control charts on the respective parts, minding the gap that, you know common cause variation and whatnot. So at that time I'm thinking, salary and benefits, that's maybe a $100,000. Saving the corporation $10 to $20 million. How's that sound, Andrew?   0:30:42.6 AS: Sounds good.   0:30:44.3 BB: Spent a $100,000, save $10 million. So the consultant says to the engineer, so what did the plant manager say? And he said, the plant manager says no. He said, why did the plant manager say no? He said, the plant manager said, why should I spend my budget to save the corporation?   [laughter]   0:31:08.4 BB: Now, if I told you the consultant's response, then you would know the name of the company. So I'm not gonna tell you what the consultant's response was other than the paraphrase would be, I thought you were looking at things as a system. Isn't that the company's slogan? He says, well, not quite. But if you're the plant manager, you're being practical. You're saying, why should I spend my budget to save the corporation? Does that get me promoted? Does that give me visibility or does it make my boss angry? In terms of starting where you are, this is a story you're gonna love. I had an intern one summer, his father was a coworker, he came to a class I was offering twice. 'Cause we allowed employees to bring family members and our vision was to get these ideas out there, fill the empty seats in the classroom. So one is we're filling empty seats, two is, the thought was if we bring in volunteers from the community, and that was a... The training was open to what we called members of the community. Members of the community are people who are working full-time, part-time to serve society. The fact that they work for, you know, General Electric or Lockheed Martin, that was not the issue.   0:32:28.1 BB: So you get to come in because you're a soccer referee, you're a Girl Scout leader, you sing in your church choir, we're gonna fill the empty seats. So this was not taking the space of employees. This is, we have employee space, we have customers, space for customers, place for suppliers, but we still have extra spaces. Let's fill those seats. Boeing's vision was to help the communities in which we live. So I went to my boss with this proposal and he said, go right ahead. And so the operational definition was we invited members of the community. A member of the community is someone who works full-time, part-time to benefit the community.   0:33:05.5 BB: So this, and also we invited family members. And so this guy brings his son in and it was an evening class and which, you know, second shift, which means it ends around midnight. And the one who came in, the son was a, graduated from high school two years early, one of the brightest people I've ever met in my life. And he's an economist by training. So he starts asking economic questions. And he brings up, because hears me talking about how, you know, this movement within Rocketdyne that moved from being a "me" to a "we" organization, the progress we're making, the improvements we're, you know, that we could at least properly talk about. And he says says in economic theory there's this thing called the freeloader principle. Have you heard of it? And I said, no. I said, how does that work?   0:34:00.8 BB: And he says, well, economists will talk about, there'll be people that do the work, and then people who want to ride the train for free. So in your effort for Rocketdyne to move in the direction of being, you know, more of a "we" organization, how will you prevent people from freeloading? And I said, it's easy. I said, everyone will see them and they will know we see them. [laughter] So what you have at Deming organization is, if I leave the bowling ball in a doorway without asking you, you have the visibility to see that. So anyway, he threw that question out. He contacts me a month or so later and he says, Hey, Bill, he says, I'm, I'm gonna be home from college for the summer. I'm looking for a summer job. If you don't, I dunno if you have budget, if you don't have budget, I'll work for free. So I said, I don't have budget. So I made a deal with him. I said, you can come and attend all this training that we're offering over the entire summer. In exchange, here's some things I'd like you to do. So I arranged for him to get a badge. He came in every day.   0:35:10.0 BB: Everywhere I did training across Southern California, he would come with me, be a fly on a wall. And he got to see some really cool stuff. Well, towards the end of the summer, around middle of August, he comes to me and he says he's gonna quit. He's done. Next week is my last week. He says, did I tell you about my other job? I said, no, what other job? He says, oh, I told, I guess I didn't tell you. He said I wanted to see during my last summer in college, 'cause once I graduate, I'm gonna go get a real job. So this is my last summer in college and I figured if the ideas I'm learning from you are worth anything, I wanna go see now. So I says, so what'd you do? He says, I've had a summer job applying these ideas, starting where he is.   0:36:02.6 BB: And I said, okay. And he says, I got a job at a Western Wear store, in Thousand Oaks, that had a sign, walked into the mall, saw a sign at the door looking for a salesperson. So I hired in as a salesperson. I said, so how'd that go? He said, well, the way it works is the salespeople rotate as to who gets the next customer. So there's like three salespeople at any point of time. While I'm working on this one, you sit behind the counter with the others,   just sitting there, you know, twiddling your thumb. So, I said, so, so what'd you do? He said, well, what I started to do was, instead of just sitting behind the counter, if I saw the person waiting on the customer needed a calculator, I'd have it ready for them. If I thought they needed a stapler, I'd have it ready for them.   0:37:00.0 BB: I said, holy cow. I said, what'd that lead to? He said, well, next thing you know, there's, we're doing that for one another. Well, he ended up, after about a month of working there, he was named manager of the store, as a walk-in. I said, how'd that work?   [laughter]   0:37:01.5 BB: How did you after a month become salesperson, you know, moved from being a salesperson to being a manager? He said, well, they keep track of who sells how much each week. You know, it's not a commission system, but they keep track. And because I had the most sales, I got promoted. I said, well, how did you get the most sales? He said, I started asking questions that I learned from you and Tim and the others in the training. I started asking questions about, so somebody comes in, they're looking for a suit, I'm asking them, what's the engagement? And the better I understand where they're coming from, the better I know, you know, you don't need to buy this, you can rent this. And so I started asking questions. The better I understand the questions, the better I'm serving them. So one is, I'm helping my coworkers.   0:38:08.3 BB: Two is, I have been named manager because I'm helping the clients understand...we're better understanding their needs. So he starts off as a salesperson, wins over his colleague and start mimicking his behavior, gets promoted to manager. Now, what he starts to do, in the manager role, is he, there's a, there's... He in the manager's role gets like 10% of all the sales above a certain value. So he starts sharing that profit with all employees on a prorated basis. And there's, the overall sales for the store have improved dramatically.   0:38:56.6 BB: Now he's gonna go off and work on this other big project which was his senior thesis, which also involved taking Deming's ideas and Ackoff's ideas and putting them into a company that he wanted to start. But before he did that, he hired another student, turns out a Stanford graduate, and brought him to class such that this guy could take over for him and keep this thing going. And I said, so are you gonna bring the owner of the store? And he says, no. He says, they have no interest. I say, so what's gonna happen after you leave and after Sam leaves? He says, this is gonna go back to zero. But he walked away having just tried to do what he could with what he learned that summer and made a difference from where he was.   0:39:45.7 AS: Well, that's a great point to end on. And the idea being that when you look around at your company, at your school, at your job, at your life, and you wanna start implementing these ideas, it can get overwhelming as you look at the bigger and bigger systems or other things. So the objective really is just start small and start where you are. Anything you would add in a wrap-up?   0:40:11.6 BB: Yeah. Another thing I'd like to add to that, have you heard the expression, management works on the system, people work in the system?   0:40:24.8 AS: Yeah.   0:40:27.6 BB: Okay. That's attributed to Myron Tribus. And people have said to me, Bill, management works on the system, people work in the system. Well, I've heard people use that expression as a means of saying, if you aren't in management, then you can't... Then just wait. Just wait. Because if you're a willing worker, Andrew, you're just a machinist in the factory, well, Andrew, you're not, that's not management. I mean, you're working in the system. The people in management work on the system. And so a disagreement I've had with some people is that if I was to believe that expression, then I would wait for management to take action. And that may take forever. And so...   [laughter]   0:41:23.7 BB: In fact, I had a guy who was working with Deming, or a guy who was somehow affiliated with some Deming consultants, and he came to a class at Rocketdyne years ago and he says, so Bill, how often do you meet with the president of Rocketdyne? I said, not very often. He said, does he support what you're doing? I said, of course he does. If he wasn't, you wouldn't be here and I wouldn't be here. But how often do you meet with him? I said, not very often. He says, you know what Myron Tribus says, I say, oh, no. What did Myron say? He says, Myron says, management works on the system, people work in the system. He says, you need to be meeting with him all the time. I said, he's in Washington DC trying to get us next generation contracts, and I think that is far more important a point of work for him than anything else. And he says, oh, no. He says, I think you're wrong. And I said, I look at him, I said, so actually, I said, I think there might be a bigger system.   0:42:27.0 BB: You know, it's something more important to do. "More important than working with the president of your company, Bill?" I said, "What if I am meeting with people at NASA headquarters? What if I am meeting with the Army's first [woman] four star general," which I had. I said, what if that? I said, "So you just want me to start, you think the system is constrained to me just getting the president smart?" And so there I would say is, one is, if you follow the belief, and Myron was brilliant, and I don't... But I think if you take that verbatim, management works on the system, people work in the system, now you're back to Russ Ackoff and that student asking the question, where do I... Yeah, don't I have to work for management to get on board? And I said, no. What I try to do in my classes and with clients is help people on any level get smart about these ideas, try to give them everyday examples that they can share with their peers relative to givng an everyday example of Dr. Taguchi 's loss function.   0:43:40.1 BB: Giving an everyday understanding of the difference between managing actions and management systems, so that individuals can become more articulate in explaining to others. And simultaneously, what Ackoff would say, the best way to learn something is teach it to others. And so, my hope is that people listening to our podcast, don't think you have to wait for senior management to get on board, start to make a difference from where you are, practice your understanding of these ideas, explaining them to people outside of work where you might be given more time to explain it than somebody at work.   0:44:18.3 BB: Use that experience to try to do something with it. Maybe the experiments you run are at home, in some manner. And hopefully that then inspires you to go a little bit further. And another thing I'll point out is in a future podcast, I'll talk about what I learned from a good friend on how to create change within an organization starting at the bottom of the organization, which gets into some more detail, but it's still based on the premise of starting from where you are with a theory and understanding that what people call practical, there's Deming practical and there's non-Deming practical. So if they're saying they're being practical, they are truly being practical, don't be dissuaded by that.   [laughter]   0:45:04.4 AS: Boom. Well, Bill, on behalf of everyone at the Deming Institute, I want to thank you again for this discussion. For listeners, remember to go to deming.org to continue your journey. And if you wanna keep in touch with Bill, just find him on LinkedIn. This is your host, Andrew Stotz, and I'll leave you with one of my favorite quotes from Dr. Deming, "People are entitled to joy in work."

What's the difference between education and training? Why is the distinction important? How does the Deming lens offer a new perspective on teacher effectiveness? In this episode, John Dues and host Andrew Stotz talk about why it's important to go beyond skills training and encourage education for personal growth.  TRANSCRIPT 0:00:00.0 Andrew Stotz: Here we go. My name is Andrew Stotz, and I'll be your host as we continue our journey into the teachings of Dr. W Edwards Deming. Today I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. This is episode 19 and we're continuing our discussion about the shift from management myths to principles for the transformation of school systems. John, take it away.   0:00:31.2 John Dues: Andrew, good to be back. Yeah, principle 13 today, Institute a Vigorous Program of Education. I'll just start by reading the Principle, "Institute a vigorous program of education and encourage self-improvement for everyone. The school system needs not just good people, but people that are improving with education. Advances in teaching and learning processes will have their roots in knowledge." It's interesting, when I was reading about sort of this particular principle, Dr. Deming took this actually pretty far when he was asked where would you draw the line? And he basically said, I would allow any educational pursuits that people are interested in. So that was his sort of take on this particular principle. But I think it's maybe the first thing is to differentiate between training and education. When he was talking about those things, we talked about instituting training on the job back when we talked about principle six, and he basically said the training is for a skill and a skill is something that's finite because it ends when performance has reached a stable state for a person when thinking about that particular skill.   0:01:51.3 JD: The differentiator with Principle 13 is that it's focused on education and it's meant for growth. And in the Deming philosophy, this is sort of a never ending process of education. So skills, so training is focused on skills, whereas education is focused on knowledge and theory. And this is really an important distinction in my mind, and you need both, training and education are complimentary components I think of an effective school system or really an effective organization in general. So I think, I mean, obviously training is important. It's something that's necessary, especially when you come into a new job. We have lots of new teachers that come to us 'cause we're a relatively young organization. And it's pretty typical for these new teachers to come even if they majored in education many times, they don't have sort of the basic classroom management skills, the basic lesson planning skills, the basic lesson delivery skills that they need to be successful in the classroom.   0:03:00.9 JD: So we have a training program, and in the absence of that training program the teachers would probably flounder or it would take a lot longer time to get their legs under them. So training is important, but we have to sort of shorten that runway. So we have to be good at training 'cause we're like a relatively young organization and we have students that come to us on average that are below grade level. And so they can't wait a long time for these sort of teachers to get up to speed. And I think we've talked about the fact that we have this sort of three week training program before the school year starts for new teachers for that reason. And so training is obviously important, very important. But I think what I've sort of come to appreciate is this idea of... And Deming stressed this, that leaders, systems leaders understand this idea of a stable system.   0:04:00.7 JD: One of the things that he said was that "The performance of anyone that can learn a skill will come to a stable state upon which further lessons will not bring improvement of performance." And this for me, reading Deming at this point in my career was really an interesting revelation because for many years I had heard sort of policymakers, education reform types sort of lament the fact that teachers improvement largely levels off in about year five of their career. Now, there has been some more recent longitudinal teacher research in terms of effectiveness over time. And basically people have found that that's not quite true. And that teaching experience is positively correlated with student achievement gains sort of across the teacher's career. But it's definitely true that the gains and effectiveness are steepest in those initial years.   0:04:55.2 JD: And so when you put those two ideas together that there's sort of this leveling off in about year five with Deming's sort of concept of stable systems, it really sort of dawned on me that it was this perfect explanation for this phenomenon. When a teacher is in their first five years there's a lot of foundational skills like the things I was talking about, like lesson planning, lesson delivery, classroom management, those basic things. There's sort of this period of rapid improvement or growth, and then it sort of levels off after you get the basics of how to be a teacher. And then after that happens, you have this... The potential for improvement sort of lies within the organization, within the system itself and not in the individual. So this really lined up with this thing I had heard for a long time, even though I think sort of it was misinterpreted.   0:05:52.0 JD: And I think a lot of those people that were talking about teacher skills leveling off after five years, they didn't have this lens of a stable system. They didn't have that part of it. And so they were saying, well, teachers aren't improving. Well, it really wasn't the teachers not improving. It was the fact that most of the capacity, like we've talked about here for improvement lies within the system itself and not the individuals. And I would also make the argument that this is not just educators, that this is other sectors as well, healthcare or whatever that thing is.   0:06:27.0 AS: Yeah. I mean, a good way of imagining that is a person who knows nothing that has the prerequisites, the education or whatever's necessary to get the job. And they know nothing about teaching and about the school system or anything that you can just imagine that so much of the initial phase is just understanding how the system, how they operate within that system to do certain tasks, which can be a process of trying to understand all of that. But then it's like they become, it's like entering the stream and then they become the stream floating down the river where everybody's kind of doing the same thing. And then you realize, okay, by this time now their, their, the amount that they can improve has been hit for some specific tasks and things like that. And then all of a sudden their output is a function of the system.   0:07:23.0 JD: Yeah. Yeah. And I think where this can really go off the rails is when people don't understand the stable state of systems. I think that, and I think a lot of the educators from reformers were sort of talking about it as if teachers were kind of replaceable because they didn't improve after those initial five years, especially 10 years ago that was sort of the common way people talked about this. And you could then sort of the next step is to draw the conclusion that experienced educators aren't that important since that improvement sort of levels off pretty early in their career. But I think that is the completely wrong conclusion to draw. I think experienced teachers are incredibly important because of the stability they provide a school. They can provide mentorship to inexperienced teachers, they have longstanding relationships with families as multiple students come through the system.   0:08:25.0 JD: That stability is really important for all those reasons, which are hopefully fairly obvious to anybody that's worked in a school. But I think even maybe more importantly is this idea that once teachers have that baseline level of knowledge and skills, they can run a classroom, they can deliver a well-planned lesson. The reason that it then becomes important for improvement to have those folks is because once those basic things are in place, now we can actually start to work on the system where the real potential for improvement lies. And I think that was a point that was missed or glossed over in a lot of those conversations about education reform and this idea of the teacher skills leveling off after year five.   0:09:23.8 AS: Mm-hmm. One of the the things about education that I have a story that's... I guess one of the conclusions is that the next level of improvement of the system oftentimes comes from outside the system. And that's where education takes the mind into another space.   0:09:40.9 JD: Yeah.   0:09:49.2 AS: From that other space, they're getting knowledge and theories of what's going on out there. And I had an example, John, that was... When I was the head of research at Citibank, and I had been head of research before taking care of a team of analysts, and analysts are always late in their reports, they're writing long reports about whether to buy or sell a company. They're trying to gather as much information, talk to the company, things get delayed. They set their deadlines and then they... The job of a head of research is juggling those delays so that the sales team and the clients need an idea day. And it's always the case that you're juggling around and okay, we don't have something this day, let's make something up with what we've got. Okay, this guy couldn't produce on that day, but he's gonna come in on Monday. So I felt pretty good about my skills at managing that process. And then I got a job at the number one foreign, the number one broker, let's say, or investment bank at that time in Asia called CLSA. And when I talked to them, I asked them how do you handle the flow and how bad is it here [chuckle] with the analysts being late? And they said, the analysts are never late.   0:11:13.3 AS: And I was like, that's impossible. My whole career it's been about handling the analysts being late. And they said, no, analysts are never late here. And I was like, how are you doing that? And they're like, well, we have a three week plan ahead. Everybody knows it. You know your day. There is no excuse, there's no shifting, there's nothing, it has to be delivered on that day. So it's up to you to kind of bring your project to a head so that you're ready to present on that day. And if you have some kind of major setback or problem, talk to another person and switch the day with them and sort it out. And every single day we had great stuff coming out. And I would've never, I mean, I was operating at a certain level thinking I was really knocking it out of the park, 'cause I was accommodating. I was careful, I was thoughtful. I understood the pressures that people were feeling. I was doing my best, but I didn't have a knowledge that it could be a very different way of doing it. And that's where I think about going outside of your own system to observe and learn and see. And then all of a sudden you're like, oh, [laughter] Okay. And that's where I feel like what you're talking about, about the education aspect is really the most amazing part.   0:12:33.2 JD: Mm-hmm. Yeah. That actually... I hadn't planned to talk about this, but I've been reading recently about the... Called the... Well, there's a book called Toyota Kata and Kata is from martial arts. It's the various movements that you have to do sort of repeated deliberate practice so you can sort of, they become ingrained in your muscle memory. Well, the same idea is in place in Toyota. They call... Well, they don't, but the author called it... They don't call... They don't have a name for it, but he sort of observed it and gave it the Improvement Kata name Mike Rother. Yeah, there it is. Yep. There it is. That one. And one of the things that was interesting, and it kind of reminded me of this as you were talking, is that part of the improvement kata is there's a sort of a target that's aligned with the organization's vision that guides anything that the folks in the organization are working towards.   0:13:27.0 JD: And so there's always a target condition. There's an understanding of sort of where each individual is and the departments are. And they're always setting a new target on the way to that sort of vision target and running these experiments all the time. And they constantly set those targets so that they are ambitious but within reach. And then they're coached on the way repeatedly. And in that way they're sort of always moving forward the organization. And so I think of when you've changed investment banks and you're at this new bank and they're saying, Hey, this thing is possible, it's possible to do this. Here's the way we do that. Here's how we work towards that. And so you can imagine a place like Toyota being so successful, because if everybody has got this mindset, this scientific thinking where they're constantly moving towards a target and there's a method for doing so, [chuckle] that is an incredible education right there if you're an employee working in an environment like that. So that just made me think of the Toyota Kata.   0:14:41.4 AS: Yeah. And it's a great example of how reading books is part of education because you're getting exposed to new ideas and exploring and thinking about things. And that's where, well, think about the repetition in let's say a martial arts as an example. And when Dr. Deming talks about opening up education to everything for everybody, there's something to learn in almost everything out there. Like if it is about... What is it about those repetitions and why is that important and could that benefit our business? And he talked about painting and other things, you know? Like education very widely can bring you new ideas that can come back to improve your system.   0:15:27.3 JD: Yeah. And I think you have to invest in that sort of broader education, 'cause it's sort of an investment in the future, you know? Especially right now, things are changing fast. And you could have the best training program in the world, but if you are not also sort of looking out for what's next beyond that, to adapt to whatever's changing in your environment... A good example is this, we have a much better understanding of cognitive science than we did 20 years ago. And so if we didn't adapt... If we didn't sort of learn that and then adapt that and sort of include that learning in our training system that we're gonna start falling behind pretty quickly. And I think this can get... This may be part of the most important responsibility of a leader on the learning front.   0:16:28.5 JD: Because what I also see is that education leaders are often getting enticed by many, many fads that sort of come along. And so how to sort of actually latch onto something that represents a potential advantage, that's a real important skillset to have. And I don't think... That's a key... I think a key function of systems leaders is sort of to know what to let go of or what not to latch onto at all and what to sort of sink resources into because if you're gonna go do these educational pursuits, you're obviously gonna have to sink time and money resources into these things. And so being able to differentiate between what is good and what is bad is a real key skill.   0:17:22.6 AS: And one of the things about Toyota is it's like the ultimate Asian family business. And although it's now a big public company, the largest automaker in the world, and the family's ownings in the company is relatively low, it still has the influence of the family. And I was thinking about another huge company that I know of in Thailand here that shifted its focus away from, let's say, Deming in this case, to when a new CEO came in, he said, well, there's a different way and this is my way. And one of the things that's interesting about what Toyota's done, you know, Toyota gets a lot of blame for being slow to progress and stubborn and all of that, but man, they have built a machine and a... You just can't change the direction of that quickly, you really nurture what has been developed and how do you not just throw away. I was presenting to my students last night in my finance class here at Sasin School of Management in Thailand and I was showing them the DuPont Analysis in the world of finances where you break down the return on equity of a company. And I explained why they call it the DuPont Analysis, and that's because the DuPont company bought shares in General Motors in 20- or 1912 or something like that and they instituted this method of financial controls on General Motors. And I said to my students in passing, General Motors has been going bankrupt since 1912.   [laughter]   0:19:00.9 AS: And it's like every... It's not a cumulative level of learning. And that's where I feel like Toyota, what Toyota has achieved is a cumulative learning process.   0:19:16.9 JD: Mm-hmm. Yeah. You know, and it's a part of their DNA. I think certainly there have been challenges as they've grown across Europe and the United States and the world really. And a lot of the challenges that I understand is because people... That improvement Kata is sort of combined with a coaching Kata, like an approach to coaching and managers at different levels coach folks that are sort of a level down from them. And everybody in the organization, especially early, had sort of this mentor-mentee relationship. And so part of the challenge with growth was the fact that there are only so many of these folks that are grounded in this scientific thinking in the coaching part of this. And so that was a challenge as they grew, you know, in California and Kentucky and other places across the world.   0:20:17.9 JD: They had to build this coaching capacity across all of these new production facilities and other types of facilities across the world. So... But I think that what I really like about this principle...I, you know, if push came to shove, I started this by talking about Deming would basically allow almost anything when it came to allowable educational pursuits. And I think I would be much closer to that than I would be to limit those things. I think that is a really... That's a good sort of approach to take as a leader. I think here where I am at United Schools Network, one of the things that I was able to do was go take an improvement advisor course which required significant resources and time and money at the Institute for Healthcare Improvement.   0:21:19.6 JD: And so someone could look at that very easily and say, well, why are you an educator going to a healthcare organization? And I think it's one of those things where people maybe don't realize that the Deming philosophy and some of the continual improvement stuff, it's sector agnostic. And so when you can learn the philosophy, the methods, the techniques, you can bring them back to your own organization. So I think had I not gone down this path to study Deming, I wouldn't have made it to IHI and then bring this stuff back to my organization. I think it's benefited our organization in lots of ways, even though that might not have been immediately apparent to folks, you know, initially.   0:22:09.8 AS: So how would we wrap this up for the listeners to make sure that they truly understand the idea of vigorous education, self-improvement, this type of stuff?   0:22:14.0 JD: Yeah. I mean, for me the main point is that systems leaders should really encourage education among the whole workforce with a pretty wide latitude for allowable pursuits. I think especially for educators, when we seek those types of opportunities, we're also modeling this idea of continual learning to students as well. They see that just because I have a degree or a master's degree or even folks here that have a PhD, we have I think an organization that's pretty hungry for learning. And that's a model for students. Oh, this doesn't end when you graduate high school. This doesn't end when you graduate college. It doesn't even end when you graduate from graduate school. People all across the organization have books piled up on their desks and we're sending people to various learning programs and stuff like that.   0:23:09.4 JD: And I think that's a good model for students. And I think within that another big thing is to think about do you have an understanding of the stable state of systems and understanding that training programs are only gonna take you so far? Individuals are gonna come to a sort of a stable state once they've sort of maxed out on any particular skill. And that's why this idea of education is so important. Skills are important, training is important, but this other side of the coin, you have to pay attention to education. What's on the horizon? How are you gonna push the boundaries within your system? And I actually think to your point about outsiders or having an outside perspective, that's sort of, I think the benefit of education, because I think without that sort of push from an outsider, the push from the education, breakthrough improvements aren't possible in our school systems. They're not gonna come from training programs. They're gonna come from this continuous learning, this idea of continually pushing the targets, having sort of an improvement mindset. Having a coaching mindset that's always pushing towards those things. And I think this requires not just skills, but it requires new knowledge and new theory continually. And I think that has to come from this vigorous program of education.   0:24:39.7 AS: And the beauty of capitalism is that if you don't go out and get the education, your competitors will, and you don't want your source of learning to be facing constant defeat from your competitors.   [laughter]   0:24:56.2 JD: Yeah, you can't sit around and wait, that's for sure. That's for sure.   0:25:00.0 AS: Exactly. Or someone's gonna take it. And that's the beauty of the capitalist system, the adversarial aspect between companies definitely gets people riled up when they see that all of a sudden someone's doing much better with some new technique or idea. Well, I think that was a great discussion to help us understand the difference between training and education and why it's so important. John, on behalf of everyone at the Deming Institute, I want to thank you again for this discussion. For listeners, remember to go to deming.org to continue your journey. You can find John's book "Win-Win: W. Edwards Deming, the System of Profound Knowledge and the Science of Improving Schools" on amazon.com. This is your host, Andrew Stotz. And I'll leave you with one of my favorite quotes from Dr. Deming. "People are entitled to joy in work."  

How do grading systems, teacher ratings, school rankings, and other programs like those create barriers to learning? Should we eliminate them entirely, or do they have their place? John Dues and host Andrew Stotz talk about how to preserve joy in learning. TRANSCRIPT 0:00:02.4 Andrew Stotz: My name is Andrew Stotz. I'll be your host as we continue our journey into the teachings of Dr. W Edwards Deming. Today, I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. This is episode 18, and we're continuing our discussion about the shift from management myths to principles for the transformation of school systems. John, take it away.   0:00:31.3 John Dues: Good to be back, Andrew. In this episode, we're doing the 12th principle. So we're on 12 of 14, remove barriers to joy in work and learning. So that's a certainly a concept that we've talked about, but I'll start by just reading the principle. "Principle 12, remove barriers that rob educators and students of their right to joy in work and learning. This means working to abolish the system of grading student performance, the annual rating of staff and accountability rating systems for schools and school systems. The responsibility of all educational leaders must change from sheer numbers to quality." There's two really great quotes I like from Deming. One on joy in learning where he says, "Our schools must preserve and nurture the yearning for learning that everyone is born with. Joy in learning comes not so much from what is learned, but from learning."   0:01:24.4 JD: And then for joy in work, he says, "Joy in the job comes not so much from the result, the product, but from contribution to optimization of the system in which everybody wins." So he is saying basically the same thing in those two quotes, but he is talking about the contributions to the process is where the joy comes from, not necessarily the outcome. And so much of the time, we're focused on the outcome, be it the work product in a work setting or the test scores perhaps in a, in a school setting. But he's really talking about what is that process that you're contributing to? And, and you know, how do you feel because of that, those contributions you're making? I think whether you're talking about joy in work or joy in learning, sort of unifying theme in principle 12 as it's, this concern with the pride of workmanship, whether that's the workmanship of making a product or in the learning that you're doing or something you're doing as a result of that learning, like a report or a poem that you've written or whatever.   0:02:31.6 JD: And so I think as a result, it's barriers that get in the way of joy in work and learning. And you know, maybe one of the most important obstacles to improvement of the quality of our education systems in the United States. And you know, just like, sort of, it says in the outline of the principle, there's really sort of three levels that these barriers exist at. You got the students and the grading of students. And then you have oftentimes some type of rating system, evaluation system for teachers, for principals, perhaps sometimes those rating systems use test scores or other similar metrics. And then that third level is, you have the actual schools or school districts themselves that are being rated within these state accountability systems. So you sort of have, you know, these three levels. And then there's this common problem at all three levels, regardless of which one. And that's basically this thing that we've talked about repeatedly, where you under-appreciate the contribution of the system to the performance of the people, whether you're talking about students, teachers or, or you know, school systems. So I thought that's where we could focus today.   0:03:49.8 AS: Yeah, you know it strikes right at the heart of everything that we believe, as particularly as Americans, but certainly spreading that around the world, that it's all about measuring, ranking, tracking. You know, when a parent puts a kid in school, what do they want to know? What was their grades? When a student's in trouble, it's 'cause of grades. And what a student wants to know, like everybody wants to know and rely on grades. So it's just so, it's so difficult. You know, I was talking with someone else talking about why Dr. Deming's philosophy hasn't been adopted as as widely as you'd hope. And I think it's part of, it's just because it's just sacred, the sacred heart of everything that we believe. And if you can measure it, you can track it, you can feed that back and give it to people and show them where they are and you deserve where you are based upon your efforts, and you've gotta move yourself from there. That is so ingrained. And I'm just curious, like what's the hope from your side that this can be seen. I think it can be seen if you stop and look, but it's so hard to implement.   0:05:18.7 JD: Yeah. Well, I mean, I think one thing that can be confusing is obviously Deming was a statistician. So he is, has no problem with using data to improve the quality of our schools or even an individual lesson that a teacher delivers, gathering some data on how students are doing and tracking that over time. There's no problem with that. There's no problem with that I don't think at the school level either. I think the problem comes in when you create a reward and sanction system around that data. And I think that's, Deming actually think he indicated that, that system of reward or sanction on the other side is one of the main constraints from being able to develop this win-win culture. Whatever level of the system that you're talking about, that student level, the educator level, or the school and system level. They're, all those grading systems are really reward and sanction systems. And I think when you take the data and use it in that way, that's when I think Deming is talking about the real problems, the manipulation, you know, the competition for top spots that leads to all kinds of strange behaviors, those types of things. That's really where he's focusing most of his attention.   0:06:49.1 AS: And if you had no constraints from governments or other outsiders and you were setting up a new school right now with zero constraints, the only thing was absolutely optimizing the learning of young people. How would you handle this - grading? How would you handle all of this? Would you do it in a different way? Would you just do it and de-emphasize it and say, oh, well, it's not so critical? It's just information feedback, or would you teach them how to use that data like Deming may, or like how he uses data? Or would you say, no, that's just that there's no redeeming benefit, if we're not required to do it, then we wouldn't do it?   0:07:43.4 JD: Yeah, I mean, I think it'd be some combination of the things that you mentioned. I mean, on just from a practical sense, Demings certainly understood that we live within the world that we live within. And so if that hypothetical school that you're talking about is a public school and I was in Ohio, I would obviously give the state test and take whatever data I could use and use that in a positive way that I can. So I'm gonna do the thing that I'm caught on to do as a educator in a public school system. So I wouldn't opt out or anything like that. I think in terms of how I set up internal systems, I think, ..GAP. Yeah, I thought a lot about this but I haven't maybe put to paper exactly how I would do it.   0:08:36.2 JD: I think...I certainly would use assessments. I certainly would track how students are doing on standards. I would involve students in doing so they could track that over time. In terms of grading, I don't know exactly what I would do. I would definitely de-emphasize that to the extent that I possibly could so that the emphasis is on the learning and not on the grades. That would be a key sort of guiding principle. There's certain things that I think are outlandish that schools do, where they do pep rallies or pep rallies or something like that to, as the buildup to state testing comes, I find those things ridiculous. So I would stay away from doing anything like that. Kind of how we've treated state tests in the past, even prior to discovering Deming was matter of fact.   0:09:47.2 JD: Like, this is something we're preparing for, we're gonna do our best. We're gonna try our hardest, we're gonna learn from the experience, we're gonna work hard on it, and then we're gonna move on. You know, that's the type of mentality we had. In terms of like the mindset of the school I led, there was a poster in the hallway that said, you get it wrong and then you get it right. So that was the mindset is, we learn from our mistakes. We talked about creating a culture of air in our classrooms so that students felt, you know, safe, I guess is the word I would use to, or willing to call out when they didn't understand something, or they did make a mistake, and then we work together to rectify that. So that's a little bit a long-winded answer. I don't have it all worked out. I have some ideas, but I think overall using data is fine. I think it's, when you get into the rating and the ranking, that's where the problems and the rewards and the sanctions, I think that's where the problems generally come from.   0:10:50.8 AS: Yeah. I mean, I'm kind of unconstrained in my Valuation Masterclass Bootcamp, because I'm not under any, there's no supervision of what I'm doing by anybody. It's just me trying to make a better experience for the students. And the idea of grading never really came into my process. It's interesting, John, that one guy who was a student of mine, he graduated and then I hired him to work with me to take care of the other students. One of the first things he did was come up with a matrix and a grading system, [laughter] just because that's what he knew. And now he uses that system and he has little points that he gives. That system doesn't have any connection to whether you're gonna pass the class or not, or there's no ranking or anything related to it. It's just that, okay, you only got six points out of 10, which means you haven't really done the assignment. He's clearly defined what are the things that you need to have done? And then he goes through and says, did you do them? So it's definitely a, I think it's a good feedback mechanism.   0:12:08.4 JD: Yeah.   0:12:10.2 AS: But, you know, whether it's valuable. I think what I'm trying to do is create the experience that young people are learning how to value a company through the process of learning and discovery and, and discussion and, and, and going online and going through my material, asking me questions, and then demonstrating, showing different things. And then they're slowly putting those pieces together. And I can also see that it takes time. You know, it can't all happen in one week. We have six weeks and where they're at at the end of the six weeks is so much further along than where they were at the beginning. But I guess my point would be if I was completely unconstrained, which I am, it's just that it wouldn't be pro or con grades and ranking, it wouldn't even really exist because it's not a core part of learning. Core part of learning is providing the environment, the excitement, keeping people on track, helping them see, okay, here's what you gotta do now, see if you can do it. You know?   0:13:18.8 JD: Yeah. And I think what I was gonna do today is bring this alive. You know, we've talked about grading of students and even the performance appraisals in some of the past episodes. So what I thought we would do here is, sort of, focus on why grading schools could also be you know, a barrier to joy in work, how this might play out. So I think generally most people are now familiar with, because in the public school system, we've had various types of rating systems. You know, each state has their own. And I think it's, what's important here is to look at examine if the ratings help the public differentiate between schools that are doing a good job of educating kids and those that are not, because that's the point.   0:14:09.7 JD: Right? At least one of the points. And on its face, it sounds simple, you know, up until this year, Ohio has like an A through F grading system for schools, and there are sub components and you get an overall grade A to F. Right? And so it sounds simple. Schools with more A's are better schools, except for it's not that simple when you go beyond like a surface level analysis. So I thought it'd be helpful to just zoom in on two schools located here in Columbus. One's called Jones Middle School. It's in the Upper Arlington School District, which is close by. And then Columbus Collegiate Academy, I'll call it CCA, it's also a one of our middle schools. Both the schools serve grades six through eight. They're less than 10 miles apart here in Columbus.   0:15:03.6 JD: So they're geographically proximate. And this analysis comes from an article I wrote in 2020. So it's from a few years ago. So the results are a few years old, but you know, I think they're fairly representative of how the schools have performed over the last decade or school or so. So let's start with just the grades that the schools received. So the schools get an overall grade. Jones Middle School has an A, CCA has a B, so you know, fairly close there, but Jones outpaces. And then there's the achievement grade. And that's basically looking at all the kids' test scores, how they do overall. Jones gets a B, CCA gets a D, right? So Jones has quite a bit better performance. And then there's a progress category. So how much progress did the kids make during that particular school year?   0:15:57.9 JD: How much growth did they make? Now this is interesting now, CCA gets an A and Jones got a B. So just to recap, the overall grade for Jones was A, achievement B, progress B, for CCA overall, B achievement D, progress A. So basically a higher percentage of students at Jones begin year on grade level 'cause they have that higher achievement grade, but they don't grow as much as the students at CCA once they're there. This difference between achievement and progress grades becomes even more interesting as you start to factor in not only the school characteristics, but also the neighborhood characteristics. So let's talk about inside the school just to start with. So in terms of student population, Jones and CCA are pretty similar in terms of students with disabilities. So those kids with special education needs tend to, as a general rule score lower on standardized tests.   0:17:02.9 JD: So those populations are roughly equal, but 100% of the kids at CCA are economically disadvantaged as defined by the state. At Jones, just 2.4% of the kids are economically disadvantaged. When you look at other report card measures such as attendance, chronic absenteeism, Jones has much better rates. So 97 plus percent attendance rate, just 2% of their kids are chronically absent. At CCA 93% attendance rate, 21% of the kids are chronically absent. But when you start to look at these, some of these metrics framed in terms of the poverty rates in the community surrounding CCA, these numbers start to take on a different meeting. And I think what they're, especially things like chronic absenteeism, that's all the rage right now, attendance, I think what you start to need to understand is these are indicators of inequity, housing instability, neighborhood violence, lack of access to healthcare.   0:18:15.5 JD: I think they're more an indicator of those types of things than they are of school performance. So as you start to think about things in those ways, what you realize is that the students at CCA are just as capable as the students at Jones, but they face sometimes overwhelming obstacles related to poverty. It's also interesting to take a look outside the schoolhouse. So the median family income in the census tract where Jones is located is $184,000. So the median family income in that neighborhood, so it's a pretty affluent area. In the neighborhood surrounding CCA in that census tract, the median family income is just over $20,000. So we're talking about an order, orders of magnitude higher family income in upper Arlington than in the neighborhood that CCA sits in. And then there's all types of factors. Some grounded in historical reasons that relate to this, but they're also compounded by funding disparities. So the per pupil revenue at CCA for this year is $10,600. In Upper Arlington, it's nearly $17,000...   0:19:35.0 JD: This Jones Middle School has almost no students living in poverty, yet gets $6,000 more in additional revenue per student than the students that attend CCA. So think of the implications of that.   0:19:52.3 AS: When you say they get more revenue, you mean the state or the government's providing them more money per student?   0:20:00.1 JD: Yes, all in. From all sources. So when you look at what the federal government provides, the state government, and then local funding sources. When you look at all those sources combined, this more affluent middle school gets $6,000 more students, dollars per student.   0:20:14.5 AS: Obviously, it's not based upon need. Is that based upon the grade or some other?   0:20:19.0 JD: Well, it's because the funding is heavily influenced by local property taxes. And because of the affluence of...   0:20:26.7 AS: They have the resources.   0:20:28.2 JD: They have the resources. And in Ohio, charter schools don't have access to local money. So that explains most of the gap. Most of the gap. But back to my point, when you think about CCA, having kids with more challenges, less money per student, less resources to pay for a facility, to pay teachers a competitive salary, extracurricular activities, all those types of things that we want to equalize are highly inequitable between those two schools. So then you start to ask yourself, well, what are the report card grades measuring exactly? Are those grades on those state report cards a fair representation of what's happening inside the school? Or can a significant portion of those grades be attributed to this larger context in which the school sits? And I think that's where you sort of put on this systems thinking lens and realize that, sure, what teachers and the principal is doing inside the schools, they are certainly making contributions to those state report cards. But you cannot ignore what is going on outside those schools and those neighborhoods when you're thinking about these grades.   0:21:54.1 JD: And so if you're sort of thinking about... Like a formula that would sort of lead to the school's results and you just... Let's just call it A+B+C+D+E=71, where 71 is the score that the school gets. Let's just call it that. And let's call the school's contribution letter F. A, B, C, D, A+B+D+C... Or A+B+C+D+E+F=71. The school's contribution is F. Well, that equation cannot be solved unless you know the values of A through E or at least some of those values. But what we try to do with this state report card system is that we assign this value to F, the contribution of the school, with no knowledge of the effects of these other variables.   0:22:57.3 AS: So it's, in other words, the contribution of the school is 100%. You mean you're responsible for your results? Is that what it means?   0:23:04.4 JD: Well, right. So if you're going to give me... If you're going to give CCA Main Street a D in achievement, that means the only thing that contributed to that grade was the school. But there's all those things that we talked about. Some, sort of, when you look at the variables A, B, C, D, and E, those other variables, you could look at things like, what are the state standards? Or what's the test design? What's the school funding? Household income? Home environment?   0:23:34.1 AS: Education level, maybe, of families.   0:23:37.2 JD: Education level of parents. Teaching methods. All of these things are variables that are outside of the school's control, or most of the ones that I just mentioned. But we don't, we don't see that when we look at these report cards. Right? You know, and just like I said at the beginning, despite all of that, I'm in favor of administering these state tests that are standards aligned, reported annually to the public. I actually think understanding how students are performing in a standardized way is actually... Could be useful information, I think. But when you extend those systems to the grading, the rating, and the ranking, I think that's a misuse of the information. Because too much of the rating and ranking comes from the system, as opposed to being directly assignable to the school or to the individual educators within that system. I mean, I think, if you analyzed report cards in this way, I think my opinion is that a reasonable person would conclude that the comparison between Jones Middle School and CCA is not a fair one.   0:24:56.4 JD: Because those students that arrive in those schools are not on equal ground upon enrollment. And I think our time would be better spent figuring out how to make things more equitable between those two groups of students than constantly recalibrating these rating systems that at best communicate confounding information, conflicting information.   0:25:27.5 AS: KPI experts around the world listening and viewing this are saying, "oh, come on, John. What? All you got to do now is you just got to break it down. And now we're going to do the KPI by adjusting for these factors. And now we're going to compare schools based upon that." Of course, what we've learned and I've learned over my life is that every time you think you're going to break it down and make it more comparable, it gets harder and harder to do that. And it just becomes less reliable and less useful in a lot of cases. Not completely. I mean, making some simple adjustments just for, let's say, yeah, I suspect that just one factor could probably represent A, B, C, D and E probably pretty well. Maybe that's the income of the area or the amount of funding that they got. One or two of those factors probably is enough to say, okay, we gotta compare schools that have these factors similar as a first step. But every time that I've ever gone down to go deeper into measuring, it just gets...it, it, the answer isn't there.   0:26:40.6 JD: Yeah, and I'm going to tie this back to joy in work. So if you think about that current school rating system, what we fall prey to is that fundamental attribution error that we've talked about before, where we have this tendency to underestimate the impact of situational factors on other people's behavior and overestimate the impact of individual factors, you know, when it works in our favor. But what happens is if I'm a teacher at CCA, there's a likelihood that I'm going to get blamed for the results. Let's say the achievement results. If I'm at Jones Middle School, there's a likelihood for praise. Because the school is doing pretty well. But in both cases, in both cases we're vastly underestimating the impact of the situational factors or the system on those results. So over time, I think this can have an impact on joy in work of educators working in these challenging schools.   0:27:49.3 JD: Even, even in the case where in many of these schools, like the one I just talked about with CCA, that there's solid evidence that staff and these schools are often getting better outcomes if you go beyond the surface level analysis. Because if you remember, they did quite a bit better on the progress, meaning they grew the kids more in a single year, even though they may have not hit the proficiency standard at the rate that Jones did, they grew the kids more. So you could make a solid argument that CCA is actually better, even though they got lower grades on the report card, right? I've often said, what would happen if you just switched the two staffs?   0:28:33.6 AS: Yeah. Problem solved.   0:28:36.3 JD: What would happen to the report card? You know. That's interesting. Obviously, it's never going to happen, but it's an interesting hypothetical experiment. My guess is a lot of teachers will find out that would go from Jones Middle School to CCA in a much more challenging environment would find out pretty quickly, that a lot of their methods don't work as well, right? So I think that these are the types of things that we're talking about. Imagine if you're at CCA year after year after year after year, get these lower grades. Right? And even if there's some evidence, like the progress score, who's digging in to find this? That score is often harder to find than the overall grade. That score is often not in the headline and what makes it into the newspapers. You know? And so you start to ask or you start to doubt yourself. You start to think about, am I really good at my job? Those types of things come in. And if you don't have someone there doing this deeper analysis, putting this in context, that's not easy to do.   0:29:52.1 AS: Yeah, when the pressure's on.   0:29:54.4 JD: When the pressure's on. And even if you're good at doing that type of analysis, sometimes people won't believe you because, well, that's not what I'm hearing. That's not what I'm... That's not what my family's saying. Those types of things. And then, and then, if you have those good teachers that at a certain point say, I'm just going to go somewhere where it's easier. Then those kids at CCA wind up in a worse place. And that's, I'm using CCA as an example, but I think this plays out at you know challenging schools all across the country all the time.   0:30:36.2 AS: Yeah, when you were talking about the morale of the CCA teachers, I was just thinking some brilliant bureaucrat would probably come up with the idea of why don't we post this grade right on the front of this school?   [laughter]   0:30:51.4 JD: Well, yeah, they're easy to find. That's for sure. These are all public, public reports. Sure. And in fact, actually, back during, I think, during the Obama administration, during Race to the Top, when it became really in vogue to rate teachers based on their progress scores, the individual teachers. The school report cards are easy to find, like a report card on any public school in Ohio or any public district. But in some cities, what started happening is they were, newspapers were getting a hold of the list of the progress rankings for individual teachers and posting those. I remember some of those were in the newspaper. And I think we've talked about this here as well, that what researchers have shown over time with these progress scores, these value added scores, is that some of the score is attributed to the teacher from before. Teachers that take on more challenging groups of students tend to have scores that are... Progress scores that are lower, all types of things And you want good teachers in those rooms. And what you're doing is disincentivizing that to happen when you have these types of rating and, rating and rating systems. So it's a tough thing.   0:32:15.2 AS: It's such an interesting topic. And I think, it got me thinking that we should start a new series on the Deming Institute podcast, which is, bad use of data. Like examples of, you know, here we have a misuse of data or just the simple thing of not making adjustments for situational factors and the misattribution. You could argue if you just improve that, maybe there's a little bit more meaning to this. But then, of course, there's also all the unintended consequences. And I just would imagine, I'm thinking about a book I have called the... By Terry Mueller, I think, or Jerry Mueller, which is the Tyranny of Metrics.   0:33:05.9 JD: Yeah, we got a lot of copies of that in our, right in this room where I'm sitting.   [laughter]   0:33:10.8 AS: Yeah. And I think that that would be kind of fun to bring out from the audience examples of what you're seeing.   0:33:17.4 JD: Yeah. Well, and one thing I didn't even mention that is also a key contributor here is, so let's say these two middle schools get this state report card. And another contextual factor is that most of the kids that go to Jones Middle School went to, I don't know the name of it, Upper Arlington Elementary School. And a very stable neighborhood. And of course, there's a few families here and there that will move in and out. But for the vast majority, I guarantee a vast majority of the kids that took these tests in sixth, seventh and eighth grade at Jones have been in Upper Arlington since kindergarten or preschool.   0:34:00.4 AS: Yeah.   0:34:01.2 JD: CCA Main Street, because of the nature of charter schools in Ohio, is a standalone 6-8 middle school. So that means 0% of the kids went to our elementary school during these years. And now whatever happened K-5 in a school, those kids school career, that certainly plays a big role in how they're going to show up when they enroll at CCA. So the only rule in terms of counting for CCA's test scores is that the kid had to be enrolled by October, let's say the first week of October. And they take the test in March. So six months later, let's say.   0:34:49.2 AS: Yeah.   0:34:49.6 JD: So let's say probably 50% of the kids at CCA, were brand new to that building, to that district, that school year, whereas the vast majority of Jones middle school students had been in that district for seven or more years. Because kindergarten is a year, and then when you're a sixth grader. So the time that they've been there, that's not taken into account either. And that may be the most important.   0:35:19.0 AS: Yeah. That's fascinating. So how would you summarize the one thing you want the listener, the viewer to take away from this.   0:35:30.5 JD: Yeah, I mean, I think it can be easy to start to think that data is bad. That is not the problem. You need data to help inform your decision making.   The problem comes when you then take the data and attach the ratings and the rankings to it, that's when the problem comes in. So you need to detach those two things.   We need to keep it public, keep it transparent, keep it known by all stakeholders, be it parents, the public, policymakers, students themselves. But it's the rating and ranking, that's the problem. That's the key takeaway.   0:36:11.9 AS: Great. Well, on behalf of everyone at the Deming Institute, I want to thank you again for this discussion. And for listeners, remember to go to Deming.org to continue your journey. You can find John's book, Win Win. W. Edwards Deming, the System of Profound Knowledge and the science of improving schools on Amazon.com. This is your host, Andrew Stotz. And I'm going to leave you with my favorite quote from Dr. Deming, which is totally pertinent to what we just discussed. And that is: people are entitled to joy in work.

Bill Bellows, an expert in leadership in Deming organizations, discusses leadership in Deming organizations, including a story about senior 'leaders' making a huge error in judgment at a conference of auditors. They also explore the role of language in maintaining unity, the importance of teamwork, management as resource allocation, and the concept of appreciating the system and the people in an organization.

The podcast explores the benefits of cooperation over competition in various contexts such as sports teams, classrooms, and orchestras. It discusses the importance of interdependence for high performance and the role of a manager in fostering cooperation. The concept of dimming and tracking progress is introduced to improve performance, and the power of cooperation and teamwork is highlighted through personal experiences and quotes by Dr. Deming.