Environment Variables cover image

Environment Variables

Latest episodes

undefined
Jun 14, 2023 • 42min

The Week in Green Software: Code Green and Clean Power

Joining host Chris Adams on this episode of TWiGS is Nina Jabłońska, operations coordinator at Energy Tag and a master's student in sustainable energy systems. In this episode, we'll explore insights from the Linux Foundation Energy Summit in Paris, including Microsoft's urgent call for green coding and real-life examples of reducing computing emissions through cloud carbon footprint analysis. We'll also touch on employee activism at AWS, where tech workers stood up for climate action and better work-from-home conditions. Nina also tells us why sometimes she goes by Nina Jab%o%ska, and why Cara Delevingne and Keanu Reeves are the ultimate “carbon-free couple!”Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteNina Jabłońska: LinkedInFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:Carbon-aware software is central to decarbonization | State of Green Software Survey | The Green Software Foundation [3:01]Reducing cloud emissions by 60% | ThoughtWorks [24:26]Microsoft Issues Code Green Alert | Analytics India Mag [27:09]Corporate Amazon workers protest company’s climate impact and return-to-office mandate in walkout | AP News [34:43] Resources:Green Software Principles and Embedding Carbon Awareness in Your Applications | Dan Benitah & Szymon Duchniewicz, Avanade | LF Energy Summit [4:12]Technical Research Fueling NextGen Actions | Hallie Cramer & Ana Radovanovic, Google; Iegor Riepin, Technical University of Berlin; Gailin Pease, Singularity Energy | PyPSA | LF Energy Summit [8:55]GitHub - PyPSA/247-cfe: Explore the impacts of 24/7 Carbon-Free Energy PPAs [8:55] The politics of data centers | The Green Web Foundation [19:27] Cara Delevingne sprays industrial wastewater on her face in her latest beauty campaign | Vattenfall [38:20]Sad Keanu | Know Your Meme [40:07] If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!TRANSCRIPT BELOW:Nina Jablonska: So it's just a matter of really wrapping your head around how you want to do it and what concrete actions you want to you want to undertake. But in the end, I think it just pays off to be green, and I hope it will only go in this direction.Chris Adams: Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discussed the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams.Hello, and welcome to another episode of this Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams. In this episode, we have some insights from the recent Linux Foundation Energy Summit in Paris, Microsoft issuing a code red for green coding, concrete examples of using cloud carbon footprint to reduce computing emissions. Before we dive in though, let me introduce my guest today for this episode of this Week in Green Software. Today we have Nina Jabłońska of Energy Tag. Nina, I'll hand over the floor to you to introduce yourself and say what you do.Go for it.Nina Jablonska: Hello. So I'm Nina Jabłońska. Nice to hear you Chris again. So I am the operations coordinator at Energy Tag. Super happy to be here. So privately, apart from working at Energy Tag, which is a nonprofit organization, I am also actually finalizing my master's studies in sustainable energy systems, which is why I am currently placed in Stockholm.And recently I have actually taken up Spanish classes, which makes a lot of senseChris Adams: Wow, bueno!Nina Jablonska: Yeah, my, my masters, the first year I spent actually in Barcelona and I started learning. A bit of Spanish just to be able to do my groceries, and since I found that in Stockholm, everybody speaks English.So I figured I would just continue this journey of learning a third language online with, with a, um, with a teacher. But it's pretty exciting, a very nice thing to, to do some extra brain exercising in a bit different way than studying and working.Chris Adams: Cool. All right. Thank you for that, Nina, and I should probably introduce myself as well. My name is Chris Adams. I am the the co-chair of the Policy working group in the Green Software Foundation, and I'm also the executive director at the Green Web Foundation, another nonprofit working towards an entirely fossil free internet by 2030.If you are new to this show, the format is as follows. We basically have some people come onto the show. We look at some stories in the news that caught arise, and we just talk about them and share some notes and reckons basically. That's largely it, and we have a few stories ahead of us that I've foreshadowed already.We're gonna start with the first story we have here, a one from the green software report. So what I've been doing for the last few weeks is I've been inviting guests to pick an insight that caught their eye. And Nina, you are no different today. I'm gonna give you an idea of anything that you, that caught your eye when you're looking at this, and it may or may not be related to what you do at work.So yeah, I'll hand over to you. What looked interesting when you were looking at this?Nina Jablonska: Mm-hmm. Yeah. It so happens that one of the stories is actually a bit related to what we do at Energy Tag, and that's the fact that the carbon aware software, so a software that would operate in the time and place where the grid carbon intensity is low, or it would optimize its work based on the grid carbon intensity is super important to, to enable further decarbonization. And we also heard a very diff, very interesting presentation from Avanade on this during the LF Energy Summit. I think the whole conversation around having software that really can optimize and choose when and where to operate, depending on what kind of sources are available in the grid is very important.Chris Adams: It's about, yeah, the underlying kind of how dirty or green the energy is. Okay, so one thing from the actual conference we're both at the LF Energy Summit, was this talk by Dan Bonita and Szymon of- Nina, I think I might need you to help me with this, cuz it's a long polish name that I'm gonna struggle with.Could you maybe help me with this? It's, is it Szymon Duchniewicz maybe? Okay. One more time, please? Duchniewicz. Okay, great. Szymon, so Szymon that from Avanade, that was the other deck we can share a link to that has them explaining some of the work they were doing and what they were using there. Okay, thank you. That was the only thing. I just wanted to make sure I got it pronounced properly and it sounds better from you than it does from me,Nina Jablonska: The Polish surnames are, he doesn't have the weird, the weird letters though. You, forChris Adams: Diacritics and things.Nina Jablonska: Exactly. You turned mine into just the regular l and n I can see here, but for example, on my Spanish student id, they just turned that into a percentage sign. initial student Id said that. My name is Nina. Jab.Percentage sign, o, percentage sign, ska.Chris Adams: Okay. This is why people should be using Unicode as much as possible instead of Ascii, yeah. Nina. Ya percentage nska is not the correct name. The, the.Nina Jablonska: It is definitely not, but imagine going to a bar with my friends and they would check the IDs and I would just show my student ID because it was the first card that I got out of my wallet and the guy was just like, are you Elon Musk's daughter? And I just, yeah, I should learn to make a robotic sound of my voice and just try to like say back something funny in Spanish, but I could not just, it was.Chris Adams: That's, that's probably gonna be easier than explain the problems associated with Unicode and Ascii code and stuff in the middle of a bar. You've mentioned that you're in Stockholm right now, right? So that's in Sweden? Yeah. And that's a relatively green grid by comparison, right? Because that's usually a hydro or wind.What would it be?Nina Jablonska: Yeah, yeah. The northern parts of Sweden especially are very clean. They're mostly based on hydro power, as you mentioned. In the south. There is still a bit of. Challenging situation with a bit of leftover gas generation and so on. But overall, yeah, overall Swedish grid is really one of the cleanest ones, which is why most of the challenges present in other countries are not really discussed here so much.Chris Adams: Ah, I see. Whereas,Nina Jablonska: could be a good, could be a bad thing, but they're really moving at the forefront of decarbonization every of every single sector, including transport, et cetera.Chris Adams: I see. Okay. And so I'm in Berlin, so right next to the border, relatively close to the border of Poland. And you know, you are originally from Poland as well, right?Nina Jablonska: I am hence my complicated surname.Chris Adams: Ah, I see. Yeah, so that's an example of grid, which is relatively cold, heavy, and somewhat dirty. So the same program run in maybe say Sweden compared to say, uh, Warsaw or somewhere might be much dirtier depending on how you would run that.Although that may be changing over time because opponent turns out to be one of the fastest decarbonizing countries as of last year. That was one of the stories that I learned of which I was surprised to hear from, given how coal heavy that grid is, for example.Nina Jablonska: Yeah, it could be surprising, but it could also make a lot of sense just given the fact that decarbonizing the first 10, 20, 30% is way easier than decarbonizing the last. 30, 20 or 10% of energy demand. Of course, a lot of challenges come with balancing the grid supply, with introducing the technologies needed to cover the last really couple of kilowatt megawatt hours of demand in various hours.So I think it is a good sign. Of course, I wrote from my country, I would love to see coal as soon as possible, but I also think there is still a lot to be done. Partly, it's also nice that maybe the technological development needed to really cover this last piece of demand is going to happen abroad. So let's say maybe people from other countries and the grid operators from other countries will figure it out for ourselves and we will just follow their example in this sense.But,Chris Adams: Okay, cool. So that's one of the examples from here. So we spoke a little bit about the difference. The carbon intensity can be different, and this was one of the ideas behind. And kind of carbon wear computing, for example. I guess it's one thing that. It might be worth asking is like, how do we know this is really the case?And this is something that I found quite interesting that when we were both at the Linux Energy Foundation Summit, there was actually people talking about, okay, this is how you can build open models of understanding what kind of interventions you kind can actually make. This might be a kind of jump off point cuz one of the panels that we saw was specifically related to this.There was a number of large companies, but there was also some work from, I believe, I think you might know Igor's surname, Dr. Igor. Do you remember? Can you help me with his surname? Yes. So he was talking about some work that the technical University of Berlin had been doing with Google to basically model a kind of way to decarbonize all of their infrastructure between now and 2030.And the thing that kind of caught my eye was, The use of an open source modeling tool called PyPSA Python Power Systems Analysis. I think that was it. I think that's something you might be a bit more familiar with than I was. And uh, this is the first I've heard of this and maybe you might be able to shed some light on this cuz I didn't know that much about it before coming to this event, this conference.And I thought the idea that you could essentially talk about this stuff in Python, it was cool actually. Yeah. I'll hand over to you because this is something that I think you mentioned that you've been doing a bit of work with as well yourself. Right.Nina Jablonska: Yeah. Yeah, so I, as I mentioned, I am also still finalizing my master's degree. And of course, as the last part, I do need to deliver some thesis, some piece of my own work. And I actually decided to do it based on this open software and this openly available piece of code that guys from TU Berlin have written and come up with.And this is indeed part of a bigger study that they perform, which is studying the effects of 24 7, carbon free electricity procurement on the system level emissions, but also on the emissions for those customers who decide to follow this 24 7 carbon free procurement strategy. And then also on the cost premium of doing this, instead of following the business as usual, let's say energy attribute certificate system.So of course, the way companies and big consumers source clean energy from the grid is through buying those annual certificates where they match their annual energy consumption with the same amount of energy in those attribute certificates that are coming from, let's say, solar power plants or wind power plants.And why this system doesn't work, obviously is because it doesn't really send these precise signals. As we mentioned, also, with the carbon aware software, it doesn't really tell you in which time and location. The grid actually has a higher carbon intensity when it has lower carbon intensity, and it also doesn't reflect probably most importantly, the actual cost and the actual effort that you have to put in decarbonizing every single hour of your electricity consumption.So the study developed by the TU Berlin lab is essentially doing this, assuming that some companies follow this strategy of sourcing electricity in every single hour, but also from deliverable location, meaning for example, from the same country or for the same bidding zone. And also that this energy is going to come from additional assets.So for example, from newly built solar power plants, instead of competing with the other grid users for the existing assets. And they essentially see how that would impact the grid and the great outcome of the entire LF Energy conference as well. For me, and the great thing that I could do is to meet Igor, who is one of the authors of the study and who has helped me greatly with using their piece of code for my own thesis.And I just think it's so great, really, that it is available openly and we can just download it literally on our personal computers. I am not even a, an energy system modeler. I never created. Any model similar insights to this one may be a small one during some classes at university. So I think it's really a great thing that anybody could just download it and it is very much, I think, encouraged also to just provide them with feedback to challenge their assumptions, which is essentially what I'm doing for my thesis.So yeah, it is very nice for me to combine this data and software openness that we discussed also with many other people, both of us, definitely at LF Energy Summit and this kind of new generation of clean energy procurement that is proposed.Chris Adams: So there's one, there are two things that I found quite interesting when I spoke to Iegor about this. When he gave, when he spoke on this panel, he said one of the ideas from the work that was going on is yes. You can get an idea that basically moving from maybe an annual approach to, to an hourly approach helps address some of the existing problems people have and some of the accusations of kind of greenwash related to green energy wind.People will say, I'm running all my infrastructure on all my servers on solar power, and they're saying this. Happens at night,Nina Jablonska: Mm-hmm.Chris Adams: may be somewhat inconsistent with how most of us understand solar panels to be working, for example. There's some stuff like that. But one thing that caught my eye was he was actually saying that, yeah, by doing this, we're actually ma able to model the impact of whether we can make the infrastructure itself responsive.So rather than just having to make sure that we've got enough wind and solar or hydro or stuff to do this. They were talking about how they could model reductions in demand to need so much in the first place. And the same if you have maybe 10% of all the compute that's flexible, then you need less generation, which then will impact the kind of cost of actually us moving away from what we currently have right now, which is lots and lots of fossil fuels to something which is greener and more humane on the grid.So that was cool. But you said something quite interesting just now about like location, like local and deliverable and what was is additional, is that other thing you just mentioned? Yeah.Nina Jablonska: Yeah. Basically, if we want to put it in short words, hourly matching is not enough. So the entire study, and I think the first concept that comes into mind and that's discussed is how we want to match the supply of clean energy at an hourly basis with the demand. And as you mentioned, what's impossible in the real world to consume solar energy at night if you don't have a battery?So hourly is the first pillar that we, we now call them the three pillars of carbon free energy. But the other two is, are actually equally as important as it turns out. The second one being the fact that you need to make sure that this electricity is deliverable, which means you not only have an existing interconnection between point of generation and point of consumption, but also that there is enough interconnection capacity to actually allow this electricity to flow instinctively. It doesn't make sense to import electricity when you're in Sweden from, for example, Portugal. The likelihood ofChris Adams: I see.Nina Jablonska: of your electrons flowing from a solar power plant in Portugal and actually reaching your, for example, my house in Sweden, if I had one, are extremely low.And we actually talked to some people who are modeling this as well on l F Energy Summit. I think there's going to be a, a summer of many interesting reports coming. And the third pillar then, is the additionality. So really seeing how it's not only enough if you match hourly and location, but also you need to make sure that if you introduce especially new additional demand, you do need to make sure that you have additional assets to meet this.And that is a huge thing, for example, with hydrogen, since hydrogen, especially with the ambitious goals that both the EU and the US have right now. It's really. An amount of electricity that you cannot just forget about in the eu. If we want to meet the goals for hydrogen generation by 2030, I think we will need somewhere around the equivalent of the annual consumption of France.Chris Adams: Okay.Nina Jablonska: So it's something.Chris Adams: New generation, like new clean generation that would be coming in,Nina Jablonska: Exactly, and then exactly nuclear generation. So that's the question. How do you ensure that, that this is actually clean and that it contributes to decarbonization? A study from Princeton University who are performing, we can call them sister studies, to the ones from to Berlin from Europe. So Princeton did a study where they analyzed what would happen if you didn't ensure hourly deliverable and additional electricity, and what they found is that the hydrogen you would end up producing would be twice as intense, twice as high in emissions as the one produced right now using gas.Chris Adams: So that would be the opposite of what you wanna have. So basically if you, so if I, let me just check if I understand those two things, cuz at the idea of hourly, we kind of understand, like when people say they're running on green energy and they say they're running on power and they're running a server at night, that's very intuitive, easy to understand.The deliverable thing that was like, When people say, oh, I am running green. I'm running my say websites or running a server on Green Energy. And what they're really doing is they, are basically running it on a normal grid, but they're buying some certificates from somewhere else in the world and then saying, yeah, because I've bought these certificates that my energy is green.And the example might be if I was to buy the green certificates from Spain, but I was running servers in the Netherlands or Germany, then it's quite difficult to actually shift electricity all the way across that. So it's a bit of a kind of porky pie to say that's a bit, that's green energy, right? Exactly. Okay, cool.And the final thing was about additionality. This is this idea that when someone's going to be saying they're running on green energy, they need to make sure it's adding new power to the grid. Cuz if they're not doing that, maybe you could expand on that one, because this is one thing that I think is.Interesting in the world of technology for us, because it looks like the whole discussions about massive new amounts of demand, like AI and stuff like that, it seems somewhat comparable to the discussions people are having about saying, one thing we need to do to replace fossil fuels is have a way to make hydrogen from say, solar or wind, or stuff like that.And you're saying that you need to be really careful that the power is coming from clean sources. Cause if you just pull it from the grid at certain times, it can be almost worse than basically getting hydrogen in the usual way, which is usually coming from methane gas or something. Is that what you're saying?Nina Jablonska: Methane reforming. Yeah. Which is a, a process which I, I am not a chemical engineer or hydrogen expert, but this is basically a process where you directly use natural gas to produce hydrogen, which should not be the case anymore. We should really try to use electrolyzers. But if they are grid connected electrolyzers that are going to draw this clean power from the grid. Again, if we allowed them to, in a way, fight or compete with the current consumers in the grid for the clean power that is currently available, that would be a disaster because we wouldn't end up not increasing the clean capacity. We would end up in a way forcing the order grid users to report that their carbonChris Adams: there, there is dirty air compared to what they have. I see. Okay, so there's a concrete example I think of that we've seen. So one example this makes me think of is in the Netherlands we saw a bunch of new Microsoft wind turbines installed with some new data centers and you saw quite a lot of pushback from locals because there's this idea that, oh wow, there are these cool wind turbines that are in our neighborhood now does that mean we're gonna be run using green energy?And if I understand it, that power, it was additional, but it was all additional going just to the data center. So it wasn't materially changing the kind of. Maybe the, uh, the carbon intensity of the power that you could trace to that organization, for example, even though it's forming into the grid, that was one of the things that was, can lead this kind of gap in perception essentially, that people were saying, I thought those wind turbines meant that my use of power is greener.But no, that's not how it's actually being presented right?Nina Jablonska: Yeah, that depends on which framework you use because there's, there's essentially two ways of reporting or accounting for the emissions of your electricity consumption. One of them is market based and. The other is location based. If you simply use the location based, you literally only look at the location where you're based and you take the average emission factor.And then if you do have some additional wind turbines producing clean power, then of course you're going to lower your average emission factor, which is great. But would a lot of companies do, and actually many would argue that it's a good system to implement, is the market based one where. Through the use of those contractual instruments, such as, for example, clean energy certificate, energy attribute certificates, or other -miliar similar instruments in the market, you can buy them in order to influence the amount of carbon emissions that you report, which on one hand, again, allows you to reach 100% renewable or zero emission reporting with the use of annual certificates coming from no matter what, no matter when, no matter from which kind of assets. But on the other hand, this actually does drive additional installations and additional capacity of solar and wind. It's enough to even see what the energy attribute certificates that are existing right now, what they did to the grids they actually did when they were established.Over two decades ago, they actually did encourage a lot of additions in wind and solar capacity all over the world in, in Europe, in the US and in many other parts. So I don't think we should cancel this entire system, but there is definitely a need right now to do the same, to provide the same extra financial incentive and to provide this extra something that's going to capture the cleanlinessChris Adams: Get their recognition right?Nina Jablonska: Exactly. And that's why we would need, for example, the certificates. That would be issued on an hourly basis in order to incentivize energy storage or in order to incentivize other clean firm technologies that are dispatchable, like geothermal, for example, or demand site management. Again, coming back to the carbon aware software, we need a tool that is going to capture the fact that if you choose to not consume one kilowatt hour at night when grid carbon intensity is very high, but you choose to consume the same kilowatt hour during the day when for example, this avoids curtailment of solar power, then that's a great thing to do and you should aim to do so. That's it.Chris Adams: Oh, why? Okay. Wow. There's a lot to it then. So if I understand that correctly, in the example here, say maybe having giant company. It set up some wind turbines near me. On a location based basis, it might look a little bit greener, but from a market based basis, it might make the electricity that I get to say I get to claim as being somewhat less green while the other organization gets to say, because we've spent a bunch of money to deploying this, we are gonna claim some of the greenness of it.Okay. That does explain the two different ways of thinking about this andNina Jablonska: Then again, just important thing to say is that of course we want the additional capacity, and of course it's going to do good globally for the emissions. That's also important to track what are the global emissions and emissions in the zone, for example, in the country and. It's important also to remember that if a data center purchases, let's say some wind power and additionally some storage, in order to make sure that they have this 24 7 hourly available clean energy, this extra power that's generated by this wind turbine is also going to be injected in the grid.And then if they would report their carbon emissions at an hourly basis, they would basically. Sell this extra generation to the grid, so that would also globally decrease the emission. So there is a lot of really aspects to consider here. Of course, it's not easy to predict it, but yeah, definitely it's worth to keep in mind that the market and location based systems work a bit differently.They can trigger different behaviors and trigger different results, and I think it's worth looking at both and really taking the time to understand what they mean and what, what are the rules behind them and what are the equations behind the numbers basically.Chris Adams: Okay. All right. Thank you for that. We've gone really deep into the rabbit holeNina Jablonska: We did.Chris Adams: of carbon intensity here, so should we look at the next story then, Nina? This one here was about cloud carbon footprint, about a, this is ThoughtWorks talking about how they've been able to use this tool themselves to basically reduce the emissions across a number of services by around, I think 60%.And that more or less worked out to be around a saving of 46% in terms of actual cash money costs. And that seems largely I think the phrase they're using is identify zombie workloads and switch things off. So like we spoke about before, there's literally just a case of switching things off here, but I think there is some, there's a couple of things that kind of interesting here that might be worth diving into.There's something about Scope three. Did, did that surprise you as well, Nina?Nina Jablonska: Yeah, it is very interesting because. Scope three emissions are one of the, I would say, most challenging to track and try to estimate. So I would definitely say it's interesting to, to take a look at the methodology that they took to calculate this since the emissions that we were discussing mainly so far are scope two, so directly from the use of electricity that you consume, but scope three emissions are really the emissions around the final use of your products.And then the final upstream and downstream activities around this. So I think it is really extremely difficult to, first of all, set targets, but then of course, measure your progress towards these targets. Most companies, when they do have some emission reduction targets, they are focused around scopeChris Adams: Mm-hmm.Nina Jablonska: So definitely anything that they, that they use in order to track those and to measure how their net zero goals could be achieved would be very interesting to, to look into.Chris Adams: Cool. Now, one thing that's also interesting from with my green software hat on right now is that. The cloud carbon footprint has typically used one form of measuring carbon intensity called average carbon intensity rather than just marginal carbon intensity. Cuz the Green Software Foundation has a standard called the software carbon intensity standard, up until recently was primarily just focused on marginal carbon intensity and it's, we probably don't have the time to dive into marginal versus average here cause that's quite a complicated thing.But essentially the key thing that caught my eye when I was looking at this was that, oh, you've got tools like cloud carbon, footprints. Theoretically, you should be able to use these tools to work out S SCI scores now for particular applications so that you can start tracking some of these and comparing them to each other, for example, in the same way that you might say share like an efficiency score or grading or things like that.That's one thing that we've got some scope to move towards now for some of this stuff. Okay. Should we look at the next story then? Nina?Nina Jablonska: Yep. Yeah, absolutely. The next one is about carbon again.Chris Adams: This is, yeah, Microsoft issuing code green alert. So this one here is, there's two things that are interesting here, really. So one of these was basically about this idea of Microsoft's making a big thing about. Not using water so much in its data centers are trying to move away from this and shifting to this exotic way of calling called adiabatic cooling. And this is interesting in my view because a lot of, there's been a real pushback recently about AI models, not just in terms of carbon, but also about in terms of like water usage as well here. And one thing that surprised me with this is like, There. There was one thing which is hidden away basically saying, yes, Microsoft has its claim to be carbon negative, which is zero waste and be water positive by 2030.And these were all made before there was a whole discussion about this cut and sudden craze in generative AI and large language models and things like that. And there's a question now like there's suddenly all this new demand coming onto the grid on all these other new discussions, and it feels very similar to the additionality stuff you just mentioned before about, okay, where do we go with this?How do we fit this in?Nina Jablonska: Yeah, there is a very interesting analogy between this extra demand from the AI related processes and hydrogen in the regular grid because both of these have this extra feature in them, and again, if we don't account for the extra demand that the data centers will have, I'm not talking about water, but electricity since I'm not an expert on water use here, but this really again, boils down to ensuring that this extra demand, no matter how big it is, which again, how do we estimate this and how do we even predict how much it can blow up in the future?It is really crucial that it will be covered with clean electricity, and again, the three pillars of hourly deliverability and additionality of these assets will be really important. Again, to not turn this extra demand into a carbon bomb that's just going to blow up in our faces. Because the stakes are really high.We, as we've seen with, with hydrogen demand, and I think AI and data center uses. Data centers use how much of global electricity right now?Chris Adams: We can look up the state of carbon waste software to see what figures they have for that. That might be the best way to do it.Nina Jablonska: it's around 1% maybe, but it's still a lot.Chris Adams: Yes. That's still gonna be, so that's like half of aviation is the figure spec I've heard people use specifically just for data centers, not the rest of the infrastructure. I'll say networks and things like that. So that's still. That that's a medium sized European country, basically. So that's about uk for example, the UK is about 1% more or less.Alright. So yeah, that's the kind of ballpark you're looking at basically.Nina Jablonska: Yeah, so again, if we, if this is the base consumption right now and with AI, we don't really know where it's gonna go and how big it's going to be. And the pace edit at which it has been growing recently is really beyond any estimates and any guesses. So I think we may see a similar discussion actually coming up.We've had this discussion about hydrogen. We do have the delegated act already requiring these three pillars in the European Union for the definition of in order to produce clean hydrogen and to define hydrogen as green and carbon free, we need to ensure hourly new asset, uh, no more than three year old asset than the electrolyzer, and then also the same bidding zone.The same discussion right now is happening in the US and there is more and more discussion moving towards. Also implementing those three pillars in the requirements there for the tax credit. And I think we may maybe in a couple of months hear the very same discussion on how to ensure that the data centers and that AI is powered by clean power only.Chris Adams: You actually raised a good point, Nina, because a few weeks back we looked at one of the stories of reports, uh, by amongst the authors was one, uh, woman, Sasha Luccione. And she was actually in the report that, so in the paper that she shared that we'll share a link to, there was this idea of saying, if you're gonna run AI or if you're gonna have these models, Then what you should probably be doing is actually figure out how many hours are you gonna be using this for, and then find a way to attract that because these are kinds of models which are not latency sensitive this way other the way other things might be.So if we're gonna have a model that's gonna use this much power then and we realize it's gonna create this much value, then yes, we should find ways to make sure we can run that on an hourly basis. For example, always using green energy and because these kind of things are plausible. There are scenarios where if you are gonna take maybe 20,000 hours of compute to use this, you could plausibly put them at certain times where.The sun's in the sky, or there's really easy access to green energy so that you can work out what the cumulative carbon footprint of that might actually be. That's quite similar to what you just said actually about the whole hourly thing that you mentioned with hydrogen there. I guess the question that we might have when we look at these two things is that.With hydrogen, there's a whole discussion about we need to get our fossil fuels, so we're gonna need to have this much hydrogen. But we haven't really had that discussion about saying, do we need to have this much ai or do we need to, how much compute is enough for this?Nina Jablonska: How much AI do we need?Chris Adams: yeah, because there is, there's gonna be all these assumptions about do we just need to do less or do we need to meet these massive targets that we might actually have?Cuz the ones you mentioned before was for hydrogen was what a another France worth of electricity, for example.Nina Jablonska: Yeah, around around 500 terrawatt hours of electricity, which is more or less the annual consumption of France.Chris Adams: Okay. That's a significant amount. Wow. All right, so that's, I guess we need to have maybe some of those discussions with data centers and talk about how some of that work, how, what the priorities might be for some of that then as well. Okay.Nina Jablonska: Exactly. And also one more thing that just popped into my mind is I remember there were some people even pushing against the development of AI, and I remember one of the ideas was to tax AI companies like 98% or something from the revenues. In order to just really limit, I'm sorry, I don't remember who exactly said that, but there was an idea that if AI is going to really develop at this pace and gain so much revenue, then maybe they should just pay ridiculously high tax in order to limit this in a way. And this gets me to think that if AI is going to be a business where you can make a lot of money, why don't you make sure that this money actually goes in a good place and in this sense, and the same conversation again, goes into hydrogen. With hydrogen, you are going to have subsidies. You're not going to just generate hydrogen and pay 100% of the price on your own.There is going to be large subsidies in both EU and US, and therefore there really is no excuse to not make sure that you have this additional deliverable, hourly clean power, and that you really don't use only clean power from the grid because you have the money, you have the technology. The technologies are available largely.We do have, we do know how to do it. So the question is, yeah, where is theChris Adams: priorities that you want to have for this?Nina Jablonska: and where either the legislation or the push maybe from the society is going to be to really make sure that it's doing way more good than it's going to do bad.Chris Adams: I see. So that's like a discussion about, okay, if there is all the value being created, how is that distributed? That's the discussion that you, that needs to be happening there. Okay. Alright. Speaking of this, we've just got one more story I think to look into before we wrap up with a couple of, with a, the little question here.This is actually a story from AP News about actually staff. This was happened last week actually. This says Amazon work workers. Basically they did a walkout about the company's climate impact and the return to office mandate for the walkout. This is the follow one from us having a discussion about employee activism last week.I, I think it's interesting because we see a lot of the impact and lots of the action from large firms coming from employees a lot of the time.Nina Jablonska: I think it's, I think it's an extremely interesting conversation in general, not only about remote or at in the office work, but also of the impact of both the pandemic and the climate crisis and how of the new generation of workers coming to the job market. I think the reality of what you're looking for in a job has changed so much, so much over the past two or three years,Chris Adams: mm.Nina Jablonska: and there there is power in the people.I think main outcome of this is just really, if you want to keep your employees satisfied, it's not only enough anymore to pay them well. In fact, some people are willing. There was also studies done on this that people are willing to be paid less if they know that their companies are. Extremely climate aware and sustainable yeah.Chris Adams: I agree with you. This one is actually this one thing that there's a particular quote. Okay. Today looks like it might be the start of a new chapter in Amazon's history when tech workers coming outta the pandemic stood up and said, We still wanna stay in this company and the direction of this company.This is from Eliza Pan, a former employee and a co-founder of Amazon employees for Climate Justice. These are some of the people who have really been pushing for Amazon to be moving faster. And as an organization, which is as large as it is, this is a real significant driver. That's a lot of leverage that we'd actually have there.And you see this in a number of places, and I, I think it's worth paying attention to some of this stuff here because, power, leverage and pressure comes from lots and lots of places, and today as we learn more and more about the state that we're in, I think as much pressure as possible will help us accelerate and get to where we need to be, especially for 2030 on this one.Nina Jablonska: And also not to mention that sometimes I would. Even say, usually if you do the climate consciousness part right of your business, you may up even saving money, not only spending more, so it's just a matter of really wrapping your head around how you want to do it and what concrete actions you want to you want to undertake.But in the end, I think it just pays off to be green, and I hope it will only go in this direction.Chris Adams: So this has been interesting with AM Amazon specifically because they are already. The largest purchaser of renewable energy in the world now and last year, I think they've already spent something in the region of $60 billion on infrastructure already. And this gives you an idea of the kind of scale that we need to be moving at.So this is the largest one saying you need to be moving even faster than this in order to do this. And I think it's, for many of us, it's difficult to get ahead around just the scale of these numbers and the change that we might actually be needing to do. Like you mentioned, another France worth of, of of electricity, for example, to replace fossil fuels in certain areas.It's a dizzying times to be in, that's what I can say.Nina Jablonska: Definitely super interesting.Chris Adams: Okay, so we've covered through this, we spoke about the some of the green coding stuff from Microsoft. We spoke a little bit about the carbon oil sdk. I think the last question we have now is just a final question that we have. This one is, I think this is one from Chris, our producer.If you could have any celebrity become an ambassador for green software, who would it be and why?Nina Jablonska: Is it a question coming from the Cara Delevingne, maybe.Chris Adams: Oh, that's a good one. Actually. I hadn't actually thought about that, but you might wanted to explain that one because if you, I'm not sure how many people know about this stuff. Actually, it's worth just explaining some of this.Nina Jablonska: It is so good. Of course it has it's many haters, but haters gonna hate. Basically, Cara Delevingne participated in a, in advertisement from Vattenfall, which is a huge company here, a huge energy company here in in Sweden and in other countries as well, where she promoted an emission free face mist or perfume. I don't exactly remember what it was, which was basically a campaign targeted at advertising.The fact that waterfall is moving towards carbon neutrality and they're going to, uh, create, oh, I don't remember actually if it was hydrogen or if it was just industry clean water. Anyway, it was a campaign that was aimed to raise awareness about the climate goals of Vattenfall and the way they're moving forward with with all of this, but I wouldn't pick Cara Delevingne for green software. I think for green software, and I'm so bad at names of actors and actresses, but the guy who played in Matrix?Chris Adams: Keanu Reeves.Nina Jablonska: yeah. Yeah. Because the software, the zeros and the ones in the background, they were running like green. It.Chris Adams: also green as well.Nina Jablonska: So I think he would like to the back move and avoid some carbon emissions and then, and then have these zeros and ones in the back.And it's all green software.Chris Adams: So it's literally green software against a black screen. Okay. So that's your person.Nina Jablonska: For Keanu Reeves.Chris Adams: All right. Okay. And also when builds, when things aren't working so well, we can always roll out the sad Keanu meme. So it's, it works out on low all these levels. Excellent. All right. Okay, so Cara Delevingne for Energy and Keanu Reeves for software.Nina Jablonska: Carbon free couple,Chris Adams: Carbon free car. Yes, indeed. Alright, that takes us to the end. I think that's all we have time for this episode of this Week in Green Software. All the resources in this episode are gonna be in the show notes as we normally do. You can also visit https://podcast.greensoftware.foundation to listen to more episodes of Environment Variables.And, uh, finally, I wanna say huge thank you, Nina. Thank you so much for coming on for this. I enjoyed hanging out and chatting with you, and I wish you the best with messing around with Python Power Systems analysis.Nina Jablonska: Thank you. I'll need some of that for the next month or so. But thanks so much for having me. It was a lot of fun. A nice way to start the week.Chris Adams: Cool. All right. Take care yourself, Nina, and everyone else. Thank you very much and see you on the next episode, tara!Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get your podcasts. And please do leave a rating and review if you like what we're doing.It helps other people discover the show, and of course, we'd love to have more listeners. To find out more about the Green Software Foundation, please visit https://greensoftware.foundation. That's https://greensoftware.foundation in any browser. Thanks again and see you in the next episode.
undefined
Jun 7, 2023 • 38min

The Week in Green Software: Open Source Innovations with Tom Greenwood

TWiGS host Chris Adams is joined by special guest Tom Greenwood from Wholegrain Digital, to bring you the latest news and updates from the world of sustainable software development. They discuss insights from The State of Green Software report, the cost reduction strategy of Amazon's Prime Video, Atlassian's sustainability program, Wholegrain Digital's Employee Activism Policy, the open-source Falcon LLM, and the innovative approach of heating swimming pools with servers. They also highlight upcoming events like the GSF’s UN World Environment Day Event (today!) and the London Open Source Data Infrastructure Meetup. Tune in for a deep dive into the intersection of technology and sustainability.TWiGS host Chris Adams is joined by special guest Tom Greenwood from Wholegrain Digital, to bring you the latest news and updates from the world of sustainable software development. They discuss insights from The State of Green Software report, the cost reduction strategy of Amazon's Prime Video, Atlassian's sustainability program, Wholegrain Digital's Employee Activism Policy, the open-source Falcon LLM, and the innovative approach of heating swimming pools with servers. They also highlight upcoming events like the GSF’s UN World Environment Day Event (today!) and the London Open Source Data Infrastructure Meetup. Tune in for a deep dive into the intersection of technology and sustainability.Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteTom Greenwood: LinkedIn / WebsiteFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:State of Green Software | Green Software Foundation [2:54]Scaling up the Prime Video audio/video monitoring service and reducing costs by 90% | Prime Video Tech [09:04]Don't F&*% the planet. | Atlassian  [17:58]Activism Policy - Wholegrain Granary | Wholegrain Digital [18:47]UAE's Falcon 40B is now Royalty Free | Technology Innovation Institute [26:28]New data centre turns waste heat into warm water for swimming pools | TheNextWeb [29:17]Events:UN World Environment Day: The Green Software Revolution (Virtual Event) - Monday June 5th [31:27]London Open Source Data Infrastructure Meetup | June 14 2023 [32:15]Resources:Green Software for Practitioners (LFC131) | Linux Foundation Training [7:10]From Carbon Aware to Carbon Intelligent  | Environment Variables episode with Luis Cruz at TU Delft [8:03]So many bad takes — What is there to learn from the Prime Video microservices to monolith story | Adrian Cockcroft [11:09]Grok Ventures | Mike Cannon-Brookes [15:42]Blueprint for climate activism policy | Business Declares [22:49]Climate Clauses | Chancery Lane Project [23:36]Learn About the Salesforce Sustainability Exhibit Unit | Salesforce [25:38]tiiuae (Technology Innovation Institute) | HuggingFace [28:51] W3C Web Community Group [34:44]Curiously Green Newsletter | Wholegrain Digital [36:30]Oxymoron Newsletter | Tom GreenwoodIf you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript below:Tom Greenwood: There's no point people wasting time and money and energy, like reinventing the wheel. Somebody's doing something that might be useful to others. Put it out there, share it, and then we can all stand on each other's shoulders and go a lot further, a lot faster. I think.Chris Adams: Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams.Hello, and welcome to another episode of The Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams, and in this episode we'll be talking about a few insights from the recent State of Green Software Report. A brief survey of developments of the environmental impact of large language models, unexpected news about monolith versus serverless for green coding, employee activism, policies for the workplace, and finally some events and opportunities for development from the world of green software.But before we dive into this, let me introduce my special guest from Wholegrain Digital for this episode of this week in Green software. With us today, we have Tom Greenwood. Hi Tom. Why not introduce yourself from here?Tom Greenwood: Hi, Chris. Yeah, I'm Tom and I'm co-founder of Wholegrain Digital and been the big proponent of sustainable Web design for a number of years. I wrote the book. Sustainable Web design and yeah, into all things sustainable business and sustainable technology. Really so keen to be here.Chris Adams: Cool. Thank you. Also the website Carbon Guy asTom Greenwood: Not the website carbon guy. Yeah.Chris Adams: Yes.Tom Greenwood: Not many people know that I'm involved in that. I sometimes, I'm walking around in like tech conferences and I hear somebody talking about this website, carbon calculator, and I'm like, yeah,Chris Adams: Yeah,Tom Greenwood: I was involved in that. Right? Yeah.Chris Adams: And for folks, and if you are not used to, if this is your first episode, my name is Chris. As I mentioned before, I am the executive director of the Green Web Foundation and the policy chair for the Green Software Foundation. I'm one of the maintainers of a software library called CO2 js, and we also work at the Green Web Foundation, where we run various checkers and tools and open source software for we're understanding the environmental impact of green software.So if you are new to this show, the general format is that it's a roundup of some new stories that we've seen this week that we thought were worth talking about. So what we'll do is we'll share a link, have a bit of a chat about each of these, and then run through until we run out of time. Should we have a look at the first one together then?Tom Greenwood: Yeah, sure. Let's dive in.Chris Adams: Okay, so the first one here is a new report that was released last week, which is called The State of Green Software released by the Green Software Foundation. This has been a bit of a labor of love for the last. Me nearly a year trying to get some of this together. And, uh, it went live last week. And if you go to https://stateof.greensoftware.foundation/, you can see the report and all of the findings in there, hyperlinked glory.Tom, there's a couple of things that caught your eyes on here. What, what should we talk about first in this one?Tom Greenwood: Yeah, sure. First of all, someone's been very busy doing all this research, which is fantastic, and I was really excited to see that there was so much in it, which is a big change from several years back where there was not a lot going on in this space. And the thing that jumped out at me specifically on that level was one of the items around they'd found 2000 specialized software tools related to green software, which is a huge number, does that, to think that there are that many projects going on, however big or small it might be, it means there's a lot of people interested and are starting to actually work in this space.Chris Adams: That's true, and if you think there's maybe what, and a few million developers. That's actually a surprisingly high proportion of developers and projects. Assume you have a one-to-one and there's not no one person making a hundred of them. That's actually pretty impressive, actually. I think the research that we have here.Let's have a quick look. Cause I can't remember if this is just looking at GitHub or if there's been a look across all of the different tools. Yeah, this is mainly looking at GitHub actually. So given there's been a kind of explosion of other tools like GitLab or giti or other things like that, there may be more like you folks used GitLab as well,Tom Greenwood: We use GitLab. Yes. So we are not included in the statistic. Yeah. So that'sChris Adams: be more than that case.Tom Greenwood: it could be, yeah. And they've been quite cautious in their numbers, I think, in the way that they've laid it out. So actually, if anything, it could be more.Chris Adams: So we have some forks, but including the forks, it's at least 2000, which is a number which is significantly higher than zero, which probably what it was maybe five years ago. So that's encouraging. Alright, anything else catch your eye on this one actually, Tom?Tom Greenwood: Yeah, the other one was around it, what was called decarbonization alone Cannot make green software, and it was basically an article around the fact that we just need to think about more than just using renewable energy and making things energy efficient. There are obviously two really important components, but there are other environmental factors from digital technology, basically they focus specifically on water. But I think like the message is really, let's think more holistically about the environmental impact of digital technology rather than just being about like energy, weather and carbon emissions. And I think that's really important because like water is obviously like a key resource fundamental to human life, especially clean drinking water.And it's limited, but it also gets, if you take this more holistic mindset, then you also think about things like electronic waste as well and how these things factor. Um, I'm really glad that they've highlighted that. Cause I think that. When we're talking about these things, we do tend to focus, be a bit tunnel visioned on the kind of the energy piece.Chris Adams: You used that spec specific term, a tunnel visioned on the carbon. We'll have to share a link to that diagram of the person's eyes. You know the one I'm talking about where someone's only. Looking at carbon and missing all of the other kind of parts of this big circular forms of impact that we actually have.Okay, cool. I'm glad you mentioned that. Well, we work at the Green, Web Foundation. We talk about the environmental impact of software in a number of ways. We talk about efficiency, which is one thing we are used to, but we talk about intensity of which carbon is one, and you can also have water in intensity and.Various other minerals being drawn out the worth and also toxicity and things like that. So yeah, this is absolutely a place to be looking at. All right. There's, can I give, can I share one, because thereTom Greenwood: Yeah. Yeah, goChris Adams: my eye. So this one here was this idea that developers want to have a positive impact.And there was one really nice study or stat from this goes from according to this survey, which is over, I think it's just under 3000 developers took place in the survey from this, 35% of the practitioners shared they and their organization never measure the environmental impact of software. They said that they really want to though.So they found that say only 8.5% have actually taken any green software training, although more than half of them are looking for stuff. So this suggests that there is an unpinned demand and or an unmet demand for this stuff. And I guess the thing we should probably do at this point with my hat on is basically say that or share a link to the fact that the Linux Foundation does actually have some free training that can give you, I'm not sure if I'm allowed to call it accredited or certified, but there is some form of recognition that lawyers allow you to use the note word for that.Let you say that you've done this and get a bit of a grounding on this. We'll share a link to that because it's actually quite useful. And it was based around the Principles Green website from a couple of years back that Asim worked onTom Greenwood: that's brilliant here. It's obviously disappointing in a way that like people haven't been able to necessarily do the training or find the training that they want, but the fact that like more than half of software practitioners would like to. Is amazing cuz it's just a matter of time. Then before they do find it and they do take that training and they start to embed it into their works.That's exciting.Chris Adams: There is also scope and hope in my view for things when people are just starting to come into the industry. So previously we did a podcast interview with Luis Cruz at TU Technical University Delft, where he was talking about an open source syllabus that he was working on for students doing a master's at his course.And last week I went to South Southern Germany to Frey Borg to, for the first ever software engineering course, which was specifically aimed at sustainability first ahead of the actual software engineering part, which I really enjoyed. It was really cool, and it was a project run by the European Commission where they basically issued something like 20 scholarships to all these young students from say, Bangladesh or Nigeria or Germany or Indonesia.Lots and lots of places which are outside of just the North America and Western Europe where people who are often, many cases you would associate with the people on the sharp end of a, lots of the changes of climate. You had a bunch of those people coming along and learning and talking about, okay, yeah, this is how I wanna build this into my work when I graduate.It was really exciting and really inspiring. I'll have to share some more links to that one as well.Tom Greenwood: That is amazing.Chris Adams: All right. Let's look at the next story then. So this is one about, I think it's called Scaling Up the Prime Audio Video Monitoring Service, and Reducing Cost by 90%. It's a bit, it is a pretty, pretty dull title, but basically the thrust of this story is that it did arou, it did the rounds.Recently Amazon shared a blog post, uh, about their Amazon Prime video service. And a lot of us are used to this idea of serverless software being the kind of trendy thing that turns itself off and it's seen as one of the most efficient ways to run infrastructure. The key thing from this was the team at Amazon basically saying we moved away from using serverless to using boring, old and busted monolithic parts of the infrastructure and we saved 90% of our infrastructure costs by doing this. This caused an explosion of hot takes across the internet with everyone saying, oh, monoliths versus serverless, everything like that. And I find it interesting in my view, cuz this goes against the narrative that we typically do have where everything has to scale down to zero and everything like that.Anything that catches your eye on this one, Tom?Tom Greenwood: Yeah, I get asked this question a lot, people asking me like, oh, shouldn't everything be serverless and I'm not gonna claim that I'm an expert in this but, but my answer is always, it depends like everything. And I think my view has always been that we shouldn't be dogmatic about technology. Like it's all about context and what you're trying to do with it.And every technology has a really valuable use case, but equally, every technology has its flaws that mean that the wrong. Application is not necessarily the best thing. And I think this is really interesting cuz they basically, they've started off, they've used the hot trendy thing and it has been the right thing to build a prototype and get it going and.Like an MVP to demonstrate the principle, but then they found that actually we wanna scale this. We wanna make it really robust and efficient over the long term. Then actually the sort of monolith approach is actually really what we need. And I think it breaks down some of the dogma and I think it just just demonstrates actually we need to just assess each use case on its merits rather than being dogmatic and allying ourselves to one solution for everything.Chris Adams: Yeah, I agree with you on this. What we'll do is we'll share a link to a really nice piece from Adrian Cockcroft. Basically, it's called So Many Bad Takes. What is there to learn from the Prime video microservices to monolith story, which expands on this in a bit more detail. Also, just for context, Tom, you folks use WordPress and PHP as like one of the main things that you folks use, right?Tom Greenwood: We do. Yeah, that gets a lot of criticism.Chris Adams: This is the thing that is, in my view, entertaining because the actual programming model for PHP, if you think about the things that people like about serverless, like you run something and it scales back down to zero. The actual programming model used for PHP, where you just load a script. Bootstrap everything, server response, and then go back to, to nothing Again.That's basically how things like PHP tend to work and how they're designed to work. This is how the whole shed hosting thing, for which it may be maligned, but this kind of approach has been essentially the mainstay for a bunch of infrastructure for 20 years. So when you actually think about this, if you squint basically WordPress and bhp, a bunch of this stuff can look kind of serverless in this way.So yeah, that's the thing that I just have, I'll share with all of you. Okay. Should we look at the next story from this one?Tom Greenwood: Yeah. Yeah.Chris Adams: All right, so I'm not sure I'm allowed to say this without ruining the language on this, so I'm gonna just spell it out the, there's a really nice piece from Atlassian called Don't F Sharp at bang percent the planet.I think it might be don't, I'm not sure that's whatTom Greenwood: Yeah, we know what to say.Chris Adams: in, yeah, exactly. So I was born in Australia and Australians can be known for colorful language, and this is a. Quite an Australian way to talk about don't f the planet. Basically, this is Atlassians talking about their most recent work on basically net zero and them sharing an actual report about how they did it, how they went about, what steps they did, what was easy, what was not so hard, and how other organizations can follow this themselves.Have you been following any of these, Tom?Tom Greenwood: Yeah, it's really interesting. It's good to see. Firstly, just that like you've got a big name company in the tech space that's not one of the big three. Going down this path and saying, look, we're taking sustainability seriously and we're taking it seriously on multiple levels and it's not just a marketing thing.But then it's also nice to see how they're laying out really transparently in a way that a lot of the big tech companies are a bit vague. And instead Atlassian has said, look, here's a nice report that tells you like how the journey of like. Why we're doing this, how we got here, where we've got to the things we found difficult, and then obviously they're gonna be reporting on that moving forward, which is really good.One of the things that jumped out at me was the fact that they set themselves this target for 2025 for having everything using a hundred percent renewable energy, but they then found that actually just switching to renewable energy provider and then using credits for the rest is, is like such a low hanging fruit.They did it almost immediately and then the question was like, oh, okay. Like how do we make this more robust now? That's the question moving forwards. But the low hanging fruit was already there and they didn't even know it until they looked into it. So it's nice to see things like that where I think they used the phrase Go fast and then go far, which I think is a really good way of thinking about it.Do something to take it like a step forward and then keep moving forward because there aren't no any fruits. And I think a lot of people are put off by just feeling, oh, I dunno what to do. Especially things like net zero can sound really complicated and scary as like such a, like a big, lofty goal. And I think it's nice to see how the, they've taken this approach of let's just start moving in the right direction as fast as we can and then find the blockers along the way.Chris Adams: Yeah. I have to say I'm a bit of a fan of Atlassian in general, and I, we use Trello at where we work. All right. And I know people have opinions about things like Jira and, and Confluence and things like that, and, but it, it's really nice for an organization to be so transparent about the infrastructure as well.In their report, they're one of the few organizations that basically say, here's a breakdown of all of our infrastructure, how much we're using, and ev every single data center. And they provide this reporting, which is almost impossible to get out of other organizations, so it's really cool to see them doing it.Yeah. The other thing that I think is quite interesting is that there's a kind of stereotype of like tech billionaires being generally terrible people. Right. There's something really interesting that I think from Mike Cannon-Brookes, who's one of the founders of Atlassian. So the funding he's using rather than I know, turning large social media websites into kind of havens for right wing climate denial.One of the key things that he's been doing is basically aggressively buying up the biggest source of carbon emissions in Australia, which is the biggest power station they have. And then finding ways to refinance it so they can shut it down and replace it with wind and solar basically, or primarily solar.So this is what they're doing and that's one of the projects called Grok Ventures that's doing all this stuff. So there's all this stuff here, and then there's like activist investing to accelerate this transition away from fossil fuels. It's like really cool to actually see someone talking about some, something about this and using funds in a kind of, In my view, a very kind of pro-social and progressive way, but also somewhat techy and boring basically, is okay, you will need to do some boring refinancing of this stuff rather than only looking at the shiny things.It's cool.Tom Greenwood: Yeah. Yeah, it is. Yeah. The things like financing can sound really dull, but I think it highlights how typically you'd look at something like sustainability in a business, big tech company, as being like, okay. Yeah, let's do some offsets and we'll reduce our energy consumption and so on. But actually like looking at how that company has resources and influence that it can use more broadly, that actually can have really big impact is super interesting and it's really nice to see that they're pulling that lever.It reminds me a little bit of also, like when I lived in Australia for a bit, there was a company, big mortgage company that was looking at introducing solar powered loans, and the idea was basically that they could refinance people's homes in order for them to buy solar panels and then once they got solar panels, that would generate an income that would actually mean they'd pay up for their mortgage faster than if they hadn't done it.And it's things like that where you think actually, like it sounds really dull when you like about refinancing things for um, sustainability, but then when you actually look at what you could achieve, oh, actually that's pretty clever. It was a bit of financial wizardry.Chris Adams: Yeah, absolutely. And uh, really good example in the UK is actually one of the writers of Love Actually. His new thing is actually this thing about divest moving your pensions, basically moving your pension outta fossil fuels into renewables. Cause he basically said there's 51 trillion. Pounds or dollars of money invested in stuff and you can either, by default it's usually invested some chunk of it in fossil fuels.So one of the things you can do is actually just take some of this. You're not having to give any money, you're just making a change. So it's not doing the bad stuff and going into the good stuff. It's really cool. They said like they've run, they started the pro- the campaign just a few years ago, and they talk about how they've been able to redirect something like more than a trillion pounds of investment away from fossil fuels into renewables already, which is gonna make a significant change, right? Yeah. Once you find the leverage point, it's pretty impressive. And this is going back to the hot waste, what we're talking about. This is one of the reasons why it's interesting to work at developer because there aren't that many developers.This is the argument that Asim keeps making. It's basically because there aren't that many developers, if you can impact some of the developers to make changes there, then you can have some relatively high leverage changes that cascade through the actual supply chain, basically. So that's one of the things.But sometimes you do need boring policy things, or not boring, but whole need necessary, but sometimes need to do the work on the policy front for this. And, uh, this is something we spoke about ages ago actually, when you folks published your sustainability policy, and then you released it with creator comments. That was really helpful cuz that was directly relevant for our organization. We ended up essentially using that as a template ourselves for this stuff. And that's probably a nice segue into the next story that we see here.Alright, so this one is about Wholegrain Digital. We've introduced an employee activism policy, so this is talking about some of the other things you can do as a technologist, which aren't just about coding.Cuz while coding is fun, we are also citizens as well as just consumers or. I don't know what's, I don't have a word for a contractor. Yeah. We're more than just contractors and consumers I suppose. Maybe you could talk about a bit about this one, because there's a bunch of thought that's got into this and I was really pleased to see this go live actually.Tom Greenwood: yeah, sure. So it actually came from an event called Good Fest that I attended last year. Good Fest is. Like a, a sort of creative conference for, for making the world better essentially held down in Cornwell every year. It's amazing event. And there was a talk there from a guy at Patagonia and he was talking about how Patagonia in the US and he is like really supportive of their employees taking part in activism.Immediately after that, had a lunch with a guy called Viril who is involved with Just Stop Oil and it was a really interesting conversation where he started talking to me about how actually a lot of the barriers to activism are employment related. Activism can come in many forms, but a lot of people are in.Either nervous to get involved because they're worried that it might reflect badly in terms of what their employer might think of them, or they are struggled to get time off work or they can't afford to get time off work, or they're worried that, like what happens if I get in trouble and like I get arrested or something and then I might lose my job?Or what happens if something happened and maybe I got glued to a. Bus or something. And then I had to miss a day off work and, and people think, oh, I don't really know how I can fit this into my life as an employee in a company where I've got responsibilities and I dunno how the company will look upon it.And so on. And we started chatting in about, surely like companies could introduce things that would basically try to mitigate as much of this as possible. So I said about trying to figure out like what might those things be? And then along the way, Ben Tolhurst from Business Declares, which is like a nonprofit, organization that gets businesses to commit to net zero and playing a role in trying to tackle climate change.He heard that I was working on this, got really interested because he's really interested in the sort of activism side of things himself. And also he's got a lot of connections with people in other businesses that are looking at what they could do from a climate change point of view. So it quickly evolved into Ben helping write the policy as well as hooking in people from other companies who were, who were intrigued by this idea, or maybe this is something that that we might be interested in doing as a company, we then realize that we really need some lawyers to tell us whether we're doing something stupid. So we involved Bates Wells, which is a B Court law firm, and who are basically like a bunch of hippies that have got law degrees. And I'm not sure if they'd like me describing them that way, but I think that's why they're so brilliant.They, they care about the outcome rather than just being like all about risk mitigation andChris Adams: Principled legal professionals who like granola.Tom Greenwood: Yeah. Yeah, that's, yeah, they're great. And they were really helpful in basically going through it and rather than literally tearing all of the heart out of it, which it did get run by another law firm who literally did that and came back and said, just don't do it.Bates Wells came back and they were like, look, here's all the risks we can see. Here's our thoughts on how you can mitigate them. You go decide how much risk you're prepared to take. And so the outcome of that is that we crafted a policy for our company, Wholegrain Digital, which basically means that people can take time off to get involved in various forms of activism. If they do get arrested, they're not gonna get fired. So there's security of employment. If they do get arrested, we'll contribute to the bail money if necessary. So there's some things that we could do that are quite tangible that basically say, look like if you are passionate, we're not gonna tell you to go out and do anything.But if it's this sort of comes intrinsically to you and you feel this is important, it's not just climate change, it might be some other kind of social or environmental issues and you want to go and stand up for it, then. We really wanna back you because we need people in society like that. And here's what we can do.And then in return, it basically says, here's the things we ask of you if you are going to do that, and you want some support from us as a company. And it basically is saying, look, just be careful. Try to keep yourself safe and uh,Chris Adams: have your back. Basically,Tom Greenwood: we have your back. Yeah, exactly. So we published ours and then business declares then published a variant of it, which is open source so that any company can base, and it's got guidance notes in the template as well, including some of these things that the the spoke to us about.So that as a company, you can basically take this template and say, okay, how might this fit for us? How much risk are we prepared to take? And you can craft your own policy. Gonna get your own legal advice, but hopefully more and more companies will see this as a way of lowering the barrier to entry for people who would like to get involved in more activism, but maybe feel like there's some things that are holding them back.Chris Adams: Cool. I'm really glad you shared that, and I really like the approach that you've mentioned about it almost being a kinda like modular approach. So you're able to see how far you're able to go because this somewhat reminiscent of the work. I believe the Chancery Lane in the UK has been doing around writing climate clauses into kind of commercial contracts and things like that.Cuz I know that you folks have spoken about things like having a carbon budget on a consulting project, or if you're building something, you'll do things like that. They have a bunch of existing mechanisms like that, which are easy to put into standard form contracts. So when you are doing some work.These are the things you can include, and I assure you there is a kind of link to WordPress for this, which is why I'm where I'm getting to with this. The way that the people at Chancery Lane explained it to me was basically this idea that in the legal world there's like Lexus Nexus and there's a few organizations which have these kind of standard form pro contracts.They're built like the WordPress of standard commercial contracts that you do this stuff and they realized this and they said, okay. We can take some ideas from open source and we can apply that to the legal kind of world. So there is now a website called Climate Clauses, which is from the Chancery Lane Project, which is, you know how like WordPress plug-ins extend something to carry in new directions.They've basically taken the same approach to standard form contracts that people use for entering business deals with other people. For example, they said, here's how you can include like the module for net zero or the module for a budget or the module for environmental performance clauses. It's really coolTom Greenwood: really good. Yeah.Chris Adams: Yeah, we'll share a link to that as well because when I first heard about that, when I had a lawyer explain it to me and say, yeah, dude, this is basically no, we, we saw what you folks were doing at WordPress, we figure we should have that too. And I thought, wow, that was such a cool idea. Cuz it's so different from, it's very easy as a tech you to just think, oh wow, we are the only people with this special tech spec technique.But it turns out that no other skills and other industries can be inspired by some of the things that we, we are doing here.Tom Greenwood: Yeah. Yeah. And like you said earlier about the sustainability policy that, that we shared with you guys. I guess a few years ago. There's no point. People wasting time and money and energy, like reinventing the wheel. Somebody's doing something that might be useful to others. Put it out there, share it, and then we can all stand on each other's shoulders and go a lot further, a lot faster, I think.Chris Adams: Yeah, I agree. And just to round this story off, the example of these contracts, I just came back, there's a project called, there's a contract called the Salesforce Sustainability Exhibit. So Salesforce large company, they basically used this, they used the chance relaying climate clauses as the basis for all their stuff they do with all of their supply chain now.So it just like open source, it always comes up in weird places. So it turns out that a bunch of people working on a side project ended up having some of the basis for one of the largest companies in the world to be, for them to use is their basis for essentially building sustainability and climate awareness into how they do business with pretty much the entire supply chain.Tom Greenwood: That is amazing. Ripple effect, eh?Chris Adams: Yeah, indeed. Alright, so speaking of open source, let's look at the next thing that we have here. So this is Falcon, an entirely open source LLM, which is a large language model you can run on your laptop. Tom, this was, this might feel a little bit left field and uh, I, I'll give the introduction and then I'll let you come in on this one actually.So, We are used to large language models coming from organizations like Facebook or Microsoft or Google, for example, or not necessarily coming from, but us being able to use the results of, and this one here is, okay, weirdly or unexpectedly, United Arab Emirates. Have basically published a entirely open source, royalty free, a machine learning module.And there's a few things which are interesting. In my book, when we looked over the website, they, it's designed to be more efficient than say, GPT three by the significant amount. And it requires maybe a fifth of the computer inference time. So when you've used, once you've trained it, you are using to try to get numbers back when you speak to ChatGPT, is that kind of thing.That's what they're using and this is designed to be open for. Anyone to use. So rather than having to only get it from say, OpenAI or own you from Google, anyone is able to run this even on if your laptop's fast enough, your own laptop here, and I think this is one of the first and largest and highest kind of performing open models for this.And it speaks to the idea that only a few years ago, but only less than six months ago, these were millions of dollars to train and only available from $3 trillion companies, and now you can train and run this stuff on your own hardware for less than a million tens of millions of dollars. Right? Amazing.Right.Tom Greenwood: A huge leap forward and it, yeah, it feels a bit ironic that, that this is not coming from OpenAI. It's coming from coming from the Technology Innovation Institute in the United Arab Emirates as an open source option, which is amazing and brilliant that they're doing that. And it's almost a.Chris Adams: that like open night, it's not open source, it's not really open data, but it has the word open and you not, you don't typically associate open with lots of the kind of news that you might read about the, you about say the UAE for example. Especially when you think about things like say COP 28 and stuff.And yet here you have an open model being released, it gives you an idea of just where the stuff comes from open source. It's really hard to predict basically. So we'll see what happens with this. AndTom Greenwood: is. Yeah.Chris Adams: folks who are curious about this, we've shared a link to Hugging Face, which is a kind of GitHub for machine learning stuff where there is a bunch of really interesting work by, it's one of the only machine learning and companies I know of with a climate lead.Who specializes there and maybe one day we'll get, we'll be able to get them onto the show. Sasha Luccione, she's been creating some really good papers and yeah, this is one of the things that she's been doing actually. So we'll share a link to that for folks to look at. All right. Should we look at that last story then, Tom?Because this one, one that you shared that, I think it's a really nice one actually. So this is Heating Swimming Pools with Service And this one, maybe you can talk about this one actually, Tom, cuz this was the one that you brought, brought along.Tom Greenwood: Yeah, so this one really caught my imagination. About a year ago. There was, there was a company that was in the Netherlands that was building sort of small data centers on farms to heat greenhouses and that. That really caught my imagination as like a great way of doing things. And then suddenly this one popped up in the uk, this company called Deep Green, installing tiny cloud data centers at leisure centers, basically.And it's this beautiful kind of symbiotic relationship between data centers that need cooling and. Swimming pools that need heating and particularly we've got this energy crisis, like energy prices have gone through the roof. A lot of local councils in particular are like really struggling with money.Some swimming pools are being closed down just cuz like cost of heating the things. And then you've got this company that comes along and says, actually, like we could put a little data center in your leisure center and heat your swimming pool essentially for free. We'll pay for the electricity to run the servers and give you the heat.It. It just seems like such a brilliant solution where you've got this huge tank of water that needs to be kept constantly warm, and you've got these servers that need to be kept constantly cool. It's one of those things where when I saw it, I was like, oh my God, how has no one thought of this before?Chris Adams: Yeah, is there's a pleasing circularity to this and a kind of this term called free calling, which is usually around air, and this feels like the same idea. I'm a big fan of this as well. Actually. It also asks questions about what data centers should and shouldn't look like because we're used to data centers being, well not, the common narrative for big data centers or when you hear a data centers machine learning, you're thinking of like a football pitch full of machines, which is almost like a kind of big box out of town Walmart style warehouse full of things, like a bit barn. And this is the further opposite. It's integrating it into the fabric of the urban environment, for example. Yeah, this is a really nice story actually. Thanks for sharing this one.Tom Greenwood: it's okay.Chris Adams: All right, so we're just coming up to the half an hour mark and we are just gonna look at some of the events now, actually. So I guess the thing we should probably share is this is the 5th of June time of recording. And if you aren't aware, today is the UN World Environment Day and uh, today you probably. Us recording this now is probably gonna be a little bit late for people to know about this, but there is an, there is a virtual event taking place later on today, which will be recorded, which is by the Green Software Foundation called Green Software Revolution, where there's a number of people including the.One of the head, the, the chair of the community group, Anne Currie, Asim Hussain, he of Principles Green Pindy Bhullar ubs, the at the bank, who is also a PhD specialist in sustainability. And Tamara Kneese, who was the lead researcher for the State of Green software report. So there's a bunch of stuff there and we've online for people to stream or look afterwards, after this.And what else have you got? They've got this open source infrastructure meetup on in London on June the 14th as well. We have that there. Is there anything that caught your eye on this one, Tom?Tom Greenwood: I guess my curiosity is more to see what's happening in terms of sustainability in this open source world that they're gonna be focusing on AI and deep learning for enterprise, and I guess we're at this space now where the whole AI world is like kicking off in a big way this year and there's, in the sustainability world, I guess the question is just, oh my God, how much energy is gonna be used by these things?I think it's fair to say a lot of us are in this space where we're like, torn with these like amazing, exciting opportunities of the technology as well as some of the potential threats, both from an environmental point of view, from a like societal point of view. So for me, the, I'm just curious to see what the op open source world is bringing to this conversation, because obviously that's where a lot of kind of conversations around tech ethics often happens in the open source world.Chris Adams: Yeah, I'm with you on this as well. It's easy to get really caught up on some of this stuff, especially if you start playing with some of these like chat tools, but, You're right. There is a non-zero footprint associated with this stuff, and even now it's actually quite difficult to find some of the numbers for this.We have shared links to give some estimates of this, and now that you have an entirely open stack, presumably you could start coming up with some numbers, and yet I'm not aware of any services that still provide these numbers on a kind of per request basis yet. Like how Website Carbon has done, or even some of the stuff that we've done with like.co2.js or so on, but it does feel like it's needed. So you are aware of when you're speaking to someone, what the actual impact of that when you're speaking? Not someone, when you're speaking to spicy auto complete, like it's not a person. We've gotta remember that.Tom Greenwood: I, when I've tried these tools, I keep having to tell myself, don't say thank you. It's a slippery slope.Chris Adams: I know what you mean. But if you, British, you're taught to, you're taught to apologize when someone stands on your own foot, let alone saying please. And thank you. SoTom Greenwood: but I feel like saying thank you to ChatGPT, GPT is the slippery slope to ex machina.Chris Adams: Could be. Alright. Alright, Tom, I'm gonna, I'm gonna park that there before we go down that scary rabbit hole, but I'm just gonna, we're just coming up to the end, so I'm just gonna come up with one of the questions. Are there any open source projects that you've seen that you might direct people to or anything that you'd like to direct people's attention to?Whilst I have you here on this call before we head off?Tom Greenwood: I guess the thing that would be great to direct people to is the W3C Web Community Group, which is, to be honest, I haven't been. Anywhere, like as involved as I, I would've liked to have been for personal reasons, but they're doing amazing work as a community, really exploring kind of all of the facets of what goes into creating a more sustainable Web for the benefit of the wider web community and producing some guidelines to help everybody.So it's just something I'd, if you're interested, go and have a look at it. Get involved. There's some exciting stuff happening there.Chris Adams: And W three three is the Worldwide Web Consortium, W3C and SustiWeb is the sustainable Web group.Tom Greenwood: Exactly. Yes.Chris Adams: Yes. Awesome. Okay. I think that one of the few groups who are really good at using Wikipedia or using Wikis to share links and things, cause I think there was a link shared about their massive list of resources that they were working on at the moment.Tom Greenwood: Yeah. Yeah. They're pretty good at docu documentation. It's quite impressive.Chris Adams: All right, we'll share some links for that for anyone who's so interested in that part there. Tom, I think this brings us up to the time that we have and I wanted to say thank you so much for coming on. I really enjoyed chatting with you again mate, and it's lovely hanging out again because now that I'm no longer in the UK it's much, much harder to come visit you, folk.Come visit you in London, so, or wherever you are now. So, Once again, thank you very much for coming onto the podcast and I wish you the best. And just before I go is, where should people follow you or where should people look if they want to hear? If they like the sound of your voice or found what you had to say?Interesting. Is there a newsletter or a website you would point people to?Tom Greenwood: Yeah, so my company's wholegraindigital.com. You find that you look me up on LinkedIn. There are lots of Tom Greenwoods who run, and some of them run Web design agencies. But if you find the Tom Greenwood that runs Wholegrain Digital, then that's me. And then I've also got two newsletters. So there's the Curiously Green Newsletter, which you can sign up for at www.wholegraindigital.com/curiously-green/, which is a Green Web newsletter covering things that's going on in the world of sustainable Web design, but also Greentech more broadly.And then I have another newsletter on subs called Oxymoron, which is about exploring the confusing world of sustainable business and how we reconcile the aims of creating a more socially, environmentally friendly world with the world of business.Chris Adams: Cool. Thank you very much. I'm subscriber to both of those and I really do enjoy them. So thank you for writing them and once again, thank you for coming onto Environment Variables, Tom. Take care mate.Tom Greenwood: Thanks Chris.Chris Adams: Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get your podcasts. And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners.To find out more about the Green Software Foundation, please visit https://greensoftware.foundation/. That's https://greensoftware.foundation/ in any browser. Thanks again and see you in the next episode.
undefined
May 31, 2023 • 42min

Fact Check: Colleen Josephson, Miguel Ponce de Leon & AI Optimization of the Environmental Impact of Software

This episode of Fact Check we ask the question, can AI always help us optimise the environmental impact of software? Host Chris Adams is joined by VMWare’s Colleen Josephson and Miguel Ponce de Leon to tackle this from their unique perspectives within the industry. They also talk all things sustainability in virtualization and networking and how this begins with green software. They also give us insight into how VMWare is tackling decarbonization within their own company.Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteColleen Josephson: Twitter / WebsiteMiguel Ponce de Leon: LinkedInFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterResources:O-RAN SC Projects | O-RAN [6:34]Deep Cooling Solution in Data Centers | Office of the CTO Blog [19:45]RIC Radio Access Network Intelligence Controller [27:28]Kubernetes used in the O-RAN open source AI/ML Framework | O-RAN [29:32]HotCarbon 2023  [38:06]European Green Digital Coalition [37:26]Evaluating Coupling Models for Cloud Datacenters and Power Grids | Adrien Chien [39:35]If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript Below:Miguel Ponce de Leon: And the thing is, we're right in this maelstrom, this tornado of activity that's just got underway and just seeing how they fit together, it's not a perfect fit. I would say there. I couldn't give you, this is exactly the time horizon and this is how it's gonna happen, but I can tell with the level of funding, both from governmental agencies, from companies themselves, from research institutes to lots of public bodies and developers in their own time.It's a great time to be in and around this space of developing software, but specifically for the delivery of green technologies as we see it.Chris Adams: Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I am your host, Chris Adams.Hello and welcome to Environment Variables, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams, and in this episode we have two very special guests for an episode of fact check on Environmental Variables. From VMware, we have Colleen Josephson, and Miguel Ponce de Leon. Hey guys.Miguel Ponce de Leon: Hey Chris. Hey.Chris Adams: Okay, so for our listeners who are unaware, VMware has been a member of the Green Software Foundation since January, 2022. And we'll be talking a little bit about AI and the environmental impact of cloud. And we figured VMware spent a lot of time working in this field. In fact, they're synonymous with virtualization, but they also work in a number of other fields.One in particular is networking. So this is where our backgrounds come from. Before we dive in, let's just actually give a chance for our guests to introduce themselves properly so they don't, so we know who they are. So I think, Miguel, if you just introduce yourself and what you do, we'll hand over them next to Colleen afterwards.Miguel Ponce de Leon: Very good. So my name is Miguel Ponce de Leon. I'm director of Distributed Edge Intelligence in the office of the CTO here at VMware. So it's very much looking at research and innovation that happens from cloud. Towards enterprises and towards telecommunications. So networking, which is a topic that we're gonna talk about here, and very much looking at what it means and the impact of having the edge of the network and sustainability and connectivity to the cloud have had an impact on our products and services.Chris Adams: Thank you, Miguel and Colleen. I'll give you a bit of space to introduce yourself as well. For folks who missed your inaugural podcast last year.Colleen Josephson: Thank you very much. Yes. I'm Colleen Josephson. I'm a senior research scientist at VMware. I'm on the same team as Miguel, and a bit of news is that I'm actually transitioning to a full-time academic position at UC, Santa Cruz, where I'll be continuing to. To research sustainability, particularly in the space of low power in distributed systems.Last time I was a guest on the podcast, I was the org lead for VMware, and I'm very pleased to share that Miguel, uh, I've passed on the torch to him, so he's very qualified and excellent, so I'm really excited to be doing this podcast today with him.Chris Adams: Thank you, Colleen. All right, so for folks who are new to this format, Fact Check is a kind of format we use where we basically take a statement that people. Put into use in discussions around sustainability and software and we basically dive into it a little bit more to actually examine some of the assumptions because a lot of the time it really helps to really understand what some of the nuances behind this.And today, the fact check statement we are looking at is this one, can AI always help us optimize the environmental impact of software? And Miguel, I might invite you to talk a little bit about this part first actually, because this is something I think you've heard at least one time before.Miguel Ponce de Leon: More than one time, actually, I just as part of the introduction, just again, to say, look, I've been in and around telecommunication systems over the last 25 odd years from analog systems to two G, 3g, 4g, 5g. I know all these Gs that people hear about, but essentially it is and about looking about optimizing the way the networks are going to be deployed and used in the future, and very much we're seeing huge uptick in the use of artificial intelligence and machine learning to help with this optimization, and it is true to say that it can help, but I think there's a number of factors in order to ensure that what you use for putting the model together, for deploying that AI model and that, that you optimize the network, that you are getting the totality and that end-to-end sustainability and energy usage from all of that.I think there's a lot of factors that we need to drop into it when we discuss that.Chris Adams: Okay, so we've got a series of factors here and maybe if we start with one or two dimensions or key things that have an influence here, if we start there, maybe that'll help us frame some of our discussion. So maybe if we start with the first one, what's one of the bigger levers, Colleen, maybe if I hand over to you, if there's one that you would pick, what might, might it be?Colleen Josephson: Training. Training is a very expensive process nowadays. Whether it's in the telco space, cuz again, VMware, as you hinted, we have a long history of virtualization in cloud, but that also has become very relevant to telecommunications. We need to train the models that we use to make these decisions to try and save energy and the process of having so much data.And training it. It can be really power consuming. So I think one of the things that stands out to me is what is your anticipated energy savings once you've deployed this model? How long do you anticipate that this model will be good for? And do you need to retrain it? All of those you wanna have some idea of so that you can calculate whether or not it was worth the energy to train this model in the first place.Miguel, do you have anything to add?Miguel Ponce de Leon: Yeah, just, oh, I absolutely agree when it comes to, to train the model, but what I'd love to really highlight to everybody, even here listening is that these systems are being more open for everybody to get involved, more developers to, to get involved. Again, I talked about all those Gs before, but they were very much closed to certain vendors and certain companies that built it.We now have Open-RAN this open radio access network, which means that we can use. More AI models and people's training of those models within systems and deploy them more readily. But it also means that we have to have newer understandings about, again, when we talk about wireless, we talk about power amplifiers.We talk about controlling power amplifiers with AI models, and again, how it is that we're going to make sure that we efficiently train those systems in an energy efficient way before we even talk about turning on and off those radio head ends to save energy more often than not to save it so that, again, when we don't have so many people within an area, and therefore the radio doesn't need to be pumping out that signal the whole time.Again, immediately you can see what the benefit is. But if we end up spending so much energy trying to train the model in the first place, then again, have we achieved our actual overall goal?Colleen Josephson: For the listeners tuning in who might be less familiar with the structure of wireless networks, it might be worth giving a little bit of background on this power consumption. For telecommunications specifically, the biggest energy challenges are the radio access network or RAN, as Miguel was just talking about, and also data centers.And the way that I like to think of it is that wireless communication is basically shouting energy into the void at high enough power so that the receiver can decode it. It's inherently consuming a lot of energy. So a lot of the challenge in this space is trying to look at how can we use various tactics, whether they're AI informed or not, to save power for this radio access network.And also increasingly data centers.Chris Adams: So there's one thing that you mentioned there, Colleen. So you spoke about most of the kind of areas where people are focusing on are either the data center or the radio access network, but not really the kind of pipes between data centers or the kind of backbone. Is that one thing there where there's already a fair degree of efficiency or where you don't see that much change at that part?Colleen Josephson: I think the pipes between data centers that's inclusive of data centers. I'm sorry if I was not clear of that. Yes, so that the kind of the inter data center communication is definitely a part of the energy consumption end to end system that we need to consider.Chris Adams: Okay, but there's a chunk about radio, but there's one area which is relatively new to us or relatively new, like this radio access network where cuz we've seen so much growth in cellular and things like that, and without growing so fast. This has been one thing that we are now looking to use tools like AI or something to make them work a little bit more efficiently than what people would manually be switching on things on and off or what, what, maybe we could explore some of the levers you actually have here, because it's not clear to me why you might be using AI in the first place for this part specifically.Miguel Ponce de Leon: I might say a little something about that, Chris, because again, what you're gonna find with radio, what you're finding today with 5G, and you'll find it in the future as well, is that there will be more aerials. They will have smaller power outputs, but there'll be more of them. And with more of them, it means that you have to network more of them.And with networking, that many nodes, you're going to have a, an optimization system in order to decide where to place them, when to place them, and when to leave them on and when to actually turn them off. Because if you have less of them, what you're actually gonna do is you're more or less, what's happening is you're leaving the actual radio head ends and the amplifiers, you're leaving them on constantly sucking up all that energy in juice. Now what we have is we have more aerials, lesser coverage, but because you have more, essentially it's more of a complex item than having a, a couple of network engineers monitor them themselves monitoring the issues as they potentially break or they have to be modified.So it's a much wider range of, let's say, input variables that you actually have to, you cover off on.Colleen Josephson: Just adding to your comment, Chris, earlier and Miguel's, absolutely right. We have a lot of input Variables, but. You were talking about kind of data center, network consumption and kind of the back haul, and I think I wanna revisit this topic of radio access network and wireless communication. And it's gonna get a little bit down into the physics of it, but if you have a wire going from one end to the other, fiber optic, those have much less loss.So you can consume much more rapidly, get much more throughput for the same power consumption with a wired network than compared to a wireless network. With wireless you have all sorts of types of loss. The channel conditions are changing drastically all the time. So this wireless aspect is really one of the things that makes it, the radio access part of the network's a higher power consumer because you have this signal that you're sending out into the air as opposed to this little cable that has much more controlled conditions, you're gonna see something they call path loss. When you're going from the transmitter to the receiver, you're gonna see something called multi-path, which is where there are multiple copies of the transmitted signal arriving at the receiver. And these wireless networks have to be designed to overcome some of these challenges, and that's where a lot of kind of the radio access network consuming more power comes from, if that makes sense.Chris Adams: I think that does. So if I was to maybe take a step back for folks who might be familiar with 3G and 4g, when we talk about some of this, if that was a model where you have one or two very large kind of transmitters or receivers, that's a shift to 5G or possibly even six G is many more smaller ones possibly with this.And as a result, you have a kind of explosion of complexity. That's the, that's the thing that you have to manage, that you didn't have to manage before. And maybe the, this other thing I should ask you about then is that, it sounds really basic, but one of the ways when people talk about, say, 5G or six G being potentially more efficient or greener is just because it's easier to turn some of the system off rather than just having things blasting the entire time, 24 7. That's one of the assumptions that you're looking at?Miguel Ponce de Leon: That's exactly it Chris. And just to explain the complexity as well, there is the possibilities. We're looking at them again with next G and six G systems. We'll, we're basically, there'll be a small aerial connected to your home, for example. But again, what you'll want to do is making sure that is controlled efficiently.That it's looked after optimally. So for us, all of that is causing this need to self-organize the network in some way. That's the way we use terminology. There's a self-organization of where you put the frequencies on each one of the antennas and things like that,Chris Adams: Ah, okay.Miguel Ponce de Leon: having that kind of control remotely can be interesting and it could be.For example, that your home aerial today could be with operator number one, we won't name the operators, but you can keep in mind that most, in most countries we have 2, 3, 4 operators in country, but an operator could pay you for that aerial that you've put on your home and could be optimizing it for your six G signal tomorrow.It could be operator B that's using your aerial in some way, shape or form, and they may have a different way of optimizing. That same aerial for the signal that it's producing and sending out there and paying for your time to use it. So again, that's why we see a much more open system, a kind of an open ecosystem of how telecommunications will be actually provided in the future.Colleen Josephson: And adding to that, there's some really great opportunities for, I like to talk about the power of open systems and virtualization, software definition, rapid prototyping. This really gives us an opportunity for that that we haven't had yet quite in this space of the traditional monolithic vendor stacks.By opening it up to more members of the ecosystem, people can prototype these new clever applications, whether they be AI based or otherwise, and deploy them and get much more quick feedback on how much energy are we saving by trying this and rapidly iterate on those sorts of developments.Chris Adams: Ah, okay. I'm really glad you brought it back to the AI part here for the initial fact check. So basically, faced with all this complexity, there's been this assumption that if there's something complex, we're just gonna throw AI at it. Like how Google did when they bought Deep Mind and then threw AI at their own data centers to twiddle the knobs instead of actually having humans do this.And it turns out that maybe that isn't the best way because there's a significant impact. From actually training in the first place, and that may be larger than the inference in this case, for example. That's where the complexity lies in some of this, by the sounds of it.Colleen Josephson: Yeah, definitely.Chris Adams: I think that helps break down some of this actually.The idea being that, yeah, there is an inference that we need to be thinking about and a training part that we need to be aware of. And if you spend your entire energy budget on the training part, then you need a huge amount of use to make up for that saving that you might actually have. And that's something we're not quite sure whether we'd actually see here.And you also mentioned something that was quite interesting Colleen about a kind of decomposition of what might have been a kind of quite monolithic stack into a larger number of small look moving components, for example. So rather than just having one vertically integrated system, there might be a number of different players involved, or some of their work might be done in a cloud somewhere else or something like that?Miguel Ponce de Leon: Yeah, so I will have to say a little something about how the networks are changing towards cloud native, right? So how communication service providers, or telcos, as we might call them as well, are moving towards more, and I'll say something, technologies like containerization, containerizing, the software within those containers, they're actually developed by different entities, by different developers, by different companies.And the integration of them all still provide you with an end-to-end telecommunication system. And what I think is really interesting here, For, and especially for the Green, Software Foundation is around the carbon impact of the software that's developed and how that's tested in a CICD a continuous integration, continuous deployment development environment to see the impact of the overall delivery of these individual players who have been plugged together to provide a communication system as we go towards next G. And this is something, again, a lot of research is going into certainly around communication service providers in Europe, they're saying, okay, I can get vendor A, B, and C. I'll plug them together, I'll put them in a containerized orchestration environment.But they're also asking their question, not just performance, not just security, but what is the sustainability and energy impact? And if B is not written in an efficient software way. The software way is not energy efficient and not secure. Well, I'm afraid vendor B will have to pop out and an alternative to that is, is being looked at how you pop that in.And again, all the factors around performance, security, and sustainability are important factors with these products actually going online. So again, that's the type of research that we're seeing happening at this moment in time is how do you do that? How do you measure the baseline around that, especially in a cloud native world?How do you get the baseline and then how do you take actions Because now that it's so pluggable and playable, like I give the example, I can put A, B, and C, but now I can take out B and put a replacement in. We really have to be cognizant of the delivery of, of that service too.Chris Adams: Okay, so it sounds like you're implying there are for want of a better term, as long as you are honoring a particular contract of an API. The idea would be that if you have a stack of technology, here's a chance to swap out one part of your stack to make, to replace it with a greener part of your stack.And hopefully that will result in a kind of more diverse, healthy ecosystem that you'd be working with here, for example, where there's a kind of chance we would compete on transparency and compete on sustainability in this instead of just actually on performance and cost, for example. Cuz in many cases that's the world we we are living in now, right?Miguel Ponce de Leon: Big time. Big time. And I do know of operators that now are looking at can they provide their clients with a energy sustainable service? Like they'll allow their customers to actually choose. So you can choose your service and it has A, B, and C, or you can choose your service with A, Z and C. One is more green.One is using energy in a more efficient way. And is that what your company decides to do? Then they can offer it in that way. So that's also what I see from a research perspective, what we're seeing at companies and entities around the communication space looking to, to address. But I know Colleen has some examples too, around this, right?Colleen Josephson: Yeah, so bringing back the data center thread, one thing that I thought was really interesting in some of the work that VMware has contributed to is that we saw the data center portion of a network's power consumption double between 4G and 5g, and we're expecting that trend to continue and become even more pronounced going into six G.So that's why we say that the two big things to think about are the radio access network and also the data centers. And that brings to mind one of our data center success stories where it comes to AI and energy savings. One big source of emissions is power that's drawn for data center cooling in particular.And to tackle this, we've actually partnered with Intel and a company called Clark Data on a solution called Deep Cooling. It uses big data and AI to model various physical parameters in large data centers. Things like power load heating, required cooling, and it uses insights gained from this modeling to predict the results of changing computing workloads and then automatically adjusts the equipment parameters to optimize the system cooling, and it's implemented right now in several large Chinese data centers, and it's been effective at helping customers significantly improve power usage effectiveness, and reduce carbon emissions. I think the figures I have here saving 18 to 25% of electricity for cooling.This is one example of kind of an AI success story. But again, you always have to think about when I go to train this model, when I go to use it, what is the story going to be when we consider end to end, not just the immediate usage.Chris Adams: So this maybe might be a chance to talk about some of the metrics you might use with this then, because one thing we spoke about in a previous episode was that there are various researchers who are talking about AI and they're talking about. The idea that you might attract the energy embedded into that model.Just the way we talk about embedded energy in, say, building physical hardware, there might be an idea of like energy embedded into a model before you actually use it, for example, as ways of listing this stuff. And when people talk about that, people talk about, say like the energy usage, but people also talk about the carbon impact of that part as well.And this kind of speaks to the idea there's maybe another lever, not just energy itself. Is that maybe something you might wanna talk a little bit? More about the fact that it's not just energy, it's the kind of energy or how green or dirty the energy might be, or what levers you actually have there to affect that.Colleen Josephson: Yeah, that sounds like it's getting a bit into some of the green load balancing or carbon aware workload migration that we talked about last time, and I'm pleased to share that our work on that has been progressing. It's still very much in the research phase. There's not much new that we can publicly share yet.What I can say is that the calculations from the Mobile World Congress work that we did a year ago, which found that you can have carbon emission savings of up to 50% by more intelligently placing your workload. Depending on where the municipal power is greener or less green, they appear to match our prototype results.So we're preparing to submit some research writings on this work. So stay tuned. Hopefully much more will be publicly available soon. And we also have some exciting collaborations on this front, looking at how carbon wear load balancing interacts with energy grids and making sure that data centers that begin to implement these novel solutions, they remain good energy citizens and don't unintentionally negatively impact our energy systems.Chris Adams: So this sounds like we might be thinking about AI in a few other places then, because there's this phrase that I haven't heard people use that often. Being a good energy citizen as a data center, could you maybe explain that bit more because most of us, we know that data centers use energy, but there's more qualities to the energy than you might have there, and you might not know about the density of demand or load, for example that might be worth explaining.Miguel Ponce de Leon: So one of the things I can mention is that we are working with, uh, grid utility. In Ireland and with that grid utility that also hosts a data center. As it so happens, we're also working with an accelerator program, a program that is helping startups to look at how you can not just link, but actually be able to take the correct measurements from the green sources, the wind farm locations, and the usage within the data center for its workloads. So again, here it's about leveraging, not just the research we'll say, that would come from research performing organizations or from the offices, the CTO of VMware, but also looking at startups and startups within the space and to link this. And that is helping the utilities understand what type of usage.And imagine it's a utility that has their own data center. So it's helping them be a good citizen, even within their own environment. But being able to measure it and then being able to take action on it, right? Because that's the important thing is, okay, you've got your baseline, but what can I change about what I'm delivering within that data center, even down to the containers?How can I move my clusters and pods? Overt and maybe consolidate some of the pods. We're even moving some of that research as well to look at, even with the pods being available, how many of the CPUs are they using within the cluster? So again, it's about being able to help data center owners being good citizens around that space.Chris Adams: Okay, so there's one thing that came out of that. We spoke before about how previously with three and 4G you might have basically a series of very large antennas blasting stuff out all the time, but now you'd be shifting to a lot, a kind of constellation of smaller antennas, which you might have to spend some time coordinating and time and energy in terms of coordination costs to figure out which ones to turn off so you can provide things working quickly, but also things being more geo efficient.It sounds like there's something like that on the data center level as well, like where we might have had data centers, which have been a steady 24 7 load, but there's actually scoped scale it down or up a bit. Is that what you're proposing?Miguel Ponce de Leon: That's exactly it. Chris, you're painting a great picture here of the interconnectivity of it all. But yes, cuz you know, again, as Colleen was saying earlier, we have two main parts to the network. There's the radio side and then there's the core side. And that what we're doing here as part of the VMware team, as well as collaboration with a number of other companies in it, is attacking it from both sides.And again, looking at how you can really look at that end-to-end element of actually delivering those potential energy savings in order to reach some of the goals. As Colleen was saying earlier, I could say the telecommunications world is really looking at reducing by 2030 and even beyond then by a number of factors from where they are today.You need to look at all facets of how that's delivered. So yeah, that's, and that's what you hear from what we talk about when we're looking at the startups. We're looking at how to link both the wind farm energy to the actual data center energy that's used.Chris Adams: Okay, so I can see why people might just say, this is so complicated and there are so many moving parts. I don't wanna think about it. I'm just gonna let AI think about this. And that's why there's this assumption that, yeah, that's gonna be doing the optimizing, but there's an impact in its own right to do that.And there may be other ways of doing this. Maybe we could talk a little bit about some of the projects that are either in the open or in the world that people might point to allow people to start playing around with some of this stuff for experimenting. Cuz Miguel, you mentioned open RAN. So my assumption is there's an open standard or some open source projects that people might play with and I know that we've spoken about in previous episodes, some software or some tools on the kind of data center side. Maybe Miguel, if I spoke to you about some of the open ran style, things like that people could point to and look at, maybe to experiment with themselves. What projects on GitHub or GitLab or things like that might you point people to if they were interested in this kind of very dynamic new network and data network world?Miguel Ponce de Leon: Sure, and I'm sure we can give some links as well. So folks, and it's always the easiest thing, right? We give the show notes and we'll give some links off to it. But there is again, to help control the radio access network, there's a thing called the RIC; the short name for it, but it's radio, the radio access network intelligence controller, and there is an open source version of this.And the RIC uses a thing called, uh, cube flow. So this is a way of being able to host your machine learning model in a way that will be able to interact with the radio network. So there's a couple of open instances there where if you have a Kubernetes cluster, once you have the, uh, open source rig from the ONF the Open Networking Foundation that you can develop, again, some in-house terminology here, but we have what's called the X app and the R app.So the X app is this realtime application that can immediately, uh, basically turn on and off the radio head ends to help with that energy saving. Or we have the near realtime app, which is more or less, you can spend a little bit more time considering, given the complexity of the number of aerials that are out there, about how you'll deploy and which ones you would turn on and off.And that's somewhere, again, a number of easy programs written in Python that if you wanted to get up and running and in doing so, you could have an impact on a future well known operators network in your area. Because the whole system is becoming far more open and the app that's developed on the open source projects I've just mentioned, you could then put them on things like the VMware RIC.We offer a one that's very much telco grade gets deployed in the network, but the app that you've developed in ai, that the model that you've developed can be deployed in the same way. You don't have to wrap it up much more differently than to do so there. There are some relatively easy touch points to, to get involved here.Chris Adams: Okay. And Colleen, we spoke before about junkyard data centers and I think last time you came on we, you were talking about some of the research that you folks are doing with the VMware to start tracking and measuring the savings, the carbon savings before. So if there, are there any kind of data center projects or orchestration projects you might point people to?Because I think I've spoken about things like eco visors and stuff before, but I'd love to know what else is going on here actually,Colleen Josephson: Yeah, I shared some overlap with what Miguel was talking about, to be honest, and I think containerization, Kepler very important project. Yeah, so Kepler is this energy monitoring and tool for Kubernetes containers and you can hook this into some visualization systems. You know, that's one kind of open source project for monitoring data center, energy consumption that I'm aware of.Very important in that area. Not AI specific, but those two areas are a frequent topic of conversation among people who work in cloud and data centers.Chris Adams: Yes, Kubernetes efficient power level exporter. I found the link for it actually. That's what it stands for. There's a project. Where there's actually an ongoing conversation and some of the kind of Green Software Foundation I can't remember which repo it is, specifically where Adrian Cockcroft has been mentioning this idea of Kepler as one of the mechanisms to allow kind of minute by minute reporting at a cloud level so that you can actually get some of the numbers to optimize for carbon or optimize for energy usage.Cuz this is one thing that you don't always have for all your providers, and that's one of the kind of underlying piece of technology used to expose these kind of resources usage figures for each of these kind of pods or clusters of computing and things like that. So we've got about five or six minutes time left, and I did want to leave some space to talk about some of the kind of wackier stuff that we didn't get a chance to talk about last time.Just before. Towards the end of last episode, we spoke a little bit about things like junkyard data centers, which were like data centers made of various end of life computers and things like that. And Colleen you mentioned different kinds of either zero power or low power. Things like soil powered batteries and stuff like that.And seeing as we've gone into all this kind of industrial level stuff, I figured it might be worth an interesting to look at some of the other level, like the really low, ultra low power stuff. Is this what you're gonna be going to study or is this some of this work you've done before? Because I think it's gonna be interesting to some of the crowd here, realizing that things happen at the bottom end of the scale as well.Colleen Josephson: Yeah, yeah. This is the bridging of the two worlds and the data center and these big monolithic or not so monolithic anymore systems are really important to consider, but. We use these telecommunication systems to hook into much smaller devices, tablets, smartphones, and ever increasingly IoT. And what is really interesting about these IoT and smartphone, smaller user devices is they are special because they've been designed to be power efficient.So the carbon footprint for them is significantly larger in the manufacturer phase. Compared to the device use phase. So they, they have a much higher embodied carbon footprint proportionally than the energy consumption that they use. There's some really interesting work going on here for how can we lower the embodied carbon footprint of some of these massively, or we anticipate them to be massively deployed miniature systems.And one of the ways that I've worked on that's out of the box is batteries. So we have some ultra low power communication devices that, you know, we can. Begin to use to do something called simultaneous sensing and communication. And one of the bigger footprint aspects of some of these systems are the batteries, traditionally speaking.So if you can minimize or eliminate the need to have a battery, then you can significantly reduce the embodied carbon footprint. So one of the things that I've looked at is can we actually harvest energy from the soil itself? So this is really early stage research that we're starting to look at UC, Santa Cruz, and it hooks into something called intermittent computing, if you've ever heard of it.And it's this idea of computing systems that don't constantly have power available and the paradigms that the system operates at. We design data centers, we assume that power is always going to be available or we did. And so now if we have to be much more dynamic and on our feet about when power is available, we have to be able to very rapidly save progress.Go into power shave mode and then rapidly spin back up again when there's power available. So the intermittent computing community has been really active at connecting the ultra low power and ultra far edge and hooking it into our core networking and traditional communication systems. I can add, if we're looking for off the wall ideas.Hot Carbon. The first inaugural hot carbon workshop was last year. I'm pleased to share that this year there will be a second iteration of this workshop. One exciting development is that it's tentatively going to be sponsored by ACM Sig Energy this year, in addition to VMware's continued support. So I'm actually working as the publication chair for that workshop.The submission deadline was yesterday, 5 21. The workshop itself will be on July 9th. Just shout out to those of you listening. So tune in for what's sure to be a very interesting cutting edge work in the sustainable software space, and it's going to be a hybrid workshop. The physical location is in Boston Mass, but now if you go to the website, hotcarbon.org, up very soon should be a registration link so that you can sign up to attend virtually or in person if you happen to be in the Boston area.Chris Adams: Cool. Thank you for sharing that. Colleen, for anyone who is on the fence, I virtually attended Hot Carbon last year and I basically plundered that list of people for guests for this podcast cause there's loads of really interesting projects going on there. There's also some really nice stuff I. Colleen I just wanna ask about this idea of intermittent computing, cuz it sounds like it's like really almost super serverless. So the idea that there's, it's almost like battery-less, basically the idea that you do the things scale right down to zero and you just basically don't really work until you've got energy coming back in again.That's the idea behind that.Colleen Josephson: I think there, there are definite connections to battery-less. An intermittent computing paradigm can work whether there's a battery or not. Trying to work around how charged that battery is and turning off when power is reducing. But yeah, it's a very prominent area of work when you consider battery-less computing and just to connect everything end to end.You might have these very low power sub microwatt, in some cases, devices at the ultra far edge, but you need to have something. That brings that data back to the cloud, and this is where you have more traditional edge computing, like maybe a server that's at a farm or some things that people are starting to think of are edge data centers that are potentially even mounted to drones, or edge 5G that's mounted to drones.So lots of really near edge and far edge paradigms.Chris Adams: Okay, so it sounds like as we have moved from monolithic, gigantic computers to things becoming smaller and more distributed, there is a coordination cost, which is why people often talk about, this is so complicated I'm just gonna hope that AI solves it for me, which is where some of these ideas came from, that of course, you can use AI to automatically work out, erase the environmental impact from computing.I hope that one thing we're taking away from this conversation is that no, it's a bit more complicated than that and, but there's lots of exciting rabbit holes to drive down. Folks, I've really enjoyed this conversation actually, and I think we're coming up to the time that we have here with the la Do you folks, if in the last few minutes that I might actually ask, are there any projects or things you might point people to that we haven't spoken about that you'd like to give a shout out to before we wind up?Miguel Ponce de Leon: Okay, because I'm based in Europe, right? There is a coalition that's working together with a number of working groups, really looking at how all the things that we just talked about, but with more specifics. Cuz I know you, you wanna, do you use the word fact checking around what we're trying to achieve here.So there's a number of working groups in, in Europe where companies are coming together and really looking to do this Now. One of them is the European Green Digital Coalition, right? So the EDGC I'll send you on a link and around it as well. But thi this is a space where, We're having to look at, cuz at the end of the day, we will standardize around what way you're going to measure these changes.What way It's gonna have an impact on business in what way? When you do offer this fantastic green telecommunication service, what you're saying is energy aware. But there's gonna have to be standardization around whether or not that is actually the case. And so there is a good bit of work in and around this.Again, I almost seem to use the word research and it's happening. And the thing is, we're right in this maelstrom, this tornado of activity that's just got underway and just seeing how they fit together, it's not a perfect fit I would say there. I couldn't give you, this is exactly the time horizon and this is how it's gonna happen, but I can tell with the level of funding, both from governmental agencies, from companies themselves, from research institutes to lots of public bodies and developers in their own time. It's a great time to be in and around this space of developing software, but specifically for the delivery of green technologies as we see it.For me, that would be the big pointer, and I'm hoping that someone, one or two of the topics that we've mentioned here, would give Annie developer an opportunity to actually, like you were saying earlier, Chris, have a look at a GitHub project. Have a look at being able to develop a small model, some code, and have somewhere to actually apply it where it will have an effect on your own services in the future.So certainly that's what I'm excited about and why I'm working hand in hand with colleague on this particular topic.Chris Adams: Okay. Thank you, Miguel and Colleen. Just as we as we wind out, what would you draw people's attention to apart from hot carbon, of course, which is freaking awesome.Colleen Josephson: Yeah, I've got two, two things. For those of you listening who might be interested in doing a bit of a deeper dive on telco sustainability, here's, there'll be a i, I just shared a link to our VMware Telco sustainability white paper, so that goes, Into more detail on some of the challenges of the radio access network, the RAN and the data center, and then also coming back up the stack to this idea of data center being good energy citizens.I want to name our collaborator Adrien Chen at the University of Chicago. He's been active with us in this area and in some of these collaborations and this paper here. Evaluating coupling models for cloud data centers and power grids, that that work is really great for showing some of the problems of how data centers can disrupt the grid.So I encourage people to go check that out if they're interested in that topic as well.Chris Adams: Cool folks. We began talking a little bit about a fact check. We. I think we've realized that you can't automatically assume that AI will automatically reduce the environmental impact of everything. And we realize there's quite a lot to it. But I've really enjoyed driving down all these rabbit holes with you folks and uh, yeah, thank you so much.We'd love to have you folks come on again. Yeah, folks, have a lovely morning or afternoon wherever you are in the world and yeah, see you around. Take care folks. Tira.Colleen Josephson: Thanks again, Chris.Miguel Ponce de Leon: Thank you ChrisChris Adams: Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get to your podcasts. And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners.To find out more about the Green Software Foundation, please visit greensoftware.foundation. That's greensoftware.foundation In any browser. Thanks again and see you in the next episode.
undefined
May 24, 2023 • 29min

The Week in Green Software: DIMPACT with Andri Johnston

Host Chris Adams is joined by Andri Johnston, Digital Sustainable Lead for Cambridge University Press and Assessment as they talk about using DIMPACT to calculate the carbon impact of digital publishing as well as news from the world of green software concerning one acronym; ESG and one portmanteau; LightSwitchOps. They also cover some upcoming events and we learn about Andri’s love of books!Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteAndri Johnston: LinkedInFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:ESG as a lever for sustainability impact | Elise Zelechowski Thoughtworks  [2:49]Using DIMPACT to calculate the carbon impact of digital publishing at Cambridge University Press & Assessment | Andri Johnston & William Pickett [7:31]How Would the Business Benefit from Your Greener Java Application? | Holly Cummins at Devoxx UK [14:53]Resources:Thoughtworks.com/socialjustice [3:33]ShareAction [6:16]As You Sow [6:43]The True Climate Impact of Streaming | Netflix & Dimpact [8:49]Virtual conference carbon footprint revealed | Cambridge.org [11:23]David Hsu on mastodon.energy [13:53]The Baking Forecast UK [21:20]Effects of Internet-based multiple-site conferences on greenhouse gas emissions | Vlad Coraoma Events:Green Infrastructure Meetup GfK [x] Green Coding Berlin - 31 May 6:30-8:30PM | Green Coding Berlin [23:19]UN World Environment Day: The Green Software Revolution (Virtual Event) - Monday June 5th | GSF [24:02]LF Energy Summit 2023 (June 1 – 2, PARIS & Virtual) | Linux Foundation [24:46] If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript below:Andri Johnston: We have no control over what device people are using or what energy grid they're using, but we do have control over how we're building our software and making it as energy efficient as possible. And in my experience, the moment we were able to show that those numbers to board execs and that kind of level, it was like, oh, okay, so we actually can do something.Chris Adams: Hello and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams.Hello, and welcome to another episode of The Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams, and in this episode we'll be looking at the news from the world of green software that involves ESG and a portmanteau LightSwitchOps.Not only do we have this, but we'll also have some exciting events for you to attend. As always, we usually try to introduce our guests before we get started, and this week we have Andri Johnson joining us. Andri say hi.Andri Johnston: Hi. Thank you so much for getting me on the podcast. So yeah, I'm Andri Andri Johnson. I am the digital sustainability lead at Cambridge University Press and Assessment. And a little bit about me. I'm a very keen runner and gardener, however, that's taking a backseat right now cuz I am 36 weeks pregnant and I've deep dived into the world of sustainability and babies, which is a very weird world, but really exciting.So, yeah. That's me.Chris Adams: Cool. Thank you. Andri, you seem to be continuing our trend of guests who are just about to have kids before they disappear onto the other one. Yeah. Sara. Sara Bergman who was on before. She was also just coming to the end before she popped a sprog as well. And uh, yeah, uh, nice to hear. I wish you were the best for the second half of this actually.Okay, so for everyone who is, who listened to this first time, this is basically a news roundup show. So what we do is we look at some stories that caught our eyes, we share a couple of records about them, and then. Basically move on from there and if we discuss anything or any links come up that might be interesting.We'll make sure we add it into this show notes, so if there's any acronyms or anything like that, we'll work to point to some either definitions or lists for further reading. Okay. Andri, will that further ado? Should we look at the first of these stories?Andri Johnston: Yeah, sure. Let's go.Chris Adams: Okay, so this first story is ESG as a lever for sustainability impact by Elise Zelechowski at ThoughtWorks.Elise is actually the co-chair of the policy working group, and this is a blog post that she's written about some of the approaches that ThoughtWorks is taking around esg. ESG for the uninitiated stands for environmental, social and Governance, and it's a kind of set of terms or a kind of framework that people use to assess a company's performance in terms of sustainability and across a number of dimensions.ThoughtWorks has been talking about some of this for a while, and they've been probably one of the, in many ways, kind of leaders in this particular field. They've literally got a url, which is thoughtworks.com/socialjustice, to give you an idea of where they stand on a bunch of this stuff. And Andri, Andri, you had to look through this piece.Is there anything you wanna add on this one?Andri Johnston: Yeah, I found it really interesting and I'm really encouraged by the fact that especially on the tech side, more companies are starting to look at ESG. Not just reporting on carbon emissions. So at Cambridge University Press and Assessment, ESG is very important to us because we are linked with the University of Cambridge, we have to comply with a lot of social issues as well.And our environmental team and our EDIB team work very closely together. So for me, this was really interesting that Elise was talking about how companies need to evaluate themselves on all of these factors, and also working with your suppliers and that kind of thing, because that's, that's difficult.Like it's one thing, getting your carbon emissions from them, but really making sure you align with their ethics and it aligns with your ethics. I think that's really important. So I found it really interesting and very encouraging that more companies are starting to do that. Yeah.Chris Adams: I wonder how much might also be tied to, so ThoughtWorks went public this year and uh, there are over the last year or two, you have seen. A real uptick in ESG as a kind of buzzword in investment circles and in particular, say Europe for example, things you might consider kinda like green investments are able to get access to capital in ways that other groups don't.Particularly with something related called the European Taxonomy, which is specifically about saying, okay, these things which are green, Which we have decided society needs more of, get access to lower interest rates so they can borrow cheaper compared to other ones. And, uh, this is, there's a real push from investors asking about this in many ways.Sort of getting an idea of what they're exposed to from a climate point of view, but also from a kind of governance point of view and things like that as well.Andri Johnston: I guess there's also something around how this sits with your employees, because for us, we're technically a not-for-profit and for us, a lot of people come to work. At UP&A because of the ethics around it, the university, a couple of years had to de divest because of connections with big oil companies.And for us, it's the same. Our internal colleagues will ask us questions, who are we partnering with? What's their ethics? How does that align? So I guess there's both the investment part but also thinking about your colleagues internally and how they feel about your sustainability as a whole. So using this as a measure.Chris Adams: Yeah. This is definitely a thing. Actually, there's a few interesting kind of jump off points here that may be going outside the remit of green software, but a problem might be of interest. I know in the UK there's an organization called ShareAction that's been doing a. Bunch of really interesting work on employees and where their money's invested, because a lot of the time if you're working for a company where that you feel that you believe in or you want to be spending some time with, you'd, you'd like the the money that's being put aside for you to also be doing things that you also believe in, rather than propping up fossil fuels or doing things like that.Especially when the science is spelling out that we really need to not be involved in that as well. Okay. And there is also an organization called, I think As You Sow they've done some really interesting work with shareholder activism, specifically about putting shareholder resolutions to get a large organizations to move more quickly on sustainability.There's some really fascinating work that they did with Microsoft actually to basically really push for some more circular electronics. And what we'll do is we'll share a link specifically about how basically some engagement at a kind of shareholder level using the kind of shareholder resolutions mechanism was used to basically say, let's actually look at the environmental impact of say things like, say Microsoft Services lasting longer, and is that actually a net gain for us?And it turns out that it was, it's a really nice and interesting story because yeah, it turns out there are lots of ways that you can push for things rather than just coding. And I think that's gonna be the next thing we might touch on actually, which is the story about using DIMPACT. So DIMPACT. Or maybe you can help, how to pronounce this.What'sAndri Johnston: I think we just say DIMPACT, but yeah, it's digital impact, so it can be either, but yeah, DIMPACT.Chris Adams: All right. Okay, so this is using DIMPACT to calculate the carbon impact of digital publishing at Cambridge University Press and Assessment. This is a story about the use of DIMPACT, which is a model that was developed by a consortium of different organizations, largely to understand the environmental impact of basically digital services and Andri just before we started the call, you were telling me a little bit about some of the origin stories of this and how some of this came about, and this is some of the work that you've been involved with, right.Andri Johnston: Yeah. Yeah. DIMPACT was created by a consultancy company called Cornerstone based in London, in conjunction with the University of Bristol and their computer engineering department. And it basically, the first kind of version of it came from the BBC wanting to understand what the carbon footprint was of their online advertising.And from there, the tool is built with each different company using different model, and for example, there's a digital publishing module, which we use, but there's also a video streaming module, which Netflix, for example, used last year, Netflix and the Carbon Trust with Cornerstone published a white paper on video streaming, and it was really interesting debunking a lot of the myths around video streaming and where the majority of the carbon emissions lie.But the whole tool is based on the same kind of methodology. It's just different workflows depending on what type of business you're in. Advertising, streaming, or publishing like us. Yeah.Chris Adams: I see, and you spoke about this idea that there's maybe one model that's been published that, that we can, we're gonna link to, this is open for people to look at, but the idea was that get based on the use case, you might want to use a model slightly differently. So streaming might use a digital infrastructure in a different way to publishing, for example, because there's maybe a different environmental impact from watching something or streaming some files compared to dynamically generating a page every single time or something like that.Andri Johnston: Yeah. Yeah, exactly. Exactly. And I think what's fascinating and what I find really good about the tool is the granularity it can go into. So on a publishing side we publish the majority of our content online, so all of our customers access our books, our journals, our textbooks online, but there's also a content production kind of side to it, and that's what I find really useful about the tool.It doesn't just look at the hosting and the accessing of your webpage. It also looks at your entire workflow of your content production and storage, which I think is quite unique. And that's why we started using it because it allowed us as publishers to look at our complete workflow from the start of producing your content for book, for example, all the way through, let's see, someone accessing it online.So yeah, that it gives you a very good overview of your complete carbon footprint.Chris Adams: Oh wow. So that's quite a large boundary. So rather than just saying, I'm just gonna look at the website you're talking about, okay, if there's maybe another batch job, or there's another whole edit editing subsystem, you're keeping that inside your kind of boundaries at where, right. Okay.Andri Johnston: Exactly.Chris Adams: All right. Okay.What we'll do, we'll share some links to some of the underlying assumptions and ideas behind how these models work, but there's one thing I also wanted to actually talk about, cuz there's another link inside. This was this idea of using some of these related tools to understand the environmental impact of virtual conferences as well as the publishing part.Andri Johnston: Yeah. Yeah, because we'd partnered with DIMPACT to do the publishing side when I was doing the article that the will link to it was a pilot project that we did in the academic division for at CUP&A and in the academic publishing world conferences are huge and we had a lot of people coming back and saying, no, we should go back to in-person conferences.But at the same time, a lot of pushback and saying, no, we should do it online for environmental reasons. So we actually really wanted to understand what the impact was of a virtual conference. So we partnered with DIMPACT again and they. We're developing a module for virtual conferences. They're similar to the publishing and advertising module.They developed this module for virtual conferences and we took a two day online conference with about a hundred participants per session. We had eight different sessions and we had people from all over the world joining us. We had about 500 participants in total over the whole time. So it was quite big.Um, and we actually found that. Over the two days, the conference emitted between 15 and 20 kilograms of CO2. For the entire conference. We would've had at least 70 to a hundred people fly in from the US to the conference. It was just really fascinating to do that calculation and to see what the impact was and was never to say.In-person events are bad. It's just so you have the tools and you have the knowledge to be able to say, this is what the impact is of our online conference for this specific conference. We made the choice to do it because of this. So yeah, I think it's great to have that knowledge.Chris Adams: Okay, so in this scenario, Streaming is not the new flying. Flying is still the new flying.Andri Johnston: Flying is still the new flying. Yeah.Chris Adams: Okay. And what, you said 15 to 20 kilos of co2? Right. Okay. So if we assume, typically this is a kind of common factor that I've seen shared, and we'll share a link to. Typically if you have a cappuccino or a cup of coffee, you're looking at maybe between two to 400 grams of co2 just for that cup of coffee here.So basically the coffee break for a hundred people was roughly the same carbon footprint as the entire virtual conference, just for the assumptions are more or less in the same ballpark here. Okay. All right. That's a useful thing to bear in mind when we're looking at some of this then. Wow. Okay. Also, there's one thing I might share related to this, now that you've actually just spoke about this.There's a chap on mastodon.energy, David Hsu. He's done, he's actually been sharing some really interesting work about that's been happening at MIT about their approach with flying and basically academic. The whole kind of idea of, okay, if I'm an academic or I'm doing a bunch of, I'm involved in lots of conferences, where is the environmental impact?We'll share a link to that deck as well. Cause it's really fascinating and it shows a bunch of the ideas that are being used in MIT to basically get handle on the environmental impact from the whole life cycle of creating what we might refer to as knowledge products like this. And you talk about lots of measures, like say, applying an internal carbon levy the way Microsoft does, but they also talk about things like, say literally just public tracking of this stuff. So you get a rough idea of, okay, at a team level, these are the miles flown for this kind of work and things like that to basically make these things more visible so you can create, uh, an awareness of social proof around this stuff. Okay. Thank you, Andri. That was great.Andri Johnston: it sounds fascinating. Yeah.Chris Adams: All right.Should we look at the next story? Okay, so this is Holly Cummins at Devoxx UK. How would you or the business benefit from your greener Java application? So we spoke about a talk by Holly Cummins at Red Hat about greener Java applications. And this is a talk that Holly was speaking about and this is where this notion of LightSwitchOps has come up.I think she's also Holly's on a bit of a roll, cause she's mentioned she's come up with a bunch of really quite memorable terms like cloud zombies and things like that here. Is there anything that kind of caught your eye when you were reading this stuff?Andri Johnston: I think I really liked the idea of making colleagues more aware of greener Java and greener coat because, so taking it back a little bit to the work we did with the DIMPACT tool, as we know in the majority of digital products at the majority of our carbon emissions lie with our end users, and there's still a little bit of a back and forth whether we should be reporting on that, whether we shouldn't, is that part of scope three?But what we realize is that's the one place you can actually start making a difference in the way that you. Build your software and that, and especially the way that you are creating the content and these pages that people access. And I think this is a kind of thing that you need to provide to your teams as a tool to say, we can make a difference in how we're building our website.So for me that was a really easy way to say, here's a tip, here's a small thing that we can do as digital product people to make our websites more energy efficient at the end of the day. So for me that was really good. It's that, found it really interesting. I was like, I definitely wanna share this article with my teams.Yeah.Chris Adams: So I have a question here about borders, cuz I just, before this, Cost. I did a bit of research on the model, and there are various ways of modeling the environmental impact of a digital service. And the actual end user part is often one of the things which is can seen as a kind of stickler. Like for example, Mozilla, when they report on their emissions, 98% of their scope three, their supply chain carbon footprint came from the device of end users of this.And basically, this is an organization which reported their carbon footprint of around 800,000 tons. Where 98% of it came from end users, whereas large other organizations like say Google and Netflix, they haven't included these numbers themselves for some of this, and Digital Impact does, but it includes the usage, not the kind of embodied emissions that went into making theAndri Johnston: Yes, that's correct. Yeah. Yeah. But I think something that we need to take into consideration and why, I think for us it's important to report and to calculate those emissions is because, and Holly points to the carbon emissions of different regions for data centers, which is very true. But also carbon emissions are different for different end users depending on where they're based in the world.So we know that over 50% of all our customers are not based in the global south and don't have access to grids that are gonna greenify anytime soon. It's really important to understand that if that's where the majority of our carbon emissions lie, we have no control over what device people are using or what energy grid they're using.But we do have control over how we're building our software and making it as energy efficient as possible. And in my experience, the moment we were able to show that those numbers to board execs and that kind of level, it was like, oh, okay, so we actually can do something. So yeah, I think it's just important to keep that in mind and not just say, we're not gonna report on it because it's not our problem.Because I do think in some ways it's our responsibility too, to still work on it.Chris Adams: Yes. There's also one thing you just mentioned actually just springs to mind how there's actually a paper from, I think the Limits conference a couple of years ago that was, that came up in some of the discussions of the Green Software Foundation. When we're trying to figure out, okay, where should the boundary be for some of this, there are decisions that can be made at publishing level that will basically induce people to upgrade or use one device over another device.We might know this is premature obsolescence, but a lot of the times you might see it when if you use Slack or tools like that, you might see how. You stopped being able to use certain browsers with Slack, for example, or even if you tried to use a browser, like say, Firefox might be the browser that I use by default.I can't use Firefox on some tools because they assume the use of Chrome or certain tools like that. And there's a whole thing about, okay, well how far are you gonna actually be supporting a, and what happens as a result of you choosing to support certain devices over another one? All right. Okay. There's also, the other thing that we're gonna talk about with this was this idea of LightSwitchOps.I really like it. It cuz it feels like it captures, and we've spoken about, there's an idea in tech where people talk about things like serverless, whereas there's an idea of things being switched off that when you stop using them. But the idea that we don't have service is a bit of a kind of, It's a fiction that is cool, but let's be real.We're not really, we know their service still there. Whereas LightSwitchOps, the idea of switching things off, it makes it feel much, much nicer and it feels easier to say than scale to zero. So once I kind of get your take on LightSwitchOps as a kind of low tech and, but a friendly way to talk about some of this stuff here.Andri Johnston: I think that's exactly what it is. It's a friendly way to explain to people how we can build our products and how we can make sure that they're energy efficient. So just to give a bit of background, I don't come from a tech background at all. I come from a publishing background and I taught myself all of these things and I got fascinated by it.And it sometimes gets quite overwhelming when you are talking about, especially things like around cloud hosting and serverless, and it's becomes very techy. But the moment you can simplify it, Then it's almost like you can say, oh, okay, yeah, I can make, I can do this. Anyone can change the way that we're creating our products.So yes, I think that's exactly what it is. It's simplifying tech for everyone to understand and digital sustainability, because it does still seem very farfetched in, in some ways. If you're not super techy.Chris Adams: Yeah, I'm with you on this. Are you familiar with the baking forecast, by the way? Andri. Okay. The baking forecast is the way I talk about carbon intensity to people who are not really already really into this stuff. At the baking forecast, you, I think it still is a Twitter account that basically will tell you, when the electricity is gonna be particularly green in the UK, so if you're gonna bake a delicious cake or loaf of bread or anything like that, it'll be a particularly green cake, which means that you'll feel particularly good about yourself.And as opposed to if it's a really fossil fuel, heavy, heavy moment of the grid, maybe on a wait a little while, probably don't bake today or bake tomorrow, and they just provide little forecast just like we have the shipping forecast, which is a well loved. Institution in the uk you now have the baking forecast to communicate the idea of carbon intensity of electricity.And that seems to be pretty intuitive to a nation that is a fan of the British, the Great British Bake Off or anything like that. It seems like a really nice way in to talk about something which is gonna become more and more of a kind of staple or a regular constant. Uh, and as we move away from a kind of fossil fuel kind of based grid to something which is more in tune with the natural cycles and rhythms that we see of like sunlight and wind and things like that.Andri Johnston: Yeah, it feels more natural in any case, isn't it like to live with nature in that way?Chris Adams: Yeah The approach that I found as well, like when you talk about grids having a kind of cycles, then it's a little bit like really sped up seasonality for food. Uh, that's how I try to explain that to other people as well. Cause once you've. People have some notion like, yeah, okay. Things come into season, there's cycles you can use there.And if you think about grids and electric, that's like the equivalent for people who work in technology is basically like chefs might have seasonality. We have grid intensity for what we do.Andri Johnston: Yeah, that's a really good way to see it. Yeah.Chris Adams: Okay. Thank you. Alright. Should we look at some of the events here to see what we've got coming up?Andri Johnston: Yeah.Chris Adams: All right. Okay, so there is an event that's listed below here. This is the Green Infrastructure Meetup by Green Coding Berlin, and it's about, there's a guy, yeah, Arne Tarara. He, he works at the imaginatively titled Green CodingBerlin. They're basically a a bunch of people in Berlin who really into green coding basically, and they're presenting and running an event that's happening in Berlin on the 31st of May. So that's what's happening there. And there's a, there's some talks that they have, Arne Tarara and his little gang of people, they have a bunch of open source tools, which they make available for everyone to use for free and to basically try using some of this stuff.And the other thing we have is UN World Environment Day. This is on June the fifth as well, actually.Andri Johnston: That looks really interesting. I was looking at that. I was like, oh wow. Like I really want to attend that one.Chris Adams: Yeah, and the people speaking here. So we've got Asim Hussain, who's a regular on this podcast. Anne Currie, she of Space Death Rays and data centers in space. There's Tamara Kneese she's actually one of the lead authors on a report about. Basically cryptocurrencies and the environmental impact of grid cryptocurrencies for the Linux Foundation, but she's also doing a bunch of work with the Green Software Foundation on upcoming green software report and Pindy Bhullar, this CTO for ESG at UBS and a PhD researcher.This is an online event for anyone who's interested on the 5th of June. The other thing they don't have mentioned is the Linux Foundation Energy Summit that's taking place in Paris where it's a two day long conference with a bunch of events that I'm hoping will be shared afterwards because, well, I'll be going there in person to see, and I've seen a bunch of tools and talks coming upcoming, specifically about various kinds of open source tools that you can use to quantify and understand the environmental DIMPACT of the digital services that we use in on a daily basis.Andri Johnston: Sounds really interesting. I have to say, I'm definitely gonna share the UN one, the online one as well, because I am a bit biased towards online events. So having, coming from South Africa, I always had this feeling that there's not enough opportunities to go to things like this. And one thing that I really love is how there's more and more online events like this for people who can't travel all the way.Yeah. So I, I think that's really great to have more of these.Chris Adams: I know what you mean. I'm really with a bit of luck. What I'd love to see as a follow on from some of this stuff, we've seen people understanding the environmental impact of entirely virtual events, and we see a significant amount of information about the impact of in-person events where we see that most of the time, the road to the impact is around 80%.Basically of flying people to and from an event a lot of the time. But this idea of kinda like hub and spoke or kind of hybrid events, I haven't seen that many published reports or things to help us understand if there is a way to have some kind of interim here. Because there is something to be said for high bandwidth interactions with other people, but there is also a significant environmental impact associated with that.And, uh, there have to be some alternatives to this. What we'll do, I'll share a link cuz anyone I know about is a piece by Vlad Coraoma. He's shared a paper about this from a couple of years ago, but beyond that though, ah, Andri something we could, it'd be really nice to see. So if few folks are doing that anytime soon or doing any kind of hybrid events, do please let us know and it'd be really lovely to hear about that.Andri Johnston: Yeah, it's definitely something that we're interested in looking into more, so I'll keep you in the loop.Chris Adams: Cool. All right, Andri, thank you very much for this. We're just coming to the end of this, which is time for the kind of closing question. I suppose you work for one of the most well known publishers in the UK, and I guess I should ask you about books in that case, where do you tend to get your books? Do you buy 'em secondhand in shops or do you read on Kindle, or is there some particular channel you into?What would you recommend?Andri Johnston: I think I am a bit of a book snob. Previously I worked in trade publishing in Penguin, so I'm a little bit of a book snob if I'm just reading something. Quickly, then I get it on my Kobo because I'm also very aware of the actual impact of a physical book on the environment. But when I do buy physical books, I usually go to indie bookstores and buy the hard cover version because I know how much goes into producing it as well.I don't buy that many books, which seems shocking, but working in publishing, but it's just because I've become very mindful of what I do buy. So if it's a quick read, I read it on my Kobo, but if it's, it's like a book I really want in paper, I'll go to a very indie niche little bookstore and support that way.That being said, secondhand, old secondhand book stores that are very dusty are definitely one of my favorite places in the world. So yeah, I'm definitely a little bit of a book snob, but that's to be expected.Chris Adams: That's so good. The problem, I think that's fair. If you work with books all day long, then you get to have opinions about books. All right, Andri, thank you so much for coming on for this little session today and uh, yeah, I've really enjoyed this chat, so thank you for coming on for this week in Green Software and hopefully we'll have you on again sometime soon.Andri Johnston: Yeah. Thank you so much for having me. It's really great and thank you for the great podcast. I really enjoyed and I always learn a lot, so thank you so much.Chris Adams: Cool, thanks Andri Andri. See you around. Bye.Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get your podcasts. And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners.To find out more about the Green Software Foundation, please visit greensoftware.foundation. That's greensoftware.foundation In any browser. Thanks again and see you in the next episode.
undefined
May 17, 2023 • 40min

The Week in Green Software: AWS & Scope 3 Emissions Data

Host Chris Adams is joined by the GSF’s Asim Hussain on this episode of The Week in Green Software. They discuss some interesting news about Amazon, AWS and their scope 3 GHG protocol emission data. We also find out how Python has got its Mojo back and we have a very exciting tool from Catchpoint WebpageTest for measuring site’s carbon footprint. Finally, some great green software events that you can be part of! Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteAsim Hussain: LinkedIn / TwitterFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:AWS confirms Scope 3 GHG emissions data will be made freely available to customers in ‘early 2024’ | Computer Weekly [3:17]Amazon’s SusScanner for CloudFormationTemplates | Charles Roberts on LinkedIn [13:22]Mojo may be the biggest programming language advance in decades | Fast.Ai [16:28]Measure & Improve Your Site's Footprint with Carbon Control from Catchpoint WebPageTest | Catchpoint [22:14]Resources:Picture of Coffee Analogy with GHG Scope Protocols | GHG Protocol [8:24]Survey on Need for GHG Protocol Corporate Standards and Guidance Updates | GHG Protocol [10:25]Adrian Cockcroft’s Monitorama Talk | Vimeo [24:41]Carbon Impact | Dynatrace Hub [24:58]Is data transfer the best proxy for website carbon emissions? | Fershad Irani [28:23]Learn.greensoftware.foundation | GSF [31:55]Events:Ottawa GSF Meetup (May 24 at 9:00 am EDT): | GSF [31:00]SDIA Hackathon on the Environmental Impact of Software (May 24 at 1:00 pm CET, Berlin): | SDIA [32:47]London GSF Meetup - Anniversary Special  (May 25, 6:00 pm BST) | GSF [36:04]If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript Below:Asim Hussain: I think in an organizational perspective, scope three is turning out to be quite an amazing lever to drive change cuz by calculating the scope three, they're also applying pressure to their suppliers and saying, reduce your scope three, reduce your emissions, reduce effectively your scope one and two and your three or our go to another supplier.Chris Adams: Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams. Welcome to another episode of this Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams, and in this episode we have interesting news about Amazon and AWS. A programming language with a lot of Mojo and some exciting events coming across from the world of green software, as well as some interesting news with WebpageTestbefore we dive in though, let me introduce my esteemed guest and colleague for this episode of this week in green software, which we sometimes call TWiGS, today we have Asim Hussain. Hi Asim.Asim Hussain: Hiya. So my name is Asim Hussain. I am the executive director and chairperson of the Green Software Foundation. I'm also the director of Green Software at Intel.Chris Adams: Cool. All right. And most recently, learning about throat singing to go along with your mushroom collection.Asim Hussain: I'm also becoming quite musical, so I've actually bought, I've actually got two flutes since we've met Chris. I've bought two flutes, a guitar, and, wait, what else? Oh, there's another musical instrument I can't quite remember. Anyway, yeah,Chris Adams: That's three musical instrumentsAsim Hussain: my voice. My voice. That was it. I've been taking singing lessons. I knew there was a third I.Chris Adams: that's pretty cool. My wife is a trained musician and she's been teaching me the spoons, so that's basically all I have forgot to go with.Asim Hussain: My wife is also a classically trained musician. She speaks it very hard to be somebody who's learning music inside a house because yeah, anyway, there'sChris Adams: Wow. I did not know.Asim Hussain: yeah, yeah. Both quite musical. Yeah. We've got, our partners are quite musical. There you go.Chris Adams: Okay. And if you are new to this podcast, my name is Chris Adams. I too am one of the directors of the Green Web Foundation, a small nonprofit working towards an entirely fossil free internet by 2030. So before we dive into the rest of this show, it's worth sharing. All the links and all the discussion we do, we will share it in show notes with this.And the general format is to basically look at some stories in the news relating to green software and share a few reckons on them. And you're very welcome to come chime in with your comments, uh, afterwards as well. Okay, Asim, should we start?Asim Hussain: Yeah, let's go for it.Chris Adams: Okay, so story number one is AWS Amazon Web service confirms Scope three GHG emissions data will be made freely available to customers in early 2024.This is a story from Computer Weekly, and as Amazon is one of, is basically the largest provider. This feels like a fairly big deal Asim, especially when you bear in mind that this may bring AWS's Customer Carbon Footprint tool up to kind of parity with some of the other providers like Google and Microsoft.Asim Hussain: Yeah, I remember when AWS first came out with their tool. Probably there's a lesson learned here for cloud providers when you come out with carbon measurement tools, make sure it's got scope three in it, because almost all the news are like, great, but where's scope three? Because it's so essential and it's such a large figure cloud providers.I've heard an argument for smaller cloud providers where they don't own, physically own the data centers with which they are providing services, that an argument can be made that it's so much more challenging to obtain the Scope three data there. But when you own your own data centers, the expectation is that you're going to be able to have to provide that, that data.Cause it is such a significant number.Chris Adams: Hi, I'm so sorry, Asim. I realize we've just dived straight into a jargon without even just telling it all what scope one, two, or three might actually be. So I'll just quickly, for those who are new to the subject, or folks who have never heard of the GHG, the Greenhouse Gas Protocol, essentially this is a way.The kind of defacto standard for measuring the carbon footprint of any organization or any activity. And, uh, you typically split it into three kind of buckets of emissions. And because we are nerds or developers and drink coffee, we can use hot beverages as the mechanism from standing. The difference between scope one, two, and three, you can think of scope one, which is from combusting fossil fuel.That's a bit like. Turning on gas to heat up water so you can have a nice cup of coffee. Alright, scope two. It's like turning on an electric kettle so someone is setting fire. Something to heat up some water somewhere to generate electricity so that you can heat up a kettle. So it's all the emissions associated with electricity that you might purchase, for example.Now Scope three is a little bit like walking into a Starbucks or a third wave coffee shop, and then. Buying a cup of coffee. So you are not involved in actually farming beans or burning anything, but there is definitely a supply chain associated so that you can have coffee. So these are the three kind of scopes, and typically Scope one and two are quite the common ones that organizations tend to report on. But for these, for lots and lots of organizations, scope three can make up 80% plus of the environmental impact. And this is why we've been talking about it as being quite a big deal because if you do not have 80% of your reported numbers, they may look somewhat different to the other providers.Asim Hussain: And I, that's a really great, is the word analogy or metaphor? AChris Adams: Analogy I think is you.Asim Hussain: yeah. And I'm gonna use that as well. That's wonderful. And I also realized, as I was saying that I think I may have given the impression in my previous statement that Amazon just made the casual choice not to include Scope three, and I don't think that's, that was the point.Scope three calculation is hard. It's extremely hard. It's extremely hard to get right. There's a lot of error bars. It's really obvious a lot of the time what to choose, what values to choose, what to input, and so that's why perhaps Amazon's taken this long to come up with the Scope three data because they've been spending a lot of time making sure they wanted to provide Scope three data that they were comfortable with providing.I just wanna state that it's quite complicated cause as you can imagine, going into Starbucks and trying to figure out. How much a coffee with all the components you can imagine that come up to delivering that coffee to Starbucks, the shipping, the person in the farm, making it, growing it, all of that stuff is someone needs to calculate all of that stuff and it's very, very hard.Chris Adams: This is indeed true, and even when organizations are reporting Scope three, there's sadly 15 separate subcategories beneath it, which makes it even more complicated a lot of the time. And there is another thing which makes it even harder, is that when you're trying to record Scope three, it's one of the parts of this protocol where.There isn't the same concern about double counting in other places, cuz initially when the GHG protocol was actually put forward, the idea was that you would use your own scope three figures as something that you wouldn't necessarily compare to another provider, but you could compare to your own performance over time as a way to track your glide path to something which might be avoiding climate apocalypse at an organizational level. However, this is one of the things that has actually made Scope three quite difficult for people to understand because this double counting issue is prevalent in this kind of scope and not so much in some of the other parts.So yeah, that's one we can dive into. And what I'll do is I'll share a link to that picture. Cause I've got a nice diagram for the coffee one I just shared with you. Yeah.Asim Hussain: that's the go. But also I think you raised an interesting point with the whole idea of double counting, cuz I wanna dive into that just a little bit more, think it's interesting, so for instance, it's quite easy with like scope one. Like you, if I have an oil drum in my front yard and I'm burning something in it, No one's double counting that.That's not in your yard. We know that's not in your yard. We know it's in my yard. It's very easy when I'm buying electricity because of the way that you have to trust the system works. The database is actually like allocating that kilo hour to me it only goes to one other person. Whereas with supply chain is quite interesting cuz your scope one and two, if you are a manufacturer, your Scope one and two will actually be another.Organization's Scope three.Chris Adams: Indeed.Asim Hussain: So I believe. The theoretical idea is that if every company, an individual in the world calculated the scope one and twos, that would all sum up to this wonderful total, which is equal to the total of carbon emissions in the world. And you're right, scope three is just, just nice to have.But I think in, in an organizational perspective, scope three is turning out to be quite an amazing lever to drive change Cuz by calculating the scope three, they're also applying pressure to their suppliers and saying, reduce your scope. Three, reduce your emissions, reduce effectively your scope one and two and your three or our go to another supplier and it's providing that pressure, which I think is really, I dunno if that was intentional or an accident, but it Yeah, I can see the, I canChris Adams: This was one of, this was one of the, I think this was one of the principles initially, and there's some very explicit principles designed for the kind of GHG protocol. The other thing that's worth sharing that we might refer to a little bit later before we dive too deeply, is that there is actually a whole process of redesigning how people measure this stuff.And what we can do is we can share a link to a kind of summary of some of the responses to the World Resources Institute saying, Hey, we're thinking of updating how we measure carbon emissions. Cause there are some problems with the current approach. What do you think? So there's some stuff there that we'll share to, but we'll share a link to, but we won't be able to dive too deeply into it because Asim, I think the two of us are getting outta our depth pretty quickly.Asim Hussain: that depth. Yeah. Um, but anyway, one of the, Part to this title that my mind zoomed in on. It says AWS confirmed scope three GHG emission data will be made freely available to early 2024. Why was the word freely added? It seems weird. A census could work without it. So the fact that freely is there implies that, can you pay for it now?Chris Adams: The reason is that if you are a publicly traded company and you need to do your own reporting, there's actually been a while where you. If you spend enough money with that with Amazon under an nda, you can get these numbers. Alright? Now the thing is that basically means that only people who are spending above a certain figure ever get to have an idea about this.And it also means that if these figures aren't in the public domain, then it becomes very difficult to have a data informed discussion about where we're moving with any of this stuff. And this is. Important when you have the largest provider, which has an organizational carbon footprint of 60, 70 million tons each year, which is, this is like a small European country level basically.So this is one of the things that has been problematic. So hopefully this may be a reference to saying it becomes available for everyone so we can finally have some understanding around this. But as opposed to just only the people who wanna do an NDA on that, cuz there is a kind of prisoner's dilemma aspect when you basically only get your own numbers so you can get your own reporting, but you make it difficult for anyone to have any kind of effective policy interventions on this at a kind of more wider and societal level.Asim Hussain: Yeah. Yeah, very brilliant. So basically my personal website is hosted on Amazon s3. So I mean, I was always a major custom of Amazon's prior to this, so now I'm able, but even, I didn't even, I didn't classify, uh, to getting the data, but even now I'll be able to get, anybody can get it. Okay.Chris Adams: Yeah, next year, eventually. Yeah, soAsim Hussain: year, sorry,Chris Adams: we early 2024 basically just in time for the law to make sure it's absolutely essential anyway, so you do feel like, alright, organizations have to report this in 2024, so this May, maybe there's some link between that and all these new laws landing, which have reporting deadlines in May, 2024.Possibly. We'll see where that goes.Asim Hussain: it's weird. Weird cause and effect here, isn't it? I wonder. Yeah,Chris Adams: Oh, we'll see. It's good. It's good to actually see the progress and this does make it easier for any responsible professional to start understanding some of the impacts associated with their use of digital services. Alright, next one. Next story. Up.Asim Hussain: Yep, yep. Yep.Chris Adams: This is another one continuing our kind of Amazon tip, which is Amazon's SusScanner for cloud formation templates.This was shared by Charles Roberts, senior Security consultant at Amazon, and from what I can tell, this is now an open source tool, which can basically scan your cloud formation code to give you an idea of where you might make some improvements. And it's, this is largely referring to some of the kind of pillars, architected pillars, and sustainability from AWS.And assume, I think you folks might have done something like this in your old Microsoft days about having some recommendations and pointers for this, right?Asim Hussain: yeah. Maybe I'll just take a step back and talk a little bit about the well architected kind of framework itself, which is, Amazon's got one and Microsoft has one that's also called the Well Architected Framework.Chris Adams: Oh,Asim Hussain: I believe Amazon's came first. I used to think all that the well architecture framework was, cuz if you go to the website, you'll see well architected framework and they have I think four or five pillars secure to your reliability, this and that and the other.And it's advice for how. If you want to build a reliable cloud application, this is how you should build a reliable cloud application. Now, for the longest time, I just assumed it was just advice on our website, but it turns out it's actually a scoring system. And so what Amazon Cloud consultants do and so does Azure ones, is when you work with the customer is it's the scorecard.You go through and you ask 'em questions about their infra, about their system. Based on their answers, it gives you a literal score and you get a number afterwards. And that number can indicate how much work you need to do to rectify. And so when they added the sustainability pillar, what they also did was they added a bunch of questions.And if you don't, if you answered no or however it was structured to those questions, you got a yes or no, you got a certain score. And so from my understand from this is cloud formation, is there is what you call it now, infrastructure as code? Is that what Cloud I believe, yeah. It's infrastructure as code.So it's textual description in configuration files for how your application is defined, and it effectively runs it against that, those scores, and it sees what's your number, and it basically gives you a sustainability score, which is really cool. That's to say, yeah, automatic sustainability score. Yeah.Chris Adams: this is true. I think there are a number of tools that start, do start doing this, but having something riches in part of the ecosystem. Okay. It's better than not having this. So yeah, if you cut live it a Python, or if you ever have to manage anything related to some infrastructure as code and you're using cloud formation instead of Terraform or some other tool, then yeah, worth a look all.Asim Hussain: I think from when I, I had an original chat with the, with Charles. I don't believe Charles was the actual person who authored this, but he's the one who shared it. Currently. It's automatically scanning stuff and comparing it to AWS world Architected pillar rules, but you can create your own as well, so you can create custom rules for it, perhaps to your makeup or perhaps other people can come up with their own rules for what makes a good sustainable application, add it to that framework as well. So yeah, it can beChris Adams: Wow, I didn't know that. Cool. All right. Next story coming up is Mojo, possibly the biggest programming language advance in decades. This is a link to fast ai. Yeah.Asim Hussain: It's quite a headline. Quite a headline. Mojo may be the biggest programming language advanced in decades. Come on, let's talk about it.Chris Adams: Okay, I'll, I, I actually read through this and I, I'm actually pretty excited about this and I shared this before because I do a bit of coding in Python as my kind of main working language, and Python is often maligned for being a slow language, even if it is a relatively pleasant language to be using.Asim Hussain: Mm-hmm.Chris Adams: But the general kind of gist of this story is that it combines the ease of use of Python, and it's designed as a kind of super set of Python so that you would actually have all the syntax and all the kind of ease of use and the familiarity of using Python. But you have a really smart compiler, so normally.Like with kind of, you have different flavors of Python. So for example, there's like maybe Sea Python or Pi Pie or stuff like that. These take this and come up with some kind of much, much faster representation of that code, and there's limits to what you might have there. Now, Chris, what's the guy's second name?Who's behind this?Asim Hussain: Latner.Chris Adams: Thank you, Chris Latner. Yeah, so LVM is known for creating a kind of where you might have things that kind of create assembly or stuff like that. It creates what's referred to as an intermediate representation. So this is like a piece of language, which is easy to turn into, really fast code for hardware.One of the kind of innovations was that a project which he worked on was called MLIR, so a machine learning focused intermediate representation. This is particularly interesting because it means that you can have that same ease of use of taking something which is relatively easy to write and make something which is really easy to run fast on GPUs or TPUs.I forget what TPU stands for, but it's a transformer processor unit perhaps.Asim Hussain: Tensor processing unitChris Adams: Thank you. Yeah, tensor. So basically we fast AI essentially. And this essentially means that you get the speed of these really low level languages with a lot of this. And typically you could do bits of that. Like you might write something in Rust, which is like what the COR kids do, and then use some kind of bridge language.But this idea is that there's like a subset of just extra functions you might type. So rather than typing deaf my function, blah, you just do. Fn my function, which is somewhat Rusty, and then your compiler knows that this part can be super duper fast and they're promising hundreds or thousands of hundreds or thousand fold speed improvement on this one, which is mind blowing in my view.Asim Hussain: My initial first thoughts were, I've been a user of Python for a long time now, on and off, but it is been aligned for a long time for being slow, and I think that's unfair. Because you would never normally write the things that need high performance directly in Python. Like that's why Python is still used for machineChris Adams: Mm.Asim Hussain: because what you end up doing is you import NumPy or, or even TensorFlow or something like that, and then you actually, your code is executed using those libraries.Those libraries are written in C and c plus.Chris Adams: Correct.Asim Hussain: So a, I think it was off times maligned. And so I was like thinking to myself, is this really necessary? Because. You can still get that performance improvements. But I was just reading it again and I realized that it was a really important point here was that it's actually really hard to debug that.Chris Adams: Exactly. Yeah.Asim Hussain: And that's the really, I, as soon as I like read that, I was like, oh, of course. And now you can actually just debug Python code. It's not just gonna make a call to some external thing, mysterious black box that does something fast and you dunno what it's gonna do. You can step through, step by step.And I think that's very interesting. That's right. Cause that was a learning experience that's really gonna help people. Build performance systems. Yeah.Chris Adams: I am hoping this means that I don't need to learn how to try and learn Rust or something, to be honest, cuz there's lots of things which seem nice. But this basically is an alternative to having to learn yet another language because if it's gonna take me 10 years before learning Rust, then I'm not gonna be very far from retirement before I'm any good at coding in these new languages.So yeah, that.Asim Hussain: I never thought about it from that perspective, but you're right that a lot of people are gonna hate me for saying this. This could be a Rust killer. This could be like, there's a lot of people who know Python already and if this is gonna give you effectively Rust level speeds, which it would, it will do.Cuz it's a system level, it comp compiles onto system level. That's very interesting.Chris Adams: See now you see where I share that? See, kind of be exciting, right? Yeah. Alright. But for folks who are fans of Rust, it is the, I think, the most popular, most lovely programming language. This doesn't mean that you won't have a job. There's lots and lots of work for Rust, and I think Rust has actually been adopted in favor of C plus for a number of Microsoft projects now, cuz there's a lot to be said for.Yeah, absolutely. So there's plenty of life in a Rusty world. Absolutely. And this isn't really out yet as well. We're not even sure if we're gonna have this as open source yet, but it looks like it might be in all the previous projects like LLVM and so on were open source so we can hold our fingers and hopefully Asim, we can stay relevant for maybe a few more years before we are consigned to the aging programmer trash pile.Okay.Asim Hussain: know. There's, there's still people paid to code in a cobalt, so I think we're, I think we're all right.Chris Adams: You're right. Okay. That's great. Let's hope that stays there and we don't get replaced by some form of machine learning in the future. Alright, should we move on from that one? Because that feels like it's about to just, I can see it yawning open ahead of us.Asim Hussain: you mentioned AI. Let's close it down quickly and moveChris Adams: Yes. Okay. So the next story is from an organization called Catchpoint.And in particular there is a project called Webpage Test, which is an open source, a Web performance tool, specifically designed that's used by governments and lots of Web performance specialists to basically analyze pages somewhat like how we just described the well architected thing for Amazon Cloudworks.So this is interesting in my view because webpage test is one of the most well known uses like Web performance tools. They've started incorporating the carbon measurements inside this, and it's a really nice quote from. I guess what I'll refer to as the godfather of cloud or what, what would you call Adrian Cockcroft?Sustainability is becoming a higher priority for organizations globally. Not only is our ethical responsibility, but there are new regulations that will require companies to monitor and manage their environmental reporting, said Adrian Cockcroft, tech advisor and sustainability advocate. Carbon control is making it easy to take the first step by measuring the carbon footprint of a website, a Web application, whilst also providing actionable recommendations on actions that could result in improvements.So that was like major praise. I was pretty excited to see that actually, because this is, this was like one of the former VPs of cloud and he's very much someone who cast a significant shadow across industry. So yeah, I saw that showing up in LinkedIn. I was like, Oh sweet result.Asim Hussain: interesting. I remember he also mentioned, cuz Adrian was a year ago, he spoke, he gave a very, a really excellent talk, a very inspirational talk as in, I don't mean inspirational as in go and do it, but as in opening people's minds to the idea of monitoring as an action for this, it really helps inform something of me.So I think I remember part of the post was, The creator of Carbon Control saying that the idea for it came from meeting at that Monitorama conference like a year ago and how that idea kickstarted this whole thing, which, yeah, which makes me, I always say the most powerful thing you can have as an idea.So it's just goes to show, just having one one talk can lead to, yeah.Chris Adams: The thing I might share with you is that success has many mothers. And this is also using a library called CO2.js, which includes some of these numbers, some of the kind of conversion practice. So if you have an idea for how much, what kind of resources a webpage might be using, this is what it converts into carbon figures.So one thing I've shared a link to the Monitorama talk, cuz it's a really good talk and this kind of process from monitoring tool to carbon tracking tool. Dynatrace is another organization that does something like this. So there is a, it's a real kind of trend in my view, and it's really encouraging, I think.Asim Hussain: Has Dynatrace added some sort of energy carbon tracking? I haven't seen thatChris Adams: Yes, last week Max uh, Schulze from the SDIA, he referenced this and I didn't know about it before there. I'll share a link into their show notes. But yeah, they have their own carbon impact figures as well now. So.Asim Hussain: There's so much stuff happening in this space. It's so amazing. Just, yeah.Chris Adams: So who knows, maybe Datadog will do it and let's hope they don't charge 65 million per year for the privilege. Sorry, that's a nerdy joke about Datadog's recent investor reporting, realizing, and they mentioned that one of their providers was paying 65 million us.Asim Hussain: million for.Chris Adams: it looked like it was Coinbase.People weren't paying attention, and suddenly the numbers went up. And when Coinbase realized there was a 65 million hole in the reporting and they had to explain what happened, and they said, yeah, someone realized that they weren't paying attention to it. So if you ever feel bad about cloud spend, yes, they,Asim Hussain: So they literally, they, because of Coinbase's growth, they just hadn't factored in how much the observability was adding to the whole thing, and it just added toChris Adams: I think that was the idea. So this was like the, I think the canonical example of sometimes cloud can lead to people not paying too much attention to expenditure. But see, I've never done 65 million of spend before and I'm not sure I will, but that's now my kind of benchmark to make me feel better about myself if anything I have is not very efficient.Asim Hussain: that, that Datadog account manager is driving around in a new Ferrari, I reckon.Chris Adams: You hope so, or maybe not, because that's gone now. So they probably had a comfortable disc, had a discussion and said, Hey folks, are you sure you wanna be spending 65 million a year with us on tracking your logs and metrics? So there was actually something ongoing there. So there was some proactive outreach to say, folks, I'm not sure if you mean to do this.Are you sure you wanna be doing this? Apparently,Asim Hussain: We're just bringing it back to Catchpoint trying to, because you've been a Major S CO2.js, which is the Green Web Foundation's project. I did put the Green Software Foundation website through and fingers crossed and it, and we scored pretty well. I think there's still room for improvement. I thought believe we did score green, but why don't you tell people what does it tell you?Chris Adams: So the main thing that webpage test does is it will look at your page and analyze it. And like we mentioned with Well Architect Checker, it'll basically. Tell you some things that you could improve based on what it's seen about your page. So if your pages are very large page and sending a bunch of JavaScript over the wire, which would result in a kind of poor experience for someone waiting for it to be loaded, it will say, maybe you shouldn't be sending such massive payloads over the wire, because it's not gonna be very much fun.And it also is gonna have a impact on your end user's battery as well. Now what it actually uses is inside the library that we maintain called CO2.js. There are a number of different models, and one of the models that is in use is called the Sustainable Web design model, which is based on some peer reviewed literature. Basically saying for this amount of usage, which is right now is basically the data center of the wire. It basically makes some assumptions about how much energy use happens on the device, in the servers and in the networks. And this gives you some idea of what the actual missions might actually be.So that's how it works, and you can link back to it and we can share a link specifically to see some of the assumptions for this. There's also a really nice post by one of the people who was actually advising on this and helping get this implemented, Fershad Irani, he's written about, okay, this is the things you need to make.These are the assumptions we've had to make here, and these are the alternatives we might use in future for this. So this is designed to be a first step that you could then start improving this, cuz as we know Asim, all models are wrong, but some models can be useful.Asim Hussain: This is the post that Fershad wrote about basically asking the question is network bandwidth the only metric we should be using andChris Adams: Yes,Asim Hussain: between? Yeah. I thought it was a very interesting, yeah, very interesting thought. Cause I think, not how CO2 JS works, but I presume it just says JavaScript is equal to this,Chris Adams: pretty much.Asim Hussain: Yeah. So he was thinking about what if you could split and you would give the same carbon waiting to a kilobyte of a JPEG image as you would give to a kilobyte of a video image, but maybe there's a difference.Chris Adams: Yes. So this was raised by Mike Gifford, who was. So he was a real kind of like sustainability and accessibility advocate based in Canada. He actually opened this issue in the CO2.js repository to talk about some of this stuff. So it's really worth looking and we'll share a link to that. But what we've done is we've shared a link called Is Data Transfer their best proxy for website carbon emissions?Where he explains this and talks about where this is good and why this is bad. Because very much, a lot of the time, the tools you use to understand an environmental impact of something, it'll often be impacted or influenced by what data you have available because not everything is instrumented to provide the kind of levels of num uh, levels of detail that you would like to have at the moment, but we're getting there.Asim Hussain: Yeah, like I think my response to him was like, like when it comes to models, as we just said before, like they have inputs and they have outputs, and you tweak the inputs to optimize the output. And so if the only input you have is bandwidth, that's the only thing you would tweak. If you separate it out bandwidth for image and video, and you saw that video is so much higher than image that would change the decisions that you would make, which I think is an interesting thing here cuz I, there's a balancing point between making something useful and ubiquitous and so everybody finds value out of it versus getting enough fine grain information. So the behavioral choices afterwards are the right or better people claim better choices.Chris Adams: Yes. This is actually a nice segue to some of the events we might be discussing. Actually assume So should we look at some of these on then?Asim Hussain: Let's go for it.Chris Adams: the first one is Ottawa, the Green Software Foundation Meetup on the 24th of May.Asim Hussain: Wonderful. Yes. I'm so excited about this one.Chris Adams: Abhishek's talking. This is actually exciting cuz Abhishek has been quite involved in this as anAsim Hussain: unfortunately he had to, for personal reason, had to pull out one at the last minute. It's, Henry Richardson is now giving a talk there, which is just as exciting cuz he's the, I dunno what his title is, at Watttime is Researcher.Chris Adams: Lord of beards.Asim Hussain: Lord of beards,Chris Adams: does have an impressive beard here.Asim Hussain: lord of beards, emperor of electricity, carbon emissions.That's what he is by anyway. He'll be giving a talk and I believe also, yeah, Tajinder Singh from GitHub will be giving a talk on sustainable DevOps. Oh, we never heard that one. Have we yet? Su No. Yes, we have SusDevOps. We've heard that one before. No, we haven't. We've heard DevSusOps.Chris Adams: no. Is this like the people's front of Judea? It does feel like it.Asim Hussain: one of them will win out in the end.Chris Adams: Oh, speaking of things with ops at the end, so Google and ThoughtWorks have a thing called green ops. That's their particular term that they use for this and on in Berlin, Google had an event talking about green tech and assume, do you remember your principles.green stuff?Yeah. I'll have to share a picture. They saw them sighting your principles green and their own internal stuff. It was pretty cool. I've got a really blurry photo. I'm not sure if I'm allowed to share it, but I could definitely tell you. It was definitely in the kind of presentation that was shared with various people at it.Asim Hussain: Ah, brilliant. That actually I just checked now. We haven't actually deployed it. We're on the verge of deploying a change to principles.green. So actually all those pages are now going to get forwardedChris Adams: Oh.Asim Hussain: to the new learn.greensoftware.foundation, the new, I forgot it suddenly, can't quite remember what we called it now, but our green software training.But if the evolution of this page be.Chris Adams: All right. Here's the elegant segue I was gonna be mentioning. So the SDIA has a hackathon on the 24th of May. Also in Berlin, where this is actually some work with the German Environment Agency, the equivalent, the Umweltbundesamt. I think they are actually hosting this event. With the SDIA, A Green Software Foundation member to do a hackathon about trying to understand the environmental impact of software.And they have actually a whole set of tools and a hack day specifically for improving the environmental impact of open source tools. So there's a competition there. The reason I was mentioning this is because this was actually where the initial work with Mozilla to start exposing some of these numbers.It initially took place. I met some folks at Mozilla and they explained how they've been able to reverse engineer the energy usage figures for visiting a page. So you can actually get some of the numbers, like the environmental footprint for JavaScript versus videos or pictures and things like that. So maybe here's to actually extending it some more so we can make that more available to more people.So yeah, that's the 24th and available for everyone.Asim Hussain: I've gotta say, that's the wonderful things about hackathons. It's not even really what happens on, it's not even necessarily who wins on the day, but it's the work that happens. It's the connections you've make and happens after us. I did not know that that may work that you've done with Firefox.I don't think we've really talked in any great detail about at all. I think we definitely would love to be less deep dive on that, or even deep dive on CO2.js one day.Chris Adams: We should ask some of the folks at Mozilla because there's a bunch of other things they're doing and there's a bunch of really cool stuff they've been doing with telemetry that I think would actually fit into this. Cuz I think there's a chance to create a kind of public data set, specifically be used on actual observed data rather than the model data that you see, right?Asim Hussain: because they have dataChris Adams: Yeah, exactly.Asim Hussain: not in any nefarious way, but they must be collecting data.Chris Adams: Anyone who runs a browser, they gonna Google collect this, probably Edge, have this as well. They've got a rough idea of, cuz every single organization would have to optimize this and try to reduce the kind of costs imposed on their users.Asim Hussain: if it's anything like how it was at Microsoft, like you'd actually ask the users of the canary version of Edge and you actually, you would have a pop-up saying, do you want to give your data? And I go, 0.01% people say, yes, but that's enough to get like a significant amount data. So I imagine the firefighters doing the same out of, I just wanted to just make sure everybody's clear.There's a hackathon in Berlin 24th of May. There's a prize of 1,700 Euros. That's Space Shack Berlin, which sounds amazing. Chris will be there, Max will be there.Chris Adams: Yes, I am definitely gonna be there. Some, some of the Green Web Foundation, some of the SDIA folks will be there and I suspect some other people will also be around as well. So there's a nice group of people now said doing stuff in our little town, and I really like it. Actually. I'm very much enjoying itAsim Hussain: our little town of Berlin. Yes.Chris Adams: compared to London, where I moved from.It does feel, yeah,Asim Hussain: I always thought Berlin was huge. I've never really,Chris Adams: the population is definitely lower, but it feels a bit more spacious.Asim Hussain: Berlin. Anyway.Chris Adams: All right,Asim Hussain: Great stuff. So youChris Adams: back to London.Asim Hussain: Oh, back to London. There we go. Always comes back to London. Yeah, so there's a London Green Software Foundation Meetup happening the day after on the May 25th at 6:00 PM UK time.That is actually, I believe it's coming with the UBS offices in London, which have very cool offices actually. And it's also a special anniversary special. It's actually the two year anniversary of the birth of the Green Software Foundation, yet I will actually be there myself. There'll be networking, drinks and pizzas. Will there be a cake? We should definitely have a cake actually now that realized, yeah, there will be a cake. I dunno. Maybe there might be a cake.Chris Adams: If you've got 10 days, alright, you who knows, you might even have cake pops. Easy for people to eat.Asim Hussain: Great idea.Chris Adams: Cake on a stick is the future my friend.Asim Hussain: Cake on a stick. There we go.Chris Adams: Yes. All right. Okay, so I think that's it for our news Roundup and list of upcoming events. This is the part of the show. We have a short show closing question to ask to our guests.This is what we see. We've seen a number of meetups happening recently. If you could travel anywhere without too much impact in the environment, where'd you like to see, uh, meetup and why? I'll put that one to you. Asim.Asim Hussain: Oh, that's a great question cuz you know, I would actually really like to see meetups happening in places where it is typically been very hard for, not for us, but for people to discuss. Other, other people with an interest in sustainability and find each other. So I often find in, especially in Asia, it's in the larger cities, it's usually better.We've had meetups in Japan and some of the larger Indian cities, but I'd love to see, oh, I could travel. Oh, I probably wouldn't travel myself because there's a little bit too much impact, but I'd love for other people to go and travel locally to their local Asian GSF meetup.Chris Adams: Okay, cool. I'm gonna be really boring here. I'm gonna say something like Vienna. Because never been to Vienna. Sounds like a cool place. And what I've been told is that Vienna is one of the cities where if you had like electric scooters and things like that, you had dedicated places to put them rather than putting them in the middle of the pavement.So there are car parking spaces dedicated for that. And there's even an app in Vienna. So if someone has parked it in the wrong place, you can take a photo. Send it to it. And then the people who are allowed to operate the scheme, they have an SLA to maintain, so they have to get it moved within four or five hours, otherwise they get fined.This feels like a really interesting use of public space and I feel like, yeah, I quite like using some of these scooters, but I don't like how if you are in a wheelchair they can get in their way and it doesn't feel like it's the best and most equitable use of space. And this felt like a really nice a way to address some of those issues.Asim Hussain: That sounds lovely. Yeah.Chris Adams: Yeah, so Vienna, that's what I would say. Alright. Okay. That's all for this episode of The Week in Green Software. All the resources in this episode are in the show description below and you can visit podcast.greensoftware.foundation to listen to more episodes of our podcast. Finally, I think huge thank you.I've really enjoyed chatting with you again, Asim, nice to see you. So yeah, take care of yourself, mate. Lovely seeing you. Too-da-loo. Ta everyone.Asim Hussain: Bye.Chris Adams: Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get your podcasts. And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners.To find out more about the Green Software Foundation, please visit greensoftware.foundation. That's greensoftware.foundation in any browser. Thanks again and see you in the next episode.
undefined
May 10, 2023 • 35min

The Week in Green Software: IaaS, PaaS, SaaS!

Host Chris Adams is joined by Max Schulze from the SDIA (The Sustainable Digital Alliance) and they discuss three stories from the worlds of IaaS, PaaS and Saas! While these three acronyms are more than likely ever present in most digital people’s lives, we might not know about the environmental impact that they have. Chris and Max cover stories from the CNCF, Google, CIODive and OpenJS as well as upcoming events in the Green Software community. Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteMax Schulze: LinkedIn / WebsiteFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:CNCF: Sustainable Software Projects Breed Eco-Sustainable Computing Systems: / Forbes [6:52]Google: We have no moat, and neither does Open AI the story of open source vs openAI / Simon Willison [14:37]Technology pulls enterprise green ambitions within reach: / CIODive.com [20:57]OpenJS Foundation Receives Major Government Investment from Sovereign Tech Fund for Web Security and Stability / OpenJS [30:41]Resources:Microsoft scales cloud-native workloads with carbon awareness / SDX Central [7:02]Kepler / Red Hat Emerging Technologies / [7:33]ECO-Qube / SDIA [9:25]Environmental Data Agent (EDA) / SDIA [9:55]Carbon Aware Scheduling on Nomad / Green Web Foundation [12:37]Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality / LMSYS Org [20:40]Unilever completes cloud-only migration to Microsoft Azure / CIO Dive [24:21]Events:Rise of AI 23 (9 - 10 May, BERLIN ᐧ Hybrid) / Rise of AI [28:15]SDIA Hackathon on the Environmental Impact of Software (24 May, BERLIN) / SDIA [28:45]LF Energy Summit 2023 (June 1 – 2, PARIS & Virtual) / Linux Foundation [31:47]If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript below:Max Schulze: It's important that we recognize that this is happening on more than just Kubernetes. That's why I think it's a movement that's happening.Chris Adams: Absolutely. Yeah. Diverse ecosystems are healthy ecosystems.Hello and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams. Hello, and welcome to another episode of The Week in Green Software, where we bring you the latest news and updates from the world of sustainable software and software development. I'm your host, Chris Adams, and in this episode we're gonna be covering three stories about green software and the acronyms, PaaS, SaaS, and IaaS.We'll also be discussing some exciting upcoming events in the world of Green software and talking about moats and open ai. Before we dive in though, please let me introduce myself, my guest for this episode for of this working green software to today we have Max Schulze. Hi Max.Max Schulze: Hey Chris.Chris Adams: Okay, Max, uh, although we've known each other since about 2019 when we first went to some Green Cloud procurement events back in Brussels many years ago, you may not be familiar.Some other folks might not know too much about you. So if you introduce yourself, then we'll kind of jump into some of the stories.Max Schulze: Thank you Chris, and thank you for having me as your guest today. It's always fun to to chat with you and debate with you. I'm Max. I'm the director of and founder of the SDIA Sustainable Digital Infrastructure Alliance. That's why we never say that. We always say SDIA cuz it's unpronounceable.Very excited to be here. I also talk about digital infrastructure all day. I write about it. I think about it. I talk about it, and recently I've been very involved in driving data centers to be more sustainable and more transparent through like the European energy efficiency directive, but also the code of conduct for data centers.Chris Adams: This is something you'd be doing in not just German, but also in English. Is that correct?Max Schulze: Yeah, I'm one of the very few Germans that can also speak very fluent English, so it's not a problem for me.Chris Adams: Okay. All right, Max. Okay, so we've spoken about the format here and for folks who are new to this, basically what we're gonna do is look at a few stories that caught that kind of came up across our feeds and came up on our radar This week. We'll do share a little bit of reckons and share some extra context that you might not be too much to aware of, and then we'll look at some coming events.So Max, the first story we have here before we actually go too far, we've used these phrases, PaaS, SaaS, and IaaS. Let's just briefly just define these, cuz these might come in handy and we might refer to this a little bit later. So Max, Hey, let's start actually, because ERs is at the very bottom. Let's start there then.Work your way upwards actually. All right.Max Schulze: Yeah. So yes, for me is the commodity. It's compute. Storage and network capacity essentially is what AWS started with EC2 VPC and s3. Those were like the three primitives that you can build almost any software from and abstracted in a way that you don't see the server, you don't see the data center.So it's really like digital resources as commodities in the highest form of abstraction.Chris Adams: And IaaS for most people stands for infrastructure as a service, right? So you pay for things on a kind of monthly or hourly basis, almost like metered electricity. Yep.Max Schulze: Yep.Chris Adams: Okay, cool. All right then, so that's IaaS or IaaS, PaaS, the next one up. That's platform as a service, which as I understand it, you might not want to be working with all these low level things yourself.So there are companies that provide higher order so. Functions on top of this. So for example, you might choose to purchase cloud storage or some computing power from a hyperscaler or maybe a French company, say Scaleway or something like that. But you might also pay for someone to just give you a place to put a Docker container or a piece of program, run a program, and they take care of keeping it fast and secure so that you can just focus on writing some code.So that's platform as a service. Do you have a go at describing what SaaS or software as a service might be then Max.Max Schulze: To me it's the most ironic one because past, like a database as a service is also a software as a service, but it's tools that developers use to build more software. So it's funny. And SaaS is when you then glue a lot of different kind of open source components together into a product. For example, this product that we're using to record the podcast is also a software as a service product.The most well known right now is probably Office 365 or like Microsoft Teams or now SaaS based product. So usually subscription based, usually Web based, but can also be desktop applications. But it's more about the fact that you don't have to maintain, run, or install any software. It's just available to you at any given time as a service.Chris Adams: So we've defined these somewhat confusing terms and Max is almost like a taxonomy that people actually need to be armed with for them to understand any of this stuff. And it might be worth just briefly touching on that before we dive into one of the stories. Cause I know this is some work that you've done when you speak to policy makers about them struggling a bit to try to work out where one layer ends, another one begins, and where you need to purchase these and how you actually purchase these.Max Schulze: I think in tech or IT, we often lose simplicity to understand things or to make things understandable, because we want to be so specific, we want to be 100% accurate. And a lot of people get lost in that process when they hear a hybrid cloud setup or on-prem versus public versus, yeah, something else. Or a VPS, a VPS machine, or a dedicated machine, and you hear these things, it's like, what is this?And I think it's, what I've really come to realize is that you have all these words, and think about it, public cloud. Five years didn't exist five years ago, didn't exist as a term, and now we are using it every day and every developer knows what it means. But outside of our bubble, very few people actually understand all these different technologies.And ultimately it's software, hardware, some form of infrastructure, networks, data centers, and energy, and that's it. This is the whole thing, but we have so many words to describe different configurations of those that I think it's really important that we have some kind of taxonomy. You also know that we wrote a paper on this sometime ago to propose something, but I think we need very simplified explanation models so that we don't lose policy makers with our complexity.Chris Adams: All right, thanks for that, Max. So now that we've got a little bit of kind of background for what some of these terms mean, should we look at the first of these stories here? So this is one in Forbes from the CNCF, which is the Cloud Native Computing Foundation. They're talking about software projects and e sustainable computing systems.We've touched on some of this, the idea of kind of Kubernetes or low Carbonetes and the idea that there are existing products and projects that could be adapted to basically tread someone more lightly. On the planet as it were. And this is the first time I've actually seen people in the CNCF really talking publicly about this and really talking a lot about their special interest groups, where they are essentially trying to get gaggles of nerds to talk about some of this stuff.And there's a few particular projects of interest that have been catching people's eyes of late. One of these is Kepler from Red Hat, which stands for Kubernetes Efficient Power Level Export-er, right? And that's been one tool which has been used to essentially expose some of the energy numbers when you run little clusters of compute so that you can start to quantify and understand the environmental impact from some of these tools.Max, I know that you folks did some work with similar project or related projects around this, and it sounds like it will be quite simple, but I think you can share a few war stories about some of this stuff and where some of the difficulties might actually be when you're working with this.Max Schulze: So I think first of all, it's great that the CNCF is actually talking about this. They've had the sustainability working group, I think for almost a year now, and I'm glad that they're now going a bit more public with it. I think there's a lot of value in Kubernetes and what it can do in terms of distributing workloads across different physical locations and machines.I think the worst story that you're alluding to is that. I think we've seen a lot of technology solutions that enables load shifting, which is the one of the holy graves. Like I can move it where the energy is greener. I can move it where there's under utilization and things like this. The problem is that the infrastructure, so it doesn't matter if it's a virtual machine or the data center doesn't actually expose the.These metrics that you would need to make those decisions. Right. So we see a lot of workarounds where you're trying to guess which data center you are in, and then you're getting the emission factor of the whole grid around it, which doesn't really exist, and there's so much data missing that. I think the problem to solve is not necessarily the at the highest level, but rather in the levels below, making these APIs available, making these metrics available to enable load shifting, not to solve load shifting.Chris Adams: Okay, thanks Max. This is also something we might touch on a little bit later. When. We talk about some of the events that we have upcoming here. I think you also did a bit of work with a project called ECO-Qube when there was some discussion about actually exposing some of the numbers from data centers, because as I understand it, one of the reasons people basically say we can't share these numbers is we don't have access to these numbers, but I understand that you ended up spending a bit time looking into this specifically to see where the real pain points and what the possible solutions might be for people at the data center level to expose some of the numbers for the rest of us further down the food chain as it were, so we can actually optimize for carbon.Max Schulze: Yeah, we did. I actually, we even released, it's gonna go open source in I think a few months. It's running in three pilot data centers. It's basically a monitoring system like Prometheus and Grafana. But what is surprising that even though we in it monitor a lot, right? The underlying infrastructure doesn't have a very sophisticated monitoring system.You can really imagine it like software from 20 years ago. It's not that you can just query are the diesel generators on or not. It's the cooling system at 40% or 50% load. And so we wrote basic in experimental piece of software that collects all that data. Makes it available as one unified API so that you talk to the infrastructure, like you talk to some database system and you just say, what's the energy mix right now?Is the diesel generator running? Is the, I dunno, is there wind park running nearby? And you get all these signals and you can respond to those signals. And I fundamentally believe that when the signals are available, when the transparency is there, then software will adjust to the available parameters.Chris Adams: Okay, so we will share a link to this. What was the name of this particular project that we should be looking for, that we should be searching for if we do lookMax Schulze: the environmental data agent, EDA EDA, if we renamed it, I think to EDS, but EDS is already like European data something, uh, or European Space Agency, something related to that. So it's not the environmental data system. But the environmental data agent, because it is really a physical box that sits in a data center that has two network cables connected.One from the IT side and one from the infrastructure side. And it also acts as a firewall because you don't want the data center, physical infrastructure connected to the internet either that, um, the security risk, of course.Chris Adams: When you talk about connecting that in that way, you are, you are referring to the idea of maybe you don't wanna have the cooling systems exposed so someone can switch them on or off, resulting in. We already have heating problems as is right now, so makingMax Schulze: You don't want it to be hacked. Let's put it like this. And the safest way for cybersecurity, for everybody listening who loves cybersecurity, the best way to protect a computer is to not connect it to the internet.Chris Adams: Okay. All right. Yeah. Okay, so that gives us some pointers there. And there's something to be talking about some of the CNTF projects that people might be interested in. So we spoke to Kepler, and we'll be touching on a proposal by Adrian Cockcroft to a formula. VP of Sustainability, Amazon, who's been talking about some of the actual proposed metrics that you could actually use, and he'll be explaining where some of the problems are when you do try to actually work out these numbers from existing providers.So that's one thing we could talk about, but maybe in the future episode, we might touch on it a little bit later on today. Yeah, goMax Schulze: what about you? Didn't you guys do something with Nomad?Chris Adams: Yeah, so my organization, the Green, Web, Foundation, we did a bit of work with Nomad because we saw a bunch of people using Kubernetes as a way to orchestrate all kinds of computers to run software.And we have a kind of tradition at the Green Web Foundation, where we look for the people who are not the dominant providers, because they're often doing some really interesting work. So we did some work with Firefox as, for example, took a carbon calculation library into that particular library as well into that.But last year we did a bit of work with the folks at Hashicorp, because we use Nomad ourselves to run our kind of internal infrastructure. And there's now a separate Fork of Nomad, which does have this kind of carbon oil computing inside it right now. So this is on one thing that we did a bit messing around with, and also what the other reason is that I'm quite a big fan of a service called fly.io, which is one of these PaaS.It's a kind of way to manage software without having to actually be. Maintaining all your kind of Amazon accounts yourself, for example. And I think the idea of like green fly sounded kind of cute. So we were just doing some work. We're there to use that basically. So we did some work on this, I think last year with an organization called Ripe that the people who allocate IP addresses to the world basically.So we did some work there. But yeah, that's the exposure that we have so far since in the last six months. What we've seen is Microsoft basically donates their own. Schedule and a bunch of their own open source works specifically for demonstrating how they do carbon air computing. So there's a bunch of things around here, but that is probably the thing to look at if you are using Kubernetes.But if you are looking at Nomad, then I'm very happy to talk about this and I'll share a link to a blog post where we explained how we would go about doing this and where we're moving to next. Cause it's got a lot easier.Max Schulze: I think it's though, it's important that we recognize that this is happening on more than just Kubernetes. That's why I think it's a movement that's happening.Chris Adams: Absolutely. Yeah. Diverse ecosystems are healthy ecosystems, as we say, where I work. Okay. Next story. Let's talk about moats. So this is a story which is partly blogged by developer Django co-founding. Nerd, I suppose, and now a AI specialist or AI researcher, Simon Willison. He linked to this leaked paper from Google, which says, we have no moat and neither does open ai.This is basically a story which in many ways, kinds of goes against this kind of narrative that we've seen over the last year or two, where lots and lots of the. Advances in kind of machine learning and AI have been associated with ex ever larger amounts of compute. And while we did do a bit of research and point to some papers a few weeks ago where there is less of a link between absolute brute computing power and the actual kind of accuracy of models, there's now a really interesting paper talking by a, a kind of nameless person inside Google.Basically saying, since a bunch of open models have been released, The kind of gap between million pound uh models and literally a hundred dollars models worth of training is really narrowing quite now. And the quote that I think is probably good for setting the scene is this one. So this was talking about comparing models like say, GPT3 or Google's bard, for example, with some of the more recent ones based around, I forget this, Lama, LMA, and Lama and alpaca.I'll refer to these later on. While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open source models are faster, more customizable, more private, and pound for pound more capable. They are doing things with a hundred dollars and 13 billion parameters that we struggle with 10 billion than 540 billion parameters, and they're doing this in weeks, not in months.Max Schulze: I think the biggest risk here is the rebound effect because. Yes, it's now more efficient, so to say, to put AI models. It's basically everywhere and everybody can have their own and like I can have one for my notion space. I can have one for my Basecamp, I can have one for my Wiki. I can have one for my tickets.That just means that same as with LEDs, we will get exponentially more AI models embedded into everything that's probably in aggregate, we'll use still much more infrastructure, much more energy, much more GPU power than ever before. I think doesn't matter if you have 10 big ones or a billion small ones, the effect is probably almost the same, if not even worse with the small one.So just looking at it from the environmental perspective, what do you think about it?Chris Adams: I think that automatically reducing the amount of compute needed for this, in my view, is a good idea. And if you just have a larger number of smaller players who are playing rather than just an oligopoly of three or four. I think that means that when it comes to actually regulating and being able to have civil society involved, I think you get more people able to talk about this.And you don't just get to have innovations coming from a very small group of people. So I think that you end up with, um, which would be more representative of society and therefore probably coming up with a. Uses and ideas, which are probably not quite so full of some of the kind of gaps and some of the kind of blind spots we've seen previously.So I think this, by having a larger number of people doing this, I think is a good idea. I think that makes it more likely that you have one or two people who are pushing for, say, The idea of these models being as a part of you training, you basically just say, I'm only gonna run this on green energy, for example, or I'm going to disclose the information about how this has been run.And because you have more people who are actually able to do this, I think you're gonna end up with. Greater transparency in people being much more explicit about both the providence of the data and the actual cost in terms of environmental impact that's come into it in the first place. So I think this creates scope to compete on transparency and compete on the fact the data can be trusted and has actually mean created in a more equitable fashion.So I think that's good. And there's another really key idea that I saw here was basically people saying lot of these new open source projects, they're achieving wins, not by having loads of data, by having much, much better curated data. And I think this is actually a much more promising direction to be going in than what we've been seeing so far where you just throw ever larger amounts of compute because if you are, say Google or Microsoft, you've made so much money that you don't know what else to do, then spend 70 billion on buying your own company's stock, right? That makes you think that it'd be nice if there's just more people who are able to use this rather than a small vanishing number of people put involved here.I think that's actually useful from a governance and an environmental point of view, basically.Max Schulze: So also from a society perspective, you basically say, well, we had this property theft problem, right? Then also larger datasets, open source dataset, address that. I agree with you. I do think just for completeness, I want to say that we do still need rules for bias and lots of other problems. I think we, from a societal perspective, so the third component of sustainability, we do need still rules.I think we need rules, some basic ground rules and principles for what's okay to do with AI and also what problems are okay to solve with AI. There was a great article by The Economist on a war game that they play with nuclear weapons and basically the end of that every. Minister and government person that plays that game says, I want to automate the decision of when to deploy retaliation strikes, and like everybody can tell.And also my neck hair went up and I was like, no, you don't wanna give that decision making power to a machine. That's the whole point. And I think we need those kind of principles and rules of what you can do with AI and whatnot.Chris Adams: Okay. This is actually one thing that gets touched on a little bit later, is this whole explosion of much, much clearer data sets where you actually have a good idea of what the provenance is and how that's been created. Cuz this has been one of the problems that we've touched on in previous episodes.When you are playing around with LLM models, if you look on Twitter, you will see lots and lots of people telling you about how your job will be destroyed if you do not learn to use OpenAI, but there's also. A flip side to this about, well, some of the labor rights associated with this, and whose labor is actually going into these models and being obscured that we touched on.Okay, so this is the last story that we have. This is technology pools, enterprise green ambitions. This is from CIOdive.com, and this story is largely talking about some of the providers of IaaS infrastructure as a service. And what's some of the mechanisms you might actually have available to you to reduce the emissions associated in your supply chain?So this is aimed at telling CIOs. Okay. There is this thing called Scope three, which is like a kind of way of thinking about the emissions in your organization's supply chain. And let's talk. It talks a little bit about which companies are doing better than others, and we've seen some new updates from actually Amazon of all people.So for the last year, there was the kind of initial rush to get an early version of say, Amazon's cloud computing. Sustainability dashboards out the door. And then no updates have happened for 12 months. And then we've seen some updates again. So it looks like folks are starting to pick up on this, but that is not the whole story.And I think Max, you might have some records to share on this one here actually.Max Schulze: Ayayay Chris, I'm gonna be very diplomatic here. I admire that Microsoft is very transparent about their Scope three and their data reporting. You have to. You with a grain of salt, because if you go one layer deeper and you look at the available data from, let's say, how much emissions is in a data center building, how much is in a server, even HP and Dell's reports are.Let's say vague. So let's say if you look at it as like a chain of data that you need to collect, I think that it's starting and it's good that the big ones are really saying we want to be more transparent, and then they realize, oh, we don't have the data from our suppliers. I think that's a good thing.I think that it's always tricky because even the GHG protocol is made mostly by corporations. They make their own reporting rules. So I think there is a lot of work still to be done to include all environmental effects. I do agree with the article also talks about third party vendors and consultants.I think there's a lot of tools being built to help with this. Our formulas have been integrated in Dynatrace monitoring tool. So in Dynatrace, you can actually now at least calculate the energy of your AWS systems and you get very much larger numbers than AWS is reporting to you. So yeah, again, comes down to rules and standards.And I think in tech, this is the first time somebody's doing like a holistic inventory of all environmental impacts of digital technology, and we are lacking so much data at every corner. It's just not there. So a lot of these things are really brutal estimates right now.Chris Adams: This is true. We spoke about this change. We were surprised by some changes coming through, and I'm afraid this is a bit spotty and nerdy. This energy efficiency directive that was basically rooted recently that is seen as a transparency win for a few people, basically that to provide a lot more transparency at a data center level that you haven't seen previously.Max, I think you, you had some exposure to this or you saw how some of the, what they say in gentlemen, how the sausage gets made, right? Maybe you could share a little bit on this one here.Max Schulze: Yeah. Yes, we were very involved in this process. It was very politically loaded. It's essentially about, so even the big cloud companies often rent data center capacity at co-location facilities, which are, uh, You can think of it like WeWork for your servers, right? You get everything power cooling included in your rent, but you have to bring your own servers.And some of these companies are very intransparent about your energy consumption, the emissions of your energy consumption, the embodied emissions. And this law essentially forces them to both make it public and then also attribute it and give it to their customers. And that's quite the game changer, especially because the law, the first reporting interval, you pointed this out as well, is already in May, 2024, which is very short notice and will drive a lot of data centers to now really quickly scramble together a reporting system.Right now, the most used spreadsheets and uh, that, that's why also what you mentioned earlier, the, our EDA project of course, can help with this. That's why it's open source so that every data center can deploy the monitoring tool and then release that data as quickly as possible. And I think that will also increase the accuracy of what the hyperscalers are reporting, but also what you as a developer have access to.I hope it's, of course the, all your Digital Oceans and AWSs have to still pass through that information, but I, the law really sets the stage to get the data in place to begin with.Chris Adams: I see, and there was one thing that surprised me when I read through this, was this real focus on heat reuse, basically. Now that's a key thing. It's starting to be warm again, at least in Western Europe compared to other parts of the world. But, uh, we do know essentially space heating or heating things up here is one of the big sources of emissions for this.And, uh, I think Max, you mentioned some of the idea, like one of the reasons some of the transparency stuff might have come through is because there was a almost disproportionate amount of interest in making sure that heat gets reused by various organizations. Is this one thing that you saw?Max Schulze: Yeah, absolutely. I think heat recovery has been something the SDIA has been talking about for five years as like, why on earth are we putting a hundred megawatts into a system that produces 100 megawatts of heat and then not use it because you will know your computer generation. Every electronic process generates that heat and it's just silly to not use it.And because you mentioned it, this idea for example, that in summer you can't use the heat is complete bollocks because storing thermal energy, right? Putting it in an underground tank to store the heat, you can store it for a whole year until winter and hear this, to store energy one kilowatt in the lithium ion battery.Cost about $180 per kilowatt hour storing one kilowatt of thermal energy using any form of tank, $1 per kilowatt hour. SoChris Adams: Okay.Max Schulze: not storing that heat recovered or not, we have to use it. It is like literally we put all these green electrons, right? All this green energy into the data center, and then instead of reusing those green electrons, we just throw them away as heat.And it's the rarest commodity we have on this planet right now is green electricity, and we should use it as much as we can in as many times as we can. And yeah, I'm really glad that the directive suggests that, or basically forces the data centers to at least consider heat recovery and show proof that they have considered it.Chris Adams: Now, and this is something that I understand has been so outside of this world, I'm a bit of a kind of heat nerd because I know that Denmark is actually one of the, one of the countries which has a long history of storing heat for long periods of time just like this. And I think I might have spoken outta turn about just when it's hot, you don't, you might not want to put the heat somewhere, but you're absolutely right.There's various parts of the world where they store things in significant bodies of thermal mass, like pools underwater and so on, so that you can pull the heat out and as people end up do using things like heat pumps and so on, you're able to move it around to other places to make better use of that actually. Okay. All right. We podcast about green software and not just heat. So I'm just gonna look at some of the events as we run up now. So we have, I think, two or three events on the horizon that are coming up here. The first of these is this rise of AI 23. This is happening in Berlin on the ninth and 10th of May.This is a hybrid one, and basically the Responsible AI crew starting to look at carbon neutrality and trying to understand. The actual leverage points on a project to work out where you can make meaningful savings. Here, this is a free thing to join to see some of the talks and there's another event taking place later on in May that I think, Max, you might have something to say about here cuz it has your organization's name on it actually.Max Schulze: Yeah, so we are hosting a hackathon with the German environmental agency to measure the environmental impact of software. This is really about measuring and we build a test system where people can basically upload their code to a GitHub account, and we have a special CICD runner that people can use and that runner is so to say, energy aware and also carbon aware, and it measures everything. So what we are gonna do, hopefully, is take some open source projects like a Django or like some noJS library, and gonna basically see what can we change in the code and then run all the tests again. So without. Reducing the functional scope without removing any tests. How can we make it more energy efficient?How can we use less energy or use less server capacity, and also measure in between different versions of software. That was an idea that somebody brought to us that I thought was really exciting to say, you know, when you release a new version of a piece of software, can you basically do a diff of the energy use versus functionality growth and basically say each new version should not use more energy than the version before unless it adds like significant amount of functionality free to attend.Chris Adams: Oh, cool. All right, so a bit like how cars keep getting bigger and bigger and some of the things you might care about, say crash safety, but some other things like cup holders you may be less excited about or there's maybe things you are. The idea is to provide that level of transparency to make some of that more visible to people.Yeah.Max Schulze: Yeah, what you can measure, you can change, right? And so I think if we make people aware that their software keeps growing in terms of environmental impact, then I think there's more incentive to reduce it.Chris Adams: I see, and this is part of the project, I think of the German Comp SoftAWERE, the project with the Federal Environment Agency, the Umweltbundesamt who are doing thisMax Schulze: Very good pronunciation, Chris. VeryChris Adams: to get some practice in. All right. Actually there's some, I'm I, there's another story we didn't have time for, but I'm just gonna share cuz it caught my eyes.Basically the Sovereign Tech fund is essentially a fund in Germany and they've basically made a donation of 875,000 euros or $900,000 to the openJS Foundation. So the people, the foundation that maintains like noJS and various tools like that. This is the first time I've seen a government make a direct donation in this kind of, Fashion for quite a substantial amount for something like this.Actually, this is like the focus on security rather than sustainable software. But it caught my eye cuz I was not aware of just how much, I guess the German government is involved at the software level now.Max Schulze: Funny. Yeah, I think it's interesting because. That also means that soon the open source community will finally get political because once you take the money from the government, you also have to have a position.Chris Adams: This is very true actually, and I wonder this might be something we touch on in a future episode actually. Okay, so we've got that happening on the 24th of May. That's the hackathon there that people will be going along to, or that you can go to. Final event that we have listed here is the LF Energy Summit taking place in June.So this is happening at window. In LA Force, Paris, France, and this actually has a few people from the Green Software Foundation presenting both the Green software principles and uh, the Carbon Aware sdk, which is an open source software development toolkit for people who are building projects, uh, using the kind of Microsoft stack, using C Sharp and so on, and trying to basically reduce the impact there.This is something that I think we also touched on, Max, you spoke about the idea of Linux appearing in various parts of the kind of. Energy sector now, and this to my knowledge, is where you see a lot of people in the kind of open source world now looking at lots and lots of proprietary scarda infrastructure tools and say, maybe we can use some open tools to make it easier to maintain and manage this stuff.Because once we go down to the data center level, it can become a bit harder to get the numbers or basically work with open source software the way that you might see it at an infrastructure level really closer to the metal.Max Schulze: Generally a bit worried because I think. The energy system works, right. Our computers right now are running. The light is on. There's no no problem to fix. What we need to do is to scale renewable energy as quickly as possible, and the technology for that. We have 14 megawatt wind turbines now is really there, and a lot of the problems in renewable energy is about.It's about permitting. It's about, I don't wanna win park in front of my house. I don't want solar field next to my house. And I don't think that the solution is digitalization right now. I think as a tech sector, as digital people, we need to look at our own stuff and not go bring our stuff to other industries right now so much we need to make sure that we are not going to be the bigger problem at the end as the biggest energy consumer left or something like this.I'm always trying to put us back on track. Like tech can solve tech. We don't need to go solve energy system right now because energy system is already on track to decarbonize itself and let's just let them run with that. If they need help, they will call and we do us.Chris Adams: Okay. Okay, Max. I think that's the wise words indeed. Max, thank you so much for coming on to this show and this conversation. I really enjoyed chatting with you and I hope we can do this again sometime soon.Max Schulze: Me too. It was, it's always a pleasure to talk with you, Chris, and I always feel like we have to rush so much, but we could do a lot. We could do four hour podcast episodes.Chris Adams: Maybe in the future we'll do that. Okay. Alright. That's all for this episode of The Week in Green Software. All the resources for this episode are in the show description below, and you can visit podcast.greensoftware.foundation To listen to more episodes of Environment Variables, the kind of larger name for this podcast.I'd like to say thank you very much again, Max for coming on, and folks, see you next week on the next episode. Bye for now. See you around Max. Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get to your podcasts.And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners. To find out more about the Green Software Foundation, please visit greensoftware.foundation That's greensoftware.foundation in any browser.Thanks again and see you in the next episode.
undefined
May 3, 2023 • 39min

The Week in Green Software: Data Centers in Space

Host Chris Adams is joined by Anne Currie on this episode of The Week in Green Software. They discuss the potential for data centers in space and how the use of potential death rays might be the way forward in powering these! Not only this, but sweeping changes in Reporting Law, and making Kubernetes clusters into Low Carbonetes clusters are covered too. Anne has a special report on her upcoming book and Chris finds his own variation of Boaty McBoatface!Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteAnne Currie: LinkedIn / Website Find out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:Data centers move into space to mitigate power consumption and pollution / El Pais [2:41]Building Green Software Book Preview [14:43]Microsoft Scales Cloud-Native Workloads with Carbon Awareness / SDX Central [21:32]Solicitation for Public Comments on the Business Practices of Cloud Computing Providers / FTC [26:32]The SDIA welcomes the deal of the European Council and Parliament on the Energy Efficiency Directive / SDIA [30:16]Resources:Community Clouds and Energy Islands with Dawn Nafus and Laura Watts about Data Centers in the Orkneys [6:26]White Paper that Anne’s Book is based on [14:43]Designing for Sustainability by Tim Frick [20:43]https://github.com/Azure/carbon-aware-keda-operator [22:00]The Green Web Foundation’s Guide on Carbon Aware Scheduling w/ Kubernetes and NomadRoss Fairbanks [22:18]Kube Green [28:17]Boaty McBoatFace Culture Ship RandomizerIf you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript below:Anne Currie: Data centers in Greenland are an obvious thing because there's tons of free energy, green energy from ice melt runoff.Chris Adams: Yeah.Anne Currie: But one of the issues there is that nobody lives in Greenland to man the data center, but even few people live in space demand the data centers. So I would, I would hope that you would solve the Greenland issue first.Use all that enormous amount of energy before you,Chris Adams: Okay, so our site, so before we reach for the sky, let's sort out things down here on Earth. Yeah?Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams.Hello, and welcome to another episode of The Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams. This week we'll be talking about data centers in space, sweeping changes in reporting climate laws affecting the digital sector.Making Kubernetes clusters into low Carbonetes clusters and a set of interesting looking coming events. But before we dive in, let me introduce my esteemed guest for this episode of this week in Green Software. This week we have Anne Currie. Hi Anne.Anne Currie: Hello.Chris Adams: Anne, would you just introduce yourself?Anne Currie: My name is Anne Currie and I am currently one of the community co-chairs for the Green Software Foundation. I'm a software engineer. I was a software engineer for many years, many years and 30 years I've been in the industry. And so I date from the time in the nineties when we used to build software using the same kind of techniques that we might, that we are thinking about using to date for green software because machines were very weak then, and we had to handle that. So that's my perspective on this.Chris Adams: Cool. Thank you, Anne. So if you are new to this podcast, my name is Chris Adams. I am the executive director of the Green Web Foundation, a nonprofit focused around us reaching an entirely fossil for internet by 2030. And I'm also the policy chair, the chair of the policy working group in the Green Software Foundation.Each week we do a run through of stories that caught eyes, or that might be fun to discuss. And everything we do discuss, we share all the links that we can find for you to dive it down your own little Wikipedia kind of holes after this session. Alright, so Anne, should we look at the first story that came up here?It's data centers move into space to mitigate power consumption and pollution. So this is the story from El Pais, a Spanish newspaper, and uh, they published this story I think of stem. It's about this program called Ascend, which is Advanced Space Cloud for European net zero emissions and data sovereignty program.Anne Currie: That's not, that's not a little bit contrived at all.Chris Adams: Yeah, exactly. And the European Union has selected fails Acun space, a joint venture between Thales group in France or Thales possibly, I'm not quite sure if I'm pronouncing that correct. And the Italian defense conglomerate Leonardo. And the plan is to see if you can create space data centers here. And I think the plan here is to try to address some of the energy issues related to data centers on the ground. I found like the initial press release for this, but Anne as a science fiction writer, I figured you might have some records here before we dive into this a little bit more, actually.Anne Currie: Yes I do and I read the piece and it's, it is an interesting piece from my perspective. I am also a science fiction writer and I have written a series called the Panopticon Series and three of them are set in space and address the technology in space you mentioned is all about Arthur C. Clark. And interestingly cuz Arthur C. Clark was a physicist when he did his. For example, his lunar based novels, he put realistic technology in it, and he often had patents. So he had the first patent on an electromagnetic cannon in space, which uses electromagnetic fields to fire stuff around. Or it was a, an idea of delivery mechanism for getting stuff from the surface of the moon into orbit.Chris Adams: Whoa, whoa. Did you say that Arthur C. Clark patented the rail gun? Is that,Anne Currie: did? Yes,Chris Adams: oh my God, my mind is blown. Gone. Please do. Go ahead. That's, I'm never gonna think of Quake another way that's changed how I think of Quake. I.Anne Currie: But thinking, I don't think he was thinking about it in the form of a rail, but it might be quite specific patterns. Often quite specific. It might be specifically for electromagnetic canons for the delivery of stuff from the surface of the moon to to lunar orbit. But anyway, he did have the patents on that, which now expired cuz it was quite a long time ago.But anyway. So that all that stuff does all work. And in fact, there's loads of interesting things you can do with rail guns in space as a way of, as a transport mechanism or a power transport mechanism as well. But anyway, there's, that's a side there. In terms of data centers in space, obviously you've gotten a lot of power that can potentially be generated in space room solar because you've got nothing in the way between you and the sun, and the panels can be in a hundred percent light.So, but it is a very. Interesting idea. And along those lines, China and India have been coopering for a while. I dunno if they still are, but they were cooperating a few years ago on a space based solar power system. So space based solar power is the idea that you have a giant laser in space and you capture the energy from solar panels and you beam them down, beam it downChris Adams: down to a panel on the ground, right?Anne Currie: Yeah. Which has some kind of giant death ray connotations around it. So it's not, it depends how you do it depends whether you use light lasers or microwaves to get it onto the ground. And then there are lots of, but it is perfectly doable and I think that's a very plausible idea for getting power, using the same kind of idea of using solar and space to get power down toChris Adams: Okay.Anne Currie: re-usable space.But yet it's, so the idea of data centers and spaces that you build them out there in orbit somewhere, probably quite a long way out. Cause they don't necessarily need to be a near earth orbit. And that's quite busy. And yet you could just be powering it directly. The difficulty with that is always that it's gonna be very hard to maintain that data center, but it did remind me slightly of a story that came up a few years ago, and it's definitely true, which is that Azure have been experimenting with undersea data centers in effectively the size ofChris Adams: Yeah. Around the Orkney's underwater. Yeah.Anne Currie: Yeah, and those have similar issues in that you put them in and then you can't maintain them. That's it there. So the idea of having a self-contained, smallish data center that's no one can subsequently touch is not a new one. So it's not utterly, utterly impossible. And of course, Starlink has got the cost of getting stuff into orbit down quite low.Yeah. So it's not impossible. It'sChris Adams: It doesn't seem impossible. I, so I think I struggle with some of the numbers on this. Because in this press release, we see something saying, okay, we want to install data centers in orbit, powered by solar plants generating several hundred megawatts of power. Now, several hundred megawatts is a very large data center, so like hyperscalers are between 20 to 50 megawatts of power.So you're looking at something like that and then, I also, let's just look at say, okay, the International Space Station, they've got solar arrays. Right now they have maybe 120 kilowatts of power coming through, but they're old, and that's two and a half thousand square meters here. So more or less, if you are looking at something which is, I don't know, what is that roughly, that's maybe that's for a hundred kilowatts of power.You're looking at maybe what, 2000 square meters per a hundred kilowatts. That means. For a single megawatt of power, you're looking at 20,000 square meters, and if you're looking for hundreds of megawatts, that's gonna be 20,000 square meters multiplied by hundreds. That's a lot of solar to have in the sky.This is the thing I was struggling to get my head around. Things might have got more efficient in the last, say, 20 to 30 years, but surely that is gonna be a heavy thing to get into the sky in under any circumstances, will it not.Anne Currie: Presumably that is a massively heavy things to get into the sky, but launch has really come down in price a lot. And of course it doesn't have to be particularly co-located with the data center cuz you can use those space-based solar power death rays to the subject of my last science fiction novel called Death Ray.So you can, you don't have to be right by the thing, you could have those arrays literally millions of miles away in space and beam it back. You do get dilation on the beams if they're too far, but you can keep relaying them.Chris Adams: Okay, so we could have our data centers in some or, and then the solar panels further out. So they're far away from there. Okay, so that's one thing. Then you mentioned that there, there's different kinds of orbits, right? So as I understand, There's kind of low earth orbit like LEO, which is Starlink, and that's maybe 2000 kilometers above the ground.And then would that mean you're hidden from the sun so that it's dark for your satellite sometimes?Anne Currie: Yes, I think it does. I think you have to be reasonable distance outChris Adams: Yeah. So geo stationary I think is like maybe bit further out where it looks like you're not moving because you're that much further out. Right?Anne Currie: And you've asked me a question, I dunno the answer here. I do not know how far you have to go out to be constantly in the sun, but to be honest, it's just less busy further out. So if you can be further out, there are loads of reasons why you might prefer to do that. And yeah, it's just a matter of then beaming the power back.Chris Adams: Now I'm with you on this, and then this feels like latency's gonna come up at some point, right? Because I'm curious about cause. In the LEO, like low earth orbit 2000 kilometers. We already use CDNs for like to have things closed. So if it's 2000 kilometers, that's one thing, but if it's something, I think geostationary is something like it's either 20,000 kilometers into the sky or 40,000 kilometers into the sky.So that's gonna be, I don't know if speed of light is what, 180,000 kilometers per second. That's gonna be a significant chunk of latency no matter what you do. And that's even if, if it's just you going straight up and down, if you're going around the world, that's gonna be even harder, surely.Anne Currie: Yeah, lower orbit latency isn't too much for an issue. It depends, but it, the further you go out, the more there it is. If you had your data center on the moon, latency is about a second each way? No, it's half a second each way, but it's, it is a total latency. You say about a second, which is obviously it wouldn't make for a very good podcast or a Zoom call, but it depends on your use.And it depends. Just depends whether the latency is an issue or not, because sometimes bandwidth is more of an issue with than latency, so.Chris Adams: Oh, okay. Yeah.Anne Currie: Yeah. It all depends what you do, what you're doing with it, and where it's going and how much. I mean, I, I would guess that the whole point was a lot of the things they're talking about, like in that article they were talking about, data that they gathered in space, being analyzed in space, using the, a big array of CPUs, and then boomed back in a more compressed form back to earth.In that case, latency is not an issue in any way, but if you wanted to move all data centers into space, then latency would be a giant issue. As you say, CDNs and stuff on the edge.Chris Adams: Yeah. And the final thing, we'll stop on the space part cause there's other things we're gonna talk about. But the final thing that really kind of, cuz I scratched on my head about this, cuz last week we spoke all about using different kinds of ways to keep computers cool. Right? Now when you're in space, one of the arguments seems to be that because it's so cold anyway, you don't need to worry about cooling.I don't think that's how I understand physics. As I understand it there are three ways to cool things down. There's radiation, convection, and conduction, and I'm not familiar with that many cool breezes in space, so I can't rely on conduction. Maybe convection, not very much. So that just leaves radiation.And those pictures of the space shuttle with its doors open, it's open to radiate out heat. Because it's got so much heat still. So I feel like if you've got this issue where data centers generate lots of heat and there's no way to get rid of them, this feels like a problem that I don't see how it's gonna be solved by putting things into space that people haven't really taken on board yet.And Anne I'm struggling with this, maybe you've got some pointers or maybe it does sound just bonkers.Anne Currie: Not just bonkers, it's, it is, you're completely reliant on radiation and they have quite good things where they have little radiating shapes and stuff that can radiate off heat more quickly. But it's not easy. So it's not easy. It feels to me like you'd be able to do better on the moon because at least you're in contact with something that can conduct heat away.Depends on how conductive moon dust is and or moon rock is, and I dunno that.Chris Adams: Heat up the moon until it glows red. Okay.Anne Currie: But yeah, you're right. It's not a no-brainer that we could just go in. It's not like that under sea ones. People go, oh, that's great cuz you don't have to worry about cooling if you've got a data center under the sea.And that's true because it could just conduct into the sea and that's fine. But space is not the sea, you can't do it. So yeah, it's not trivial.Chris Adams: So we have latency, death rays and uh, heating some of the challenges that may face us if we try to put data centers into the sky. But this is one potential proposed solutions to the issues around energy crises or the energy supply for, or sustainability issues related to data centers by the sounds of things.And thank you for sharing all this, um, about the, provided the science fiction pointers on this, cuz yeah, this blew my mind when I first saw it and I, I think that you've actually shared a lot of useful things on this.Anne Currie: I think it'll happen. I think it'll happen, but I think there are other things that data centers in Greenland are an obvious thing because there's tons of free energy, green energy from ice melt run-off.Chris Adams: Ah, yeah.Anne Currie: But one of the issues there is that nobody lives in Greenland to man the data center, but even few people live in space demand the data center.So I would, I would hope that you would solve the Greenland issue first. Use all that enormous amount of energy before you,Chris Adams: Okay, so our site, so before we reach for the sky, let's sort out things down here on Earth. Yeah. All right. Okay, cool. Thank you Anne. Alright, next story is a sneak peek about a new book coming out. Anne, I think this is, this is your thing. It's a coming O'Reilly book called Building Green Software. We were quite excited about some of this cuz there's a couple of co-authors who also been on this here before.So spit on this podcast. Anne, I'm gonna hand over to you to talk a little bit about this cuz you are far more familiar with it than I am. And yeah, you know better than I do. So please do tell more.Anne Currie: Yes, so this is an O'Reilly book that we're working on, the O'Reilly book called Building Green Software, which is gonna be there. It's not the first green software book they've done, but it's the first kind of full picture as opposed to there are quite a few good niche ones out there for things like Web development, but this one is all the things.And there will be me and Sara Bergman, who is a key part of the Green Software Foundation and Sarah Hsu, who is also a key part of that Green Software Foundation. And so we are writing all together and the idea is to net down the thinking that. We've all, as a community, come to agree on about what's the right way to do things.So it's all based around the idea that there's three things that we need to be good at. We need to be good at carbon efficiency, hardware efficiency, and carbon awareness. So that's what we'll be talking about in the book. So we'll be talking about carbon efficiency in terms of code efficiency, operational efficiency, plus design efficiency through carbon awareness, how designs that allow you to shift around what you're doing.And we'll be talking a little bit more about that later, I think in this podcast and hardware efficiency. So don't cause everybody to throw away their phones every time you produce a new version of your software, cuz I dunno, you might know the answer to this, Chris, but what has the most embodied carbon per gram of anything in the world?And my guess would be a chip. And in terms of consumer devices, my guess would be hands down a mobile phone.Chris Adams: Do you know what? I've never actually thought about that in terms of Okay. A single kind of consumer good in terms of post embedded energy inside it. So it's true that there's a significant amount of power that goes goes into turning sand into silicon and all the other kind of materials there.Anne Currie: But also the operation, cuz silicon fabs are unbelievably difficult to make.Chris Adams: Yeah. And of course, and this is actually one thing we should probably talk about in a future episode. When you look at where lots of the really high-end chips are currently made, a lot of them are in Taiwan, which has a very kind of fossil fuel heavy grid. So even if the stuff is really efficient and even if they're just using electricity, that's gonna be one of the problems.But even then, when you are making these, because most of the ways that you achieve the high levels of heat, don't rely on electric kinds of power they rely on, but literally heat from combusting fossil fuels. You've got an issue there. This is actually something that's changing. There's a really fascinating paper by Doctor Sylvia Medadu who's talking about some of the advantages in heat pumps.You can now get heat pumps up to the high hundreds of degrees lts basically. So there are lots and lots of things that can be decarbonized now, but. For you to reap those benefits, you actually need to have decarbonized electricity in the first place. And Taiwan is struggling a bit there because it's not a really big place with lots and lots of land and it doesn't actually have much in the way of surrounding kind of shallow water for creating, say, offshore wind or things like that for the time being.So that's gonna be an interesting one ahead of us. But yes, you're right. I guess,Anne Currie: need the power back beamed in from space on giant lasers.Chris Adams: yeah, maybe what they need is a death ray. Yes. Uh,Anne Currie: in handy in all kinds of ways. If you were Taiwan as well, I would imagine.Chris Adams: Yeah, let's leave that one there before we get taken off the internet by a advanced persistent threat. Alright. Okay,Anne Currie: But, but anyway. Oh, that's, that's an aside. The book. The book. So the book, we are beavering away at the moment writing the book. We've submitted quite a few chapters already, so it's all going well. And the idea with an O'Reilly book, the way they do it is it's you as a writer, you writers, you submit the chapters and as the chapters are at least vaguely polished.Vaguely, okay. They'll go live for people to read in a kind of advanced read on safari. So that will be,Chris Adams: shortcuts thing?Anne Currie: Yeah, so shortcut so people will be available, will be allowed to read these things. So the introduction has already gone out and it's not live yet, but we are expecting it to go live quite soon. So we will let everybody know through this when it's live and also the co deficiency chapter.And after that we've got the various other chapters. But they'll, they'll be available in Safari quite really quite soon. Then the book, the book actually gets physically published and we get an animal. We'll have an animal, but we dunno what the animal's gonna be. So at that point we'll find out what the animal is and the book gets published.And then, uh, so it'll be available to buy in physical form if you so choose. And also at that point it will also be available. One of the things that we agreed with O'Reilly is that it will also be available under a Creative Commons license at that point.Chris Adams: Boom.Anne Currie: even need to buy it or have an O'Reilly subscription.And because if this is all stuff that is, hopefully by the time we get through this and everybody's reviewed it, it will be, this is just what we want everybody to be doing. This should hopefully be a baseline.Chris Adams: that's super cool. I did not realize about the actual Creative Commons licensing for that. That's really helpful. That means that brings the barrier right down.Anne Currie: Yeah, but it'll be a while cuz it takes quite a while for the book to actually come out. So I'm imagining that first quarter, 2024 will be when that's available, unless we really get our skates on and get it done much more quickly than that.Chris Adams: I have one question, if I may before we move on from this one. I haven't used Safari and I have never written a book, but I have heard horror stories about working with publishers and emailing Word documents back and forth. Is it still that process or is there something like GitHub or what does it look like to write a technical book these days for a technical provider?Anne Currie: For O'Reilly, you've got quite a lot of different options, and one of them, the one that we are using is just Google Docs, and so that's super easy because Sara is in Norway. Shira, our editor, is in. And I was on the west coast of the us. I'm in the southeast of England. Sarah isn't too far away from me.She's in London, so that's quite easy to do. But fundamentally, Google Docs are pretty good for that kind of thing.Chris Adams: Wow. So Sarah, yourself and Shira, it sounds like it'll beAnne Currie: Sarah and Sarah. Yeah. It's really quite hard.Chris Adams: Yeah, and this is interesting cause there are a number of existing green software books. So there's one called Designing for Sustainability by Tim Frick, who'sAnne Currie: Oh, yeah, yeah. Which is very good actually.Chris Adams: Yeah. And then Tom Greenwood from Whole Grain Digital.Anne Currie: yeah, yeah, that's alsoChris Adams: he had his. Yeah. And I think there are a couple of other books that I've seen come out as a number of other ones, but. The first time I've heard of one of these books, which is actually written by guys who aren't just men basically. So this is actually quite inco. I think this one book may have actually righted the gender balance in the sustainability book canon.Yeah.Anne Currie: hopefully, and there is method in our madness on this in that we wanted to make sure that we got on stage to talk about it as well. And we are three women who are very good public speakers, so really we should be able to make a little noise about this.Chris Adams: Good. I wish you the best and I'm looking forward to some of the shortcuts for some of this. In that case, should we look at the next story?Anne Currie: Okay. Absolutely.Chris Adams: All right. Okay. This is Microsoft Scale's workload with Carbon Awareness. Now the actual story is links from SDX Central. As far as I can tell. This is basically a kind of press release talking about Microsoft and Cloud network stuff.But the thing that was really more specific is actually some of the GitHub issues that we've linked to inside the show notes here. Basically, there is a carbon aware operator for Kubernetes to add in a bit of kind of carbon awareness into it by the looks of things. So if you go to github.com/azure, then Carbon Aware KEDA operator, there's an open source operator that you can plug into Kubernetes to do this.And I think this is something that we've both discussed before, but I suspect you might have some records on this because I joined a mutual friend of ours, Ross Fairbanks, did some work in this field a while ago as well, actually.Anne Currie: Yeah. Ross and I used to work on a startup called Micro Scaling Systems, which was all about cluster scheduling. And one of the thing that we always had in mind was adding carbon awareness to cluster scheduling, so moving jobs so that they, uh, get, wait until there's green carbon available. There's green electricity available on the grid.Now Google have been talking about this as well. They aren't offering it as a service like this Kubernetes scheduler, but the idea, they've been doing it internally, they've been trialing it internally as a way of shifting workloads in time. So, so that they consume green electricity, more assiduously than they would otherwise have done.And this is the same idea now. As far as I'm aware, this is mostly about being able to compress what's on your machines so you can turn machines off. It's all kind of bin packing on machines, cuz all the machines you wanna compress them in so that there are few machines running because they've got loads of containers running on those machines differently shaped, and they're all squeezed onto a smaller number of machines at times when there's no green power available.And some machines got to get turned off. And in order to do that you have to have jobs that can wait. So this is not just merely a matter of scheduling, and it's two sides of information here. You need to know. What the current mixes are on the grid and what it's likely to be, which a lot of that goes around weather and grid load.So it doesn't matter if you've got great weather, but you've got high grid load, then maybe you're still not gonna have any green power. But if you've got low grid load, maybe you've actually just got too much power and you want to be using it. So it's not just about following the sun or following the wind.You need this information about what the grid is like, what the weather conditions are on the grid, so to speak. And you also need to know what jobs that are running in your data centers are non-time sensitive, so they can be moved around forward and backwards in time. So the same kind of things that might be running on a spot instance, for example.Now Google pointed out that with their stuff, they're pretty good at labeling their jobs internally, so they're pretty good at labeling jobs and saying this is a low priority. You can just wait if this has to wait. 12 hours fine. Things like video transcoding for YouTube. Sometimes that happens very quickly.You might notice as a user, sometimes it happens very quickly. Sometimes it happens and it takes quite a long time, and that's because Google. Just go. It's not a high priority thing, so something needs to wait that it will be video transcoding. So you need jobs that are non-time sensitive and are labeled as non-time sensitive.So I say one of the things that Google pointed out that they struggled with a little bit on this is that they can do it internally where things are very well labeled, but they find it very difficult on the public cloud where VMs are just black boxes and they have absolutely no idea whether the contents could wait until there's green power available.So for a scheduler, you need both the information on which to schedule, but you also need the information about the jobs to know which ones are schedulable. There's work to do as a user, as well as just install the scheduler. You will need to start labeling your jobs.Chris Adams: And this is presumably something gets touched on in both books and patterns about the idea of decomposing maybe a particular monolith or a single big program into a number of smaller programs where some bits have to be. Really low latency, responding quickly, any other parts can be moved around so you can make use of either carbon or cost savings presumably.Anne Currie: Yes, absolutely. Yeah, cuz it, cuz you won't be moving these jobs, I would imagine. You won't be moving them from data center to data center cuz you know, data gravity and all that kind of stuff. But you will be moving them in time. There's really no downside to moving things in time. And so there's no data gravity download.So it's, that's where the wind tends to be.Chris Adams: So just, can I check with, so you mentioned an interesting concept here, data gravity. So data gravity is the idea that one data is in one place, you are not able to move it, it's difficult or expensive to move to another provider. Is there like a technical reason for that or what's the thinking behind that?Anne Currie: Yeah, it's, it's network, it's bandwidth, it's all, and it takes time and blah, blah, blah. But there's an awful lot of data. Gravity is one of the re one of the ways thatChris Adams: So we're referring to egress fees here. Yeah. So paying money to get things out of your cloud storage. Oh, just by the way, if anyone, you. There's a whole FTC kind of inquiry right now about oligopoly and competition right now at the cloud sector. So this may be something that if you feel like you would like to be able to do more stuff with in terms of green computing, maybe this is a thing that you might want to respond to the ongoing FTC basic kind of inquiry into this stuff.Cuz I feel that maybe it'd be better for us to actually be able to move things to more than just two or three clouds. Cuz data gravity seems primarily to be a kind of business constraint rather than a technical constraint.Anne Currie: Yeah, it probably is. Really? Yeah. Technically it's diff, it's difficult, but it's doable. You can get, you could have copies of your data in multiple places. And yeah, you could move it at night. You could copy it on, you could do the whole snowmobile thing, copy, copy it all out once to a bunch of disks and drive them across the country.It's not an insurmountable problem no matter how big the, the data is, but it is unbelievably costly. So yeah, that is fairly insurmountable because you don't, there's nothing much you can do about that.Chris Adams: Okay, this is true just like the cost of transmission in some places actually. Alright, so we spoke about the Azure carbon aware KEDA operator. So I think maybe we should actually explain what KEDA says. Cause there's something in the briefing here. Yeah. Kubernetes Event Driven Autoscaler. So the idea would, being that this would automatically scale Kubernetes up so you have more computers or more pods, and then scale it down again in response to various activities, that's what it would be, right?Anne Currie: That sounds plausible. I dunno, but that sounds plausible. And actually then you just use your normal scheduler and presumably your normal, however you label your pods normally on how many of these do I need to keep alive at any point? So the ones that are less important to you can just all get shut off.Chris Adams: Yeah. There's also another related project to this called Kube Green, which is a project by some folks in Italy. Actually, this is early on. It doesn't do quite the clever kind of carbon air scheduling stuff, but if you want to dip your toes into this. It literally turns off your pods when you go home. So basically all your staging devices and your developing developer machines at 6:00 PM they switch off and go to sleep just like you might choose to go home and go to sleep.Also, in the show notes, we've got a link from the Green Web Foundation, where we talk a little bit about this using both Kubernetes and Nomad a while ago. But the stuff from Azure looks really complete and it looks really quite exciting actually.Anne Currie: That is, so I, we ran like a sustainability track at, uh, QCon, London, uh, a couple of weeks. Sco big conference and it was very successful. One of our, I think our top rated speaker was a woman called, another woman called Holly Cummins, who is a really excellent speaker from Red Hat. I don't know if Holly, but she spoke about that.Her dream was that we'd have effectively light switch operations, so it should be as confident. Turning off machines on in, in the cloud or in private cloud or public cloud or wherever. As you are turning the light off with the light switch, because when you turn the light off with the light switch, no one thinks, oh, I won't turn the light off just in case it doesn't turn back on again. The aim is that you feel that confidence about all of your systems that you could just turn them off. Because you don't need them overnight knowing that you could turn them back on safely in the morning, and her light switch analogy was excellent. It's like you don't leave all your lights on at all night just in case you can't turn them back on again in the morning.That would be madness, but that's what we do with computers. One of the best things that you can do with your systems is invest in making sure that you can turn them off and then on again.Chris Adams: I think that's a useful piece of advice to make sure you can turn your things off and on again, if you'll. Is like a low stakes, but I think you and me, we've been on various projects where we've been afraid to do that. So I'm glad that someone is spelling it out that it's really needs to be this basic.Alright, next story. This is one that really caught my eye cause this is the SDIA who are a Green software Foundation member, the Sustainable Digital Infrastructure Alliance. The kind of headline is the SDIA welcomes the deal of the European Council and Parliament on energy efficiency directive. This is super like legal blood gump, but basically there is some really, in my view, quite far reaching stuff inside this.Essentially, there has been a whole bunch of laws being thrashed out about transparency around energy usage for data centers, and this seems to have snuck through in the first quarter of 2023. And there are some headlines which are in my view, which go much further than we are right now. So I'll just read some of this stuff out.So owners and operators of data centers above 500 kilowatts will need to make the environmental performance public at least once a year. This includes annual energy consumption, power utilization, temperature, heat utilization, use of renewable energy, as in how much renewable energy you're using and where it's coming from.And we haven't mentioned it here, but it's also water usage as well. Now these are figures which. I, and you've tried to get, I'm sure you can talk about how easy it is to get access to these figuresAnne Currie: Almost impossible. Yeah.Chris Adams: and now they're like, it's law. Basically this is coming in. People need to be delivering, do their first reporting in March, 2024.So things, something which a large providers have been pushing back against and saying, no, we can't possibly share of this stuff now it's. Basically gonna be part of the law in all around Europe. So if you're outside of Europe, you still may be okay, but this is quite a precedent to be setting, in my view, cuz yeah, this is something that a lots of us we've been asking for and really pushing for and now you've essentially got one block saying no, this is a condition of doing business in this part of, cuz how on earth are we gonna know if we were on target or not in harming our emissions by 2030, for example.Anne Currie: Yeah, and in fact, this was discussed on stage at the coupon conference as well this time by Adrian Cockcroft, who is the retired VP of Sustainers. He can never remember what the titles of anybody are at aws, but anyway, who's the big cheese? Of sustainable architecture at aws and he was saying, if you're American, you might think this might, this won't affect you cause it's just an EU directive and your data centers in the US who, who cares?But it is basically the GDPR of Green. The EU is such a big block. They have so much clout and they exert their will that this is the same way that everybody ended up having to do GDPR. This will be the same. Everyone will have to comply with these things, even if you think that you're in the US and they won't touch you.The reality of the situation is that this will all spread out in a GPL style until everybody is forced to comply in the same way that we've had to comply with the GDPR.Chris Adams: That's a win for transparency by the sound of things, but it's probably gonna be a headache for a bunch of people who have to start reporting in less than 11 months for the first reporting deadline for this. There's also something that I call my eye here is that any data center exceeding one megawatt of power, they need to recover the waste heat.So basically they need to put it to good use or prove that they, it's either technically or economically unfeasible for them to be doing. So this isn't a really interesting one because within Europe at least, and I'm gonna speak about Germany where I live, like 40% of the energy demand is from gas heating things up.So if you have this being put to actually addressing one of the other big demands for energy inside Europe, that's actually quite a far-reaching one and one megawatt. That's likely to impact pretty much every hyperscaler, cuz hyperscalers tend to be 20 megawatts upwards in size. And as a kind of, I was trying to do some like rough figures, like 500 kilowatts if you're assuming maybe 15 to 20 kilowatts per rack.So that's, I know between 20 to 40 racks of service based on how efficient your data center might be. That's not that big. That's like a lot of data centers. This is gonna be impacting basically,Anne Currie: Yeah, so we're gonna see an awful lot of public heated poolsChris Adams: I hope so. Yeah, absolutely. IAnne Currie: ringing every data center anywhere, everywhere in the world.Chris Adams: Maybe this will change how we think about how you build data centers. Like when you build a data center as a kind of big box out of town, Walmart style thing, then it's really difficult to use the heat. But if you're able to integrate the data center into the kind of fabric of the urban environment, then there isAnne Currie: really want to have, but you don't. But that has issues of its own. You do not want that generally because in the open environment, you want people living. And also you don't want the draw on the grid, cuz often those cities, the grids are already overloaded. So it would be counterproductive to have a whole load of data centers now suddenly located in urban environments just so that they can have a local pool that's heated up using their excess path.I would say that's counterproductive, but.Chris Adams: they're providing or generating any of their own, any of their own power on site. That's another thing that some of the new providers are doing. They're basically looking at using batteries on site as a way to act as a kind of anchor customer, but also to provide use. Cause if you have this case where you're scaling machines up and down, there will be times where you should be able to be a kind of active participant in the grid.Just like how having a kind of read write energy grid, just like we have a two-way internet and you could have a two-way grid, but that's a, another podcast I suspect.Anne Currie: Part of the grid balancing solution, which is absolutely required, particularly when we struggle with grid balancing at the moment, and that's when most of the grid is powered by stuff that is utterly predictable, like gas or coal. When he starts adding a whole load of comparatively massively unpredictable solar and wind into the mix, then grid balancing is a major problem.Chris Adams: It gets more complicated depending on how much of a grid island you might be. So if you are connected to other things, You can get stuff from neighbors, but if you can't then it's a bit more complicated. Now there is some interesting news related to that. I, I assure you, were not an energy podcast. There is basically an energy England to Dutch interconnect just announced in the last week and there's a bunch of similar stuff happening around this field, but we probably need to discuss that another time.And I think we're coming up to the last few minutes of this and I think there's been a question being that's been posed to us that I think Chris, our producer, shared. If we were to launch one data center into space, what would you name it and why? I am. You can have a bit of a thinker like, and I'm gonna go for the dataface out answer that people tend to use when faced with this stuff or what English people tend to use when they get the chance to name things.Boaty McBoatface, the well-known research vessel, was doing some absolutely fantastic work in the field of climate science. I'll share some links specifically for that because yeah, both face or Richard Attenborough or the Sir Richard Attenborough is its official name. That's a thing. So yeah, that's my example.That's my answer. Data McDataface. What about you, Anne? you call a data center?Anne Currie: I dunno, but I can immediately say what I would choose as my naming convention. I would give them culture ship name conventions, the Ian Banks Culture Series, all the AI spaceships name themselves, with some slightly tongue in cheek name.Chris Adams: Of course I love you one andAnne Currie: Oh yeah, exactly. Yes. Yeah, so I would, I would give them culture names.So that's up. There's an exercise for the listener to come up with a whole load of, in fact, I believe there is a cultureship named generator online that you can, it will automatically, or to be a perfectly honestly ChatGPT, but almost certainly supply you with culture ship names that it has made up. So I would defer to Ian banks and in the, and,Chris Adams: And a generative AI large learning model. For naming our servers. I guess that's a circular of nothing else. All right, I think that takes us up to the time we have here. Okay, that's all we have for this episode of The Week in Green Software. All the resources for this episode are in the show description below, and you can visit podcast.greensoftware.foundation to listen to more episodes of this particular show.Thank you very much, Anne for joining us, and hopefully see you on one of the future ones. So bye for now. See you around Anne.Anne Currie: Goodbye.Chris Adams: Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get to your podcasts. And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners.To find out more about the Green Software Foundation, please visit greensoftware.foundation. That's greensoftware.foundation In any browser. Thanks again and see you in the next episode.
undefined
Apr 26, 2023 • 45min

Fact Check: Ola Fagerström and Microsoft's Surface Emissions Estimator

In this episode, we have a very special guest for an episode of Fact Check on Environmental Variables, Ola Fagerström from Microsoft Surface joins host Asim Hussain to talk about his work on the Microsoft's Surface Emissions Estimator - an important tool that helps measure the carbon footprint of the device. Ola talks about how difficult it was to take into account everything from materials used, to manufacturing, to packaging, and even end-of-life disposal to give an accurate estimate of the emissions produced by each device; and how these principles can be applied to other areas of green software development.  Learn more about our people:Asim Hussain: LinkedIn / TwitterOla Fagerström: LinkedIn Find out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterResources:Microsoft’s Surface Emissions Estimator AnnouncementOla’s Post on LinkedIn about Microsoft Surface Emissions Estimator / LinkedIn [7:46]Energy Star Calculation / Energy Star [15:51]Microsoft Edge Green Tabs / Microsoft  [23:13]Internal Carbon Fee / Microsoft [37:12]New EU Laws on CSRD / European Commission [41:59]If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcription Below:Ola Fagerström: When is the first company going to start to say, we only allow eight tabs open? Because if you start to have, I'm just making numbers up, 16 tabs, you might run to your boss and say, Hey, I need a device with the 32 gigs of memory because my memory is constantly filled. Yeah, sorry. We put a policy that you can only have eight tabs open because that will save on the memory, and therefore we can buy cheaper or devices that are actually greener.Asim Hussain: Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Asim Hussain.So welcome to Environment Variables, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Asim Hussain. In this episode, we have a very special guest for an episode of Fact check on Environment Variables from Microsoft Surface. We have technology specialist Ola Fagerström.Ola Fagerström: Hi there, Asim. What a nice, uh, way to get introduced as a special guest and.Asim Hussain: Probably worse ways of being introduced isn't there? Not so special guest anyway. Ola, like it's great to have you on the show. Obviously we were colleagues at Microsoft, we're both circling kind of the sustainability space. I'm not at Microsoft anymore. So to give our listeners some context, could you please introduce yourself?Ola Fagerström: Yes, I'm Ola Fagerström. I'm based and live in the fantastic country of Sweden, where probably some of you listeners have heard of a small girl called Greta. Which is also helping, pushing the environment forward and doing a lot of stuff. So part of, I can say part of that inspiration, but I've been with Microsoft for in, oh, what is it this week?11 years.Asim Hussain: Oh wow.Ola Fagerström: So quite some time I've been with the devices and Surface family for the last, what is it? Eight, nine years since we launched Surface Pro Free back in the market. Way back in the days. So, uh, that is sort of my day-to-day job and then working with sustainability almost on a daily basis to make sure that we can.Help and tell our customers what we actually do, and I report back to our dear engineers what they have to do betterAsim Hussain: Ah, yes. Yeah. Yeah. ThatOla Fagerström: as well. Sit sitting a little bit that in between of, uh, explaining difficult things to people on the simple way on one end and the other way around as well.Asim Hussain: Yeah, and you have to explain the sustainability difficult things and even more difficult. So thank you for that. Yes, we've really great to have you on the podcast to talk about your work. So to just explain how this works to our listeners, this is a type of episode which we call Fact Check. It's slightly different from our typical Environment Variables or this week in Green Software TWiGS episodes.We're first going to ask you a few questions about your background and experience in the world of sustainable software, on the world of sustainability, and then we're going to do a bit of a deep dive into your work with Microsoft and the Microsoft Surface Emissions Estimator, and then we'll just see where that takes us.Ola Fagerström: Sounds like a good plan, I think. Yeah.Asim Hussain: Yeah. Um, just a, before we dive in, it's just a reminder for everybody that everything we talk about will be linked in the show notes below this episode. So here's my first question. Can you tell me more about your background and how you became a device sustainability specialist at Microsoft?Ola Fagerström: Yeah, so one of the things, as I said previously, coming from a region or a country where sustainability has always been on top of mind. Of our customers, people living here, it's been a, a constant topping, bringing back to our dear friends, sitting on the other side of the pond to ask them to do more. And then at one point in time, then you realize as well, okay, if they can't provide you with everything, then you actually have to start to dig in yourself.And help to do more as well. That is creating the thing that didn't actually exist. And that started quite some time ago, years and years back.Asim Hussain: So that's cuz like you're in the surface space and imagine you're getting asked a lot of questions. Is that I betOla Fagerström: Absolutely. And going back 4, 5, 6 years ago, bringing that back to maybe a market where sustainability was not the top of the agenda. That was in many cases, yeah, but we have some legal information you can find online. We can send you a PDF and things like that. But that was not so much maybe what my, my customers and I wanted to know when we started to think about those things.Asim Hussain: Yes. And that's really good. I think Anne Currie, who, who's one of the co-hosts of podcasts, talks about this quite often, which is if you are a customer of an organization, asks questions cuz that's what gives Ola and people like Ola kind of the imperative to do this work that we're describing here right now. So just before we really dig into kind of the service missions estimates, I know you mentioned that you live in a country where sustainability is a key, a very important thing. But would you say there was a particular moment or turning point in your career where you decided to focus on sustainability?Ola Fagerström: I think one of those key things when I really felt like, okay. Even though I think this is important now I know that the company feel that this is important. And one of those key things was of course, when Microsoft in 2020 went out and said that we are going to be carbon negative, we are going to be zero waste, we are going to be water positive.All of those things. One of the fine lines in the announcement said as well, that one of our focus things is around our product and devices. And I was like, don't really know all about that. Let's see what's behind that.Asim Hussain: Yeah. I love that answer because I've said this before and I, cause I was at the same company at the same time, and when the leader of a company comes out publicly and makes a statement, it gives freedom to the people working inside that organization to then follow through on those actions. Cause then when you're having meetings, you can just say to people Sachin, he said it on stage, so you know, you better have this conversation with me and let's talk it through.Whereas prior to that public announcement, that kind of conversation is more difficult, isn't it?Ola Fagerström: And, and the interesting in this, and then we'll probably discuss this a bit further on as well, if you are listening as a, as a customer and you have a company that has said something publicly, in most cases, the one who has signed off on that is in many cases the board of directors or the CEO. So you can quite easily start to hold them accountable to that.Okay. But you said this. We have set up this call. You and your dear friend at the table has actually signed up from this, so how are we going to do it?Asim Hussain: Yes. That's the wonderful thing, about making a public commitment. Whether it's telling all of your friends, you're gonna quit smoking, or whether it's a public sustainability commitment, there's a certain amount of peer pressure to keeping you honorable. So let's dig into the work that you've been doing.Firstly, can you give us a quick overview of what the Microsoft Surface Emissions Estimator is? And you know what it does? Am I saying it right as well? Is that the official title?Ola Fagerström: Yeah. Yeah, it's a very long word. And of course we have legal friends that's making sure that we use exactly the right wording. So therefore, it's not the calculator, it's an estimator and things like that. At,Asim Hussain: Mm. Mm-hmm.Ola Fagerström: so it very much came from that announcement that we said that we are going to be as a company, carbon negative. When you start to dig into the details of that, you are also saying, see for example, that we are publishing what we call from our side an Eco report. So you can see, okay, what is the estimated impact from purchasing, a, surface Pro Nine, let's say. Those are public things. That's a PDF that you can find online, but then it quickly starts to come and you start to nerd, as I did around those things because in all of those PDFs, there are some fine lines saying, oh, the numbers in this PDF comes with the fixed assumptions of whatever it might be.In our case, it says that the numbers in this case is based on the assumption that device is used in the US for example, for four and a half years.Asim Hussain: Mm-hmm. Mm-hmm.Ola Fagerström: Brilliant. If you're a customer that's using it for four and a half year in the US but if you start to think, yeah, but I'm a UK customer and I'm going to use that device for two years, is that really accurate for me then that number? So I start to then to dive into, okay. But we probably can calculate that in a much more granular and much more accurate way for all those customers who don't fit that four and a half year.Asim Hussain: Hmm.Ola Fagerström: The surface emission estimate is all about to make sure that you can understand what is the footprint from me with the assumptions that I say in the tool versus assumptions that someone has made for me.Asim Hussain: Hmm. Okay, so you're just trying, so you, you, I dunno if it's this, if it's just the Swedish way of saying it, but you called it a eco. Is it LCA report you're describing before?Ola Fagerström: Yeah, so in that, in that eco profile, you then see that the numbers are then based on what we call an LCA calculation or a life cycle calculation. If you don't know what an LCA is, basically you collect all the information that you have about the product that you intend to manufacture, and you can do some estimation of what is, for example, the environmental impact from producing that.Asim Hussain: Because effectively what an LCA sounds like, an Eco Report is just another, or a summarized version perhaps, of what an LCA form sounds like. Maybe something that's formalized for devices. It perhaps is, it sounds like. Yeah.Ola Fagerström: And you can find those eco reports for any given product. It's basically an LCA is not something specifically to the pc. It's done in the car industry and it's been done for a very long time. But we are on the path of where that data becomes super crucial for customers to understand.Asim Hussain: Because, okay, I see. So like for with a typical LCA report, what you're doing is you're just basic, effectively just writing a PDF because the technology has not moved on since 1994 about the ability to disseminate knowledge to other human beings. Just the PDF is the pinnacle of data dissemination in the sustainability arena.But the challenge with the PDF with something digital is you have to make a ton of assumptions like what you just made because it is just a static bit of data. So like, how would I write a static bit of data? About the carbon emissions of my laptop. You have to make a ton of assumptions. You have to assume what my user profile is.How much do I use it? Where am I? How long am I gonna keep it for? But that's all statically written down in a PDF. From what I'm hearing, from what you're saying is the estimator like a dynamic LCA, where you can put your real values in and it gives you your real estimated values back out.Ola Fagerström: Yeah. Cause what we have done now in the estimator is basically we have taken that LCA and broken it apart because in a normal LCA then, or in the output from that, you say, okay, how much in this case, carbon emission is associated with the production of that device. How much comes from transporting it to the location where it's going to be used?How much carbon emission is going to come from using that device in the PC, and that's how much electricity is that going to use in the location where you might be. And then the last one comes from the end of life treatment. So what we do in this case is that we say that use the production part be because that's very static.But then the transportation part is dynamic because we know, for example, then by our own logistics, what does it take to ship a device from our factory to maybe a central warehouse? To a central warehouse to the end location where the customer might be? The other thing as well is that. The energy grid in the UK might be very different from the grid in Sweden or in India or somewhere else.So we need to start to think of how much energy or how much CO2 is associated with, for example, one of use in the UK versus Sweden versus India. So that's what we also then bring into the tool to show that, okay, how much energy is that device actually going to use? And then we have. Done some clever stuff in it as well, where we actually start to show actual usage or telemetry data in that to make it even more granular.Asim Hussain: I believe the estimators designed a, probably a, and you tell me if I'm wrong, obviously tell me if I'm wrong, but for organizations that perhaps would buy a rather large amount of surface devices and manage like a fleet of devices, and so then typically if I was in that organization prior to the estimator, all I would've ever been able to do is take the LCA report.I've bought 10,000 services. Multiply, whatever that number report by 10,000, and that's just my carbon emissions. Now I can then put in some real values. And you mentioned transportation, so I presume what you can, one of the things you can say is 1000 of those machines were delivered to our France offices in France, 1000 in Germany, 2000 in Singapore, or something like that.So the estimator sounds like that's one of the variables it takes into account. So also sounds, from what you said, it also takes into account grid intensity of electricity to also take that variable into account. Are there any other variables, like what other variables Ola Fagerström: can I factor in?Yeah, so you can also say for how many years I'm going to use it. So you can say, I'm going to use it for two years, or three or four years instead to take that into account as well. Okay. How long are you going to use that energy in that location? But the cool stuff in the tool as well. Like we said, we're going to link to the tool so you can look it up yourself.Is that on the used part? We actually have two bars in there that shows. One, how much energy is that device using according to the Energy Star standard? Because all the devices say that, oh, we are rubber stamp. We meet energy star standards. But what people don't realize, and I have to share a little bit of a, a hard moment when I did my digging out about this tool, is that when you are reading the formula that Energy Star is using, To measure the amount of energy a device, tablet, or phone is using, they are saying in the formula, okay, you as a manufacturer has to measure how much energy is that device using and the grand prize for you Asim, if you know the answer to this, how much energy is your device using when it's in, in off mode?Asim Hussain: Ah,Ola Fagerström: When it's in what they call sleep mode and what they call as long idle and short idle, but what are we missing in this calculation?Asim Hussain: Uh oh. Well, it's idles. It just sounds like effectively off states, isn't it? So it's just like idles, sleep, off. Not actual. Also perhaps as a mirror of what I am actually like when I'm in front of my computer, which is fairly idle and sleepy, but doesn't really like factor in like as sometimes on a rare occasion I'm also quite active.So it sounds like it's not taking that into consideration.Ola Fagerström: So the funny is that when you explain that to people and say that, imagine that you would go out to the garage and look for that new car, and then they would have in the fine print and say, oh, by the way, the amount of fuel this car is going to use, it's measured by you parked a car in the parking lot, you put in the key in the ignition.You turn the key and let the engine run for a little while or for a little while longer, but you don't leave the parking lot.Asim Hussain: Right.Ola Fagerström: And I was like, yeah, but that can't be right. I must be missing something in their calculation. So I asked one of our engineers that's doing the Energy Star certification, ask them.Is it really right that Energy Stars actually don't calculate for actual usage? He said yeah, there's a small formula for it, but you have to think of where does Energy Star come from that was created to make sure that you lower the energy usage from refrigerators,Asim Hussain: Uh,Ola Fagerström: that, air conditions, which has a very fixed on and off or idle, but they don't actually take into calculation the actual usage of a tablet or a pc.Asim Hussain: interesting.Ola Fagerström: So when you start to think of, oh, we have a energy saving goal in our company, great. As a starting point that you ask for energy star certified devices. Of course, I'm not arguing by that. But it won't take you to your energy reduction goals because you need to start to measure actual usage. So what you will see in the tool is one bar saying, this is the amount of energy that energy stars are requiring to meet Energy star certification.Then we have a green bar saying, this is the amount of energy that we see collected from devices being used out in the field. For example, the Surface Laptop studio that might be used for CAD work and stuff like that. Of course, it's going to use a lot more energy than just to log into windows and don't do anything.It's like measuring the amount of fuel a car with a turbo is using based on that you're just parked is on the parking lot. Of course, the turbo is never kicking in. If you're just standing there and looking at technician.Asim Hussain: So, cause I imagine what people perhaps have done in the past with the absence of an LCA, maybe with one is take the energy star, I'm sure energy star as well as giving you A, B, C, D, E, F, or whatever it is. It's probably giving you an energy consumption per minute or something like that. And if you were just to use that and multiply it by the number of minutes you're using it, but it would not reflect cuz that's effectively saying like that's how much energy your compute would use if it was idle.What you are reporting in the estimator is actual usage. Isn't that a bit, I'm sure like that bar is so far high than the energy star bar, isn't it just a pretty depressing like thing to look at all the time?Ola Fagerström: No, actually, it's interesting because in some cases that bar might be higher. In some cases it's actually lower because some cases we also see that the device is used as intended. For example, the Surface Go, which is more sort of an iPad format. People might use it, just log in, check their emails, not doing anything more, so the energy usage will be actually lower than what we see when we did the testing.So this is also then seeing and giving the customer the deep insight because again, the nerding part of this, and this is the fun part of listening to podcasts, that you always learn stuff. When you are reading those eco profiles from the other large manufacturers, the sort of little fine line saying in there, the use of this device is calculated according to the Energy Star standard.So that means that, oh, we say that you're going to use 15 kilos of co2. Okay. But that's just based on that me logging into windows and not doing anything. So what we now do in the tool is actually using that telemetry data to saying that a hundred surface pro nines are going to use, I'm just making up numbers now, 900 kilowatt hours.Asim Hussain: So just want to clarify one quick point before we dig into this. So is that information available kind of per customer, or is this something that you're aggregating up and just making available yourself? Or, if I'm a customer and I'm using the emissions estimator, and I've got 10,000 machines, would you tell me the average consumption across all my machines?Ola Fagerström: No, it won't be across your machines, but it's across the sort of Windows estate. But it's based on that specific skew and product. So it's for a Surface Pro 9 i5, whatever it might be, coming from the data reported back to Windows and Microsoft.Asim Hussain: So this actually could be quite useful information for a lot of people out there in the world. Like they could actually go to this and then see, forget energy star. You've effectively got a real world model of usage, real human UX, user experience of devices and energy consumption that goes there.Fascinating.Ola Fagerström: So, of course inside of today, that's only a long green bar saying this is the energy usage. Then we have to start to think of what you are doing on your daily, which is making sure that the software that runs in that green bar, Because then we can start to slice that up and say, oh, what is, for example, Edge using as part of that, or whatever kind of software I'm running on that device.Asim Hussain: Can you reveal? Cause I've, I think I've heard data from various sources. I don't think I've heard anything official from a Microsoft perspective, uh, or just stay quiet if it's true. But is it true that browsing or browsers take up, is it 60 or 70% of the energy consumption on most kind of laptop devices?Is that something that is too far away from what you think is true?Ola Fagerström: I think the interesting in that question is that if you look at what we have done in Edge, where we now can start to put the tabs into green mode, which is actually quite interesting because then you can start to measure those things as well to see, okay, how much are we actually saving by using that kind of green mode or whatever kind of green or energy saving that you have put in your software.And then start to think of how are we collaborating in that sense with the OS that device is running on.Asim Hussain: That was the feature of Edge that dragged me onto Edge was that that was, it was both useful from a sustainability perspective and also just from a human perspective. Cuz I'm one of those people that just opens a ton of tabs and it's just way more performing.Ola Fagerström: Yes to nerd on that a little bit. It's kind of interesting as well when we start to talk about in this world to make sure that we save on the environment. So when is the first company going to start to say, we only allow eight tabs open?Because if you start to have, I'm just making numbers up, 16 tabs, you might run to your boss and say, Hey, I need a device with the 32 gigs of memory because my memory is constantly filled.Yeah, sorry. We put a policy that you can only have eight tabs open because that will save on the memory and therefore we can buy cheaper or devices that are actually greener.Asim Hussain: That's a very interesting angle to take on this whole world. You're right, actually, yeah. You constantly install things on your computers. They slowly degrade over time. And then all you have to do is reinstall everything and start from scratch and everything's really fast again. So yeah, there's a slow degradation which forces you into action choosing tooling.I think that's also another factor, like tooling should be,Ola Fagerström: Absolutely. And. It leads me also sort into the discussion where another thing that people constantly talk about now as well is of course circularity in in, in those things as well. And where I, cuz I'm in a lot of discussions with customers and they often ask, well, yeah, but what kind of questions should I ask for the, yeah, probably the first question you should ask for, what is the residual value of the thing that I'm going to purchase?Asim Hussain: When you say residual value, would you mind, would you mind kind of clarifying what you about residualOla Fagerström: Yeah, of course.Asim Hussain: Yeah.Ola Fagerström: Cause when you start to think of when you purchase something, you are probably then doing it with the intent of either using that thing until it falls apart and you're going to recycle it, or you're going to purchase something with the intent of, I'm going to use it for X amount of time and then resell it. We know for a fact something with no value at all will most likely just be thrown in the bin. Something with a high value will for sure be sold over and over again, regardless if it's a PC, a phone, or whatever it might be. And I often refer to this as well in calls and say, nobody would think of taking their three year old iPhone and throw it in the bin.Everybody knows, Hey, I can just go on eBay and get $400 for it and it will definitely be sold again. Exactly the same thing we see with Surface. My daughter is still using my Surface Pro free that I got. What is it now? Eight years ago,Asim Hussain: Yeah,Ola Fagerström: a couple of weeks ago when we checked on eBay, that was still worth $150.Compare that to something. Made of cheap plastic that nobody cares of, that would've been thrown away a long time ago.Asim Hussain: It's a very interesting point as you remind you. Cause I, I got a, a electric car a couple of years ago and I leased it. And what was fascinating about that experience is that they, they still look arguably very expensive for a car. However, the thing that was fascinating about with the lease price was actually quite low.Ola Fagerström: Yep.Asim Hussain: after I've finished leasing it for two years, its value remains high so they can lease it for less, if that makes sense. If that math makes sense. Yeah.Ola Fagerström: interesting to this is again that key question. When you purchase and you want to come into circularity, how are you going to enter that and how long are you going to use that? Whatever you buy until it falls apart and you're going to make sure that you repair it yourself. Or if you repair something, send it back to repair centers and things like that.Or are you going to do, just as you said, making sure that working with the lease partner that's actually going to make sure that electric car's getting sold again and again?Asim Hussain: That's very interesting. Yeah, I think the world is gonna have to move towards that secondary market model. And I think it's interesting cuz in the tech space, I would argue that four or five years ago, like it really mattered getting, I felt a very significant difference getting the latest model in my life.I would argue these days, maybe I just don't do as much hardcore as I used to, but like for most of the work that I do, which is having a meeting, browsing, writing a document, like there's almost no difference. Now if I was to get a new machine in terms of any performance, like a machine that's like 4, 5, 6, 7 years ago, would do just as fine for me as a machine right now.Which maybe indicates, and I used to this, the nature of devices is changing.Ola Fagerström: And I think also when we start to think of the other thing that you used to work with it, which is of course Azure, back in the day at Microsoft. How much power do you need in your device versus how much can you actually start to use from somewhere else when you need it?Asim Hussain: Hmm.Ola Fagerström: Without your own organization need to, uh, purchase 10,000 servers and have to build all of those things where you today can then buy it from Windows 365, which powers next generation of windows.So, do I need to buy a laptop with. I nine just because I'm making some CAD drawings for a couple months, or can I just buy that as a license when I need it for X amount of time?Asim Hussain: The There are virtualized desktops as well. I think that's, that's kinda the thin client argument, isn't it? Like we could get away now, perhaps a lot. I think a lot of people will probably get away with very thin clients and then just a lot of the compute on the cloud and then that can be hopefully have greater efficiency, efficiencies of scaleOla Fagerström: I think so, definitely too. And something that I'd like to point out, what is a little bit special with the tool or actually the methodology that Microsoft and the eSign team is actually using now? To do that LCA, which stands out as very much as the gold standards for everyone else, is that when you're doing that LCA, you can do it in two ways.Either you can use a simplified tool, which is based on an either an algorithm or you can use a tool that then takes into account your own supply chain.Asim Hussain: Oh.Ola Fagerström: That means I've made this little simple analogy. So if you are listening to this and you've imagined in your head that you work in IT, and then our dear friends at the communication department comes to us and ask, Hey, you work in IT.You can always help with everything. Hey, of course we do. We do it all the time. We are going to run a super expensive ad campaign. Okay. We need you to find a new picture supply for that. Okay. Also, I can do that. Okay, great. The only requirement we have is that it needs to be a picture of an orange and gray super sport bike.Okay. I know exactly what I'm going to ask for. Shouldn't be a problem to find a new supplier for it. The first supply took them about 20 minutes to do the job, it only required one person. They used a simplified tool where you just put in a few keywords today, orange and gray, super sport bike, standing inside your studio.Voila! You have a picture of an orange and gray bike. The tool that you used may not give you who took it because nobody took it. Can you see when it was taken? Probably not. Is it a hundred percent color accurate? Most likely not either. The other supplier, it took them three bloody months to do the same job.They used a super expensive tool to do it. They used a super high resolution sensor. Came back with the most astonishing picture you can ever imagine. You're zooming to every screw. You can see who took it when it was taken a hundred percent color accurate. Could you compare those two? Of course. Cuz Hey, you just asked me to find a supplier of orange and gray bikes.Could you really compare that? Probably not. So what most manufacturers today are using is a simplified tool because their catalog of devices is so large,Asim Hussain: Right.Ola Fagerström: so they put in a few keywords like. What is the size of my screen? What is the material that I might use? What is the thickness of the motherboard?It takes about 20 minutes to half an hour. What it gives you is sort of a half blurry picture because it's not the display that you exactly are using or exactly that disk that you are using. What Microsoft has done very differently now is that we have gone out to our own supply chain. And collected exactly the measurement of what does it take to produce that specific screw that we use in a Surface Pro 9, if I just make something, or that specific motor board that is used in just that device, and that takes all the way from producing that raw material.To getting it to the next supplier, to the next, to the next, to the next. So of course, that spreadsheet is, you know, thousands and thousands of rows of processes, and then we produce that life cycle for that specific skew using the bill of materials or the bomb for that specific device.Asim Hussain: So I'd always assumed, actually that's how everybody does it. So what you are saying to me, that's how Microsoft does it. But if I'm another manufacturer, there are tools out there. I'm some sort of Web interface tools where I can just answer a series of questions roughly describing my head. I've got a head, I'm holding headphones right now.It's these headphones that I've manufactured. And it will roughly generate cause it's gonna have, it's gonna be so averaged out now, isn't it? Yes. I've got a bit of metal. But what metal is in this? How much, you know, within 20 minutes it'll gimme a very rough report. But you are saying there is multiple levels of quality of LCA reports that are out there.Is there some way, as a consumer I can know that this report was built using not, yeah.Ola Fagerström: what you need to start to ask, especially if you are an organization and purchase something, the first key question then, okay. The data that you provide me, or this number that I saw in your eco profile or whatever it is that they call it, is that using what the nerd calls primary data means data collected from your own measurement and supply chain.Secondary data might be data that is publicly available in some sort of database. What we could see when we did our own measurements, we could see, for example, that the assumption of how much energy was used when you, for example, molded out the chassis of a surface device, and we could pair that to the measurement from our actual supplier of it.We saw that the energy usage was 20 times higher.Asim Hussain: So you actually created this manually yourself or some other mechanism through in-house manufacturing. You created your own chassis or what case you said, and then you calculated that was in a controlled environment, so you calculated the energy you needed to do that. You went to your suppliers and then asked your supplier for the same information, and then number was 20 times less than your number, is that what you're saying?Or the other way around?Ola Fagerström: No. So what we did before was we used one of those industry available databases that said that if you are producing one kilo of aluminum into a CNC chas- chassis, you're most likely going to use this amount of energy. So we could say then, so don't hold me accountable for the numbers, I'm just making some up.Let's say that to create 500 grams of surface chassis, you may be using 15 kilowatt hours of energy. But then when we actually compared that and went to the supplier who did that molding for us and ask, okay, how much energy are you using to create 500 grams of that chassis? And they said, oh, but that's 150 kilowatt hours that we use.Asim Hussain: Oh, so suppliers were telling you like a greater amount than these existing kind of emission factor models.Ola Fagerström: Exactly. Because when you start to look down to where those model comes from and the assumptions of that, in some cases, those models and assumptions might be 20 years old.Asim Hussain: Wow, I suppose you are actually trying, cuz you're trying to model everything in the world. Everything that could possibly be modeled in a supply chain.Ola Fagerström: The interesting to this is also what many people are not aware of. So inside Microsoft we have what's called the internal carbon fee. So all parts of Microsoft needs to pay a carbon fee depending on how much they add to the organization.Asim Hussain: In terms of carbon emissions?Ola Fagerström: Yeah so as taxpayer, we all know we want to have control of our numbers to make sure that we pay as little or, as much tax as we have to. Of course, to be able to do that, you need to have measurements from the people that you are purchasing things from.Asim Hussain: Yeah, I know. I remember for the Microsoft announcement, that was one of the announcements was one of the pressures that Microsoft put on its suppliers was to provide that data. Which is one of the hidden aspects of that, but you had to dig a couple of layers deep into that announcement to get that. But yeah.Ola Fagerström: And that, of course, then starts to play into account. Cause what we do then in the estimator is that then we are both showing very accurate numbers based on that specific skew that you are looking at. Which comes from the measurement of our own manufacturing and supply chain. And then couple that with measurements from the logistics and then we take measurements from actually using it device based on telemetry in the location and for the years that you're going to use it.So when we start to compare that there is, okay, here we are providing you with a Hasselblad picture for you picture nerds out there, you know what it is and the image quality. Versus the simple picture that I got from Dall-E or using Bing Create. Very different in when it comes to quality and control of everything.Asim Hussain: That sounds really fascinating. So you've got better numbers, you got more refined. Numbers more accurate, more precise numbers. How are these numbers being absorbed back into Microsoft in its sustainability? Are they being factored into the sustainability report and kind of Microsoft commitments or, yeah is this a separate measurement?Ola Fagerström: So of course being able then to both model your supply chain, then you can start to take informed decisions when you are selecting what you want to do with your suppliers to make sure that you meet your sustainability goals. That could be things like, okay, which suppliers should we invest in to make sure that they have green energy?Are there some suppliers that adds more carbon footprint to our devices than others? Where should we put our effort and investment? If you don't have that kind of measurement from your supply chain, then it's easy to say, oh, we are just going to go out and plant a couple of a hundred trees and hope that we are fine with that.Okay, great for the planet. Maybe not so great. If you're going to meet your sustainability goals. Don't want to cackle down on people saying that we're planting trees, but or for them who plant trees. It's a good thing you do, but you need to start with the basics.Asim Hussain: Yes, and I can see actually the drawbacks then of using those simplified models would be that every single manufacturer that uses that simplified tool to generate it, it would give you poor information for what to optimize for. Cuz if it's just an emission factor for thickness of motherboard rather than constituent, then that's just gonna apply pressure to have a thinner motherboard.Because you're assuming a thinner motherboard. Cause that's the only variable there that you can tweak. Whereas the actual surface landscape that you wanna optimize for is very different. So that's a really fascinating insight. I think we've run, we're getting close, closer time. So just wanna ask one final question.You know, what advice would you give to other companies or individuals looking to reduce their carbon footprint? Other people in similar roles that you perhaps in other companies.Ola Fagerström: I really urge people to say or ask exactly what I said. Ask your supplier, how did they get to their number? Are they actually measuring that from their own supply chain? And I mean, that could be if you are just going to purchase a new office desk, find the eco profile for that office desk and ask that supplier.Have you measured that from your own factory? Because it will tell you both how much they have actually invested in people like me and you to actually do this work and make sure that our customers can actually get that kind of data. Because if they even don't know, it'll just give you a rough idea about what it is.Yeah. It tells you quite easily what it is.Asim Hussain: Mm, very interesting. Yeah, ask them if it's primary or secondary data.Ola Fagerström: Yeah. And again, if you are working at the company that has gone up and said, okay, we are going to meet this goal, and you are actually manufacturing something or writing code, or whatever it is, are you actually measuring that and how are you providing that to your customers? Because with the new laws coming in EU with CSRD and things like that, I was told in one meeting that organizations might need to report on a thousand data points when it comes to sustainability.Asim Hussain: Good.Ola Fagerström: That is the work that's coming just ahead of us.Asim Hussain: Yes. Yeah. And so asking lots of questions and you have to ask the questions to get that data to be able to report, andOla Fagerström: And then also be able to say, no. Okay, dear customer, if you can't provide me all supply, if you can't provide me with that, I'm going to go to that other manufacturer and I have this other little analogy that I use. If you would go to the car or to the garage that we talked about car before, and you would say, okay, how far can I drive in this electric car?And they would say, oh, oh, you can easily get a thousand miles on every charge. Brilliant. I would buy that car directly. And then you ask that little hard follow up question. By the way, have you tested that yourself? Oh, you know, no. No. That is based on that. It's an electric car and it's a sedan. Oh, so you haven't invested in testing that yourself?No. That would be way too expensive and required way too much work for us. No. Maybe in the future we will do. That's the work that Microsoft has already done because we set up that work years back again. When we started to say, okay, we can't select you as a supplier if you can't provide me, and we will make sure that we can provide our customers so they can actually feel secure when they buy our products to understand what is the footprint of things.Asim Hussain: Wonderful. Full. Yeah, great information, great insights from somebody like yourself who's been at the forefront into really calculating these numbers. And I can really see, and I, I knew you from before, but I can really see that doing this properly is really important to you and making sure that there's a truth to those numbers and a usefulness to those numbers.So thank you very much. Ola, thank you so much for your time, for time today and spending time. And thank you so much for the work you've been doing at Microsoft.Ola Fagerström: Thanks a lot for having me and fantastic to know. It out a little bit over over an hour as well.Asim Hussain: There we go. So that's all for this episode of Environment Variables. All the resources for this episode are in the show description below, and you can visit podcast.greensoftware.foundation to listen to more episodes of Environment Variables. I would like to say huge thank you to Ola again for being on the podcast today.Thank you for sharing your unique input to the world of sustainable software, and thanks again for coming on this show. Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get your podcasts. And please do leave a rating and review if you like what we're doing.It helps other people discover the show. And of course, we want more listeners. To find out more about the Green Software Foundation, please visit greensoftware.foundation . Thanks again and see you in the next episode.
undefined
Apr 19, 2023 • 41min

The Week in Green Software: The Hidden Cost of AI

This week host Chris Adams is joined by Asim Hussain and Environment Variables regular Sara Bergman to discuss the hidden costs of generative AI. What’s really at the tip of this iceberg and how far down does it go? They also discuss just how thirsty AI chatbots really are and developments in platform engineering. Finally, we share some opportunities for development from the world of green software.Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteSara Bergman: LinkedIn / TwitterAsim Hussain: LinkedIn / TwitterFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:AI Chatbots Guzzle Enormous Amounts of Water, Study Finds: / Evening Standard [3:16]Two-phase cooling will be hit by EPA rules and 3M's exit from PFAS "forever chemicals" / DCD [9:35]The Mounting Human and Environmental Costs of Generative AI: / Ars Technica  [15:02]ChatGPT: Mayor starts legal bid over false bribery claim / BBC [20:29]Free Dolly: Introducing the World's First Truly Open Instruction-Tuned LLM / DataBricks [25:19]How Platform Engineering Makes Software Sustainable: / Devops.com [30:43]Resources:How much water do data centers use? / David Mytton [8:10]Making AI Less “Thirsty”: Uncovering and Addressing the Secret Water Footprint of AI Models / Back Market / UC Riverside & UT Arlington [9:28]Jevon’s Paradox / Wikipedia [14:24]The AI Iceberg / Ars Technica [22:54]Simon Willison’s Blog about Dolly [25:37]Breaking the code of silence: what we learned from content moderators at the landmark Berlin summit / Foxglove [28:03]Holly Cummins from Red Hat’s Speech at QCon London 2023 [32:34]Events:Meetup on How to measure energy consumption of software (April 24, Virtual) / Green Coding Berlin [35:11]Microsoft India’s Green Software Development Hackathon (March 21 – April 24, 2023 • Virtual): [36:13]GreenTech Southwest Meetup (April 20, 6:00 pm - 8:00 pm • Bristol & Virtual): / Green Web Foundation [37:00]Transcript Below:Asim Hussain: I'm talking to people in my family, in fact, who are like thinking, will I have a job in two years time? Will I have a job in three years time? And like as historically, we have ignored in the just transition the other side have created a lot of very unpleasant noises, which has forced us to deal with that.I think the same thing's gonna happen here. I think there's gonna be a lot of noises, and I would love for people to start really talking about how do we make that transition fairer.Chris Adams: Hello, and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams.Welcome to another episode of The Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams of the Green Web Foundation. And in this episode we have some interesting news about how thirsty AI chatbots really are, and we uncover the hidden costs of generative AI.And finally, we share some opportunities for development from the world of green software. Before we dive in though, let me introduce my guests and colleagues for this episode. Today we have Sara.Sara Bergman: Hi. Glad to be back and in this format as well. So my name is Sara Bergman. I'm a software engineer at Microsoft. I also work with the standards working group here in the Green Software Foundation. I do some conference speaking. I'm actually speaking at conference later this year on this topic in particular. So it's very near and dear to my heart.Chris Adams: Cool. Thank you, Sara, and Asim.Asim Hussain: Hi, I'm Asim Hussain. I am the executive director and chairperson of the Green Software Foundation. And I also am director of Green Software at Intel. Excited to be here. Am I supposed to say an anecdote?Chris Adams: This is when you normally talk about mushrooms Asim.Asim Hussain: ThisChris Adams: Yeah.Asim Hussain: I actually bought a robot lawnmower yesterday and it's currently mowing my lawn, so that's a weird anecdote. But anyway.Chris Adams: That is quite a special anecdote. I don't quite know where to go from there, so I'm just gonna park it and then maybe the,Asim Hussain: let's cut it outChris Adams: yeah, the.Asim Hussain: robot. It's a really shitty robot. The every few minutes I'm going outside and pulling it out of a ditch. But anyway.Chris Adams: Okay. And if you're new to me, my name is Chris Adams. I am the executive director of the Green Web Foundation, where we are working towards an entirely fossil free internet by 2030. So before we dive in, there's a reminder. Everything we talk about on this show will be shared as links in the show notes that are published.So if something did catch your interest, please do follow the link to the podcast.greensoftware.foundation link, and you'll see all the links that we do actually have plus some extra commentary. Let's begin with our roundup of the news then. So this is the first story from the evening standard actually, AI chatbots, guzzle, enormous amounts of water study finds.So we're starting this episode off with some news from a mainstream news source, the evening standard in London, in the UK. It's actually covering a report from the university of Colorado Riverside and the University of Texas Arlington, where some researchers are working to estimate the water consumption figure for AI chat models such as Google Bard, and ChatGPT.The water consumption required to train advanced AI models such as Google Bard and ChatGPT is potentially staggering. With training GPT and Microsoft Data Centers requiring something in the region of 700,000 liters of clear freshwater according to our paper from these two universities. The operation used super computers with 10,000 graphics cards and over 285,000 cores.And this study calls for AI model developers and data center operators to be a bit more transparent about the water usage, as well as suggesting some steps that people could actually do to make better use or incentivize people to use chatbots during cooler, more water efficient hours.Asim Hussain: Hmm. I think in the parlance of, uh, World. The consumption of water in data is, no one was surprised. No one in the data center space went, oh, water. But it's actually a term, I think, is it? W There's a term called PUE for power. There's a term for water called WUE, am I saying that right? Water Utilization Effect?Sara Bergman: Yep. Water Usage Effect.Asim Hussain: And this has come up multiple. This is something I remember when I was at Microsoft. It was one of the, Sara, do they have a target for w ISara Bergman: Yeah, for 2030, replenishing more water than they used. But all hyperscalers do have targets for water usage. So it, as you say, it's definitely a known problem in the space.Chris Adams: This is one of the next ones, so maybe I should ask, Asim. Why do data centers need so much water in the first place? Is it cuz it's when you initially think about it? Yeah.Asim Hussain: Very thirsty ops People see ops people. They're so big. When the ops people walk around, they just need to guzzle a lot. I think it's for cooling. I think it's for cooling, just cooling service. When you actually look at kind of compute, the challenge of compute is the challenge of cooling and trying to get the maximum from efficiency as possible is all about kind of cooling chips.So, I'm not sure the mechanism of cooling where it's probably just like typical HVAC systems and things like that, but it's just cooling aspects of it. And I think also from my understanding, it's not just the fact that it's usually, cuz you don't just wanna take put river water in your HVAC system. It's like good quality clean drinking water, which could go to everybody.But it's also the fact the other end of it, you're pumping out hot water into natural like rivers and stuff like that. And I'm not a hundred percent whether this article or paper covers it, but there's like an impact to nature as well. Some of this stuff, I'm unsure. Maybe both of you have got an idea for this.Like I'm unsure like why is this, why are we running out of water?Chris Adams: So in the study there is actually a map mapping out water stress in various regions, and you'll often see overlaps between areas of water stress and data centers typically because data centers as critical infrastructure get to get the first bite of the cherry, as it were, just like with power. Last week, Aerin Booth was talking specifically about this, how when you are considered critical infrastructure, essentially priority goes to storing data about people rather than the people.That was the phrase he used, which was quite memorable.Sara Bergman: I think this is a fascinating topic, first and foremost, and also what you can use for cooling is essentially air cooling. So you can like pump in cool air interior data center and use that as a cooling. That works great in some parts of the world for the majority of the year. So where I live in the Nordic this is great. This works great. Other places like Arizona who has a lot of solar power, it does not work so great. Arizona is also water stressed. So you get these multiple climate factors on top of each other, which becomes a problem. And the second part, which makes water very interesting is that it's so incredibly localized.If we think about our energy grid, that is also localized, but we can send electrons way further with way less waste or loss compared to water. We don't have the infrastructure today to send water over vast amount of stretches of land. We have very localized production of water. There is like even some places in the world where you look at, there are some islands around here in the Nordics, they have like incredible amounts of water facilities because it's just not centralized and cuz there hasn't been a point or they don't have the, a large body of water for which they could centralize, et cetera.So that makes it an even more localized issue and even more connected to the communities who live in the immediate vicinity of the data center.Chris Adams: Okay, so this is one of the issues. It's the locality, not just actually the wider thing. There's also a link from here from David Mytton who's a researcher in this field, and he's been one of the people contributing to a number of the Green Software Foundation projects. He's written a bit about how much water do data centers use.It's really worth looking into because one of the immediate takeaways that you don't really see from this paper is while we are talking about the water used by the data centers themselves, the majority of the water in most cases right now is actually coming from the energy sources, not necessarily the data center themselves.So you've got water being used to cool, say the generation, like a big fat thermal station, like a coal fire power station, or a nuclear station. So there's a chunk of the water usage there. Then there's the more localized water usage in the data center itself, where it's pulling it out of, say, an aquifer or a like subsurface store of water.So there's two places to look at, and this is another one of the levers you might actually have. There are tools, as Sara mentioned about different kinds of cooling, like adiabatic cooling, which use ideas from almost hundreds and hundreds of years old, as well as actually the effect at the generation part.And this is where moving away from burning fossil fuels, I'm gonna keep bringing that in, is a way to reduce the water impact. The paper here actually talks a little bit about having metrics so that you might get an idea of the embedded water in a model, just the same way you might have the embedded carbon in a model, for example.So it's worth a look, and we'll share a link to the underlying paper as well as the original evening standard piece that was shared. Sara, I spoke a little bit about adiabatic, but you've shared a couple of links which look interesting as well here about the different kinds of cooling available in the world of data centers, which is not really my specialization.Sara Bergman: I won't say it's my specialization either, but I think it's been some interesting conversations. So this has been a known problem for a long time, which means there have been a lot of people thinking actively about this, which is always a great thing to be in or a great situation to be in. And one of the things that have been experimentally used by several hyperscaler providers is what's called two-phase cooling, which is basically where you use a type of liquid, it's a chemical, not water based.And then you use this to cool your server acts. It looks wild, but it's apparently very effective. But as of February, this year, the European, oh, let's see if I can find the full name for that. E C H A.Asim Hussain: Yeah. European Chemical Agency, there's no H there. Where's the h?Sara Bergman: Where's the chemical? Maybe, I don't know. Yeah. This is how you know we're not chemists in case you tune into the post calls wondering our profession. Yeah, so they, but I think also the American EPA, they both ruled or have concerns about the type of liquid that was used for this cooling, because it's what's called a forever chemical, which we have seen in other areas.Its not great on, on the environment and the people who inhabit it, but because of that, 3M basically stopped producing these PFAS type of substances, which were used for cooling. And now people are saying that will likely slow down the process of innovation of this two phase cooling.Asim Hussain: So what I understand about forever chemicals is that these are chemicals that once they're in our bio circle, they'll go into the oceans and the animals will eat them, and then we'll eat them and then we will pee and they'll go in the ocean and it'll carry on going and going. And so all we're eating is like the sludge of chemical and they're all, they're quite damaging.That's, yeah, that's very scariest. Forever. Forever. Chemicals.Chris Adams: These are things in like, non-stick frying pans. So every single one of us, we have a little bit of a non-stick frying pan inside us forever now. Thanks guys.Asim Hussain: looking at my non stick fry pan, probably a lot of non-stick frying pan is inside me right now. The, so, um, Sara, so what I, one thing I've never really. Never really started. One of the questions I've always thought about liquid cooling, cuz I've seen the videos, they look really cool when you've got like a server and it's, it looks like it's boiling water and inside, but it's not.It's, it's the special oil and chemical. The reason you put servers inside these liquid cooling things is so that you can put more electricity into the server and get more power out of it. So it will make the cooling more efficient. Maybe I'm talking about Jevons paradox type thing, but it'll actually mean there's greater amount of electricity going in. I suppose maybe the trade off is overall better.Chris Adams: Yeah, these are typically used. You'll see liquid calling and liquid immersion cooling in particular. Is that simply because liquids are much, much more efficient at moving heat than air, right? So this is a really good way to get the heat you don't want somewhere else, and that's a tool that's been used in many cases.However, it's often quite expensive upfront. A lot of us will usually default to be using air cooling in a lot of places. But yes, as the power density and racks increases, then people are reaching for more kinds of cooling, just like how cars used to be air cooled and now increasing your water cold. You have the same thing happening with increasingly industrial servers.So yeah, this is something that we could definitely talk about and it's definitely one of the mechanisms that people do use to move some of the heat around. But once you've got that heat, you still need to figure out where it's gonna go and what you're gonna do with it.Asim Hussain: So just to clear, so with immersion cooling right now, it would allow us to use less water because fundamentally it's more of an efficient mechanism of extracting heat. And so right now it would allow us to reduce the water, but we'll just be back at the same problem in the near future anyway, as the power density increases.Sara Bergman: Possibly, I'm not sure, but it should also clarify that there are two kinds of liquid cooling so we have the two phase one, which is the forever chemical, and then there is the one phase one which uses a water based or an oil based. And it's, as I understood it, less effective, but it potentially still uses less water.But yeah, it's always a scale problem, right? Because our industry has to grow. So as we come up with solutions, we outgrow the solutions as well.Asim Hussain: Yeah. We're in a constant race to, to increase efficiency faster than consumption increases. Yeah. Yeah.Chris Adams: Outrun Jevon's Paradox,Asim Hussain: Out outrunning, Jevons Paradox is our challenge. Yeah.Chris Adams: Okay. And for those who are not initiated, Jevons Paradox is this notion that as things become more efficient, the absolute use tends to increase. This was first noticed when William Stanley Jevons in hundreds of years ago, noticed that making steam engines led to an increase in the use of coal that was being burned because people end up using them in lots of new places.Just the same way that making cloud can be more efficient. But if it makes more people use cloud, then we still have an increase in absolute usage. So this is one of the things that we are currently wrestling with as an industry basically. Should move on to the next story because it feels like this is a nice segue?Okay, the next one up is the mounting human and environmental costs of generative AI. This is from Sasha Luccioni, one of the researchers at Hugging Face, but I believe also was working at MLA, a Montreal Institute for Gen. I think she's a colleague of, or was a former colleague of Abhishek, one of the people working in the Green Software Foundation Standards working group actually.So this one here is a story from Ars Technica and over the last few months, the field of AI has been growing quite rapidly, as we know. And we see all these new waves of new models being used like Dall-E, which is specifically for generating images, or GPT four, which is, you may be familiar with if you've heard of the term ChatGPT every week brings a new promise of new and exciting models, but it's easy to get swept up in the waves of hype. And these capabilities, these shiny capabilities come at a real cost to society and planet. So this piece basically outlines some of the key areas that we need to be aware of. And one of them is actually the environmental toll of mining rare minerals to actually create the GPUs in the first place.And there's also a bunch here about the training costs increasing over time, how these have been growing larger and larger, and I think the figures we were looking at was actually the economic accessibility of this. So the training cost of GPT three has listed around 5 million dollars, 175 billion parameters, which basically restrict who gets to create these models in the first place. That's the idea behind this. And this also talks a little bit about the climate emissions as well. Citing a study from Professor Emma Strubell, talking about the environmental emissions from an earlier model called Bert, b e r t, which had a figure of around 280 tons of emissions dedicated to the training of this one here.There's also talking about some of the other larger models and how they're growing over time. So these figures, I think this one refers to things like GPT. The estimated figures would've been if, depending on what the energy source would've been, they were looking at around, assuming you're running this on coal and natural gas, like one of the typical things on the grid, the figures for the actual emissions associated with training are in the region of 500 metric tons of carbon emissions, which is what they've listed here.Asim Hussain: Yeah, I just think there's a lot of stuff being said about AI. There's a lot of noise. There's a lot of noise about this, and I see a lot of people trying to play down the impacts of AI Both. I'm just gonna talk to sustainability. I think the societal spec, or which I would be happy to talk for hours and end about, but like for instance here, it was just mentioned that just the cost of training GPT-3 was $4.6 million.That's one training run. How many times have people actually. Train that you tweak it, you run it again, that doesn't uncover inference. And this is also GPT-3, which I believe is an order of magnitude less complicated than GPT-4, which is an order of magnitude less complicated than GPT-5. And when you actually look at the way.Like the business value of AI models, the emergent properties are coming through vastly more compute and vastly more data. This is just an indication of where we are right now. The future is like this nonlinear curve upwards of even more and more. So I think that's the thing I think to think about and that some of the things people have said to me have been around the lines of, even though it's this big, it's not as big as the airline industry.It's not as big as other things. Whereas my answer to that is actually one of the reasons why we pay so much attention to software space is so few of us like a 2, 3, 4%, but it's relatively small number of people, the number of people who are involved in training things like GPT is minuscule. The number of people that need to be influenced to reduce those emissions, I think is very small, considering the impact they would have, which is why I would argue it's very worthwhile having strong sustainability conversations in this space. That's my rant on this whole topic. Yeah.Sara Bergman: I agree. I plus one the rant, but also something that I think is interesting in this space because I really like to read research. And this is a topic that I've been speaking about for a few years now and what I see is there's conversation and research around the training cost and there's quite a lot there and it has been for quite like the paper you mentioned, Chris, that.From 2019, it's a very well written paper, so I would still argue that people should go and read it. But this has obviously been talked about and I don't know if it's because it's easy to research on or because it's fun, but what I see less obvious inference cost, and when you have these huge production companies, I can only guess that the inference is much higher than the actual training, and any number of times, like a billion is gonna be a big number, but even more in the shadow than inference is data collection, where at least I cannot find any good research on what is the cost of this? How do people do this? And when we have these larger and larger models, well we need larger, larger datasets to feed them. And how do we gather this data and where does it come from? And I don't know, maybe we're awesome at reusing datasets here. I don't really know. But without research, it's hard to say.So if someone's listening, have a great article, please send it my way. I'd be curious to read it.Chris Adams: So we'll speak on the labor part for a second, cuz that's definitely one thing that's, that was highlighted in this essay. But Sara, you mentioned something quite interesting about where the data is coming from because there's actually a really interesting scenario that came up literally just this month. If you are using ChatGPT.Try typing in the name Brian Hood. Ask who is Brian Hood inter ChatGPT right now. Tell me if you get something back.Asim Hussain: Who is.Chris Adams: Brian Hood. So b r i a n Hood?Asim Hussain: It's taken me a long time. I think, mayor?Chris Adams: Yep. Okay.Asim Hussain: Okay. An Australian mayor prepares the world's first defamation case against ChatGPT is that what it is?that whatChris Adams: Yeah, this is exactly it. So this is a story. Basically, this gentleman in Australia essentially started a lawsuit against ChatGPT, cuz this gentleman was, he was a whistleblower in a significant financial, essentially a FIA financial fiasco back in 2010. And for a long time ChatGPT was basically listing him as the person who was the cause of this.So, when you have models, which can lie and not tell the right thing, you had this baked into the model. So if you would ask this, it would basically say this person was, it would switch this stuff around. Cause we know that ChatGPT can be a little bit, not entirely truthy, basically, because it's very small auto complete, not actually really intelligence.And this now brings up the question, how do you actually then retrain the entire model Now to get this person out, you can't just remove the line in a database because the model will break. So there's now a whole set of new research onto retraining and relearning because this person here has a pretty valid request of, Hey, can you please not be defaming me inside this?There's a human right associated with this, specifically in Europe, for example. This is the kind of things that are currently, we are wrestling with right now. Have to manage either the retraining of this or to allow a sense of redress and accountability. When you are looking at this stuff.Asim Hussain: Sara are the, well, you are the expert of the AI like cuz we just read that it takes $4.6 million to retrain GPT-3. I presume it doesn't take $4.6 million to edit out this Australian mayor, but it wouldn't be the same as like Google just de-indexing pageSara Bergman: No.Asim Hussain: I imagined be significantly higher. Yeah,Sara Bergman: Yeah, because we have transparency into those systems, right? We don't really have transparency into what makes, yeah, it's like a brain. You don't go in there and just remove a line like, yeah.Chris Adams: It's an interesting one to think about that, right? Because if we don't have this, I think the essay does refer to some of these ideas. It presents this idea of a kind of, AI iceberg is the kind of model that's shared inside this with things like the benefits generate really realistic images, do your homework for you, answer questions, and then there's all these other costs and things we need to take- think about like the raising barrier to entry, the actual emissions, the tons of carbon emissions. If it's a 50 tons of CO2 to remove someone's name from a 500 tonne model, then that's quite an expensive refresh cycle when you're developing. If we ever worry about continuous integration, this feels like it's in a different league, for example, that we might need to be somewhat aware of.Asim Hussain: Or if you wanna delete your data, if you like go with a delete data request, how does it, that has to like factor all the way through. And then the thing is, like we, we've had Anne on. Me and Anne have spoken quite a few times about this idea that really these days it's about developer velocity. Like we have abstracted so many layers.Like one of the big paradigm shifts in computing was adding like a level of programming abstraction onto hardware, which birthed like an entire explosion of software being written and applications being built because we just made it so much easier to build, arguably inefficient. We weren't focusing on efficiency, we were focusing on speed of developers and speed to getting stuff out to market.And I'm seeing more and more stuff in the generative AI space, which is a similar idea, which is, it's not really about building efficient stuff, it's just about getting stuff out there as quickly as possible. What if you, instead of writing a really efficient API call, you just wrote like a ChatGPT prompt as an API request, and it gave you like 50,000 words and you stripped 49,000 on the way cuz you needed one. But that was just the quickest way to get a solution. How many times have we built software like that? Have you seen software like that? That's I think the danger of the world that we're heading in is cuz it's all just about that getting a valuable thing out on where does the ef- where our world is about efficiency.Everything we talk about is about efficiency. So where's the efficiency in this? That's where I'm concerned at.Sara Bergman: Yeah, no I agree. And I think I called the AI a brain and I already regret it because it is generative, right? It doesn't like, it reads the world and then present it in a slightly different format. I've seen people say, oh, AI has the same biases as us. Like, yeah, because we modeled it after ourselves. At least for now that's how it works. So that's another aspect I think is interesting.Chris Adams: So this is one thing, we'll just touch on this and then move on to the next story. Have you folks been looking at their new stuff, coming with, I think Databricks published Dolly, which was an open source LLM, and they've also created their first entirely open Creative Commons training dataset. Specifically, they've got a bunch of their own staff to work to create this dataset where there's very clear provenance of where the data's coming in.So unlike with some tools where you don't know where the data's come from, there's a lot of visibility on this, and there's a chap Simon Willison. He's been blogging all about how he's been able to run these things on his own local machines, but also there are people running these on Raspberry Pi's. Now, they're not very fast, but this is the direction that things are moving to where you see the open sourcing of this.Because right now, while OpenAI is, we don't actually know where the data is coming from, what data is being used for this, which has all kinds of interesting issues when, like we just mentioned here as well.Asim Hussain: It's not very open Is.Chris Adams: We said we were gonna talk about that. There was also one other thing that was touched on here was this, the idea of when you're building an LLM and you're creating this training data, there's also an issue of like hidden labor inside this.Uh, there are people who are actually paid to be working on this. And I think the piece by Sasha Luccioni refers to actually this time article about essentially Kenyan gig workers being paid less than $2 an hour to essentially examine all the messages for OpenAI. And this is very similar to the kind of content moderation stuff that you see in lots of other places.I think this is actually really interesting cuz it raises these issues like what do we actually do? Or what can we done to address this issue of like unpaid laborers or underpaid people working in AI model development. Cuz that's not necessarily the people writing the code, but there's definitely people involved in doing that just like we have when other platforms, for example, too,Asim Hussain: I think this is where things get very interesting with, and I'm gonna stray very far beyond sustainability right now, but we're talking about why are they getting paid so little is because it's unskilled labor, right? It's unskilled labor, and that's why you can get away with paying people $2 an hour.When the AI is a de-skilling the workforce anyway, right? So the de-skilling the workforce and like I saw somebody post the day, like maybe the future of software developing is just prompting ChatGPT, which is an interesting idea, but I'm thinking like, how much are you gonna pay somebody to enter prompts into ChatGPT versus-Chris Adams: As a promptAsim Hussain: engineer.As a prompt engineer.Chris Adams: So there's an issue of underpaid or very low paid labor involved in the AI model development that we don't really have really well addressed right now. And this is something that definitely needs to be addressed. There is actually one thing that may be worth looking at in other fields where you do see this, where you have the use of gig workers involved in this, like content moderation.There's lots of parallels to this kind of work where you have people who are considered outside of a firm who have to do this work. And typically what we've seen there is actually honestly workers organizing and talking about their, the conditions they need to be part of. There's a link to Foxglove, the UK law firm, who are doing some really interesting work specifically about representing the power and representing essentially people working in these kind of moderation or below the API kind of roles because they are very clearly part of it.And depending on when you look at the cost structure for a particular, say, organization, like if you look at, say, Facebook for example, Facebook might have made something the region of over a hundred billion of revenue last year. And this project, the actual moderation, which is one of the key parts, there is a single contract to a consulting firm for 500 million dollars for that part there, which is less than half percent of the revenue is being dedicated to this part here.And that's an issue about, okay. How are you representing these costs when we're creating this and how do we actually make sure that there is a just and a correct way to actually recognize this kind of labor, especially to address some of these issues? Cuz it doesn't seem particularly fair to me right now to do this.Sara Bergman: And I think it's also interesting because this is not the first time in history this is happening, right? Machines have been taking jobs from humans since the Industrial Revolution, but we want it to be for good. We want the machines. Whether that's a mechanical machine or a digital machine to take away the dangerous, the boring, the damaging jobs so that we as humans can focus on the fun, create a positive things of labor.And here you have a paradox, right, where this is potentially improving the working conditions of one group of people, but forcing it for another group of people. And how do you represent that and how do we solve that? Yeah.Asim Hussain: There's a lot of parallels here cuz we're talking about this in the energy transition as well. We're talking about just transition. We're talking about if we wanna move everybody over towards renewables, we have to think about the people that are in other industries because one of the reasons, cause they vote and they'll get quite upset if they lose their jobs and don't have an option.So it's always been like this thing as towards just transition and I'd love for there to be conversations about that happening right now in the AI space. Cause I'm talking to people in my family in fact who are like thinking, will I have a job in two years time? I'll have a job in three years time. And like as historically, we have ignored in the just transition in the other side have created a lot of very unpleasant.Which has forced us to deal with that. I think the same thing's gonna happen here. I think there's gonna be a lot of noises, and I would love for people to start really talking about how do we make that transition fairer?Chris Adams: I think this is one that we need to dive into in a bit more detail in a future one. In the meantime, Foxglove is probably one organization that's doing some really interesting work in this field at the moment, and I believe there is some work coming from AI now in this field as well. Okay, so the next one is, Platform engineering, how platform engineering makes software sustainable.So this story here comes from devops.com and the kind of thrust of this story is platform engineering seems to be essentially an idea of providing self-service tools for software teams themselves. So they are able to say, spin up an application or access, spin up a database. Ideally in our kind of green software world, spin up a cluster that turns itself off at the end of the day.Because we do know that one of the big issues we have is that people just leave things on. Cause it's easier in terms of people's time to leave, loads of things running rather than turning them off. So this is the idea that by incorporating tools like Cube Green or some of the metrics tools, uh, I think Spotify had been doing, you can essentially set some more sustainable defaults for teams rather than relying on them to remember to do all this stuff themselves.That's the general idea for some of this. Those are the benefits. Being proposed was, yeah, less friction. Reduction of cognitive load for developers. Basically consistency across the board. That's one of the things that seems to be pushed in this angle here.Asim Hussain: Yeah, I'm seeing it's got two aspects to it from a sustainability perspective, and I like the way they phrased it. They're talking about observability and optimization. You know, observability is like, how do you. Having that visibility. Most people don't really know. They don't think we have. I think we should tell 'em that the secret Sara about how people use cloud?Like most companies haven't got a clue like what's going on. And they're like sending out emails going, why are we spending $50,000 on this thing? And somebody goes, oh, I forgot to switch that off two years ago. That's like a level of visibility which exists right now. And so like any kind of like surfacing of that observability.And when I was at Microsoft, I got that email like every, two weeks we hired someone just to email everybody, to tell them to switch things off cuz it was costing so much money to keep it running.Sara Bergman: And actually at QCon in London last month, Holly Cummins from Red Hat, she actually had a whole talk on cloud zombies and she told a lot of these funny stories. So if you had the chance to catch that, she covered a lot of it because yeah, it's harder even with on-prem because then you might have a physical server.That you don't even know where it's located in your buildings cuz you run a university and you have lots of buildings or whatever. And uh, yeah.Asim Hussain: I have definitely remember, this is a long time ago and it was not Microsoft. So before you think I'm saying a Microsoft story, I remember. I was doing audits and then discovering machines that hadn't, we just completely forgot about, completely, utterly forgot about whole machines.Chris Adams: So the company was making so much money that they didn't have to care, or they didn't realize that itAsim Hussain: You can look through my LinkedIn and probably guess. Yeah.Sara Bergman: but I think this is also interesting because if we look at data centers. We have seen on-prem data centers that are managed by one corporation for their own sort of benefit. They're typically way less effective than the hyperscaler cloud platforms, and that is because they can spend their money as in engineering resources to make them so efficient, because it's worthwhile the investment for them just in pure monetary cost because that's their primary business, whereas, Company running an On-Prem data center.It's not their primary use case. They're maybe never gonna have enough people to do asset management in the most effective way possible. And it obviously depends on how you do it, but this internal developer platforms platform engineering situation, it could be the same thing, right? It all depends on how you do it, but potentially if you allocate a small group of people who are responsible and sustainability is one of their primary goals, then they have the incentive to spend the engineering capacity, and I'm saying engineering, but really any kind of practitioner that you are to make it more sustainable instead of having 10 different teams all have to fight for the same change. So it has potential, but it's possible to say the outcome without really getting into the nitty gritty.Asim Hussain: I loved your explanation there. I'd never really heard it phrased that way, but yes, like Microsoft and Azure, the team, you're making money through Azure, so you're gonna make Azure more efficient. But if you are a consumer, you're making money by selling shoes or something.Sara Bergman: Yeah.Asim Hussain: Yeah, that makes a lot of sense.Yeah.Chris Adams: Alright let's talk about some of the events that we have listed inside this then. We have just a few meetups and events, which might catch your eyes of some people. These are all virtual events. So the first one is a meetup on measuring the energy consumption of software. This is some work by a group called Green Coding Berlin.They're a small but mighty little outfit working on some very literally named tools. Like we can probably guess what the Green Metrics tool might do, right? As you can imagine. Does that, and they've got another tool called Eco CI, should we guess what that one does?Asim Hussain: Continuous. I'm trying to think of something funny for I, but I can't think of anything. Integration.Chris Adams: So, yeah, this is a small team of Berlin based developers who've been building a bunch of entirely open source tools specifically for this. The thing that I might share with you that might be interesting is that some of this work looks like it's probably gonna be fitting into the work with Wagtail at Jango based CMS on the Google Summer of code that we mentioned last week, where the goal is to actually start figuring out what the environmental impact of running various CI tools actually is, but also to measure where the, where the savings might actually possibly be inside open source tools. So you can pull out some of these patterns cuz we have things like patterns in the Green Software Foundation. Some of those might be applicable specifically for this.There's a Microsoft Green software development hackathon from the 21st to the 24th of April.Christ, that's this weekend, isn't it?Asim Hussain: Oh wow.Sara Bergman: Yeah.Asim Hussain: I thought this was like the internal Microsoft Hackathon, but this looks like an external one. It looks like Microsoft India is having a green software development hackathon and Wow. 1,945 registrations, so good luck if you're applying. You've got a lot of stiff stuff. I got a lot of competition there.I dunno what the prize is, it doesn't say.Chris Adams: I don't see actually that much in the prizes listed here either, but I'll be honest folks, I dunno about you, but. I'm gonna sound like an old fart now, but like when I first got involved with this, they weren't called hackathons. They were called hack days. With the idea being that you'd like work on something, you're not trying to win a prize, you're doing it because actual hacking on something is interesting in the first place.You figure out what can actually do rather than to win something to kick off your startup, basically, I. I'm a bit confused about this part, but uh, yeah, it looks like it's happening this weekend. Maybe if something comes out of it, we might feature it.And then finally there's the Green Tech Southwest Meetup in Bristol of all places.This one is run by Hannah Smith of the Green Web Foundation, and it's featuring two people. Adam Turner, who's the head of digital sustainability at DEFRA. That's the Department for Environment Food and Rural Affairs, who are the kind of defacto environmental department for the UK government.Asim Hussain: Thought it was DARPA.Chris Adams: Oh, not that's, that's America and that's a slightlyAsim Hussain: Oh, is that the me? Okay. Isn't that the weapons one? Any whatever.Chris Adams: No, that's, yes.The, there there is DARPA and darpa E. These are the folks. I'm out by death here. I'm not gonna pretend to, to know what DARPA is or what it, or what the significance would be for this one. I'm actually quite excited about this because this guy, Adam has actually been writing quite a lot about where the challenges are, and he's also been talking about, okay, these are the things that we're doing as a government with legally binding targets that we need to be meeting, and this is what our sustainability strategy looks like.And the nice thing is that. If you are not sure about what to do, because the UK government publishes all their stuff, you can kinda copy their homework to get an idea of what you might apply internally for yourself, and they're actually got a really quite well-developed team and there's a lot of really interesting stuff to be looking at for both just on-prem and in cloud and things like that actually.Asim Hussain: Mm, very interesting.Chris Adams: We've spoken about the news and the events. I guess there's a question. We spoke a little bit about this generative AI iceberg and some of the things that should be on this list. Is there anything that isn't there that should be there? Maybe Sara, I might start with you. If there's anything that we should be putting into this AI iceberg as things that people should be aware of that will share a link in the podcast for.Sara Bergman: Yeah, so one thing that I saw that wasn't there was lack of diversity in research. They said lack of interest. So maybe the same thing, but I think with the increasing cost, if really only the really large universities and or the really big corporation can participate in this sort of bleeding edge AI research, we're missing out on emerging research for people who probably have great ideas and couldn't do this incredibly well, but simply don't have the monetary resources.Chris Adams: That's a really good point to mention here cuz when you see a lot of these papers, they tend not to be coming from that many different places so far, and this was something that was raised in an earlier discussion, an earlier paper, basically making the argument that, yeah, when you only get models coming from Western Europe and North America, you're probably gonna miss out on a bunch of extra context that we are currently missing.In the same way that in lots of other places, when you only have modeling from certain parts of the world, you get an incomplete idea of what modeling the world might be looked like or what kind of policy options we do have to meet the climate challenges that face us.Sara Bergman: Yeah, because talent is equally distributed opportunity's not.Chris Adams: Indeed.Asim Hussain: I love that.Chris Adams: I think we'll leave on that one as a challenge from this. So that's all for this episode of The Week in Green Software. All the resources for this episode and papers and links will be available on the Green Software Foundation podcast website, which is podcast.greensoftware.foundation. So thanks again for listening and we'll see you on the next episode.Thanks, Sara. Thanks Asim.Asim Hussain: Thanks, Chris. Thanks. Thanks everyone.Chris Adams: Bye.Sara Bergman: Bye.Chris Adams: Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get to your podcasts. And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners.To find out more about the Green Software Foundation, please visit greensoftware.foundation. That's greensoftware.foundation In any browser. Thanks again and see you in the next episode.
undefined
Apr 12, 2023 • 26min

The Week in Green Software: Generative AI and Cloud Zombies

Chris Adams is joined by cloud sustainability advocate and founder of Cloud Sustainably, Aerin Booth in this episode of TWiGS brought to you by the Green Software Foundation. On this episode Aerin provides his insight into the cloud to discuss cloud zombies, the effect that generative AI is having on the environment and exciting developments from Xbox (including a list of some of Aerin’s favourite nostalgic games!). We also touch on GreenOps and the future for green software developers.  Learn more about our people:Chris Adams: LinkedIn / GitHub / WebsiteAerin Booth: LinkedIn / PodcastFind out more about the GSF:The Green Software Foundation Website Sign up to the Green Software Foundation NewsletterNews:Generative AI and cloud zombies: Raising the alarm about global climate impact: / Silicon Angle [2:48]Report on ChatGPT Model’s Emissions Offers Rare Glimpse of AI’s Climate Impacts: / Truthout.org [2:48]Xbox’s New Energy Measurement Tools are World Changing: / Xbox [6:23]Wagtail and the summer of code / GitHub [14:32]Events:LF Energy Summit ( June 1 at 2:05 pm - 2:35 pm CET • Paris & Virtual)  [19:35]GreenTech Southwest Meetup (April 20, 6:00 pm - 8:00 pm • Bristol & Virtual) [20:00]Resources:PS5 Power Consumption / ecoenergygeek [10:58]The UK’s Digital Markets, Competition and Consumer Bill / Linklaters Sustainable Futures [20:16]The Carbon Reduction Opportunity of Moving to Amazon Web Services / 451 Research [21:02]If you enjoyed this episode then please either:Follow, rate, and review on Apple PodcastsFollow and rate on SpotifyWatch our videos on The Green Software Foundation YouTube Channel!Connect with us on Twitter, Github and LinkedIn!Transcript Below:Aerin Booth: When I think about anything we choose to do, not only in terms of carbon and IT, but in our life, if it doesn't have purpose, it's almost a waste. And we forget that we're not really building things for ourselves in technology. We're trying to build services for one, helps people in their day-to-day lives and hopefully save the freaking planet in the next upcoming climate change catastrophe the rest of our lives.Chris Adams: Hello and welcome to Environment Variables, brought to you by the Green Software Foundation. In each episode, we discuss the latest news and events surrounding green software. On our show, you can expect candid conversations with top experts in their field who have a passion for how to reduce the greenhouse gas emissions of software.I'm your host, Chris Adams. Hello, and welcome to another episode of The Week in Green Software, where we bring you the latest news and updates from the world of sustainable software development. I'm your host, Chris Adams, and in this episode we'll be discussing generative AI worrying impact that I could be having on the environment.We'll also cover some exciting news from Xbox and some events for you to take part in as part of the world of green software. Before we dive in though, let me introduce my guest with us today. We have Aerin Booth the former head of Cloud at the UK Home Office now turned cloud sustainably advocate joining us.Hi Aerin.Aerin Booth: Hello. Nice to meet you. Thank you so much for having me on. So my name is Aerin Booth. I, like Chris said, former, I say in name in, in some ways product manager for Public Cloud at the UK Home Office. But while I was there, I signed 130 million pound contract, was part of negotiating the memorandum, understanding between the UK government and the cloud providers, hyperscalers, AWS, Azure and Google.Um, and did a lot of other stuff for the cloud community across the UK. And then moved into my own consulting. So I've been running a consulting company for the last few years. Not to go too salesy or anything, but it's called Cloud Sustainably. Just helping people rethink how we consider carbon emissions in it, because it's on the rise.And obviously we all know and care about this. We wouldn't be listening to this podcast otherwise. And yeah, I think more people talking about it does the world a little bit of good. And yeah, I've been on an interesting journey to say the least.Chris Adams: Okay, thanks Aerin. So if you're new to this podcast, I am Chris Adams. I am the policy chair, sorry, I'm the chair of the policy working group in the Green Software Foundation and the executive director of the Green. Web Foundation. Every week we do this, we will basically share any of the links that we discuss and do a roundup of the news.So that's generally of the plan. Today, it's gonna be a bit of a short one cuz it's Easter, so we're gonna keep it short and sweet. And I suppose Aerin, should we look at what stories have come up on our radars today? What's the first one here? There's one about generative ai and in particular, the environmental impact from generative AI and cloud zombies.Aerin. I think given your background, with cloud, the Cloud zombies one might be an interesting one for you to start with actually.Aerin Booth: It is really interesting. Yeah, cloud zombies, I mean it's, we could probably use any term we want really. I did a talk on being ethical in tech at Reve last year in November, and just before that I did a talk, I think it was titled DALL-E oh God, what was it called? Now? Is DALL-E Ethical? Something around like the use of ai?What's the purpose?Chris Adams: This is DALL-E, the AI model, not the former modern artist, right?Aerin Booth: Yeah, yeah. There's a good comparison, isn't it? Names of such power and sort of representation. In terms of what were open AI going for, when they were creating this, and I see the power of AI. I use it myself, like when I'm on Instagram, on TikTok and all these things, and you see these, I don't use filters, but I do use like generative images.I had one recently, which was really cool, but. When I think about anything we choose to do, not only in terms of carbon and IT, but in our life, if it doesn't have purpose, it's almost a waste. I saw a lot of apps on Twitter ever since I did that talk, and just keeping on what's going on in the world of AI stuff like, oh, change your hair cuts to these five different 10 different styles, and it cost like 30 quid.Because it costs that much energy effectively. Like this article and some of the notes here are talking about the carbon emissions training a model. So what was it? Chat GPT three. It was 502 tons of carbon, which at the end of the day, what is that? A little bit in Norway for a little bit. But if we're all using this all of the time, and now what we're seeing is stuff like Bing and another search engines integrating, using this model as every single transaction on the internet.And there's a lot of transactions on the internet. It's bigger than we realize.Chris Adams: Yes. Okay. So that's the stuff that you get to use. I think this term, cloud zombies is particular being referred to this idea of basically, long running jobs and basically, essentially cloud stuff that no one is even using alone. Some of this stuff here, you could probably make an argument that most of us aren't necessarily asking for kind of a neat kind of AI features inside Bing when we're just doing a search.But I think this one was specifically referring to this massive amount of waste from people generally not really turning things off or just it being easy to leave something on. Then, then to turn it off and face the consequences of things being turned off. I think that's where the phrase came from, and I wondered if this is something you might have something to speak to given some of the background with Cloud that you saw.Aerin Booth: Definitely. I mean, you think about working at the Home Office, none of this is not public, by the way, that this is in ministerial statements in Parliament, but the percentage of AWS spend as terms of cloud and we had the definition of cloud is always hazy, a bit dreamy and up in the cloud, but we estimated it was about 94 to 97% of all of our spending was with AWS when we at the Home Office. And when you think about that, is that a problem? Yes. Now, but we started using the clouds in that department in 2016, and it's now 2023. Think about the journey cloud's been on since it was invented, invented, or whatever else we started using there.It has gone through generations like we, we used to string together S3 and VPNs and build things ourselves. Then we have managed services, or Kubernetes came along in the middle, like all of these different generations of the cloud and a lot of enterprise organizations are now carrying all of these generations of the cloud and sometimes losing the skills.As new people come in, they've not always got the history of skills or long-term experience. They've been taught whatever's being taught today, and a lot of the time it is new services. So it's like you've got two ends of the spectrum. Let's say AWS is a labyrinth designed to trap anyone in any decision they could ever make and fuck it up, and then charge you for the privilege.And then a consultants in to say, oh, we'll help you with FinOps or whatever. Go calm down like you're an idiot by the way. When you need help from others, lemme charge you some money. And then you've got like the opposite end of the spectrum with GCP where in my view is let's just turn everything off every other day and it's okay.That makes sense. If things can be migrated easily. But if you are asking a company to every single year, start again. Whatever they're building on the newest platform, okay, they're keeping up with the skills, but what about developing new features instead just re-platforming because you are whim on what you are going to turn off and there's two ends to the spectrum.And Microsoft, I wish I could say they're doing better, but honestly, the horror of active directory and stringing together some of this stuff when it's supposed to just work. It's pretty gnarly. Like you, you wouldn't wanna be going in there as a startup these days. I'd recommend something like Digital Ocean or some of a new cloud SMEs, particularly for cloud.And yeah, here we are, next generation of cloud computing. It already exists and a lot of people don't see it because we stare at AWS, Microsoft, and TCP all the time.Chris Adams: I see. Okay, so this is one thing. So there, so it, so I guess one of the questions I should probably ask you here is, given that there was a significant amount here and uh, we're to. Talking about being able to switch things off. Basically. In your experience, how did people manage to keep track of which things were running and which things were not running and these kind of experiences?Cuz you need to have people to have some understanding of which things are, where you're able to scale things back. In a lot of cases, and in many cases one of the kind of ideas behind switching to something like cloud, which might be more efficient, is that it's supposed to be much easier to manage and it's easy and there, there are supposed to be some co cost savings for this surely, which would result in energy savings?Aerin Booth: Yeah. Uh, well, Let's say energy savings, for example. So this is something I've been finding very frustrating. So I started caring about sustainability in the cloud, let's say 18 months ago. It was probably like November, ReInvent, two years ago. Yeah, about 18 months ago now. So I've not been doing this for a long time, but I've been in tech for a long, longer time, 10 years or so, or at least doing my own stuff.And it's not so much spend, cuz spend comes as a result of you doing an action. Having something that is created to have a purpose like spend is secondary to whatever is you are building as a team or whatever features are coming down the pipeline. And a lot of the time, because the pace we all move at in terms of new features, new releases, management direction, all of this sort of stuff, we're on the hamster wheel.Basically just saying, okay, I've gotta add this new feature. Or the tails wagging the dog. You do user research, get two conflicting pieces of advice, and you're throwing on a new feature rather than making whatever's there better. So you're always moving forward. You're never really stopping to deal with tecta, you're never really stopping to keep up on platform.Restructures best decisions here and. I wouldn't say it's by design, but no one makes it easy. No one is really saying, okay, here's what you need to do. How about you try this? Like Amazon, you'll get hundreds and hundreds of emails about all sorts of stuff just randomly announced to every single account, and you pay your ID as an enterprise.Not very helpful, especially when you've got account teams who will help, but they've got their own sales targets as well. Because at the end of the day, the cloud is all about selling like it's rent-tier capitalism of technology. Like previously, you could own your own data center, manage it like even, and a lot of those can be cheaper for the right size organization.Just the cloud doesn't always make sense. Let's say, because one of the things we've always talked about is like a cloud first policy, but the cloud doesn't just mean AWS. Like I'm saying, Azure and G C P, there are loads of different cloud options and even SaaS services managed services. These are all in the cloud.IAS, PAS, SaaS and whatever else, that's how the cloud's moved on. A managed service from AWS is a SaaS service in a different form, and people just get a little bit mixed up sometimes and it advice for anyone. Just stop and think a bit more in terms of what you wanna achieve before you just start building stuff.And I dunno, products management and delivery management are the two key parts. Like doing them well is about shaping the team in the right direction when we're building stuff. And that's where people forget. They just follow the rules and don't understand why you should be doing these things. But anyway, quite off topic for the original question.So,Chris Adams: Alright, let's park that one there and come back to a little bit later cuz there's an event later on with the head of Digital Sustainability, who's speaking at Green Tech Southwest. And we can touch on some of that a little bit later. Next story we see here, I see one about some of the new ideas in Xbox.Xbox has some new energy management tools, which they're basically using to, by the sounds of things, reduce environmental impact from gaming specifically.One of the key things was this idea that by essentially optimizing Fortnite, the game, people have been able to identify something, the region of 18 megawatt hours a day of power, and at the same amount as basically an entire wind farm in Sweden, and basically remove that by making some optimizations to the actual game itself by removing, say, excess use, which people aren't using, for example, or removing some of the really expensive computing when it can't be perceived so easily.This is one thing. Didn't realize that. This is actually quite interesting in my view, cuz A, we forget just what the impact of gaming might be when you have all these machines, which are about maybe half a kilowatt of power, or hundreds of watts, for example, but also the scope for actual optimization here.Aerin Booth: Yeah, and, and I really like what Microsoft's doing to be honest, in terms of Xbox and the direction for their technology because they clearly have a vision that's further ahead than other providers, I'd say in some ways, especially when it comes to sustainability and technology and just even connect. I remember Microsoft Xbox Connect, like that was pretty cool back then and it just got dropped off slightly and I think PlayStation's a bit head in in VR with the new VR 2 coming out, but, I like to think about this again as a generational problem of gaming.Gaming is one of those industries which just derises it a lot in the media and people assume like hardly anyone's a gamer. I probably bet now especially was listened to the podcast. You game a lot more than you realize. Like people do it on Candy Crush, do it online betting. It's all gaming. It's all gaming theory.It's all basically around, okay, what we getting out of this? What's the purpose of this game? It either gives you fun or, or takes money off you, pick your poison. And I've got an Xbox, I've also got a PlayStation and Xbox is doing some really interesting stuff. I think one thing I might have read, maybe it's not in this article, but it's like just doing updates and downloads at a period where the carbon intensity of your energy grid in the country that you live is low.So scheduling overnight or whatever it is, cuz it, it doesn't follow the sun per se. The way we consume energy, especially when renewables are coming in the day and it varies, especially Europe way. We're all connected. So it's, I don't need to care about that. I don't need to worry, go around the house and unplug things and do all these smart home setups if it's baked into the technology that we're delivering.And Microsoft obviously just deciding to do that, whereas PlayStation, and especially, I'm gonna say rather than PlayStation, Activision, blizzard, like Activision and COD. Have you seen the size of some of these games? GTA 5. They are like almost terabyte games these days. Can you think like they're always getting updated?People are going up and down, and especially when you almost have to do a fresh install somehow, or some reason I've had to do it once or twice over the years, and that was really unnecessary. And as much as we had like games flying around disks years ago, and everyone's saying do digital now, it's like with a game, I can keep that passive to a friend, take it back to a shop and get a refund from CEX or a computer exchange store.Whereas now if I get a digital download, what I'm getting is a license to rent something off you in the future and continually have to ask for permission to download it, which you may ban me one day who the hell knows. So it's okay, we're solving the technology carbon element and now we Microsoft's going, but didn't we just do that anywhere with disks?Recycle your disks. It's mostly plastic and glass and cases and whatever, and yeah. Do you know, there's an interesting fact and, and Corey Quinn mentions this one, the fastest way to transfer data around the world is on a hard drive on a plane. That's the quickest way to send data halfway around the world because the fiber network, speed of light is the limitation and there's only so many open routes.So it's like, okay, we can still ship more data in the world, but it's just like, yeah, put it on the back of a plane, fly it round. It's, that's what we used to do with disks anyway, so it's, thank you Microsoft kind of thinking about this, but what's the point of all this and like these days, especially with ai, do games have to get any bigger, like I'm pretty.Most games I love Legend of Zelda, Wind Waker, it's cell shaded. It's timeless because of its style, not because of it's trying to chase realism of the day. Cuz we always get better at doing realism. So we always date a game by being realistic.Chris Adams: So this is actually a nice segue because one of the ideas for this story here was people are basically talking about getting between 9 to 16 watts per user of savings per player, basically, which I know sounds okay. And then you gotta think about how does that relate to, say, the power usage of say, maybe a PS 5 or Xbox.The numbers that we, I just did a bit of Googling for this beforehand, and we can see some numbers for like when a game is in full use. So with a PS5, the numbers. We see from say, okay, I'll be honest, this is pretty short. So the citation required from ecoenergygeek.com, PS5 power consumption gaming figures.You're looking at around 200 watts with outgoing, up to 350 watts of power. Now, when you compare that to say, min Nintendo Switch, Which is basically, let's say you're using something full-time gaming. You're looking at maybe between 6 and 12 Watts of power usage here. Now this is something which is 10, 20 times, and I, you've gotta ask yourself, is it really 10, 20 times better the experience for this when you have this kind of trade off here? This, there's one thing that we're not really so aware of when we are looking at the gaming we might actually use here, because the savings we're seeing here are basically the entire usage of some other smaller devices like you just mentioned.Aerin Booth: For me, I've got Steam Deck for example. They have Steam do gaming and like, you know, they've built community, they've built the steam store. Like, you know, that in itself revolutionized gaming. Like the games died off for probably creative differences and gotten bored and all fighting rather than playing together, but, What they created is a storage.Very good. The steam deck and the innovation and hardware is really good, so like they add a bit of a dodgy controller, but I love the steam deck. Not only can I stream games to it, so I can have it in my house, connect to my wifi and stream Microsoft Cloud straight to it. I can remote play to my PS5 to it.I can emulate other games that are legal to emulate if I own copies elsewhere, blah, blah, blah. Disclaimer here. Yeah, it's a brilliant device and to be honest, I've not looked into the energy consumption so much, but gaming, we shouldn't worry about gaming if I'm a gamer. You shouldn't sit here and worry about our energy consumption of, okay, I've left my TV on and I've had a game on all night.I remember when I was a kid, I didn't have a memory card for Final Fantasy VII. I had to play with my PlayStation and never switch it off and say to my mother, never turn this device off because we don't own a memory cars and you can't save games. So I'm like trying to play Final Fantasy VII and Crash Bandicoot with like never stopping it, which is quite an interesting one.Not a good attempt. I tried playing Crash Bandicoot recently as the remasters and oh my God, that game is frustrating. I can't believe I even bothered as a kid. So at the end of the day, gaming is about connecting people World of Warcraft. Best game for me in my life in a lot of ways because of the people and the connections I made.I have four godchildren because I met a friend in a guild. She married the guild leader. They had kids. They asked me to be the godfather. I went to another wedding, second marriage of hers. We've been lifelong friends ever since. I met her when I was 13, playing World of Warcraft as a old blue warlock, a female warlock, which is quite interesting.That's all my online personas have ever been women. Which is now, I look back at it, I go, that's really interesting. But yeah, it's good fun and like, yeah, it brings communities together it's healing and Tetris great example. If you play Tetris after a serious accident or incident, whether that's a stress ambulance, blah, blah, blah, it reduces PTSD because you give your brain something to do while you're trying to process all those thoughts, and it actually helps you not get them stuck and can do with your hands and spend more time processing at the same time and literally prescribe someone 30 minutes on a Game Boy of playing Tetris or on the phone after an accident or after whatever else. And it'll really help them in the future. So gaming is not until worry about when it comes to carbon.I, I think, What is to worry about is just attitudes from gaming companies around their impacts and how they run things, and that's their choices rather than the console manufacturers, some licensing deals here and there, but yeah, it's open Wild West out there these days.Chris Adams: So don't blame the gamer. Blame the. WayAerin Booth: Activision Blizzard,Chris Adams: Oh,Aerin Booth: I, no, I find it interesting. Activision Blizzard because in all honesty, There's been uproar online around the culture of that organization. It was started by a big group of men, basically provided over quite a horrible culture for a long time, over decades. They had very good stories like Green Jesus, we all love them.For all rest in peace, you're back from the dead, who knows? And you know it, it lost its path slightly. But what I see with the newest expansion is it because they really did a change of their culture? They started to actually focus on, on, on being more loving in the environment. The game itself is much more interesting now.You have queer characters and dragons and all this stuff. A lot of people are really happy about it these days and it's like this. The thing about boycotting anything, if you boycott something. Like how is anyone supposed to get better? Okay. Tell them what they did wrong, accept them. Make changes like removing people, which a lot of these companies have been doing.So removing these people who were bad for the environment and then that's it. Like I know especially, and I'm not saying this to people who were harmed directly, I can never. I can't comment on that. That's your own stuff and your own opinions. You can choose to just never interact with them again. But to say to half the world or most of the world, you have to do this way or you're a bad person.What's that gonna get us More fucking sad people in the world.Chris Adams: Yes. Okay. All right. Should we jump onto the next story?All right. Next story we have here is wagtail and the summer of code. This is quite an interesting one in my view. Basically, Wagtail is a CMS, just like WordPress is a content management system used by significant part of the internet. Wagtail's used by companies like say, a number of charities, Google, lots of well-known blocks are actually running on this, and this project is about the Google Summer of Code. There was a joint project. Basically start embedding some greener coding practices into Wagtail itself. So the idea here is to do things like introduce some kind of green modes or also think about, okay, ways that you can create a different architectures to make this scale down to zero in various places.This one actually, I think, is. I have to say I, I am somewhat involved in this because this is a joint collaboration between Torch Box an agency and the Green Web Foundation. We've been doing some work for this, but there's a number of really promising directions for this to go in, and this was using some of the tools from an organization called Green Code, green Coding Metrics, largely because when you do use some tools like say a cms, it's not obvious where to make these optimizations.And if you're making able to have something open for people to start implementing some of these pattern, The idea is that you can possibly adopt these in other places, so I might ask you actually. Yeah. Any reckons at your end on this one Aerin?Aerin Booth: so it's really great in terms of anything that is up the scale. Wagtail is effectively a content management system same as WordPress. I understand it in terms of that. That's what I've ever heard of. I might take a look afterwards. I had a little look then, but yeah. Great. Do carbon reductions at a platform level and anything hack around it.Like this is the great thing about open source projects and whatever else, like if you solve an open source project. As in terms of it has this capability now and anyone can contribute to, if you solve the problem, then we can come back like that as a team, as everyone in the community to say, okay, we care about this.Now we're gonna show it some love and make it better. That's the whole focal point about community-driven development, which is open source communities. This is the sort of thing which we could almost stop and do anyway. And you see this at Kubernetes, especially these days. I think Adrian Cockcroft did a good talk at QCon just talking around obviously stuff he learned at Netflix, but you know what we need to do with Kubernetes?Effectively, Kubernetes is a zombie of its own. It was open source to encourage people to be able to migrate between clouds or just have a more generic platform layer. You put a box and a docker, whatever to cube and it goes there and we can move trade cubes around. But the reality is it helped people get onto the cloud quickly.Okay, I can write all these things, but at the end of the day, there's always services that are connected different ways. So it's like I've got my Kubernetes cluster with all my nodes and whatever else. And then I'm relying on, uh, SSL toys. Ssl, isn't it? Like all of these things which are either cloud providers you host from AWS or you buy a SaaS service and you've then think it as chemical reaction.You're slow as the weakest reaction or whatever else, or bond is as weak as the weakest chain link. And that's where a lot of the time when I see outages in the cloud and have experiences them, it's never really the whole of Amazon going down though that has happened. It just happen a lot more regularly these days due to thermal events.That's why we care about carbon emissions. A lot of data centers can't actually handle variations in temperature than designed for that, but that's where it actually goes wrong. Like you don't even notice it as well. And I think you asked me something earlier, which I didn't finish off, and I'll come back to it now.Enterprise organizations, and I'm talking generically here because I know it's gonna be a problem everywhere because to be honest, they all run in very similar ways. And the government, civil service, massive organizations have worked in all the biggest ones. Ministry Defense, DWP, Home Office, HMRC.They're very similar. We don't even know what we build. Like enterprises, generally things will get built. Innovations, money will come in cuz this is it. Money arrives a decision maker and it something gets built underneath. So when you're an enterprise organization, you've got all this money flowing out through cash cent-, cost centers, whatever you call them, bloody accountancy things and stuff just starts getting built, which is fine, but people are building their own fiefdoms.People move on. Things get passed around. I would bet any money that people who've gone to use Service now, especially service now because it's very self directed. You have to do a lot of manual work, and I think they've got better things these days, but again, it's hard to connect everything across the generations.I would be very surprised to find many organizations that have a very full record of every single IT service, it's service name, it's in service Now. All of it's onboarding for live service and operations because things just fall through the cracks and they just exist. They are zombies themselves, and you have a service that just works.Even look at the internet itself, there's so many open source projects that sit on underlying all of our core open projects that I think there was one a couple of years ago where, I dunno if it was protest or it just went down, but it caused half the internet to fall over. Yeah, we're all building crumbling towers when we go too big in terms of tech and it, especially enterprise, because sometimes it's like, oh, you know, you're a bit of an old man now Microsoft, can you really do everything in its dog like, especially when startups are just doing it better and faster Digital Ocean, Genesis Cloud, Leaf Cloud, all of these places in Europe.Chris Adams: Okay. Alright, we'll pick that thread when we come back to this. Let's look through the last few stories that we have here. Cause we're just coming to the end of it from here. There's a few events coming up there. Linux Foundation Energy Summit in June in Paris. There's a few people speaking specifically about tools like Carbon Aware SDKs, and if you're in Paris, it seems like it's worth going.I know that I'm actually going along to see some of the talks, cuz it looks like one of the most interesting places to. Essentially find out what's happening at this intersection. One layer down where we work with at the internet, for example. There's that there. There's also a upcoming event is Green Tech Southwest at the meetup on the 20th.This looks interesting cause so if nothing else, you've got Adam Turner who is the head of digital sustainability at DEFRA talking, basically providing a bit of a way in for people who are new to the idea about. Apply sustainability to the digital sector, but he'll also be talking about the UK government's digital sustainability strategy themselves.This I think, is actually quite interesting cuz this is one of the UK's probably further along than are a number of other governments right now and they're at least very quite public on this. I might ask if there's anything that you wanna add onto this one here, cuz we're coming up to the last few minutes for you Aerin?Aerin Booth: Yes. I'll take it over for a couple minutes and just kind of add my views in here. So I'm a former civil servant. I was independent, impartial. Following the government, blah, blah, blah, blah, blah. Always did my job to the most first honour and respect of that role. I was part of a lot of these negotiations and sustainability was always a touchy subject.Like it's a very difficult thing to get anything straight out of a lot of companies, because we're all playing with assumptions and numbers right now with the reality of it, like Scope 3 hardly exists in all the cloud providers, especially AWS, they don't show Scope 3 at all in any of their online tools or any of their reports.They have an awful report. 451 did this report about the carbon reductions you can make by migrate into the cloud and they say you can have 88% energy savings in the cloud if you migrate to the cloud, and therefore you'll have carbon reduction. Okay. I said something very specific there. 88% energy reduction if your migrates to the cloud.If you read the report itself only covers scope two carbon emissions. It doesn't cover scope one, which I thought was quite interesting considering there's so many diesel backup generators in all of these places. If you think about Puerto Rico, for example, when they had the hurricane several years ago, the only thing that didn't lose power on those on the island was the data centers.The people of that country waited, what, nine months, year, 18 months to get power restored to everyone. Data centers never lost today because we prioritize data of people over people themselves. That's a crazy thing that's going on here. We're like we shipping these boxes of ones and zeros. Rather than thinking maybe I should do something better with my energy on this island and help people out for a little bit and take the loss and turn off some hard drives, put it all in disc or tape storage and turn the damn thing off for a bit.And there's so much we really need to think differently about because yeah, that report, that's all over 80 versus sustainability pages, it's literally the top link. I went to an event in Ireland, I flew over for Amazon's first ever sustainability event organized by the wonderful public sector and marketing team over in Ireland.And they basically said that report, and then they also said, oh, look at our wonderful carbon reporting tool, which by the way, everyone only reports Scope one and two. Scope one and two is about 7% of carbon emissions from AWS. 93% of all their carbon emissions comes from their own supply chain. So when I'm making a decision about my cloud and I'm looking at these wonderful graphs, I am seeing 7% of the a hundred percent of the big picture and thinking I'm making an 88% carbon reduction.So what effectively Amazon has just said. You can reduce your carbon emissions by 6% if you move to the cloud. Sound a bit different now when you really analyze the facts and read the report more than two pages or get through their first blue blog post and sustainability for me cuz I've worked with Amazon, I'm a community builder at Amazon I don't really care about not pulling punches or whatever else because I've honestly tried to work with them quite a lot and their PR team consistently always pulls the plug on sustainability conversations. And I'm not even joking. I was supposed to do a Twitter space or someone invited me and I got pulled, I'm not saying it was me, I just say they have a problem talking about sustainability.They have no idea how to do it. Cause they think. Oh, if we admit this is a problem, everyone's just gonna run away and not join. It's like maybe, but you can't just carry on what you're doing just because you want to make some profit at the end of the world while the rest of us like have to deal with the climate crisis.And yeah, I almost not given up on Amazon, but I won't be helping them directly anymore. I consult generally probably between like a bit like Corey Quinn. 10 to 15 different people or teams who reach out and ask for my advice at Amazon and all of it's unpaid, like I'm giving unpaid labor to one of the world's richest companies for no thanks or credit.Not to say thanks. I was like, oh, I deserve this fin. But to be blocked or just have events disappear randomly because of PR decisions, when all I've ever been trying to do is help is like, well, now the time to just do things differently, which is why I've got my own podcast. Why I come onto podcasts like this.I do obviously talk about sustainability with my rights hat on AWS channels when I do get on. And yeah, we need to think differently about the cloud. And for me, me and Adrian Cockcroft have been talking about this for a long time, and it'll be coming out soon and I might as well throw it at the very, very end.I've been recently asked to propose a book to the British Computing Society on Green Operations, and I'll be writing that hopefully with some co-collaborators and figure out how can we really reframe this as a cultural issue. Okay. We are DevOps because even with DevOps, what we prioritize development and developers, we're thinking about ourselves when we're building services, try thinking about the people and the planet.Chris Adams: So this is the dev suss ops thing is.Aerin Booth: Not DevSusOps, that was Adrian's term and we're not gonna use that. In some ways it has its own purpose, but again, I don't want people thinking about developers or su sus like it. It just doesn't even make sense. Like what you read that I have no Green Operations is about thinking people and the planet when we're building services.If you put those two things at the top of your priority list, okay, what is my priority? It's for people on the planet, not users. By the way, people. And then you go, okay, how do I build this? I'm gonna build it with diversity and accessibility at the front of my mindset and open source and reusability. And if honest to God, you just do those things.Think about people on the planet, build accessibility needs and usable parts and, and sharing and SaaS services. People just want to use it because it is actually a good service. You don't have to just build everything from scratch. You just need to think about things differently, and it's always chasing the tail or the money or the next feature, whatever else.And we forget that we're not really building things for ourselves in technology. We're trying to build services. For one, helps people in their day-to-day lives and hopefully save the freaking planet. In the next upcoming climate change catastrophe the rest of our lives. So green operations hopefully be published by the British Computing Society once I submit the full manuscript later this year.And yeah, it'll be a good little thing to sort of, you know, think differently when it comes to sustainability in the cloud.Chris Adams: Okay, so green operations, you heard it here first. I think that takes us up to the time we have. This actually Aerin. I'm gonna say thank you very much for joining us for this episode of this week in Green SoftwareAerin Booth: Can I just add one more thing? I always love doing this at the end of my podcast. One I is just in terms of, you wanna find me? My name's Aerin Booth, but my online persona is Aerin Clouds, A E R I N C L O U D S. That's on most social media. It's really easy to find quite a unique name, but. What I always try and say to people is like, if you're listening to this podcast, if you finish it and made it this far, thank you so much and well done.But do something nice in the next week. Take some time off you. Were gonna do, spend some time in nature. Don't forget that there's other things out there, rather than staring into a box on a screen and working for cloud companies or technology companies. When you know you shouldn't really be traveling away from everyone all the time, you shouldn't always be on the go.We need to balance these things out. And that's Green operations. If you stand in nature, you're gonna think about nature a lot more when you're making decisions, if you're always away from it, if you're in a city, you're on the tube, getting back home, sitting down, having a takeaway, it doesn't really cross your mind.And sometimes we just need to have a little bit of fresh air and it really helps us just to do some of this stuff. I'm basically a digital hippie. So let's go and let's do this together. Peace and love.Chris Adams: So the secret to Green Ops is to get out in the green. All right. That's a nice point to end on. That's all we have time for. All the resources and links will be added to this. If you have any feedback, go to greensoftware.foundation in your browser. Uh, And if you did enjoy the show, please consider leaving a review on Spotify or Apple Podcasts or wherever you get your podcast.Your feedback is valuable and helps us reach a wider audience. So thanks again. Thanks for listening and seeing you in the next episode. See you next week, Torah. Takecare, Aerin. Bye.Hey everyone. Thanks for listening. Just a reminder to follow Environment Variables on Apple Podcasts, Spotify, Google Podcasts, or wherever you get your podcasts.And please do leave a rating and review if you like what we're doing. It helps other people discover the show, and of course, we'd love to have more listeners. To find out more about the Green Software Foundation, please visit greensoftware.foundation. That's greensoftware.foundation In any browser.Thanks again and see you in the next episode.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode