The Language Model's Joke

This week, there has been a release of Lama and Alpaca, the Facebook language learning models. So you don't have to sign into OpenAI and give your phone number - which I wasn't keen on. You can download the models and there are various weights. And then you can spin it up. It took two hours for it to come back with the correct answer of 42 with all four arm cores at 100% load. If it takes two hours on a 10,000 pound Raspberry Pi, what's going to be like on a normal computer?