The author argues that Google could have seen this coming, and that in many ways this was a stable diffusion moment quote unquote for LLM's. He says the best models are those which can be iterated upon quickly. We should make small variants more than an afterthought now that we know what is possible in the less than 20 billion parameter regime," he writes.
This week, a Google researcher had a note leaked that argued that Google (and OpenAI) were going to lose AI to the open source community. In this episode, NLW explores the arguments and asks what the implications might be.
Read the original note: https://www.semianalysis.com/p/google-we-have-no-moat-and-neither