NVIDIA Is Pumping Out 3 GPT-3s Every Single Day

If Gugata soft wants 1000 GPT-3s, they'd have to buy about 10 months worth of NVIDIA's current production. It would cost 10 to 15 billion dollars. Google made around 70 billion dollars in revenue in quarter 2, 2022. Microsoft about 52 billion. The A100 has been out for a while now, and all that compute is being purchased by somebody. I'm still hand waving the engineering difficulty of wrangling that much compute,. but these companies are already extremely good at doing that  and are still improving rapidly.