The Economic Unviability of Chat GPT at Scale

To run something like chat GPT at scale would be economically unviable. OpenAI has 30,000 GPUs for about 200 million queries a day. Even with that, there's a new technique of QLORA which is a combination of quantizations and an adapter to make large language models more effective.