GPT4: A Mammoth AI Model

The training run for GPT4 was extensive operating on 25,000 a 100 GPUs for about three months. If conducted in the cloud, the total cost for this run would have been around 63 million dollars. As part of its design, GPT4 includes a vision multi- module component which means that it can actually process both text and visual inputs.