The Trend in the Use of GPUs in AI Research

A new paper titled compute trends across free errors of machine learning. It follows up on sub prior work, there's been several papers that have tried to establish the trend of how much computational power was used in AI research over time. Eddard also now talks about large scale error models like GPT-3, which are even breaking the trend of deep learning and are kind of on a different trajectory.