Training logistics: GPUs, runtime and inference costs

Antoine Bosselut, Assistant Professor at the Swiss Federal Institute of Technology (EPFL) in Lausanne, joins Danny Buerkli to explain how he and his team built Apertus, the 'open' LLM. Antoine and Danny discuss why taxpayers should fund this work, which constraints bite hardest when creating an LLM outside one of the large labs, and which public investments may be needed now.