The Future of Modeling

Mosaic is an open source implementation of, you know, decoder only language models. It's really dropped at simple. The implementation of GPT three I think is still around 300 or 400 lines of code. And that includes all the distribution and everything else because we're using PyTorch FSDP. We make our money by providing infrastructure to help people train large models. That's the most important part like we at mosaic say.