The Importance of Hiring for Enterprise Grade Software

Jonas: Our whole kind of scaling network and model is on the own all proprietary code base. So we're not just cloning Megatron or DeepSpeed, we basically got our own. We're using PyTorch, which most people are doing on our inference setup. And so unless there's some breakthroughs, so surely transformers is not the end of the story, right? Yeah, absolutely. Jonas: All of our enterprise stack is in Rust. I need to get you to talk to the folks behind Ray, the distributed computing framework.