Large models on CPUs (Practical AI #221)
Changelog Master Feed
00:00
The Importance of Usability in Optimization Platforms
Sebastian: We're working on a south platform right now to make all of this more intuitive. The base framework that we have pushed out in sparse is supposed to be able to run with any model architecture. So everything's set up very generically, which means that whenever there is a new architecture that comes out or new weights, things like that, it will take some time for us to tackle that. But that is a nice thing about having an open source community is that people are welcome to come in the tooling and the framework there should work out of the box with everything.
Transcript
Play full episode
