LAMA CPP: How to Optimize Your App for Mobile Devices

The LAMA PPCP is famous because it's all offline and can be run on very simple hardware. It ran like 10 seconds for every word that you gave to it or something like that, which I guess it makes sense. What LAMA CPP made was to optimize this code that Facebook gave because it was still running on a bit heavy computers,. Now we can make it work even on a phone like we made on Sherpa.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.