AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
LAMA CPP: How to Optimize Your App for Mobile Devices
The LAMA PPCP is famous because it's all offline and can be run on very simple hardware. It ran like 10 seconds for every word that you gave to it or something like that, which I guess it makes sense. What LAMA CPP made was to optimize this code that Facebook gave because it was still running on a bit heavy computers,. Now we can make it work even on a phone like we made on Sherpa.