AI, ML and Data Engineering InfoQ Trends Report
The InfoQ Podcast
00:00
Are You Seeing Scalable Models on the Edge?
i was going to ask if you're seeing the use of these frameworks like rags mentioned o n and x, or maybe cafe too. Are you seeing people do things like pruning and quantiation, where you take a model, or maybe distillation, so youre deftiitly sening that quantization then? Oh, yes, deffinitly, at least that's what's the gap. I am not sure like the other type of tinyme mark processos that exist out there. But for instanc the e p i have been, like, by proging myself with somethin culed e p i, which isalready able to do some simple face
Transcript
Play full episode
