AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Fine Tuning Language Models
A lot of these large language models, they've been trained on like, you know, internet scale text. But nothing about the fine tuning to put it over into that space. I think the Laura paper is truly incredible, the low rank adaptation paper from from Microsoft Research. It looks like what they're doing is reordering the like eigenvalues of every matrix.