AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Instruction Fine Tuning in Open Source Models
Lamini LM, a diverse herd of distilled models from large scale instructions. And what's interesting here is it's a case of instruction fine tuning. So teaching their AI model to basically follow instructions, which is really important task and something that you need quite a bit of training data for. They end up with this like absolutely massive data set with like two and a half million pairs of instructions and responses.