
126 - Optimizing Continuous Prompts for Generation, with Lisa Li
NLP Highlights
How to Transfer Prefixes Between Models
Lisa: Well it depends on the landscape of the prefix space. Yeah that's a very good point maybe we can just do something silly and average 10 prefixes for the same task. In general I think the transfer idea is very interesting so like there actually could be many different types of transfer. The caveat is that well first it does not tap check because GPT to medium as well has very different activation dimensions and embedding dimensions.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.