NLP Highlights cover image

126 - Optimizing Continuous Prompts for Generation, with Lisa Li

NLP Highlights

CHAPTER

How to Transfer Prefixes Between Models

Lisa: Well it depends on the landscape of the prefix space. Yeah that's a very good point maybe we can just do something silly and average 10 prefixes for the same task. In general I think the transfer idea is very interesting so like there actually could be many different types of transfer. The caveat is that well first it does not tap check because GPT to medium as well has very different activation dimensions and embedding dimensions.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner