AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Representation Engineering (Activation Hacking)
Practical AI: Machine Learning, Data Science, LLM
Modifying Model Decoding Output for Control in Generative Models
2min Snip
00:00
Summary
Transcript
Episode notes
Controlling generative models can be achieved through prompting strategies or modifying the model's decoding output. By altering how the model decodes its output, such as restricting it to specific types like binary outputs, users can have more control over the model's results without directly modifying the model's weights and biases. This method involves applying a control vector to the hidden states within the model, changing how the forward pass of the model operates. By using this approach, users can guide the model's output towards specific types of results, allowing for more controlled generation without affecting the model's core architecture.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode