2min snip

Practical AI: Machine Learning, Data Science, LLM cover image

Representation Engineering (Activation Hacking)

Practical AI: Machine Learning, Data Science, LLM

NOTE

Modifying Model Decoding Output for Control in Generative Models

Controlling generative models can be achieved through prompting strategies or modifying the model's decoding output. By altering how the model decodes its output, such as restricting it to specific types like binary outputs, users can have more control over the model's results without directly modifying the model's weights and biases. This method involves applying a control vector to the hidden states within the model, changing how the forward pass of the model operates. By using this approach, users can guide the model's output towards specific types of results, allowing for more controlled generation without affecting the model's core architecture.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode