AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Effect of Zuranging Out Modules on the Neural Net
Zurang out each successive module in turn of those 391 modules setting all its weights to zero. So if we ask the resulting network to generate a picture of a cat and a party hat, here's what we'll now get. We're seeing different kinds of sort of alienly imagined cat-like things. And yes, some of those cats are not anatomically correct. But much like in neurophysiology, there are some modules like the very first and very last ones in our original list where zurang them out basically makes the system not work at all and just generate pure random noise.