AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Train a Discriminator in a Different Landscape?
Gans are notoriously difficult to train and to train stably, exactly because of that. So what you need to do is to train them jointly so that you always keep it flat enough for the generator to come closer. And then the discriminator can well make it steeper, and then you get gradient. Ye, it does rit you back prop through the discriminator to the generator. The generator always knows in which way it needs to change too in order to fool the discriminator.