AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Using the Hidden Resent Before the Prediction Layer
We found that even when the prediction of the network was to create a false sentenceyt we could tell with above chance accuracy that from the representation it had. It knew that the sentence was false. And so this sort of brings to mind the idea of meda cognition, that you have some monitoring process that's running at the same time as youre our on line.