AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Far Is Too Far?
The perils of deep learning are that the models interpolate, they don't extrapolate. If you make a depression in the manifold, what you want is lots on of depressions in the manifold to form a canyon around your around where you want your manifold to be. But if the depressions are small and they don't form a nice canyon around your manifold, then you're not really learning anything about your manifold. So i an what i can do as it can form that valley between the what's truly in the language and these corrupted inputs. And we're just kind of hoping that that's enough. We don't consider any gibberish or anything. Yes, as you said