AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is Drop Connect a Good Model for Deep Learning?
Drop out was a least inspired by stocasticity in the brain. And that uniso neurons don't fire reliably. So i think drop connect is a good model for what the brain is doing. If it plays ar regular if it plays a regular ation roll in artificial emwors, there's no reason to believe it doesn’t play a regularisation roll in thebrain. How the brain does back prop or whether it does back prop well, that' weno get into that. Well, e nottoeeteiannoowofes, but i hear they're doing interesting work.