Jos Van Der Westhuizen

Jos Van Der Westhuizen, a PhD student at Cambridge University, discusses his immersive journey from biomedical engineering to machine learning. He dives into the importance of the forget gate in LSTMs, revealing how it boosts computational efficiency. The conversation also covers his innovative architecture, Janet, which combines attention mechanisms with LSTMs. Jos emphasizes selective learning and how managing what to forget is key in optimizing neural networks. Tune in to hear about the future of simpler, more efficient neural network designs!