Neural Networks - The Bitter Lesson

In neural networks, as well as in the human brain, like forgetting is the most important thing. The whole point of trying to minimize the low-quality information you consume is to make room for the high-quality information. But also, I do think there is something to be said for just trying to learn a lot. And if your options are a bunch oflow-quality information or none, I would say read a bunch of low- quality information.