Neural Networks - The Tree Grows From One Trunk

Stephen Wolf: I think many of these things, you know, the tree grows from one trunk, so to speak. But with neural nets, what's strange is that the original sort of McCulloch Pitt style initiation is where all the other stuff grew. And yet there were all these separate branches and a same seed, but it wasn't a single trunk from that. It took a long time for all of those to sort of be unified into a large-scale machine learning system. The amount of resources that went into these large language models is staggering.