Sara Hooker: Cohere For AI, the Hardware Lottery, and DL Tradeoffs
The Gradient: Perspectives on AI
00:00
How Do You Grow a Network With Unstructured Sparsity?
So with respect to adopting training as you go, is this with respect to things like hyper perimeters, parts of the network, architecture. What? What does that picture look like? So there i'm speaking specifically about how d how does your net work? Can you grow a network? So can you start? Can you start whith a very small network, end up with a much bigger one, but a much bigger sparce one,. so changing the notion of what your connections are as you go.
Transcript
Play full episode
