AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Interpretability in AI
It looks like we took a much smaller set of transformer layers than the ones in the modern leading edge state-of-the-art systems. So sometimes the basics are fun to explore because they're not so basic. And then somehow also hopefully generalizes some fundamental understanding of what's going on that generalizes to the bigger system.