AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There a New Scaling Law?
"It wouldn't surprise me that much if we get a new thing on the general scale of the transformer, right? Like a concept with equivalent significance as attention." "I don't think there's a clear boundary between tricks and new architectures. It's a continual did you everlay the laws on this lixocratic model?" 'Can we build an architecture that allows you to kind of combine these capabilities and get something more versatile by having different modules that communicate with each other through text?''Am, that feels like the kind of thing that am, ye.'