Robert Miles–Youtube, AI Progress and Doom
The Inside View
00:00
Is There a New Scaling Law?
"It wouldn't surprise me that much if we get a new thing on the general scale of the transformer, right? Like a concept with equivalent significance as attention." "I don't think there's a clear boundary between tricks and new architectures. It's a continual did you everlay the laws on this lixocratic model?" 'Can we build an architecture that allows you to kind of combine these capabilities and get something more versatile by having different modules that communicate with each other through text?''Am, that feels like the kind of thing that am, ye.'
Transcript
Play full episode
