The Future of Routing in Gpt3

The routing team at ugway. think this is an extremely exciting idea so to first let's try to like just to kind of unpack each thing that the first thing I want to talk about is some so these big models like gpt3 and maybe we can use prompting to try to get it to do more tasks or we can say what they're really doing is the mixture of expert style of say like the latest glam model with the trillion parameters from google It's looking what like what they want to do instead is have kind of sparse routing activations instead of one massive dense architecture.