AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is GPT 3 Parallelisable?
Corma Corma: GPT three is a great general model for like human texts, but it's not particularly good in particular. So if you have something like GPT to test, then that shows up as an example of how the algorithm can work with different text types and languages. He says there are lots of ways to train transformers including using noise parameters or even just randomly deleting words at random. The most interesting thing he has noticed so far about this system is its ability to structure sentences very similar to what humans would say they're doing.