Audio long-read: Rise of the robo-writers
Nature Podcast
00:00
The Future of Language Models
Open a i announced gpt two in february 20 teen, it originally said it wouldn't release its model because of concerns about malicious use. But before that release, university student conner lehe was able to replicate it using a couple of weeks of effort and some cloud computing credits. Lehe now leads an independent group of volunteer research called a luther a i, which is aiming to create a gpt three sized model. The biggest hurdle, he says, is not code or training data, but computation, which a cloud provider called core weave has offered to provide. One future path lies in combining language models with knowledge bases, curated data bases of declarative facts.
Transcript
Play full episode
