A primer on AI for developers with Swyx from Latent Space
Svelte Radio
00:00
The Relationship Between Pre-Training and Code Pilot
Pre-training is just building foundation models that other people can build off of. GPT three costs something like 50 to $100 million to train. You can buy them for something like $2 per 1000 tokens or they open source it and it's free. And I think there's an interesting correspondence between this and the way that we build frameworks, right? There's always a core team that takes on the hard job of maintaining and building the core thing. And then us as developers take that thing and then build the last mile for our applications.
Transcript
Play full episode
