FYI - For Your Innovation cover image

Designing The Future Of Software Engineering with Amjad Masad from Replit

FYI - For Your Innovation

00:00

Using Large Language Models to Program Transformers

In-context learning is a technique to get the language model to learn something on the fly. Microsoft started playing with it early on, starting with GPT-2 in 2019. We got some prototypes out in 2020. And we released our own version of that earlier this year called Ghost Rider. It can understand the intent behind your code. For example, you can highlight a piece of code, right-click transform, and you can tell the AI make this code faster.

Play episode from 20:34
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app