Programming Throwdown cover image

153: ChatGPT

Programming Throwdown

00:00

Is There a Difference Between Markovian Process and a Non-Markov Model?

Markovian is a process where at any given place in the process, you don't need to think about the past. The new models are transformer based and they build up a memory over time. This became much easier with this thing called an attention mechanism. And so the idea with attention mechanisms are when something goes into the memory, you actually provide a bias.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app