The Jim Rutt Show cover image

EP 187 Carlos Perez on A Pattern Language for Generative AI

The Jim Rutt Show

00:00

The Importance of Chain of Thought in GPT

One of the things I find so fascinating is the idea of the context window, as which everything has to go through and come out. Even though you have technically an 8,000 token, it tends to lose its coherence beyond maybe 1,500, 2,000 tokens. So that you actually get a better product if you can chop the work up into smaller pieces even than the context window. Things like chain of thought just comes out for free.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app