
GPT, What Are You Doing?! w/ Mikhail Voloshin
Real Vision: Finance & Investing
00:00
The Importance of Stateless Processing
The process is completely stateless and except for the last step it's completely deterministic. The program retains no implicit memory whatsoever of any previous loop. One server can handle a lot of different requests because they're stateless. This was part of the engineering part of why transformer technology like was invented in the first place to facilitate mass parallelization.
Play episode from 36:11
Transcript


