Raul Miller - Precision
The Array Cast
The Difference Between a Rational Type and a Fixed Point Type
There's an actual type that exists in every language called a fixed point type which is a floating point type represented by an integer. I only know all about this because I had to implement it for an NVIDIA library and like Part of that was doing like a month long research of all the existing implementations, rounding behavior and stuff. You do all the conversions so like you store it as an integer but like $1.23 is stored internally as the integer 123 so you never end up with Like the floating points addition like the those problems that being said you still do inherent inherit some of the problems of floating point numbers.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
