Gradient Dissent: Conversations on AI cover image

Cristóbal Valenzuela — The Next Generation of Content Creation and AI

Gradient Dissent: Conversations on AI

00:00

Quantization Is Increasing Your Inference Costs

The trade off between precision and speed really matters. quantizing model is great But also you need to make sure that you're not affecting the quality of the model because if you're affecting something on a pixel level it might change the result from being like okay to like bad. We are still exploring some stuff on on the browser. It's smooth enough, but I think we're not 100% there yet Yet.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app