Utilizing CPU Resources for Faster and Cheaper Inference

This chapter explores the advantages of using CPUs over GPUs for certain tasks, such as increased hardware availability and control, potential cost savings, and the compatibility of their technology with different CPU providers. The speakers discuss the challenges and potential of offloading compute onto personal devices or a combination of both, emphasizing the abundance of untapped CPU resources in enterprise and cloud providers.