arxiv preprint - Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models

In this episode, we discuss Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models by Seyedmorteza Sadat, Otmar Hilliges, Romann M. Weber. The paper addresses issues with high guidance scales in classifier-free guidance (CFG) for diffusion models, which can cause oversaturation and artifacts. The authors propose a modified update rule by reducing the influence of the parallel component of the update term, leading to a new method called adaptive projected guidance (APG) that maintains quality without oversaturation at higher guidance scales. APG is effective across various models and improves metrics like FID, recall, and saturation, offering a better alternative to standard CFG.