AI Breakdown

In this episode, we discuss How much do language models memorize? by John X. Morris, Chawin Sitawarin, Chuan Guo, Narine Kokhlikyan, G. Edward Suh, Alexander M. Rush, Kamalika Chaudhuri, Saeed Mahloujifar. The paper introduces a method to quantify how much a language model memorizes versus generalizes from data, defining model capacity as total memorization excluding generalization. Through extensive experiments on GPT-family models of varying sizes, the authors find that models memorize data until their capacity is full, after which generalization (or "grokking") increases and unintended memorization decreases. They establish scaling laws linking model capacity, data size, and membership inference, estimating GPT models have about 3.6 bits-per-parameter capacity.

In this episode, we discuss MMaDA: Multimodal Large Diffusion Language Models by Ling Yang, Ye Tian, Bowen Li, Xinchen Zhang, Ke Shen, Yunhai Tong, Mengdi Wang. MMaDA is a unified multimodal diffusion foundation model that leverages a modality-agnostic architecture, a mixed long chain-of-thought fine-tuning strategy, and a novel unified policy-gradient reinforcement learning algorithm to excel across textual reasoning, multimodal understanding, and text-to-image generation. It achieves superior performance compared to leading models in each domain by bridging pretraining and post-training effectively within one framework. The model and code are open-sourced to support future research and development.

In this episode, we discuss Superhuman performance of a large language model on the reasoning tasks of a physician by Peter G. Brodeur, Thomas A. Buckley, Zahir Kanjee, Ethan Goh, Evelyn Bin Ling, Priyank Jain, Stephanie Cabral, Raja-Elie Abdulnour, Adrian D. Haimovich, Jason A. Freed, Andrew Olson, Daniel J. Morgan, Jason Hom, Robert Gallo, Liam G. McCoy, Haadi Mombini, Christopher Lucas, Misha Fotoohi, Matthew Gwiazdon, Daniele Restifo, Daniel Restrepo, Eric Horvitz, Jonathan Chen, Arjun K. Manrai, Adam Rodman. It appears you have not provided the actual abstract text, only metadata such as the title, authors, and affiliations. Please share the abstract or content from the paper so I can summarize it for you in three sentences.

In this episode, we discuss The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models by Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Cho, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo. The paper introduces BIGGEN BENCH, a comprehensive benchmark designed to evaluate nine distinct language model capabilities across 77 diverse tasks with instance-specific criteria that better reflect human judgment. It addresses limitations of existing benchmarks, such as abstract evaluation metrics and coverage bias. The authors apply BIGGEN BENCH to assess 103 advanced language models using five evaluator models, making all resources publicly accessible.

In this episode, we discuss DanceGRPO: Unleashing GRPO on Visual Generation by Zeyue Xue, Jie Wu, Yu Gao, Fangyuan Kong, Lingting Zhu, Mengzhao Chen, Zhiheng Liu, Wei Liu, Qiushan Guo, Weilin Huang, Ping Luo. The paper presents DanceGRPO, a unified reinforcement learning framework that adapts Group Relative Policy Optimization to various generative paradigms, including diffusion models and rectified flows, across multiple visual generation tasks. It effectively addresses challenges in stability, compatibility with ODE-based sampling, and video generation, demonstrating significant performance improvements over existing methods. DanceGRPO enables scalable and versatile RL-based alignment of model outputs with human preferences in visual content creation.

In this episode, we discuss Visual Planning: Let's Think Only with Images by Yi Xu, Chengzu Li, Han Zhou, Xingchen Wan, Caiqi Zhang, Anna Korhonen, Ivan Vulić. This paper proposes Visual Planning, a new approach that uses purely visual sequences to perform reasoning and planning without relying on text. They introduce a reinforcement learning framework, VPRL, which enhances large vision models for improved performance on visual navigation tasks like FROZENLAKE and MAZE. Their results show that visual planning surpasses traditional text-based methods, offering a more intuitive way to handle spatial and geometric reasoning.

In this episode, we discuss A Preliminary Study for GPT-4o on Image Restoration by Hao Yang, Yan Yang, Ruikun Zhang, Liyuan Pan. This paper presents the first comprehensive evaluation of OpenAI’s GPT-4o model on various image restoration tasks, revealing that while its outputs are visually appealing, they often lack pixel-level structural accuracy. The authors demonstrate that GPT-4o can effectively serve as a visual prior to improve existing restoration networks in tasks like dehazing, deraining, and low-light enhancement. They also provide practical guidelines and release a dataset of GPT-4o-restored images to support future research in image restoration.

In this episode, we discuss DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion by Qitao Zhao, Amy Lin, Jeff Tan, Jason Y. Zhang, Deva Ramanan, Shubham Tulsiani. The paper introduces DiffusionSfM, a novel data-driven framework that directly infers 3D scene geometry and camera poses from multi-view images using a transformer-based denoising diffusion model. It represents scene geometry and camera parameters as pixel-wise ray origins and endpoints in a global coordinate frame and incorporates specialized mechanisms to handle challenges like missing data and unbounded coordinates. Experiments on synthetic and real datasets show that DiffusionSfM outperforms existing classical and learning-based SfM methods while effectively modeling uncertainty.

In this episode, we discuss RayZer: A Self-supervised Large View Synthesis Model by Hanwen Jiang, Hao Tan, Peng Wang, Haian Jin, Yue Zhao, Sai Bi, Kai Zhang, Fujun Luan, Kalyan Sunkavalli, Qixing Huang, Georgios Pavlakos. RayZer is a self-supervised multi-view 3D vision model that learns 3D scene understanding without any 3D supervision, including camera poses or scene geometry. It predicts camera parameters and reconstructs scenes from unposed, uncalibrated images using only 2D image supervision, enabled by a framework that disentangles camera and scene representations and a transformer leveraging ray-based 3D priors. RayZer achieves novel view synthesis performance on par with or better than methods relying on ground-truth pose annotations.

In this episode, we discuss Reinforcement Learning for Reasoning in Large Language Models with One Training Example by Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Lucas Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, Simon Shaolei Du, Yelong Shen. The paper demonstrates that reinforcement learning with verifiable reward using only one or two training examples (1-shot RLVR) substantially improves mathematical reasoning in large language models, nearly doubling performance on benchmarks like MATH500. This method generalizes across different models, algorithms, and examples, showing unique phenomena such as post-saturation generalization and the importance of policy gradient loss and exploration encouragement. The authors provide open-source code and data, highlighting the potential for more data-efficient RLVR approaches in improving LLM capabilities.