Deep Papers Reinforcement Learning in the Era of LLMs
Mar 15, 2024
Exploring reinforcement learning in the era of LLMs, the podcast discusses the significance of RLHF techniques in improving LLM responses. Topics include LM alignment, online vs offline RL, credit assignment, prompting strategies, data embeddings, and mapping RL principles to language models.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7
Introduction
00:00 • 5min
Reinforcement Learning and LM Alignment
04:45 • 9min
Exploring the Complexities of Reinforcement Learning Paradigms
13:30 • 19min
Exploring Credit Assignment in Reinforcement Learning for Optimal Rewards
32:26 • 2min
Optimizing Prompting Strategies and Token-Level Analysis for Language Models
34:04 • 2min
Exploring Data Embeddings and Prompt Optimization in Reasoning Systems
35:57 • 2min
Mapping Reinforcement Learning Principles to Language Models
37:42 • 7min