
Max Schwarzer
TalkRL: The Reinforcement Learning Podcast
The Differences Between Network Scaling and Replay Ratio Scaling
A larger network would be able to handle a larger number of time steps in terms of being higher fidelity to model. Big networks really shine, I think, and small networks really struggle. One other thing that I thought was really surprising actually is that network scaling and replay ratio scaling are almost exactly orthogonal. Seems counterintuitive to me.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.