TalkRL: The Reinforcement Learning Podcast cover image

Max Schwarzer

TalkRL: The Reinforcement Learning Podcast

CHAPTER

The Differences Between Network Scaling and Replay Ratio Scaling

A larger network would be able to handle a larger number of time steps in terms of being higher fidelity to model. Big networks really shine, I think, and small networks really struggle. One other thing that I thought was really surprising actually is that network scaling and replay ratio scaling are almost exactly orthogonal. Seems counterintuitive to me.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner