Iterative Pruning Improves the Learning Capabilities of the Network

The winning tickets that you find with deterctive pruning learn faster and faster than the original network. So asou keep pruning, of course, the the learning capabilities of the network are also improved. And this is especially true when the amount of data issay comparable with the number of parometers that or ling with the network. But essentially, it's quite hard to generalize these findings to all the networks, all the data sets and all training techniques because neura networks are big monsters.