How to Find Winning Tickets in Four Easy Steps

The lottery ticket hypothesis says that a randomly initialized, pretty dense neural network contains sub networks. When trained in isolation, it can actually match the test accuracy of the original network. It is quite difficult to find such a network and you don't have the guarantee to do so. There are relatively simple steps that one must follow in order to identify winning tickets. How to prune your network in four easy steps.