How to Scale Out Efficiency in Deep Learning?

The idea here is can you get by with less training data or better utilize the data you already have. I think what we've seen with deep learning is that scaling works. It makes things bigger with more parameters, with more data, with more layers,. You typically get better results. And kind of this is what where the field is going and we're trying to be smarter than just increasing everything.