The Evolution of Deep Learning and Neural Networks

Some methods are just better than others in particular situations. And this is of course the evolution of the learning and artificial intelligence or neural networks as a predictive methodology. Tree-based models have a better inductive bias, right? In respect to irregularities in the data or irregular patterns.