AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Inductive Bias of CNNs
In visual backbones like CNNs or visual transformers, you find the emergence of part detectors. This is an analogous to that in the navigation space with sequential models. But it's not clear whether they are a particularly good inductive bias for GPS coordinates over time. We can point to the existence of these representations. So it is essentially a memory that you are building over time.