Retrieval and the Future of Attention

I'm curious with this perspective on recommendation with embeddings. The way that I see recommendation that it's typically been done by these symbolic ranking models. Do you think those kind of models are still valuable? Does body think about training those kinds of models? We'll just change our idea of attention and I think retrieval is valuable and maybe that'll even become the future of attention.