The Underlying Mechanism of Attention

The underlying mechanism of attention involves three components or three sets of objects they're called query key and value. So you can think of it let's follow so say I have the sentence the cat is right and maybe you want to complete it to like furry or something like that Right? Let's start with the cat is three three words right so you're going to get three query vectors. One for each of those words. The similarity between the query word has those three dimensions it has three it's a triple yeah right. Okay so okay yeah anyways I was just trying to maybe make it more understandable how you can get. Sort of the large objective of emitting a coherent sentence merely from the objective of