AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is Reasoning Implemented in the Model?
The model is basically a transformer, but special type of transformer. And can consider the different relations of a schima elements and as well as association between the question tokens with the elements in the scheme. Are like a table name, column name. And you can give something prior knowledge about this foreign key relationship and some initial evidence about which token in the question is likely to be linked to wich column. It's obviously doesn't capture all the different types of things that we wanted to do, but it already makes a bi big difference.