AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Basic Idea of VCRAG and Borrow Twins
Borrow Twins and VCRAG are two ways to look at mutual information. Borrow Twins uses normalization, while VCRAG does not. The idea is that you want the variance of each of the variables of both of those vectors to be non-zero. It doesn't matter what it is, but it needs to be. So some people have called this dimensional collapse.