The Only Trade-Off Is That You Don't Trust the People Who Run the Federation

You definitely have to trust the people that run the federation, but not every single one of them. You need to trust them as a whole, that they will not conspire against you. If there was a federation where the guardians don't really trust each other, that might actually be a good option because then they have a harder time conspiring against you.