Why Should My Liberty Be Determined by Some One's Conscience?

Paul says in verse 28, but if some one says to you, this has been offered in sacrifice, then do not eat it. For the sake of conscience, i do not mean your conscience, but his. And so there's this kind of capstone, a set of verses here at the very end of chapter ten: Do all to the glory of god. Give no offence to jews or to greeks or to the church of god. Just as i try to please everyone in everything i do, not seeking my own advantage, but that of many, that they may be saved.