Actually, I'm my opinion, no. If people debate the issues and not the person, it shouldn't matter. ;)
I will sometimes (often, even) take a position in a debate that varies greatly from my own, for the specific purpose of learning other points of view. If you can't understand someone else's...