No, not overreacting. If you're not comfortable engaging these people, that's all you need to know.
I'm probably the most open-minded, intellectually curious person I know and even I've moved beyind "agree to disagree." I can agree to disagree on a lot of stuff. I can hear the arguments, ponder them, whatever. But when it comes to human rights, when it comes to such a basic difference in fundamental values, I can't. I just can't.