Words do indeed matter. I'm not a Christian, although I was rasied Baptist, I'm I suppose what I would call cultually Jewish but an athiest with an open mind, maybe more agnostic than athiest recently as I've just pciked up the conversion process again.
I don't know the hymn you speak of. But I can tell you I HATE repetitious music generally.