The words themselves may be harmless, but they do carry a lot of baggage with them now because of their use in Nazi Germany, so people would have to be pretty careful about when/where/how this phrase is invoked. It's just like the swastika, which is an ancient symbol used throughout the world (and continues to be a part of Buddhist symbology), but I'd wager that the first association most Americans make with it would be to Nazism.