When you started your reply with taking off your glasses and saying "First of all!" That was a little agitating so,,,, relax.
It could also be the persona you reflect to them. Maybe when they see you and your outward appreance they fear you to cause an issue? You being a Yankee, from Chicago with no accent may complain to there boss or leave a bad review of their bussiness? Yes racism is real and everywhere but being nice sometimes is just being nice.