If it's not for the safety issue, then he's probably the kind of person who cares what others say/think. But guess what? I think it's just in his head. How on earth can he actually know what others would say/think? Just ignore the comment! It's your bag; wear it whenever and wherever you like.