I live in a large city - I carry a BIRKIN and no one knows what it is (there's no boutique here), although if I carry LV, it gets noticed.
If no one knows what it is, and you love your belt, then wear it.
It's funny because the fact that H is not recognised here means I carry H because I love it, rather than for the status/recognition effect, which is why some people may wear Hermes. (By this I'm thinking of certain "celebrities"
).
It might be too flashy if the environment you are in is a less-well off one. If it isn't recognised then no-one knows its worth or what the H stands for so it's ok. I remember reading on here about a tPFer with a Constance (I think).
Someone asked her what the "H" stood for, and she said "handbag"! People only know as much as you tell them, so don't worry and wear your belt.