I carried mine to HS, it was fine...I was the only one at school, but it was just 'part' of mine, kwim? I had a LV keepall for band trips, and a few gucci purses I used and alternated with other bags. I was very matter of fact about it, and never braggy, and I think that made all the difference. One group of guys nick named me, gucc....and it was fine, it wasn't meant meanly....anymore than nick naming someone red who has red hair....if that makes sense.
So I say go for it! Enjoy your bag, don't let others change who are, what you like.