If you are old enough to appreciate Hermes and care for a bag as it should be cared for, as ANY of your possessions should be cared for, then you are old enough to carry Hermes, be it a Birkin or Kelly or a CDC clutch, (as long as you can afford it without causing financial problems or it was a gift or whatever.)
It's not anyone else's business what bag anyone else carries, IMO. There are certain things I don't think are appropriate, such as bike shorts if you weigh 400 lbs or low rise jeans if it gives you a muffin top or tube tops if you are 75, etc. But a handbag? Nah.