any bag can work for any gender as long as the proportion is right. for example, a Chanel medium flap probably wouldn't look right on a man (like you're carrying a "woman's bag") but a maxi flap probably would. of course if carrying a "woman's bag" is the look you're going for, then who cares what everyone else thinks. be like Pharrell wearing a shorts tuxedo to the Oscars - everyone said it was a fashion don't but he didn't care.
I agree here. Carry and use what you want and enjoy it. Life's much too short to burdened by what other people might think.
Revel in the fact that you are confident and happy with yourself!