See, LV is a status symbol. If a woman carries a LV bag it says something very specific about her lifestyle and her financial situation.
Often women that carry LV get it from their husbands/partners as a gift etc., which means that the husband/partner can afford the bag (easily). Therefore, the woman and the LV she carries become a symbol of their man's financial success. Men that feel inferior now envy this (unknown/maybe not even existing) man's financial success, and wonder if the bag is real. Because if it is not, they cconjecture the man is not well off and so not superior to them.
The same applies if the woman bought it with her own money, and that's even more devastating for a man.