He said something to the effect, "Do you really think because it says Italy it still wasn't produced by someone making pennies a day?"
It's more likely his jeans or his shoes were made by exploited workers than your designer handbag. But either way, anybody who wears clothing they didn't make themselves cannot act all self-righteous toward people carrying designer handbags.