Oh, I would! Because that would mean that I might get to borrow his bags too
Anyway, I don't think there's anything wrong with a man carrying a bag, I might react if it was something very, very "girly", but in a good way in that case too, because then I would think it was probably carried in an "ironic" way or something, and then it might be cool because of that.
In general, I like people who carry and wear what they like, no matter what other people think, and a man carrying a tote qualifies into that category.