sounds like maybe he was hitting on you. At first, anyway! Maybe he was just trying to break the ice. But he could have done it a million other ways.
Him: I bet your bag is fake.
Me: I bet your hair is too.
I would have said "just because you can't afford to get your gf one doesn't mean you have to take it out on me."
I would have said "just because you can't afford to get your gf one doesn't mean you have to take it out on me."