Yes, the slots definitely loosen, but they're supposed to. When I first got each of my wallets, the slots were extremely tight - so much so that it was incredibly difficult to get the cards in and out. I had to actually stick my nail underneath to prise them out the first few times! I wouldn't accept a wallet with loose slots, because that would mean it was either used or a display/item that has been shown to and tried out by other people.
Anyway, yes, it's normal for the slots to loosen but don't put more than one card in each slot or they may loosen too much!