For the ever-increasing prices, I expect pretty near to perfect. By that I mean no issues with stitching, glazing, scratches on hardware, etc. I would absolutely return for those reasons. A tiny lack of symmetry, no, I wouldn't.
I've had generally positive experiences with LV over the years, fortunately. My only real negative experiences were firstly with a hot-stamped piece purchased online, which I had to return for a replacement because the stamp was smudged and very messy. They didn't argue with that when I sent photos of the item. The other occasion was with a wallet which had poor glazing -- it split open after a matter of weeks of extremely light use, and then again in exactly the same spot shortly after a repair. The manager I dealt with tried to tell me that I may have overstuffed it or not taken proper care of it, which was not the case. I had to tell him that I'd owned much less expensive wallets for years and had never experienced anything like that. There's really no excuse. After contacting their headquarters I eventually received a refund, and bought a different style of wallet which I've owned for seven years and have never had any issues with.
My only gripe with LV is that sometimes they need to acknowledge that an item is faulty. It happens. It's not a big deal, as long as they stand behind their products and offer a replacement where appropriate instead of making excuses and attempting to place blame on the customer.