I never use the inner snap button either. It used to drive me crazy that it was there but now I've forgotten about it & like that it's there for the added design of the bag.
If you wanted the caviar, then return it for the caviar. You'll never be satisfied otherwise. It's too much $$$ if you're not 100% happy.