I know lambskin requires more care than caviar, but I bought a caviar flap and was just not happy enough with it. I find the lambskin more special. I also find that although it requires more care than caviar, it is not overly difficult to care for.
However, if you don't think you will be using the bag or will be too afraid to wear it, then you probably are better off exchanging it for something in caviar.