i have black caviar jumbos with silver and gold. I thought i have it redundant but i use both of them. I will have a hard time to choose either silver or gold, since both serve different purposes. when i wear gold jewelry , i wear jumbo with gold hardware, and when i wear silver jewelry i wear jumbo with silver hardware. You can't go wrong with both hardwares.
I wear both white and yellow gold jewelry together daily so for me it isn't really an issue of matching the hardware to my jewelry but I do think that the gold gives a bit more of a dressed up look then the silver which looks slightly more modern to me.