I think a pale pink cardie would look fine with the white bag and take away the sailor element to the look. Black and blue looks great and again, I think you could still do the white bag. I have the Colette special issue Hermes scarf that has all of these elements, gold, white, royal blue, navy blue/black and it looks super on a black jacket.
Whatever color you do, you can add a scarf with colors to lighten the overall look.