I don't really like black and brown together...I never have an all-black bag and the only black shoes I have are dressy.
I would wear a brown bag (khaki, not chocolate) with an all-black outfit, but I wouldn't wear a black bag with an all-brown outfit if that makes sense.