I do, but there is one black bag (L.A.M.B. Music Offbeat hobo) that I don't use in the summer cause it seems to wintery- big hardware, thick leather, etc. It depends on the bag.
In contrary to most girls here - I NEVER carry a black bag in the summer!
I feel that it doesn't tie in with my outfit or pulls it down.
I try to avoid wearing black in the summer though (it gets really hot in Australia), and when I do wear a black dress I will usually throw on a panama and a light coloured clutch