I tend to shy away from using my black purses in the summer. My warm-weather clothes are typically pastels or bright happy colors. I have lots of colorful purses to go along with those clothes, and so that is what I usually wear.
I live in the suburbs, and I am a SAHM so that could be partially responsible for my choices. I think, though, that if I lived in the city and worked in an office, I would probably be wearing more urban camoflage (i.e. black, tan, gray) and then in that case, my black bags would get more use in the summer.