No. Nor before Labor Day, nor on Labor Day.
However, bags that are cream, bone, champagne, eggshell, buff, ivory, or even some of the more robust off-whites may be worn anywhere or any time that you are not also wearing a sweater, a coat, mittens, or other warm-weather wear, UNLESS one or more of those items is also cream, bone, etc AND that item is one that will be seen with the bag even when you go inside and take off your wraps. Which means that at least one item of your actual clothing must also be that color.
IF you live in a climate where people own coats but only extremely wealthy, eccentric, or foolish people own sleds, then one of those items can be your shoes, however, that would mean you had matching bag and shoes, which may not be a look you want to rock, unless you are even older than this rule-set, which goes back quite a ways, and which I wish to all applicable deities, djinns and spirits that I could shed, because
I WANT ME ONE OF THEM WHITE BAGS!!
AND I DON'T CARE IF IT WOULD MAKE ME LOOK TRASHY, I COULD, AFTER 55 YEARS OF UNRELENTING ELEGANCE, PROBABLY DO WITH A DASH OF TRASHY NOW AND AGAIN.