Whenever it's warm enough to wear a summery outfit, i.e. may-august where I live, or on vacation all year round.
Not that I would mind seeing a white bag anytime of the year, but I would probably feel silly carrying it together with warm winter boots & mittens.