I really wouldn't think so. I have a fairly light color, Mandarin, and it has held up really well, even wearing it with jeans. If there is any dirt that happens to make its way onto the bag (which is rare) it just wipes right off with a damp cloth.
I have the bowling in the epi ivore and it's not hard to maintain at all. I thought I had a mark on it and wiped it with baby wipes and it came right off. So far it's held up with my 6 month old and 4 year old in tow!
i too have the bowling gm in ivorie too and it's been a cinch to maintain. someone spill a bit of coffee on my bag and it just wiped off. i do notice that the parts where the hardware rubs against the bag, there are some dirty "metal" marks but they rub right off with babywipes. i also spray leather protectant on it just to be on the safe side. i'm more worried that the light colored threads that are sewn on the handles will get dirtier than the bag itself.
Ivory Epi leather is very easy to maintain! I've had my Epi Alma Ivoire since March and there's not one dirty mark on the leather....just wipe off any marks with baby wipes or soft damp cloth, they'll come out right away. Just be careful with scuff marks on the smooth leather....