For me, it is two ugly shades of brown. I hate the Gucci monogram too, and MK. I don't care for Coach or Fendi monograms, but they don't bother me as much as LV, MK and Gucci. Goyard's is pretty subtle.
I think the reason LV is singled out as the worst is because they are ubiquitous. I don't hang around the LV forum but it is my feeling from the people I know that buy LV, that the majority of purchases are of canvas items, maybe not all the LV monogram. I've looked at LV leather items too, and many have a monogram as well. Then they have that giant LV hardware on some bags.
Gucci and Fendi make bags in leather that I like. Surprisingly, the GG hardware doesn't bother me that much. My MK bag from several years ago came with a hanging MK charm that I removed so now it is logo free except for the lining. The recent leather MK bags I've see all have a giant logo on them so even if I liked the style, I would pass. Coach is doing that a lot now too. My older Coach bags don't have a logo at all, or have a more subtle or smaller one.
Yeah, the two ugly brown colors... which probably remind people a lot of... you know.

I think Goyard pattern reminds me of Tessellations! Almost mathematical and 3D-like.