Well maybe I'm just being too European, but what's the alternative? I loath those knee-long, flappy & ridiculous contraptions what pass as 'swimwear' here... They must be hideously uncomfortable as well.
On the whole, I don't think speedos on men look any worse than bikinis/swimsuits on (even slightly) overweight women.
Only when watching on TV "syncronized diving" on the Olympics.....
-still have flashing memories-
Maybe what the OP means is it's fine when it's your man giving you eye candy ???