I think you wear both sizes well. Perhaps it comes down to how much you intend to carry? Although, I suppose that's always the case when deciding between different sizes.
Even though some people laud the longer strap length on the small.....I think both bags look better hand/arm held anyways.