Actually, this is a GREAT point that is being brought up. I truly beleive that the size you are should change the bag you buy. Like some ladies said- you don't want a bag that hugs your shoulder/arm and get's lost. You would not want to spend good money on a bag that draws attention to you the wrong way. And if you are shorter/petite, you may not want a huge bag that might hang funny or over power yourself.
Handbags accessorize your outfits and style- but you always want to make sure that you are accenting your 'goods'! That is why I always need to try on my bags and see how they make me look. Because what looks good on you, sure may not look good on me!