A lot of it are things that I don't wear often - either because it's too recognizable or it's "certain" wear type of things... my go to's every day are plain basics. I tend to bring the fashion pieces in the accessories, it makes it all more versatile.
However, that doesn't stop me from having 30 pairs of jeans... and 15! plain black tee shirts, of different cut and size. Plus plain tees in every other color of the rainbow. :/ I purged, then definately binged to refill, hahaha
You also don't have to splurge... I bargain shop a lot at TJ Maxx or clearance racks... but I just don't buy ANYTHING anymore unless I love it and can't live without it. That's part of the reason I'll only shop in store. My wardrobe might have 300 pieces in it... but I can lay in my bed in the mornings and mentally go through all my clothes, what's washed and what's not, and plan my outfit for the day in my head without getting out from under the covers. HTH...