Yes! I have had the same problem w/my BV crossbody. When it's packed light, it's comfortable for short periods. But after a while, or when it's heavy, the metal clasp digs against my collarbone.
Then again... any heavy crossbody bag would have an issue of being uncomfortable. (Or any heavy bag, for that matter.) The only crossbody bags that I find truly comfortable are LeSportsac... large webbed straps make them comfortable no matter how much I weigh them down or how long I wear them. The only thing better are cushioned backpacks.