To be honest he wouldn't mind me replacing it at all, but it wouldn't feel the same to ME to wear a "wedding ring" that he didn't slip onto my finger at our wedding all those years ago.
i hate to say it, but eventually you'll get over that stigma.
i lost my original wedding set a year and a half after we were married and thankfully the insurance sent us a replacement check to buy a new set. so yeah, i had no choice in the matter and at first, i was really really sad. but eventually, you do get over it. it also helped that my husband wasn't distressed over it either, even though he loved my original set because we picked it out together. i ended up getting something completely different not because i didn't love my original set, but because nothing could replace thatnot even a replica. it was gone, plain and simple.
even now i wear my mother's e-ring (that was not her original e-ring) that she handed down to me over a year ago. i love it and i wear it everyday. my replacement set is gorgeous (an emerald cut stone), but i guess since it wasn't my original set, it didn't have the meaning to me that my original one did. this one (my mom's) has more meaning to me than anything. i was 7 years old when we went into NYC down to the diamond district to buy it and it was back then that she promised me she would one day give it to me. turns out it was an estate ring as well which i love.
like others have said, it's a personal choice and i honestly don't think you should make yourself feel guilty over it. there are many couples who for whatever reason when they first get married cannot afford the rings of their choice, but as long as they're together, that's all that matter. well down the road, things change and so do your tastes.
you have to go with what makes YOU happy and go from there.