Is it possible to be allergic to your implants?

I had a silicone nose implant in 2013 and started having nerve problems a few months later. 4-5 years later, I now have full-blown Lupus (a serious autoimmune disorder that results in death sometimes). I am in my early 30s. I am convinced it is the silicone (even though I understand the link is questionable) and will be swapping it with a rib as soon as I have the 14-15K it costs for revision with rib :-/ NONE of my family members have this, my grandparents lived until over 100, and I've been in perfect health my entire life. Now I can't go out into the sunlight or I am crippled for days. It's ridiculous and I can't wait to remove the silicone.