I never take mine off. Ever.
A quick scary story. My bff growing up married a jeweler so she had a magnificent 5 carat emerald cut stunner as an ER. She summers at the Jersey Shore and has lots of kids. She regularly took off the ring to smear sunscreen on the kids because it got her ring gunked up. She always carefully laid it on the towel and always replaced it after she finished with the kids. One time she looked down and the ring was gone! Long story short...they looked for days, scoured the shoreline, hired professional metal-detector guys, everything. She still thinks to this day that a seagull picked it up and simply flew away with it.
I'm just sharing because she told me to never ever take my ER off....she said lotion can be cleaned, settings can be remounted but the heartache of knowing SHE lost the diamond was too painful.