I have an Apple Watch as well, and I have the Hermes double tour band. I also have nicer watches when I go out to a nice dinner or need to get dressed up because the Apple Watch is def a more casual watch
I have the Hermès watch as well and have been recently looking into a more fancier watch because as you mentioned, it is more casual.