It's great that you feel it's "too big" now because you've effectively hedged against future carat shrinkage. In time you'll feel it's a perfect size.
If you're ever in a situation where the ring makes you feel uncomfortable you can always flip the stone down or wear just your wedding band. In the meantime, you'll adjust to rocking that rock!