What do you do with your locks on your Speedys?

I keep mine on the end tab, and the keys in the pocket inside. When I'm storing it, however, I do take it off and put it inside the bag so it doesn't leave marks, or stretch, or so I don't misplace it!
 
I like when the keys are locked onto the lock and then locked onto the bag! but I would hate for it to warp the leather tab. I wish they could add some little metal ring to it or something.