I don't think it is THAT delicate. I have not had any issues with any of my lambskin Chanel items -purses or SLG's. Frankly it is the only leather that I truly LOVE. My caviar purse and card holder are ok, but I rarely use them because they just don't feel as nice as my lambskin purses and wallets. When I use the caviar or patent leather ones I am fine with them, but I dont look at them and my heart screams - oh my this is gorgeous!!!! Like it does with my lambskin items.
I guess it depends on what you call baby-ing. I never throw any of my purses around and I don't rub them against hard surfaces. I am careful when going in and out of them when I have rings on where my diamonds are higher set so my hand wont get caught on any edges. I do this for ALL my purses though. Even my less expensive LV canvas ones that are supposed to be workhorses. Frankly I worry much more when I am using my patent leather totes as the shiny exterior shows WAY worse when it is scuffed. IF you plan on kicking your purse under a table or rubbing alongside cement walls or you are going to carry water bottles inside the purse you may want to use a non leather item. If you will be mindful where you set it down and when near rough surfaces you really should be ok with any leather!
I have a black jumbo in lambskin that the bottom half got SOAKING wet on a boat trip last spring and I was FREAKING out when I saw that it had gotten wet. I carefully dried it out and you would never know that the leather got wet. I of course don't ever recommend getting ANY leather items wet but the purse looks and feels as soft and as amazing as it ever did and is no worse for the wear. Frankly I was stunned that it didnt show any changes to the leather but I wasn't complaining. I am MUCH more careful on my boating trips now though because the panic that I had that day was exhausting. Mostly because that purse is one of my absolute favorites.