I see a sleeping bag as a safety net if your clothes should become unusable for some reason. If you fall in a creek, assuming you keep your bag in a mostly waterproof sack, you have a refuge. If you're wearing your sleeping when you fall in the creek you're in trouble.