Hand washing my down quilt alleviated any anxiety about wetting the down to the degree that it clumps and loses all loft. It's actually hard to do.

I would worry about down in winter more, when the frost point can move inside the bag shell.

it depends on where you go too, and for how long. A Few nights in a relatively dry climate are nothing. In very humid places, where drying in the sun doesn't do much good, it's harder.