Clothing is a major stumbling block for me, too, in reducing pack weight. I get cold easily, and fast, and really hate being cold for any length of time. I'm 70 now, but I've always been this way (but it's not getting any better:)

So, I always (including summer)take light long johns, long pants, a light down jacket, a fleece, and a long-sleeved shirt, as well as a hat and gloves. Even though all are fairly lightweight, they add up.

My in-the-pack clothes add up to 4.26lbs. at the lightest, including socks, raingear, etc. And I'm liable at the last minute to decide on heavier pants and an extra pair of socks (3 total). Or maybe the better, 2.5oz heavier rain jacket