Layers is the answer. Also as a heavy sweater, fleece is a good choice. Pick a quick dry shirt, pull on a good breathing fleece when you stop. I carry a wind breaker too, very light, just to stop wind while resting if wind is very strong. Also in really cold weather over fleece if needed during breaks. If you need a lightweight break for snow or rain use a poncho. Breaths very well. I cannot use rain gear pants or shirts due to sweating.
_________________________
Never Pass Up a hike!