Making my first quilt. Considering the side that would go under me would compress to the point where it's basically offering no insulation, should I bother insulating?

My thought was that when the air just has a chill to it I might want just an uninsulated top cover, but to have an insulated part for when the temps drop even more. Basically thinking of early fall, late spring, when overnight temps can swing a good deal.
_________________________
Life should not be a journey to the grave with the intent of arriving safely in a well preserved body, but to skid in broadside, thoroughly used up, worn out, and loudly proclaiming Wow! What a Ride!