Its a combination of the feathers and the fabric.

I have a "down" matress and I have seen the small feathers go through the cotton cover, a denim liner then a 100% wool army blanket and flannel sheet just to poke me in the small of the back in the middle of the night.