Yes. Use a Nalgene bottle.

I'm sorry; it's early Monday morning where I am, and I needed a little kick-start to my week. The only bladder I use is an MSR Dromlite, and I only use that for carrying filtered water to a dry camp. I've never detected any plastic taste, even in water that's been sitting overnight.

However, I did (a couple years ago) buy the hose and fitting to turn it into a hydration system, just to see if I might want to make the switch. I did notice a slight plastic taste after attaching the hose. Could it be that the taste is coming from the tube, not the bladder?