Nalgene makes a line of plastic bottles for laboratories called "Scientific Nalgene". They come in various sizes - even square and rectangular bottles and are designed to minimize plastic "bleed" and are non-reactive all sorts of chemicals. These come in an incredible variety that you will not find at an outdoor store. Just google "Scientific Nalgene".

Glass is used if you are sampling trace levels of volatile organics. Trace levels are not something that I would be too worried about.