Rick points out that water is generally only stored in a container for a short time which minimizes the leaching of any chemicals, so there is that to consider. Time, Heat, and Light, are things to minimize when storing water and none of those are difficult to manage.

Now, what I now is use a collapsible bottle that is made by Enfamil, which is very similar to what you're linking to. These will accept very nicely a activated charcoal filter made by Britta .

This combination is very light, very packable, and offers some protection against at least some of the contaminants that may be in the water.

I can't convince myself that the bottle or even the filter doesn't add anything bad, but I am convinced it does remove things that I can taste and I know are bad.