I've never had a problem with my Platy. It could be stale water in the hose maybe but it wouldn't explain the plastic taste.

Just in case, what you can do is detach the hose and spin it rapidly. This will cause the water in the hose to fly out.
_________________________
http://rrooa.blogspot.com/ <-- There's my two cents. Reviews and other things so go trough the blog archive. Check it out and leave comments.