It's also been my experience that the tap water in coastal areas is usually much worse than in other areas. It's been less bad in the last ten years or so, but I can still smell what seems to be sulfur in the water, and it tastes funny, too. Unfortunately, sodas are usually canned/bottled/fountained with the local water, so getting one of those doesn't usually help.

Just get bottled water. Not much other way around it. You could be all european and get sparkling water, I suppose, if that would help alleviate the concerns about purchasing water.