The water I got for drinking smelled not really good.

This wasn't by any chance the water at one of our beaches, was it? Because that's salt water, y'know.... Seriously though, water varies greatly throughout the U.S. The clearest water (IMHO) tends to be well water in rural areas. In cities, the water is usually heavily purified, softened, etc. and is assuredly safe to drink, but may not have that crisp flavorless taste that you expect.

What can I do?

Bring your own crystal clear water from Germany maybe? Bottled water is available at any store, that may be better than what you're getting at restaurants, etc. The idea of paying for water may be a "tough concept to swallow" but if you find the tap water is intolerable, give the bottled stuff a go.