If you don't want to remove it then they can usually be muted quite substantially just by sticking a piece of tape (or even better, chewing gum/blu-tac) right over the hole in the piezo element.

Gareth