I tried making an earlier Shuttle quieter and found that it was pretty hard to do so.

The main culprit was the tiny high RPM fan inside the PSU. If your power requirements are reasonable then something like a PicoPSU could replace it. As for whether its worth spending that much is up to you...