I've found it's hard to silence a large roomy desktop case, let alone a tiny little box like that.

Yes, the PSU is a major culprit, but you'll also run into trouble quieting down the CPU cooling fan and the video card cooling fan.

I'd recommend just googling for products that are specifically designed to quiet down the Shuttle. SilenX is a good place to start.