Yeah, restarting the game is a bit of a mess, now, eh.

The simplest fix for it is to have the menu DEFAULT to the game (rather than the VolAdjust). That way, four clicks of the same button and you're back in quickly. I've made that adjustment in my copy now.