Go to the Steam menu - Preferences
Easy for you to say.
I stumbled around through the Steam website for the better part of half an hour before I finally discovered...
That seems to have done the trick. I had previously disabled the Steam in the Windows Startup menu, but to no avail.