It's not random actually. For each current visual or info mode you're using, a coresponding one is selected when you enter the menu structure. I wrote down how the info modes map, but I can't begin to map the visuals.

Today with my hard-to-see dark red lens, I was able to switch from SpectroFlip to AnnaVu almost entirely without viewing the screen. It's always nice to get around that easily.