That's exactly the same as in MP3 mode: press 'info' untill, say, track info is displayed; keep pressing 'visual': you will see the name of the visual selected (if that display is enabled), but you have to change info mode to off, line or transient in order to actually see it.

As somebody here put it, it is helpful to imagine info screen laying over the visual screen, the later showing only in the former has a 'window' for it.