but curiously...there are a subset of albums which always seem to repeatedly come up as the first album....and some others which never do.

Which, as far as I'm concerned, is a long-standing bug which should be corrected. So IMHO it's unrelated to your feature request.

An oft-requested feature is a "next album" key, which would be another completely different way of working around your issue.