Create soup playlist, select "On Device" (unless you only want this as organization inside of jEmplode):

Add Tag Layer => Artist, Sort by Title
Add Tag Layer => Album, Sort by Title (seems like some people like to do a Sort by Year here for the album layer)
Add Sort Tracks Layer => Sort by Track #

It will then manage the playlists for you.