it would be nice if cross fade was smart enough to not happen if Im "flipping" by songs quickly

As you've noticed, it does this. It's not being smart, though -- it just doesn't have enough of the next track preprocessed in order to do a proper fade, so it doesn't bother.