Perhaps some frequencies take different paths (or are damped more on certain paths?) to my ears.

Yes. This is one of the fundamental things that BBE processors do, is phase-correct individual frequencies to compensate for this kind of thing.