Works fine for me. Are you by any chance in Seek Tool info-mode? That changes the controls somewhat.

(Later) I managed to reproduce this; I think it's related to whether the end of the first song is in the cache, and not connected with the info mode. If I hold the left button for long enough (5 or 10 seconds), it eventually rewinds across the track boundary. Is this the case for you?