Kind of related, I'm the same way with my bike on a trainer. Perhaps it's due to the very stationary state of the bike, versus the natural side to side motion that you can have on the road and trail. Perhaps it's a deeper psychological impact due to being indoors?