It sounds bizarre, but lower the priority of the ssh process (using Windows Task Manager). It makes it go much quicker, and actually work.

Or it might be the rsync process that needs lowering. Try them. Alternatively, grab a copy of PuTTY and try using plink.exe from that instead of ssh. I've had good results with that, too.