If you are connecting to the player via the serial port instead of through USB or Ethernet, then it is expected to be slow.

If you are running version 2.0 beta 11 of the software without Hijack, it could be the jiffies bug which makes the player freeze for 20 minutes at a time. Try either adding Hijack (which fixes the jiffies bug) or downgrading to 1.03.