It's safe to unplug it at any time, unless you're in the middle of a sync -- the drives are mounted read-only. So, unless something catastrophic occurs, your music is safe.

As for leaving it plugged in all the time, I tend to. However, you might be concerned about the blinking LED -- it's quite bright.