No problem, plenty fast enough (assuming it has a sensible amount of ram).
Although I currently would consider 128MB too little in a new computer; would it be sensible in this application? I have no problem buying more if there will be a noticeable difference in performance.

With Linux you can just telnet/ssh into the box, with Win2k you can install TightVNC.
Excellent, I forgot about Tight VNC.