The only thing to worry about is ground loops. If it happens, try grounding the RCA shrouds to the chassis and see if that gets rid of it.

Oh, and headphone outputs have to be turned down much lower than line-level outputs or they will be distorted. If your discman has line-level outputs, use those instead.