It could be a ground loop. Have you tried plugging and uplugging different things on the back of your computer to see if the noise goes away?

When I got an extra-sensitive pair of headphones, they revealed a ground loop that I'd never heard before. I discovered that if I unplugged the USB cable between the player and the computer, the ground loop went away. Which was OK for me since I prefer to use ethernet anyway.