It certainly could be a faulty power supply or some kind of a ground loop problem.

You could try a different power supply and see if the problem goes away.