Remove the roll-off caps in the player?

Depends on your player version and whether they are fitted. It is also not guaranteed to work - however, I started doing it as standard on repair players and I had a significant number of surprised responses from owners saying "the alternator noise has gone!" including on the most troublesome of cars to put a player in, a BMW.