You are using linear law pots instead of Log law, which is the correct one for audio gain applications (your ear works logarithmically also).

I would recommend Nylar foil pots, not cheap, but no crackle and they last a long time. A company called Sychron used to make them in the UK years ago, but I can't find any reference to them now.