I had to clean my old D70 occasionally, and I used a q-tip and isopropyl alcohol. So long as the q-tip was wet, I never had any issues of it leaving bits of cotton behind.

My D700 has some kind of anti-dust gizmo, and I've never had the problem.

Lots more details and options here.