You're probably blocked waiting for IO the remaining 80% of the time. Adding more threads could very well increase the number of head seeks and reduce readahead (due to increased memory pressure) which slows you down more than you gain. I guess you're on windows, why not try to defragment your drive first.