When things go wrong with my (or a) PC this is the order I use to debug it:
First I remove all the not-so-necessary cards (soundcard, NIC,...)

Then I replace :

1) memory
2) motherboard
3) video card
4) harddisk
5) CPU

In that order. In case the CPU is an AMD I'd switch 4 & 5