Yup, samplerate conversion is important. Of course, so is the quality of the DACs on your digital amplifier.

Something else to worry about is digital bitstream jitter. This article explains it in good detail, and even specifically mentions sound cards in its discussion.