The ISO setting affects the voltage that is fed to the amplification circuitry on the sensors. Higher voltage means more sensitivity, but also more noise. Lower voltage means a cleaner image, but longer exposures required.

So, no, not just for JPG images. It also matters for RAW.

-ml