Or, with the cell selected (via keyboard), press Ctrl+K.

I agree that it is annoying. Does anyone know how to tell Excel whether you want a clicked link to open in a new window or an existing window?