I remember being told that that the reason '&' is called an ampersand is because the alphabet sung by children many, many years ago included 'and' at the end of the song.

They would sing "and per se, and" (and by itself, and), which ended up becoming slurred into a single word.

While I know the per se part to be true, I have no idea if the children singing it is true or legend.