Rummaging around a second hand shop or your box of old power adapters may reveal some that directly output the desired DC voltage.

3 volt output (or thereabouts) will substitute for two AA batteries.

4.5 volt to 5 volt (give or take) adapter would power the 3*AA light string.