If you have a spare 12V or 5V or 9V or whatever V adapter laying around, then a nice way to dial in the exact voltage that the batteries were giving, is to purchase a very cheap DC-to-DC voltage converter.

Tony recently got a couple of those for his BlueGigaEmpeg project.
Very cheap from Asia on eBay (like maybe, $1/each), somewhat more from more local retailers.