Ummh.. Are you really sure you connected everything OK? The power amps really have to have very low input impedances for the voltage to drop significantly. And can't you just turn up the gain a bit?

Sorry if I misunderstood the situationn....