No, you dont have to have the amp hooked up. All you should really need is MEMORY, IGNITION, and GROUND. I dont suppose you have a meter or test light to check if you have power on the MEMORY wire. Do you have an old factory deck to plug back into the old harness to ensure that you are getting power?