Yes, you can connect directly to the battery poles as you suggested. From the readings you specified though my guess is you have a bad (non-existant) earth, you could temporarily run a flying earth lead to battery -ve to check this out