The RTC backup is not a battery, it's a supercap (.22uF ISTR). You won't need to remove it, it shouldn't leak. This is why the RTC only runs for ~7-10 daysish with no power - though the RTC cap is charged when the unit is OFF in-car (ie, can't be turned on with the buttons, but there is power on the yellow wire).

Hugo