Yeah, take that off. A little alcohol might be useful to reduce any gooey residue. Then apply a _thin_ layer of heatsink compound before re-attaching the heatsink. (Razor blades work well for this)