The grey stuff is thermal compound that is likely all dry and chalky now. You will need to remove the old and add new thermal compound to create a thermal bond between the CPU and Heatsink. Popping it off and then putting it back on broke the bond and if it ever runs again it will probably overheat or run on the hot side of the operating range because of poor thermal conduction between CPU top and bottom side of heatsink.