I can't tell you how to carefully remove it. As stated earlier, this largely depends on what type of keyboard you have, and it's possible the keys aren't even made to be removed.
If you can't clean it, and you can't remove the key and put it back on, get a new keyboard.