Well, what you're describing is indeed the classic symptom of a bad battery. You may have bent the battery holder where it's not making good contact. To remove the battery, it's only necessary to pry the contact up a bit and just push the battery out the open side of the clip.