You can uninstall Internet Explorer from the software list. However, I recommend you keep it installed because not all websites are made for Firefox. However, the chances of running into such a website are quite slim and Firefox's superiority makes up for that.
Rather than uninstalling Internet Explorer, I suggest you set Mozilla Firefox as your default browser. It will ask if you want to do so when you launch Firefox.