There are some 3rd party programs, which will lock down Internet access, but I didn't find any free ones.
Another option would be to create another account for your kid.
I don't remember, how it was in XP, but in my Vista, I can right click on any program (like "iexplore.exe"), and set it up to be run as Administrator only. This way another profile user won't be able to start IE.