Well, again, you can also preview your pages in your browser. Your browser will recognize any file with a .htm or .html file extension. Try it with Notepad. Just create a simple page. It could be:
<html>
<head>
<title>My test page</title>
</head>
<body>This is just a test page.
</body>
</html>
Just copy the code above into a Notepad window, save it as testpage.html, and then open it with your browser. When saving file, make sure it doesn't get saved as testpage.txt or testpage.txt.html. In other words, when you save the file in Notepad, you need to type the full name, including the file extenstion; otherwise, Notepad will save it as testpage.txt.