Another option would be to install a second network card in one computer and enable internet connection sharing. Plug the internet connection into one network port and the other port into the switch, which the other computers will also be plugged into.
Network cards are pretty cheap to buy and it's supposed to be pretty easy to set up internet connection sharing on Windows (I've never done it myself).