Yes, you're much better off using just the pair wires rather than to attempt power line or wireless connections. The power-line network connection is for situations where you absolutely positively cannot pass a wire under a window under a doorway or make a very tiny hole in the wall.
Of course, Ethernet cable is rather thick, about the size of your little finger. But it's possible to have a suitable network using just the two pair of very thin wires. This type of connection can sustain 1 Mb for very long distances, like over 500 feet. For shorter distances, say under 100 feet you can get up to 10 Mb per second.
There is a company that goes by the name of t
"Two Wire" and they got their start making USB devices that would tie into a two wire or four wire telephone cord. Any kind of wire works, I used a very long extension cord, with suitable connectors of course, and it worked very well from my barn over to the RV trailer where my daughter lived for a while. However, it is not Ethernet compatible, so you have to set up network sharing for the thing to get you onto a local area network.
Here is the link for the company:
http://www.2wire.com/Notice that they make many different kinds of network products. The two wire interface was one of their earlier things.