If your printer is connected to a computer upstairs, you can share it on that computer and to use it that computer needs to be online.
If there is no computer upstairs then you will need to either connect it to the router with a Ethernet cable or USB, then setup depends on your router.
It may need a IP address or the Router may handle it differently.
Can you give more info?