It could be the router, or the placement, or poor wireless signal caused by interference, distance or even the walls.
Do you use any other devices wirelessly? Do you have the Roku a fair distance from the router? What kind of construction is your house? Thick stone walls are really bad for wireless transmissions, equally if you have any metal in the way that'll do a good job of stopping the transmission.