Actually, I was the one meddling. It's just that I saw "belkin" and "wireless problems" in the same post.
Fair enough. Wireless is always an issue. The OP ends to tell us if there is a situation where things are better with all devices working.
There is a situation where connection will fail after the first computer is turned off. Some ISPs look for the main computer as a form of ID for the user.
This is why routers have a 'MAC clone' feature.
Not knowing this you can run in circles.
Also, some ISPs will not like it if you have too many people on your connection. Or they may even forbid you for having extra devices, but not enforce the rule in a polite way.
Sp it is helpful to know who the provider is and what policies they have.