That's right. It could be your windows firewall or any other firewall. Normally windows firewall doesn't allow remote desktop connection. To enable it, got to control panel > Windows Firewall > the Right Most Tab > Settings for your local network , then tick the box labelled "remote desktop".
That might help.