Set the jumper as slave and connect it to the middle connecter that the other HDD is hooked up to...
The jumpers are located between the power and 40 pin connectors on the HDD.
Also check the main HDD while you're in there. Some of them including Western Digitals need to be jumpered "master w/slave present" to work properly.
The master should be on the end connector of the ribbon cable.
After re-connecting everything boot up and open Windows Explorer. If the new drive is not listed then it needs to be formatted first before Windows can use it.
To do this right click My Computer and select Manage...then select Disk Management.
Find the new drive listing, right clik it and select format.
WARNING: Make sure you select the correct drive...formatting the wrong drive and you will lose all your data.
Let us know.