Is your Hard drive SATA or IDE cabled?
If it's SATA it's a red fat cable, only can be plugged in one way round and in the same shaped ports. The motherboard should have small print labelling SATA1, SATA2, SATA3, and SATA4 on each port to connect, use in order. No need to worry about jumpers.
If it's IDE it's got a red strip on the side (gray ribbon cable) to show the direction it should be connected. IF multiple HDs make sure you connect them in order of master then slave (if on cable select jumper). Don't confuse the jumper pins in the middle as connectors.
Then you also need a (white) power cable per HD. Use a direct one that hasn't also been used for the graphic card or fans, etc, if possible. Ensure the pins for this aren't loose, it's a tight fit and sometimes one or more of the pin(s) can move out loosing connection. These cables are coming from your Power Supply Unit (PSU), not the motherboard.
IDE top / SATA bottom
Check your motherboard manual for layout if needed.