Well, everyone thanks for all your advices and helps. I couldn't get it running. I bought a new Power Supply Unit cost $80 bucks but it didn't work. I gave up fixing it. I bought a new motherboard $70 bucks. It solved the problem. Luckily, this new motherboard takes my old CPU, and other old parts except memory I have to buy different type. It costed me $239 bucks to get my computer back to work. Thank you too all of you worked hard with me. This topic can be close now.
Merry Christmas and a Happy New Year to all of you out there!