"When a power supply works properly, voltages all fall within an acceptable range (plus or minus 10 per cent). However, be aware that even if measured voltage falls within the appropriate range, a power supply can still cause problems. This is because problems with power supplies can be intermittent - in other words, they come and go. Therefore, if the voltages are correct, you should still suspect the power supply is the problem when certain symptoms are present. To learn for certain whether the power supply is the problem, replace it with a unit you know is good."
CompTIA A+ Guide to Managing & Maintaining Your PC, 6TH Edition, page 1220 by Jean Andrews
This is what we're taught in school, and probably the best reason to swap in a known good power supply.