Control Panel - Power Options - Choose what the power buttons do (set the power button to shut down).
That's not what the op asked. The op asked (well not really asked, but stated) how to turn off the "media light" and the volume light. The power button options can make the computer shut down, not, or ask what to do.