Hmmm... Exe's are executable files, they don't "open" with anything.
Unless... Are you sure you have your Folder Options set to show file extensions?
It could be that they are being hidden but the file is named, for example, file.exe(.mp3) < the ".mp3" being hidden?