Try this:
Open a folder that you know is slow to sort, and right click in the folder, (in an empty area, not on a file) and choose "Customize folder", and in the Customize tab, locate the "Optimize this folder for:" dropdown, and make sure it is set to "General Items".