First:
USB drivers are part of the OS. you don't need to install separate drivers. Unless the USB has some set of extra features, or it is something like a composite USB device (with something that doesn't have built in drivers), in which case the drivers are part of those installed with the chipset.
There is clearly some confusion over what a chipset is and does and therefore what the drivers are for. the chipset involves all the various IO chips on the motherboard. Not surprisingly, this includes the components responsible for USB connectivity. For Windows XP, sometimes if you don't install the chipset driver, XP will only use it as a USB 1.1 device/root hub, until you install the chipset drivers.
Yes. There <are> drivers. But that is clearly a case of pedanticism, since judging from context Allan meant that USB doesn't <need> separate drivers- like you need usually for video cards, sound cards, and so forth. Floppy drives have drivers too, but nobody goes on the internet looking for the fastest one, because there simply isn't one. Once you have the proper driver for the hardware, assuming there are no awful bugs in it, your hardware is pretty much already being used to the fullest extent. It's like people who think a newer video driver can make their MX2 able to support Pixel shader 2. Utter nonsense perpetuated by youtube videos where people play games released last year on vintage pentium PCs by "usin tweaks lol".
Truenorth: your suggestion to "disable" was close; the common tact is to uninstall them, and have the machine redetect them when it restarts. This doesn't change the driver itself- it is still the same, but the registry information and various other settings will usually revert to their defaults.