As far as I know, they would only affect speed whilst it was being accessed.
For most newer games, the disk only spins up briefly to check it is there, and that's it.
Even if it was being accessed a lot, it's usually just to load things, so a slower drive would only affect the loading speed rather than the in-game performance.