It has almost no impact on performance. The 63 bit version never invokes anything from the old version of windows. But if it did, you would not want to remove it.
It t was left there for a reason. You can revert to the original install is needed.
Deleting the old version would free up a small amount of disk space. IMO, it is not worth the effort.