Uh... disconnect the USB stick and reboot?
Tails is a specialized distribution of Linux that works the way you described.
If you somehow ignored the warnings it gives and installed it to your hard drive then you will need to reinstall Windows or do a factory reset (if the recovery partition(s) are still intact).