I have installed Office 2007 on my desktop (P4 3.06, 1GB RAM) and my girlfriend's laptop (Toshiba Libretto U100, ~1Ghz PentiumM 512MB RAM, not the fastest nor the most powerful laptop). Neither computer has shown any performance change since installing.
So to answer your question, no slowdown here.