Tools / Options/ General tab / under Send/Receive Messages check the "Send & Receive Messages at startup" box.
This is true for Outlook Express, but not Outlook.
For Outlook 2003, go to Tools, Options, Mail Setup tab, and check the box for "Send immediately when connected".