It's been a while since I've had a computer with a floppy drive, but it used to be standard boot up procedure to check for a floppy first during the boot process, before going to the hard drive.
Usually, though it just took a second or two to confirm no floppy was present. Is yours taking longer than a second or two?