Computer can boot with devices plugged into USB port

When I restart my Dell desktop computer equipped with Windows XP with anything plugged into its USB port, everything goes well until it gets to the boot page where it stops. Whereas if I do the same procedure with nothing plugged into the USB port, my computer has no problems and will make it all the way to the desktop. How can I restart it successfully with any device plugged into the USB port?

 

Ok we need full specs on system.What version of Xp are you using 64bit or 32bit.What kinda mother board is it with serial code just in case we need to look into further problems.

And another question here is this a Clean Install of Xp.

 

Uh, try disabling bios boot from usb/other options before we think about windows issues. Is this device a jump drive or usb attached hard drive or some other device?

 

During the POST screen, press F2 to enter Setup and change the boot sequence so that USB storage is AFTER the main hard drive since, apparently, the USB drive(s) is/are a data drive(s).

 

Yes I do have data drivers plugged into my USB port.