Does it always boot OK when you have the flash drive unplugged? If that's the case then it could very well be that the PC is trying to boot from it like CaTaLyST said. Try disabling boot from USB legacy device in the BIOS.