Not necessarily a very useful comment as you're using virtualbox, but parallels works fine with both prolific and ftdi usb-serial adaptors (winxp under parallels, driver installed on winxp).

The USB support of different VM apps is hugely variable...