Moving devices to another port and not working makes sense though. Windows has to treat them as different devices so still "reinstalls" them when you move ports. Every port will do the same.

So it appears the driver/device installation is a problem rather than the specific driver itself.

Certainly I'd look at fixing that PCI to PCI bridge.