It doesn't bind to each interface explicitly, but to 0.0.0.0

It can be told to bind to specific interfaces with the bind interfaces parameter in the config file. At least 2.2 can.

I never did try binding it two the two different interfaces and playing with the order though, so maybe that could be the solution. I'll have to try that during a less busy time for the box.