The problem is that users learn where things are. Then they resize the window, and things aren't where they used to be. There's a reason that consistency is bullet-pointed in pretty much every UI design text ever.

It's actually much more intuitive for it to have fallen off the edge of the window than it is for it, and everything else around it, to have been rearranged.