True, there are those who simply refused to go, but there are also a lot of people so poor that they simply couldn't afford to leave and don't have anywhere to go. Plus, if you remember, there was no way to physically get everyone out of town anyway.

Just because some official says something, it doesn't mean it's actually possible.