To cancel the noise properly, the noise-canceling signal needs to be properly 180-degrees out of phase with the incoming noise. That means you really want to have microphones adjacent to your ears, so you're getting the exact signal that's trying to get through to your ears. That's more-or-less what all the active noise-canceling headphones actually do.

I don't think you could do nearly as well with a distant microphone.