Bitt, that actually uncovered the problem for me. The ppp scripts were running the firewall wrongly when a pptp, or incoming pptp connection was run. Since the machine has no modem, and no need of ppp beyond pptp, I simply commented out the lines trying to stop and start the firewall.

I have never dialed up with Linux, so all the PPP interfaces are new to me.