PHP is interpreted on the server, so it's going to add a small penalty, depending on how much processing you do before you start to serve HTML. It's usually negligible however, and I would never think to myself or say to you "this site is slow."

You can affect the perceived speed by moving the logic around within the PHP as necessary/suitable and trying to output some HTML as early as possible.