Is there a difference between charging a device while it is powered up or not?

I find that if I turn my phone off and plug it in overnight it lasts significantly longer than if I leave the phone turned on while plugged in. Is this something that generally happens with all devices (all phones/laptops etc)?