You need to go to the App Store on the iPhone or via iTunes, and download the app called "Podcasts" from Apple.

This link should take you right to it in the UK store: https://itunes.apple.com/gb/app/podcasts/id525463029?mt=8

iOS 7 split out the Podcasts function into a standalone app, and it's not bundled with the OS anymore.