there should be a box that pops up and asks if you want to delete from this playlist only or from all playlists (which removes it completely).