Soup is the internal nickname for the folders named "Artists" "Albums" "Years" "Genres" and "All Tracks".

Now, when you delete something from a playlist, it does not disappear from the player, it stays there in the soup view.

You can go to the All Tracks screen and delete everything there if you like.