It's come up a few times... Just do a "hate album" long press, and you're all set. It's not ideal, but it'll work.

Matthew