I hand-deleted each file, and still ended up with "refs=0" files, so I guess it's not that simple.