Use a file rather than sandpaper, and just knock the corners off, making the plastic bits more round than square.

Or.. extract the contacts from the square plastic enclosures, and melt some shrink wrap onto them in place of the plastic. Should fit no problem that way.