Not "rag and bone man". It's not a colloquial phrase. It says what it means; I just think it's in more common usage in Britain. This might be a misleading hint, as it's probably unlikely for you to think of it as a notably more British term.