Interestingly Apple have just taken a step to make things like that easier to do. They are releasing a commandline only download of the bits of their dev tools (or rather some of their tools and their builds of various bits of open source) needed to build things without the full Xcode.