I think it would probably work just fine with Xvfb. The problem with pretty much any other method is that, usually, X setups want a user to be logged in before they start up. I've successfully run other stuff that needed X (read Java) against Xvfb without needing a user to log in.