Don't forget to check what wfaulk did with his vnc server over in the Empeg BBS
as Bitt did something similar for the empeg and there may be a existing codebase you can use to save having to reinvent the wheel.

Have a search in the empeg BBS programming forum for vncserver.