You could do that if you really wanted to... The display board PIC probably wouldn't like you having long wires though.
Also if you botch it and break the display board then it's going to be expensive to fix and nearly impossible to replace.