10Mbit and 100Mbit Ethernet use two pairs; Gbit Ethernet uses four. Almost all Gbit hardware will fall back to 100Mbit if needed, so unless the church needs tons of bandwidth between those two switches, you would be OK stealing two of the pairs for voice.

Peter