And when a Republican votes in the Democratic primary, he can also vote in the Republican primary, too?

No.

In an open primary, all the names are on the ballot. You can choose one name for each office, regardless of what political party the candidate espouses.

This means you get to choose whom you consider to be the best applicant for the job, period, regardless of party affiliation.

tanstaafl.