I use qmail, vpopmail, BincIMAP and SquirrelMail. I can't answer the number of users question, but qmail is reputed to scale extremely well. I've heard good things about PostFix too, now.

See this page for how I installed my system.
_________________________
-- roger