Of course, brick, stucco, concrete, or even steel/tin siding are all good materials to use, depending on where you are.

Yes, I should clarify. Hardy Plank is good stuff to use instead of wood. I think brick looks much nicer, but if there's going to be "wood" on the outside of the house I'd make sure it was Hardy Plank (or another brand of fiberboard).