The HTTP 1.1 RFC recommends that each client use only two connections per server. This is more of an "honor system" thing, web servers typically don't limit you from having more, but most "well behaved" clients have a limit of two per server.

IE's setting for this is in the registry. Go here for where you can change it.