What is the TTL set to for your domain? It'll be cached for that amount of time.