Weird. Their opening times page says "5 January - 4 February 2004: closed for annual maintenance". I'd say try and find something else to do and not bank on it being open

Tate Modern is not bad if you like going around galleries. Most of it is free as well.