How did you measure that?

Don't forget the input capacitance of the pins on the 2 devices. (and the wiring we need to add to get the fan controller hooked in)

It definitely adds up -- and 100K is pretty big. That's 50uA of pullup current.