I get the impression that the player stores a copy of the fid database in memory.

It does. And you can probably compress it reasonably well. The Karma database uses a more efficient database scheme, so maybe that'll turn up in one of the later v3.0 alphas or betas.