It sounds like it takes the first 2 minutes to find the first satellite, and then 2 minutes further for the current almanac to be downloaded/decoded, after which time it starts to have a look at which of the satellites it should use - which apparantly also takes 2 minutes to decide...

6 minutes TTFF from cold, and 8 to stability... Doesn't sound great.

But bear in mind also that time of day can affect TTFF - if you happen to be in a location that can only see 6 satellites at a particular time, and 2 of those are blocked by buildings, then TTFF is going to increase. (Nominally you should be able to see 8 SVs or more - but the constellation isn't perfect)
ie, retest that binary in a couple of hours time in a wide open space and see if that changes anything.