If the simulation accuracy is not a problem, the frequency shift may be due to your LC structure.
Supposed a LC osc with a PMOS tail current source, it is well known that the operation point of the differential pair will shift from Class A mode to Class C mode. if your tank capacitor is very big, the time for the frequency fully settling is longer.