Hi,
When you look at an IIP3 simulation/measurement you will see that for medium powers the traces follow a slope of 1 and 3, for higher levels of power the mixer will go to compression. So you must choose an input power level were the slope of 3rd order is still 3 and make a linear extrapolation of the intercept point.
Hope it helps,