After playing with the measurement I am now sure the regulator is stable. I think the regulator is too noisy so the noise floor increases at high current. But I still don't know why the regulator would be that noisy. Anyone had any experience with noisy regulator? I did not add any guard ring to my regulator and no low pass filter at the reference voltage from bandgap.