I would suggest the advance calibration out of the box.
Do the one in the Naza software then go do the compass calibration. Once calibration is completed you won't need to recalibrate unless you crash hard or it starts to act up.
The fly off issue had me concerned as well but I have only...