With my own experience of a fly away I don't think most of these are pilot error, especially if the phantom takes off in a random direction at high speed.
My theory is these are losing the RC control signal on the 5.7-5.8Ghz band and responding to interference instead, there is supposed to be...