I believe the OP is talking about distance away and not altitude above the ground.
To the OP, can you provide more details about your setup? What mobile device are you using? What type of area are you flying in? Lots of house or other structures that potentially are providing interference? Do you have a clear line of sight between you and the drone?