Sounds like a problem with your phone’s GPS system not updating quickly enough. Alternately, if this is a very urban area with lots of skyscrapers GPS may wand

Sounds like a problem with your phone’s GPS system not updating quickly enough. Alternately, if this is a very urban area with lots of skyscrapers GPS may wander significantly as the signals bounce around the buildings.