I think background app refresh may be separate from location services, and facebook still tracks your location in the background. Try also turning off location

I think background app refresh may be separate from location services, and facebook still tracks your location in the background. Try also turning off location services for fb (or set it to only when in use). Settings>Privacy>Location Services