Your phone is using GPS and Google services like maps is good at getting around blocks.
You would need to turn off GPS and then it would only get Cellur, wifi or bluetooth info.

What is your threat level?
I like to keep things private as much as possible.
I am working from from home and don’t want my boss knowing I am sitting on a beach.
I am a polical refugee in a opressive county with state forces after me