If GPS is being used, the .fit will have your location.
You could use fit Contrib to store it if not.
And while I've not tried this, it's possible you could start up GPS, and then turn it off a couple seconds after your activity starts recording, and that would get it in the fit, without using it the whole time.