You don't. Sad but true. Mine used to start almost twenty miles south of me. A year later it started more or less to be more centered on where I start my rides.
I don't know what it's based on, typically websites do it based on IP location which also can be hoakey. But in my case most other services show my IP north of where I live. I never found any showing my IP south of me.
