Map - Go - Movement direction not working

If I just open the map, my location is displayed.
If I now select a different point and press "Go," meaning I'm navigated there,
the map or my navigation arrow isn't aligned so that I'm following it, but rather points in a different direction.
In the map settings, I've set "In direction of movement."