Activity tracker stops towards end of day across software versions, please help

My Fenix 5X tends to "fall asleep" and stop recording steps towards the end of each day after a period of me standing still.

The watch only starts tracking upon being shaked vigorously/after moving for a while.

Is anyone else seeing this? My watch was replaced under warranty but the new one is behaving in the exact same way.