Watch keeps going to the activity screen by itself

my watch (forerunner 255) keeps going to the activity selection screen without me touching the button. I sometimes only notice when the battery saver notice comes up.

Is there some kind of gesture or anything that might be causing it?