Sick of looking at my watch and always seeing my flashlight

I have had an original venu when it first came out and now 2 venu 3s. So I think I know what I am doing...

But 50% of the time when I look at my watch, either the flashlight or notification screen (swipe sideways or down) are showing. I am NOT swipping. 100% when I shower.

I know I can lock the screen,  but the I need to unlock for everything and that is a pita. 

Anyone else seeing this, or is my watch screen to sensitive or maybe I am brushing against things, or don't know what I am doing?