Heart rate too low during activity

I am so frustrated with my instinct. Every time I star an activity the heart rate drops and either remains around 60 -80 bpm. The first few times I used the watch t was ok and I know my hr goes up to 180 during my activities. What is wrong? How can I fix or work around this??