Fenix 5X, pace dropping out frequently for seconds.

I am using a Fenix 5X and experience pace drops for seconds at a time and multiple times during a paddle exercise. This leads to the average pace to be lower than average moving pace. Any ideas how to fix it? Using GPS + Glonass and Galileo with almost identical results.