Pool swim stops recording distance mid activity

I've had this scenario a few times now...

Mid swim set my watch will stop recording distance

I'll press the 'back' button to start a new interval as usual, but the distance for this new interval will be stuck on 0 for the duration. Even if I end the activity and start a new one the problem persists. Come back the next day and everything is working again.

See below - the intervals highlighted are recorded as rest?