Virtual Partner Confused?

I have my Fenix 5Plus a few months now and all works great except the virtual partner function.

The first time I did a virtual race (against an existing run in the watch's memory) it worked fine until I got to the point where I usually have a break for a few stretches.
Then it was off by a few minutes. Well, I thought, it is not able to deal with pauses in a 'race' that might be understandable...
Hoever since then, whenever I tried to race a previous run or set a target time on a course it shows I am 16 minutes ahead straight from the start. It changes a little during the run but not by much...

I am on the latest software version; 6.00

Anyone seen issues like this, know how to fix it?! I really hope so as I think it would be a very useful function to help motivating and improving myself.

Thanks,