This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Instant pace is not accurate and has bias towards slower than actual pace

It appears instant pace on my Fenix 6X Sapphire has a consistent bias towards a slower than actual pace, often by 0:30-1:00 min/mile. 
That makes it more difficult to pace accurately, for example during races. It seems the bias is worse on more challenging terrain, for example on trails or under tree cover.

To understand this better I wrote a python script that parses a run activity that I export in TCX format (for easier parsing because TCX is a text based format).

Here are some examples of my script output. This is from a faster paced trail run on moderate tree covered trails:

Mile 1.00: Split: 8:42, Avg Pace: 10:04
Mile 2.00: Split: 8:52, Avg Pace: 9:22
Mile 3.00: Split: 8:37, Avg Pace: 9:17
Mile 4.00: Split: 8:04, Avg Pace: 8:31
Mile 4.53: Split: 8:03, Avg Pace: 8:03
----------
Overall pace 8:30, Avg Pace: 9:08

In this example Split time is produced every mile based on elapsed time from the beginning.
Avg Pace is produced by looking at the instant speed reported each second in each sample, averaging it over all samples of that split, and then converting that average speed to pace format (in minutes per mile). Basically Avg Pace represents the averaged result of what the watch was showing me during the run.

If anyone questions that approach, it should be OK to average the speed because it is sampled at even intervals every second (it wouldn't be OK in the case of smart recording).

As you can see there is quite a bit of discrepancy, especially in the beginning, although it gets better towards the end. Overall, after averaging, the watch reported 0:38/mile slower instant pace than what I actually ran, so there is a strong bias towards slower pace.

Here is another example - this is from a mix of road and suburban trails on more open terrain:

Mile 1.00: Split: 9:07, Avg Pace: 9:22
Mile 2.00: Split: 8:04, Avg Pace: 8:09
Mile 3.00: Split: 10:49, Avg Pace: 10:43
Mile 4.00: Split: 10:35, Avg Pace: 11:30
Mile 5.00: Split: 8:23, Avg Pace: 8:18
Mile 6.00: Split: 13:05, Avg Pace: 13:39
Mile 7.00: Split: 7:58, Avg Pace: 7:56
Mile 8.00: Split: 9:08, Avg Pace: 9:34
Mile 9.00: Split: 8:11, Avg Pace: 8:44
Mile 10.00: Split: 8:43, Avg Pace: 8:46
Mile 11.00: Split: 10:08, Avg Pace: 10:13
Mile 12.00: Split: 8:22, Avg Pace: 8:32
Mile 13.00: Split: 8:29, Avg Pace: 8:30
Mile 13.76: Split: 10:02, Avg Pace: 10:00
----------
Overall pace: 9:21, Avg Pace: 9:32

Even though this is much better overall, during some miles the discrepancy between the split times and the averaged instant pace was still up to 1 min/mile.

One more example - this is from a much slower mountainous trail run on steep terrain with a good amount of walking:
Mile 1.00: Split: 9:44, Avg Pace: 10:17
Mile 2.00: Split: 11:44, Avg Pace: 12:15
Mile 3.00: Split: 14:14, Avg Pace: 14:08
Mile 4.00: Split: 29:14, Avg Pace: 27:51
Mile 5.00: Split: 17:40, Avg Pace: 20:02
Mile 6.00: Split: 12:23, Avg Pace: 12:43
Mile 7.00: Split: 12:36, Avg Pace: 13:46
Mile 8.00: Split: 11:53, Avg Pace: 12:34
Mile 9.00: Split: 14:34, Avg Pace: 15:07
Mile 10.00: Split: 24:11, Avg Pace: 23:23
Mile 11.00: Split: 8:50, Avg Pace: 8:46
Mile 12.00: Split: 12:23, Avg Pace: 13:31
Mile 13.00: Split: 10:46, Avg Pace: 11:50
Mile 14.00: Split: 16:09, Avg Pace: 16:42
Mile 15.00: Split: 17:20, Avg Pace: 17:51
Mile 16.00: Split: 13:23, Avg Pace: 13:32
Mile 16.68: Split: 11:14, Avg Pace: 12:32
----------
Overall pace: 14:40, Avg Pace: 15:15

In this case the instant pace was faster than actual in a couple of splits, mostly in very slow ones where I walked or stopped. But the overall pattern is the same - there is a clear bias towards a slower pace.

I should add that today I installed a Rolling Average Pace Garmin IQ field that averages pace over the last 100 yards. I placed that field next to Garmin's Instant Pace and watched them side by side during an easy run. One thing was clear, every time I reached a steady pace and cruised for a while to let the rolling pace stabilize, the rolling average pace was always a bit faster than Garmin's Instant pace, which confirmed the same bias that I discovered from the post-analysis of the runs with my script.

Has anyone had similar observations?

12/05/21 EDIT: I changed the title of the post since Garmin seems to have improved the pace. It is more stable and precise than before, meaning that the values are closer together, but it is still not accurate - there is still a significant bias towards slower than actual pace

  • So if someone gets an accurate official distance in a race, there is a good chance that their watch is actually too short.

    This I dis-agree with because I usually run with a second watch (usually because the pacing is better) and the Fenix is never really shorter than the Polar V800. So either both watches are short - and in my case, I do appear long anyway, last measured 10 mile race I came up 10.15.on F6. The road races I run on open roads, and you really just cannot be wandering all over the place, you keep strictly to the left, running with not against traffic - yes, obviously you could wander a bit, and that will deviate from the official measurement, but you could also corner cut in that scenario too, and be genuinely short. I do not see this point as very compelling.

    And also I am running with a Coros Pace 2 at the moment, and the F6 Pro isn't coming up short - over a 13 mille run recently, there was 65 meters difference, F6 Pro being 65 meters shorter. 

    I am REALLY REALLY sure my watch is not measuring short, and I just didn't notice :)

    Maybe the Titanium of the 6 Sapphire may be a factor vs stainless steel black is possible - although I ran a measured half this year with a standard 6 Pro and that didn't come up short vs. the official measurements or with my Polar V800.

    Personally speaking I am only happy to make declarations of shortness or longness if I know the distance, and by know I mean really KNOW not think you know, as this is an absolutely key variable for any further calculations and even better have a second watch as an additional control point. In those scenarios, the shortness issue has never manifested itself (for me at least)

  • Sure. I compared my 6X against Suunto Ambit 3 Peak multiple times. On open terrain distances match. On wooded trails 6X falls behind by about 5% or sometimes even more. But if I take 6X distance from the recorded track points (for example, by doing distance correction in Strava), distances generally much. 

    I also compared 6X distances against certified trail courses or well know trail distances, and I generally see it is being short by about the same 5%. 

  • fenix6s owner here and I agree the amount of issues with distance I don’t see and it’s comparable with various different generations of Garmin and other brands, it’s always in the middle of relative long/short on road, trail or cross country. Sure the averaging of pace seems to have increased to stabilise it and because you start from a slower pace it seem to weigh towards the slower pace but it’s just long averaging in the run profile only. 

  • Sure. I compared my 6X against Suunto Ambit 3 Peak multiple times. On open terrain distances match. On wooded trails 6X falls behind by about 5% or sometimes even more. But if I take 6X distance from the recorded track points (for example, by doing distance correction in Strava), distances generally much. 

    I also compared 6X distances against certified trail courses or well know trail distances, and I generally see it is being short by about the same 5%. 

    Fair enough - your analysis is very compelling and its intuitively very easy to how how and why you'd see shortness in these scenarios.

    I wonder if my watch would be 'short' running your courses?

    Conversely, I wonder how your watch measure on the ones I run?

    I think we are in danger in going all GroundHog day and repeating the same points, but I hope any fix for you, does not break it for me!

  • Yesterday I went on a walk around my neighborhood with 4 devices: Fenix 6, FR245, Fitbit, and my phone. The FR245 measured 1.25 (which is also what Garmin calculated when I created a course in GC). The Fitbit and phone were 1.22 and 1.21. The Fenix 6 was 1.19. So again it is the clear outlier. I will say that when I created a course using an old run (recorded using the FR245) and exported it to the Fenix 6, the 6-mile course ended with the Fenix 6 distance at 5.96 miles. I'm not sure why it's more accurate when following a course. That very same path, when I just did a free run using the Fenix, was measured at 5.75 two days earlier. It's very strange.

  • I have the same problem with a brand new Fenix 6 Pro (version 19.30). When GPS signal degrades, instant pace keeps going down despite cadence, HR, everything being the same. I registered today an activity using both the F6 Pro and my "old" Instinct Solar: https://connect.garmin.com/modern/activity/7948817676 (F6 Pro), https://connect.garmin.com/modern/activity/7953256299 (Instinct Solar). It is kinda impossible training at a specific pace if a tree or a short overpass (you can see using the satellite map) cause these inconsistent paces..

  • I registered today an activity using both the F6 Pro and my "old" Instinct Solar: https://connect.garmin.com/modern/activity/7948817676

    Your instinct activity isn't availanle, and your F6 Pro activity shows you were paired to a Hovr set of running shoes with a built-in footpod...'

    • Under Armour UA Hovr Infinite 3'

    Are you sure you are not mistaking footpod performance for GPS performance?

  • Now the Instinct activity should be available. I never knew my shoes had a footpod, I don't think I ever tried to associate them to the devices. The most interesting part is between minutes 36:00 and 46:00, where clearly the F6 has issues with the GPS signal, while the Instinct is almost stable (little drop around minute 38).

  • If you want to PM me the .FIT files from both, I can produce an interesting graph for you. I can't get the FIT files from your links.

  • Here is the pace graph for the Instinct and F6 from the files from @dariofac  - instinct in blue, Fenix 6 (7948817676) in purple