Wrist band either too tight or too loose, is there a way to adjust it by 2-3 mm?

I have Fenix 5 Gray with the stock wrist band and I am fighting to find a comfortable fit. If I use two neighboring adjustment holes on the wrist band, one brings a too tight fit that sometimes generates pain around the wrist, and the other one brings a too loose fit with the watch sliding away from its expected position, which sometimes causes HR not to be measured. The distance between two neighboring adjustment holes is 5 mm and I need 2-3 mm to make the fit snug. Is there a way to do this?