For me it takes quite a long time, up to several minutes.
this watch should just work as it should and I should not worry about such details.
You are right, to some extent.
All the points I mentioned above are a result of various limitations of GPS technology. GPS receiver designers take measures to minimize this (like for example updating EPO or CPE from your phone), so normally a GPS fix in a modern device should take a relatively short time. If none of the points applies to you, and still you see long GPS fix times, then there might be something wrong with your device.
You might want to read this, if you're interested in some details: