Unfortunately I only had transparent tape, so it didn't solve the issue...
From the Garmin Connect mobile app, I was able to get rid of the exclamation mark by removing the device and re-pairing the device with my phone. Seemed to clear up the issue for me.