Interesting... I just added the tonesOn and vibrateOn to my conditionals in the Alert service. And the tones no longer play when my Alert method is called.on my Edge device. Even though I checked and Tones are enabled on my device. So it seems, at least on the Edge, that tonesOn() doesn't actually work as described. I have not checked on my Fenix 5XPlus. Tones do play if I remove that part of the conditional.
"The tone setting mode. return [Toybox::Lang::Boolean] true if tones are enabled on the device, otherwise false"
if (Attention has :playTone && System.getDeviceSettings().tonesOn) { ... }
if (Attention has :vibrate && System.getDeviceSettings().vibrateOn) { ... }