Nearly a second delay when switching screen with Di2 button. How do I avoid this?

 Here is a video: https://streamable.com/2yux9q

Feels bad to use like this. Especially since I have to wait between each click because of the doubleclick feature.

I suspect part of the delay is the system waiting to check for a doubleclick. How do I unbind doubleclicks to reduce the delay? I really wish to move two screens when I press the button twice and three screen when I click thrice