Virb Elite Doesn't Switch Off!

Recently been having problems switching off my Virb Elite - I press and hold the power button; the unit displays the round 'power' symbol, the indicator lights go off, it even beeps - and then powers back up again! It's very annoying! How can I solve this problem? What am I doing wrong?

Has latest firmware (3.9?)