Screen turns off during activity

The screen in my 965 turns off during activity, even though I have the below option turned on:

During Activity/Always on Display (ON)

This worked fine when I bought it, seems to have broken after the last update (or I changed something by mistake). Any ideas?