Cannot go back after doing zoom on the map

I am in a middle of a activity, I did a zoom in/out on the map, I hit the Back button and it cannot go back.  My auto zoom is disabled.

I need help. Thanks!