What setting do I have to change to keep my altimeter updating in real time?

My altimeter never changes. I live at 6667 feet, and that is all my Fenix 5 ever shows on my watch face. I know it's tracking it somewhere because my activity tracking shows the variations through the activity.I have to assume that I have some setting somewhere incorrect but I can't seem to identify that setting. I also figure that keeping it on all the time will blow the battery pretty fast, so it would be great if there were an easy to find and change toggle somewhere that doesn’t require tons of menu diving.

Thanks