How to cancel saved location while panning the map

When I pan the map, if I accidentally tap the screen, the device interprets the tap as a location of interest and it displays its coordinates in a banner at the top of the screen.  Is there a way to dismiss the banner without exiting panning mode?  Tapping on the banner only gives you an option to ride to the location.  If you tap the menu dots in the corner of that screen, it only gives you an option to save the location.  If you tap the map again, it just interprets that as a different location.  Seems like you should be able to dismiss the banner and remain in panning mode.