I don't have a solid answer, but you could go to Preferences within Garmin Express, and turn off keeping it running in the background. That may work. You would then have to check for updates manually.
If you mean Garmin Express opens fully when you start from powered off then you should look in your user settings to see what items are there to open at start.
