Found this observation in the context of #4157. If the user e.g. stops the app early by raising SystemExit in post_init, then App.start is never called, hance App.stop is never called, but App.post_stop is still called.
Will do this as follow-up to #4157.