Fixes #9989

Previously, we would strand the old route in the overlay even though it had
been removed from the history.