After all the caches have been cleaned and the logic to cleanup runtimes
has landed we may not need to always delete the caches.

Bug: https://github.com/flutter/flutter/issues/114656