Revert "Ensure VmService instance is disposed after failed direct connection attempt (#66123)" (#66164)

This reverts commit 409e994c.
Co-authored-by: Jenn Magder <magder@google.com>