Revert "Allow FlutterTester to be provided with the working directory for execution (#21119)" (#21453)

This reverts commit 857bdc7a.