* Revert "Add pub cache, artifacts, pkgs to Cirrus cache (#20080)"

This reverts commit 07e93b38.

* Revert "Reduce noise on the memory benchmarks (#19630)"

This reverts commit 8eb5cb7d.