Previously in some rather esoteric cases involving global keys reversing
relative positions we would forget to build everyone.