Hixie pointed out that what I had before was resetting all of the MediaQuery values, not just textScaleFactor. This should fix that.