See added comments for explanation.
This will prevent us from regressing on adding older versions of the unit test runner.