Add doNotPerformUpgrade setting (#2297)