Use these stiffness modifiers to satisfy the drift requirement of the code. You shouldn't use the values lesser than the ones provided by the code; they are already on the conservative side.
Do not use these modifiers to check the strength demand of individual members. Make another model, without applying any modifier, to check the strength-demand. These stiffness modifiers will result in a design in which you would under-estimate the demand in beams, and over-estimate in columns.
The value of stiffness modifier for the wall depends on weather the wall is in tension, or not. If the edge of the wall is in tension, then the modifier is 0.35.