›› 2019, Vol. ›› Issue (3): 747-754.

Previous Articles     Next Articles

The Methods for Measuring and Controlling Response Styles

Ying-Bin ZHANG1,2, 1   

  1. 1. Beijing Normal University
    2. The University of Illinois at Urbana-Champaign
  • Received:2018-04-18 Revised:2018-10-27 Online:2019-05-20 Published:2019-05-20

反应风格的测量与统计控制

张缨斌1,2, 王烨晖1   

  1. 1. 北京师范大学
    2. 伊利诺伊大学厄巴纳-香槟分校
  • 通讯作者: 王烨晖

Abstract: Response styles are one of the major sources of common method bias. They refer to the tendency to select specific categories of rating scale. The most common types of response styles include acquiescence response style, disacquiescence response style, extreme response style and midpoint response style. They can cause subjects’ response to rating scale biased, and thus, they may lead to systematic measurement errors in test scores and influence the results of the analyses of test reliability and validity and the analysis of the covariation between constructs. It is hard to measure response styles directly with a psychological scale, and thus researchers usually use the counting procedure or the modeling procedure to measure it. The counting procedure mainly includes the traditional counting procedure, the method of representative indicators for response styles, and the method of counting double agreements on reversed items. The modeling procedure mainly includes the method of specifying acquiescence response style in confirmatory factor analysis, confirmatory latent class analysis, the mixed partial credit model, the item response tree model and the multidimensional nominal response model. When selecting appropriate methods to measure response styles, researchers need to consider the following questions. Firstly, what types of response styles they want to measure? Secondly, are response styles regarded as continuous or categorical variables? Thirdly, is the content-related trait regarded as a continuous or categorical variable? Fourthly, can researchers obtain a group of heterogeneous items? Fifthly, are there some pairs of items that examine similar content but are worded in opposite directions? Lastly, is the number of positively worded items equal to the number of negatively worded items? As for controlling the effects of response styles on data analysis, different procedures are appropriate in controlling different effects of response styles, and in some cases, it requires researchers to combine the measuring procedure and the regression residual method or the partial correlation method to control the effects of response styles. Firstly, to control the bias that response styles cause in test scores, researchers can apply the modeling procedure or the combination of the counting procedure and the regression residual method. Secondly, to control the effects of response styles on the analyses of test reliability and validity, researchers can apply the combination of the modeling procedure and the regression residual method or the combination of the counting procedure and the regression residual method. With respect to the control of the effects of response styles on the measurement invariance test, researchers can apply the procedure of specifying acquiescence response style in confirmatory factor analysis, confirmatory latent class analysis or the multidimensional nominal response model. Thirdly, to control the effect of response styles on the analysis of the covariation between constructs, researchers can apply the modeling procedure, the combination of the counting procedure and the regression residual method or the combination of the counting procedure and the partial correlation method. Future research needs to extend the existing methods for measuring and controlling response styles, examine the validity of them, and systematically investigate the effects of response styles on data analysis.

Key words: response style, common method bias, acquiescence response style, extreme response style, rating scale

摘要: 反应风格是共同方法偏差的主要来源之一。本文首先讨论反应风格的定义和类型,梳理其危害,认为反应风格能使测验分数出现偏差,影响测验信效度分析和变量关系分析,有必要控制其危害。然后介绍了常用的反应风格测量方法,包括计数法和模型法两大类,对测量方法的选择给出了建议,在此基础上,就如何结合反应风格的测量方法与残差回归法、偏相关法来控制反应风格危害给出建议。

关键词: 反应风格, 共同方法偏差, 默认肯定风格, 极端反应风格, 评定量表