心理科学 2018, (2) 459-465 DOI:     ISSN: 0412-1961 CN: 21-1139/TG

本期目录 | 下期目录 | 过刊浏览 | 高级检索                                                            [打印本页]   [关闭]
统计、测量与方法
扩展功能
本文信息
Supporting info
PDF(510KB)
[HTML全文]
参考文献[PDF]
参考文献
服务与反馈
把本文推荐给朋友
加入我的书架
加入引用管理器
引用本文
Email Alert
文章反馈
浏览反馈信息
本文关键词相关文章
CD-CAT
多策略认知诊断
多策略RRUM模型
两步选题法
本文作者相关文章
戴步云
张敏强
黎光明
汪新光
胡姗
PubMed
Article by Dai,B.Y
Article by Zhang,M.J
Article by Li,G.M
Article by Wang,X.G
Article by Hu,p
可以兼顾策略、认知状态和能力的CD-CAT选题方法
戴步云1,2,张敏强1,黎光明1,汪新光1,胡姗3
1. 华南师范大学
2. 江西师范大学
3. 江西省非物质文化遗产研究保护中心
摘要: 当CD-CAT测验需要同时诊断被试的解题策略、认知状态并评估被试的宏观能力时,就需要在选题过程中兼顾这三个测量目标。用两种不同方式将多策略香农熵(MSSHE)指标与Fisher信息量相结合,提出多策略情境中的DWI指标MSDWI)选题法与“先用MSSHE后用Fisher信息量”的两步选题法。基于多策略RRUM模型(MS-RRUM),将这两种方法与随机选题法在不同属性数量条件下进行模拟比较,结果表明:当属性数量为4个或6个时,两步选题法在策略判准率、认知状态判准率和能力估计三个方面都有最佳的效果。
关键词CD-CAT   多策略认知诊断   多策略RRUM模型   两步选题法  
A CD-CAT Item Selection Method Containing Strategy, Knowledge State and Ability
1,2, Guang MingLIXin GuangWANG2,shan HU4
Abstract: Cognitive diagnostic computerized adaptive testing (CD-CAT) has become an increasingly important testing mode. Item selection methods are currently one of the most pressing issues in the field of CD-CAT research. For some tasks, not only a participant’s strategy and knowledge state (KS, i.e., attribute mastery pattern) need to be diagnosed, but also his/her macro ability needs to be assessed in CD-CAT. For the sake of high efficient, item selection methods for this type of CD-CAT have to consider the above three purposes. The Multiple-Strategy Shannon Entropy (MSSHE) index (Dai et al., 2015) and Fisher information index were combined to produce two new synthetic item selection methods in this paper. The first method was the “multiple-strategy dapperness with information” (MSDWI) index method, in which the MSDWI index was the Fisher information index Multiplied by the reciprocal of the MSSHE index. The second method was the “two-step item selection method”, in which items were first selected using the MSSHE index and then selected using the Fisher information index when the test length reached a certain value. Based on the multiple-strategy reduced reparameterized unified model (MS-RRUM) and independence attributes, under different lengths of fixed-length CD-CAT and with various numbers of knowledge attributes, three selection item methods were systematically compared in the present study: the above two methods and random method. The strategy, KS and macro ability recoveries were considered as evaluation indices. Experiments were repeated 20 times using the MATLAB 2012b software package. Groups of examinees were simulated, and each group was composed of 1000 examinees. In the simulation, examinees answered the items that were selected by a certain item selection method, and their strategies, KSs and abilities were estimated. Then, the estimated values were compared with the true values. Results showed that with respect to strategy, KS and ability estimations, the two-step method always yielded the best performance when the attribute number was 4 or 6. When the attribute number was 8, the two-step method yielded the best performance with respect to strategy and KS estimations; however, the random method yielded the best performance with respect to ability estimation. In single-strategy CD-CAT which considering KS and ability estimations meanwhile, the “dapperness with information” (DWI) index method which was “in one step” was proper (Dai, Zhang, & Li, 2016). However, according to the current study, in multiple-strategy CD-CAT which considering strategy, KS and ability estimations meanwhile, the MSDWI method which was “in one step” was inappropriate. Instead, the two-step method was better. Besides, for this context, it is not proper to involve too much attributes in a single test. This study performs the CD-CAT which considering three purposes meanwhile, and provides a theoretical foundation for more complicated cognitive diagnostic modeling in future studies. A proper item selection method in this CD-CAT context has been proposed, making item selection efficient and saving item bank.
Keywords: CD-CAT   multiple-strategy cognitive diagnosis   multiple-strategy reduced reparameterized unified model (MS-RRUM)   two-step item selection method  
DOI:
基金项目:

通讯作者: 张敏强
作者简介:
作者Email: 2640726401@qq.com

参考文献:
本刊中的类似文章

Copyright by 心理科学