고등학교 수학 과목 자동문항생성 문항모델의 Q-matrix 타당성 검정 연구

초록

Along with the development of technology in education, many studies on automatic item generation (AIG) have been done for the last two decades or so. Item models in AIG hold premise of known attributes associated with the item models. In this study, we examined the conformity between the premise and the attributes found via item response theory model in high school mathematics class. Cross-validation on the conformity has been conducted using linear logistic test model within Rasch model in test theory, focusing on the item difficulties of the item models. The validity was examined between Q-matrix from contents experts and Q-matrix found from item response theory model. There was some discrepancy between the two Q-matrices and it is suggested that item developers including classroom teachers confirm the Q-matrix from item response theory model. It should be noted that such cross-validation inform that item models developed in classroom setting would be used in high-stakes tests with reliability and validity improved.

키워드