A Bayesian Student Model without Hidden Nodes and Its Comparison with Item Response Theory

Abstract : The Bayesian framework offers a number of techniques for inferring an individual's knowledge state from evidence of mastery of concepts or skills. A typical application where such a technique can be useful is Computer Adaptive Testing (CAT). A Bayesian modeling scheme, POKS, is proposed and compared to the traditional Item Response Theory (IRT), which has been the prevalent CAT approach for the last three decades. POKS is based on the theory of knowledge spaces and constructs item-to-item graph structures without hidden nodes. It aims to offer an effective knowledge assessment method with an efficient algorithm for learning the graph structure from data. We review the different Bayesian approaches to modeling student ability assessment and discuss how POKS relates to them. The performance of POKS is compared to the IRT two parameter logistic model. Experimental results over a 34~item UNIX test and a 160~item French language test show that both approaches can classify examinees as {\em master} or {\em non-master} effectively and efficiently, with relatively comparable performance. However, more significant differences are found in favor of POKS for a second task that consists in predicting individual question item outcome. Implications of these results for adaptive testing and student modeling are discussed, as well as the limitations and advantages of POKS, namely the issue of integrating concepts into its structure.
Type de document :
Article dans une revue
International Journal of Artificial Intelligence in Education (IJAIED), 2005, 15, pp.291-323
Liste complète des métadonnées

Littérature citée [43 références]  Voir  Masquer  Télécharger

https://telearn.archives-ouvertes.fr/hal-00257164
Contributeur : Jerome Zeiliger <>
Soumis le : lundi 18 février 2008 - 15:41:32
Dernière modification le : lundi 19 mars 2018 - 22:38:02
Document(s) archivé(s) le : jeudi 20 mai 2010 - 22:39:10

Fichier

poks-irt.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00257164, version 1

Collections

Citation

Michel C Desmarais, Xiaoming Pu. A Bayesian Student Model without Hidden Nodes and Its Comparison with Item Response Theory. International Journal of Artificial Intelligence in Education (IJAIED), 2005, 15, pp.291-323. 〈hal-00257164〉

Partager

Métriques

Consultations de la notice

298

Téléchargements de fichiers

292