Degree of error in Bayesian knowledge tracing estimates from differences in sample sizes

被引:1
作者
Slater S. [1 ]
Baker R.S. [1 ]
机构
[1] University of Pennsylvania, 3700 Walnut St., Philadelphia, 19104, PA
关键词
Bayesian knowledge tracing; Knowledge inference; Simulated data; Student model;
D O I
10.1007/s41237-018-0072-x
中图分类号
学科分类号
摘要
Bayesian knowledge tracing (BKT) is a knowledge inference model that underlies many modern adaptive learning systems. The primary goal of BKT is to predict the point at which a student has reached mastery of a particular skill. In this paper, we examine the degree to which changes in sample size influence the values of the parameters within BKT models, and the effect that these errors have on predictions of student mastery. We generate simulated data sets of student responses based on underlying BKT parameters and the degree of variance which they involve, and then fit new models to these data sets, and compared the error between the predicted parameters and the seed parameters. We discuss the implications of sample size in considering the trustworthiness of BKT parameters derived in learning settings and make recommendations for the number of data points that should be used in creating BKT models. © 2018, The Behaviormetric Society.
引用
收藏
页码:475 / 493
页数:18
相关论文
共 25 条
[1]  
Baker R.S., 4.2: Bayesian knowledge tracing, Big Data and Education, (2018)
[2]  
Baker R., Corbett A.T., Aleven V., More accurate student modeling through contextual estimation of slip and guess probabilities in Bayesian knowledge tracing, Proceedings of the 9Th International Conference on Intelligent Tutoring Systems, pp. 406-415, (2008)
[3]  
Baker R., Corbett A.T., Gowda S.M., Wagner A.Z., Maclaren B.M., Kauffman L.R., Mitchell A.P., Giguere S., Contextual slip and prediction of student performance after use of an intelligent tutor, Proceedings of the 18Th Annual Conference on User Modeling, Adaptation, and Personalization, pp. 52-63, (2010)
[4]  
Baker R., Pardos Z., Gowda S., Nooraei B., Heffernan N., Ensembling predictions of student knowledge within intelligent tutoring systems, Proceedings of 19Th International Conference on User Modeling, Adaptation, and Personalization, pp. 13-24, (2011)
[5]  
Beck J., The field of EDM: Where we came from, and where we’re going, Presentation at the 7Th International Conference on Educational Data Mining, (2014)
[6]  
Beck J.E., Gong Y., Wheel-spinning: Students who fail to master a skill, International Conference on Artificial Intelligence in Education, pp. 431-440, (2013)
[7]  
Beck J., Xiong X., Limits to accuracy: How well can we do at student modeling?, Educational Data Mining 2013, (2013)
[8]  
Chen C.M., Lee H.M., Chen Y.H., Personalized e-learning system using item response theory, Comput Educ, 44, 3, pp. 237-255, (2005)
[9]  
Cohen J., Statistical power analysis, Curr Dir Psychol Sci, 1, 3, pp. 98-101, (1992)
[10]  
Corbett A.T., Anderson J.R., Knowledge tracing: modeling the acquisition of procedural knowledge, User Model User Adap Interact, 4, 4, pp. 253-278, (1995)