Bireyselleştirilmiş Bilgisayarlı Sınıflama Testlerinde Sınıflama Doğruluğunun İncelenmesi

Abstract

The aim of this study is to compare Sequential Probability Ratio Test (SPRT) and Confidence Interval (CI) classification criteria, Maximum Fisher Information method on the basis of estimated-ability (MFI-EB) and cut-point (MFI-CB) item selection methods while ability estimation method is Weighted Likelihood Estimation (WLE) in Computerized Adaptive Classification Testing (CACT), according to the average test length (ATL), average classification accuracy (ACA), and measurement precision under content balancing (Constrained Computerized Adaptive Testing: CCAT and Modified Multinomial Model: MMM) and item exposure control (Sympson-Hetter Method: SH and Item Eligibility Method: IE) when the classification is done based on two, three, or four categories for unidimensional pool of dichotomous items. 48 conditions are created in Monte Carlo (MC) simulation for the data, generated in R software, including 500 items and 5000 examinees, and the results are calculated over 30 replications. As a result of the study, it was observed that CI performs better in terms of ATL and SPRT performs better in ACA and correlation, bias, Root Mean Square Error (RMSE), and Mean Absolute Error (MAE) values, respectively; MFI-EB is more useful than MFI-KN. It was also seen that MMM is more successful in content balancing whereas CCAT is better in terms of test efficiency (ATL and ACA) and IE is superior in terms of item exposure control though SH is more beneficial in test efficiency. Besides, increasing the number of classification categories increases ATL but decreases ACA and it gives better results in terms of the correlation, bias, RMSE, and MAE values.

Keywords: computerized adaptive classification testing, content balancing, item exposure control, classification criteria, item selection methods, number of classification categories