Madde Yazarı Özelliklerinin Madde Psikometrik Özelliklerine Etkisi

Abstract

Abstract The main purpose of this study is to examine the relationship between the item writer characteristics and the psychometric properties of multiple-choice items developed by these writers. The research was conducted with 320 teachers who teach Turkish to 8th grade students in public schools in the 2020-2021 academic year. It was measured to what extent the teachers had seven item writer characteristics, which were claimed in the field, such as mastery of the field, writing skill, knowing the characteristics of the respondent, creativity, self-efficacy in item writing, and being experienced and educated in item writing. As a result of the evaluation of the LGS Verbal Section Turkish subtest items by the field experts, a blueprint was developed and teachers were asked to write a multiple-choice item with medium difficulty and high discrimination for one achievement of designed blueprint. The items developed by the teachers were applied to the 8th grade students and the psychometric properties of the items were estimated based on the student responses. The variables of item writer characteristics and item psychometric properties were analyzed by exploratory factor analysis and the relationship between them using structural equation modeling. The results of the analysis were found that the characteristics of the item writer showed a two-dimensional structure. In the first dimension, four item writer characteristic as knowing the characteristics of the respondent, mastering the rules of item writing, mastering the area on which the item was developed, and experience gained by writing the item were evaluated. Writing skill, self-efficacy and creativity were included in the second dimension as the skills that the writer should have. It was found that the writer of the item should have some knowledge and skills, and as these knowledge and skills increase, the psychometric properties of the item also improve, and also the relative effects of the characteristics of writer on the item psychometrics were introduced.