도시관리연구실

논문 초록 (Abstract)

Lee, Young-Ju. 2014. The Optimal Number of Options Based on theAnalysis of Language Domain and Item Characteristics. Korean Journal ofEnglish Language and Linguistics, 14-2, 323-348. This studyinvestigated the optimal number of options of the English sectionof the NAEA (Nation al Assessment of Educational Achievement)for language domain as well a s item characteristics. TheEnglishsection of the NAEA for the ninth graders is the test instrumentemployed in this study. By eliminati ng the leastand the secondleast frequently chosen options, a five-op tion, multiple choiceEnglish test was converted to a four- and a three-o ption version. Item difficulty, item discrimination, and information functionwe re computed as a function of the number of options,employing the 3-para meter IRT model. Results showed that therewere no significant difference s among the three means of itemdifficulty as well as item discrimina tion indices for languagedomain (i.e., listening and reading). For specific item types suchas identifying the speaker's intention , selecting the mostappropriate response to the spoken discourse , and finding outthe true statement presented in English, a three- or a four-optionversion functioned better than a five-option version. The findingswill have important practical implications for implemen ting somethree- or four-option multiple choice items for the Englishs ection of the NAEA.