Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristicdriven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of the correct answer throughout the entire answer key. Doing this theoretically limits the number of correct guesses that testtakers can make and thus reduces the amount of construct-irrelevant variance in test score interpretations. This study empirically tested the strategy to randomize the answer-key. Specifically, a factorial ANOVA was conducted to examine differences in General Biology classroom multiple-choice test scores by the interaction of method for varying the correct answer’s position and student ability. Although no statistically significant differences were found, the paper argues that the guideline is nevertheless ethically substantiated.
Joseph, Dane C., "Randomize it: Fair Procedures when Constructing Multiple-choice Test-Keys" (2019). Faculty Publications - College of Education. 214.