Evaluation of Multiple Choice Questions Quality Trend as Structure and Taxonomy

Evaluation of multiple-choice questions is a strategic activity and the most effective tool in educational system and improvement. In this study, the quality of some indexes of multiple-choice exams in Babol Para Medical faculty was investigated on the basis of structure and knowledge level distribution in the first semesters of 2007 and 2012. The Milman checklist was used for evaluating the structure quality of these questions. And these questions were also evaluated in terms of knowledge level in 3 taxonomies: 1. Reminding, 2. Perception and 3. Applying. Data analysis was performed by SPSS 16. More than 70% of these multiple-choice pre-tests contained structural flaws, while the errors decreased from 70% to 30% in post-test and this difference was statistically significant (p= 0.05). 83.9% and 79.5 % of these questions were located at taxonomy 1 in pre and post-tests, respectively. The result showed that the structural quality of these questions had desirable improvement, but there was no significant difference in taxonomy shifts- from 1 to 2, and 3- in terms of knowledge level distribution. Therefore, it is necessary to hold workshops in order to improve the quality of multiple-choice questions in terms of knowledge level distribution at University.