Original Article

Volume 37, Issue 1, 2021 , Page (51 - 55)

DOI: 10.51441/BioMedica/5-170

Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences


Authors: Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali


Abstract

Background and Objective:  Multiple-choice questions (MCQs) are a frequently used method of assessment in medical education. MCQs have to be well-constructed and have minimal flaws to achieve higher reliability and validity. Developing high quality MCQs is difficult but formal faculty training has found to have a positive impact on MCQ writing skills and quality. The purpose of the study was to assess the effect of a one-day training session on the quality of MCQs and the change in faculty’s self-rating of their competency in MCQ construction.

Methods:  This was a quasi-experimental study. A targeted workshop was conducted to train 17 faculty members in item writing skills and to improve the quality of existing item bank. Training was provided on the process of developing high quality assessment items and methods to avoid item flaws. Analysis of 48 MCQs from the existing MCQ bank was done for critique and improvement in quality. The MCQs were analyzed for level and type of questions and presence of item writing flaws. Faculty self-rating of their competency before and after the workshop session was also collected. Wilcoxon rank sum test was used to determine any change in the pre and post workshop quality of MCQs. Paired t-test was applied to analyze change in participants’ perception of their competency before and after the workshop session.

Results:  Analysis showed that after the workshop, the number of MCQs testing recall reduced significantly (N 42, 30, P ≤ 0.05). Similarly, questions testing application of knowledge improved significantly (N 6, 17,
P ≤ 0.05). Analysis of faculty’s self-rating of “change in competency” showed a significant improvement (P = 0.00) in their ability to improve the stem, lead-in and options list with appropriate and logically sequenced distractors.

Conclusion:  Targeted faculty development workshops improves the quality of MCQs construction. These trainings should be well structured and conducted on regular basis for better outcome.


Keywords: Multiple choice questions, Faculty development, Educational assessment, Workshops.


Open access Creative Commons License

Authors

Mirza Aroosa Beg

Assistant Professor Department of Medical Education, Sindh Institute of Urology and Transplantation (SIUT) Karachi – Pakistan

Afifa Tabassum

Department of Health Professions Education, Liaquat National Hospital and Medical College, Karachi - Pakistan.

Sobia Ali

Department of Health Professions Education, Liaquat National Hospital and Medical College, Karachi - Pakistan.

Publication History

Received: October 06, 2020

Revised: November 18, 2020

Accepted: March 16, 2021

Published: March 31, 2021

Pubmed Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. biomedica. 2021 ; 31 March 2021 ): 86-91. doi:10.51441/BioMedica/5-170

Web Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. https://biomedicapk.com/10.51441/BioMedica/5-170 [Access: June 13, 2021]. doi:10.51441/BioMedica/5-170

AMA (American Medical Association) Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. biomedica. 2021 ; 31 ( March 2021 ): 86-91. doi:10.51441/BioMedica/5-170

Vancouver/ICMJE Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. biomedica. ( 2021 ), [cited June 13, 2021]; 10 ( March 2021 ): 86-91. doi:10.51441/BioMedica/5-170

Harvard Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali ( 2021 ) Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. biomedica, 31 ( March 2021 ): 86-91. doi:10.51441/BioMedica/5-170

Turabian Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. 2021 . Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. BioMedica, 31 ( March 2021 ): 86-91. doi:10.51441/BioMedica/5-170

Chicago Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. "Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences." BioMedica 31 ( 2021 ), 86-91. doi:10.51441/BioMedica/5-170

MLA (The Modern Language Association) Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali. "Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences." BioMedica 31 . March 2021 ( 2021 ), 86-91. Print. doi:10.51441/BioMedica/5-170

APA (American Psychological Association) Style

Mirza Aroosa Beg, Afifa Tabassum, Sobia Ali ( 2021 ) Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences. BioMedica, 31 ( March 2021 ), 86-91. doi:10.51441/BioMedica/5-170