Evidence validity of multiple-choice questions designed with Microsoft Bing (Copilot)

Flores-Cohaila J.A.; Ruesta-Bermejo R.; Gutierrez-Rios C.; Ramos-Godoy C.; Miranda-Chávez B.; Copaja-Corzo C. · Educacion Medica (2024) · DOI: 10.1016/j.edumed.2024.100950

Resumen

Introduction: To design multiple-choice questions (MCQs) using Microsoft Bing (Copilot) and evaluate their quality and psychometric indices in medical education. Materials and methods: A 180-question exam was designed using Microsoft Bing. It was evaluated by medical educators in terms of relevance and distractor quality. After administering the exam to students, difficulty and discrimination indices were calculated. Results: Most questions were highly relevant, and the distractors were of high quality. The discrimination and difficulty indices were acceptable for the majority of the questions. Conclusion: Microsoft Bing (Copilot) could be used as a substitute for ChatGPT in designing MCQs, given the evidence of validity collected in the study.

Instituciones: Universidad Científica del Sur; Universidad San Ignacio de Loyola; Universidad Privada de Tacna; Universidad Privada San Juan Bautista