Abstract
The Medical Council of Canada makes use of examiners' pass/borderline/fail judgments of candidates' performances in OSCE stations in defining cutting scores for these stations. This process assumes that there is consistency in the judgments of different examiners used in the same stations at different testing sites. This assumption was tested using the results of the fall 1994 administration of part 2 of the Medical Council of Canada Qualifying Examination. The Council anticipated using the examiner based global ratings as part of the OSCE station scores in the fall 1995 administration of the examination. In this study, the fall 1994 results were used to estimate to what extent test reliability would increase with the addition of the global ratings.
Similar content being viewed by others
References
Norcini, J.J., Stillman, P.L., Sumick, A.I., Regan, M.B., Haley, H.L., Williams, R.G. & Freedman, M. (1993). Scoring and Standard Setting with Standardized Patients. Evaluation & the Health Professions 16: 322–332.
Reznick, R.K., Blackmore, D., Cohen, R., Baumber, J., Rothman, A., Smee, S., Chalmers, A., Poldre, P., Birtwhistte, R., Walsh, P., Spady, D. & Berard, M. (1993). Academic Medicine 68 (October Supplement): S4-S6.
Rothman, A.I., Poldre, P., Cohen, R. & Ross. J. (1993, April). Standard Setting in a Multiple Station Test of Clinical Skills. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), Atlanta, GA.
Rothman, A.I., Blackmore, D., Cohen, R. & Reznick R. (1996). The Consistency and Uncertainty in Examiners' Definitions of Pass/fail Performance on OSCE Stations. Evaluation & the Health Professions 19: 118–124.
Author information
Authors and Affiliations
Additional information
This research was done with the support of the Medical Council of Canada
Rights and permissions
About this article
Cite this article
Rothman, A.I., Blackmore, D., Dauphinee, W.D. et al. The use of global ratings in OSCE station scores. Adv Health Sci Educ 1, 215–219 (1996). https://doi.org/10.1007/BF00162918
Issue Date:
DOI: https://doi.org/10.1007/BF00162918