Skip to main content
Top
Published in: Perspectives on Medical Education 2/2020

Open Access 01-04-2020 | Original Article

Development of a CanMEDS-based instrument for evaluating medical students’ perceptions of the key competencies of a socially accountable healthcare practitioner

Authors: Claudia Naidu, Steve Reid, Vanessa Burch

Published in: Perspectives on Medical Education | Issue 2/2020

Login to get access

Abstract

Introduction

Numerous frameworks and tools have been developed to assist medical schools striving to achieve their social accountability mandate. The purpose of this study was to design an instrument to evaluate medical students’ perceptions of the key competencies of a ‘socially accountable’ healthcare practitioner using widely accepted frameworks which contain clear measurable outcomes.

Methods

The instrument was designed in three phases: selection of a competency-based framework, development of items, and validation of the instrument through exploratory factor analysis. Medical students in the 6‑year medical degree program at the University of Cape Town, South Africa were invited to participate in the study. Descriptive and inferential statistical analysis was performed using Stata/SE version 13.1.

Results

Of 619 students invited to participate in the study, 484 (78%) responded. The CanMEDS framework was selected for designing the instrument, which comprised 35 statements reflecting five competencies for each CanMEDS role. Exploratory factor analysis of the student responses yielded a 28-item instrument. There was a significant difference in overall Perceptions of Social Accountability Instrument (PSAI) scores between men and women (p = 0.002) but no significant difference between the overall PSAI scores for students in the respective years of study.

Discussion

This study describes the design of an instrument to evaluate medical students’ perceptions of the essential competencies of socially accountable healthcare practitioners. Used longitudinally, the data may provide evidence of the successes of our programs and identify areas where further improvements are required.
Appendix
Available only for authorised users
Literature
1.
go back to reference Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an independent world. Lancet. 2010;376:1923–58. Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an independent world. Lancet. 2010;376:1923–58.
3.
go back to reference The Training for Health Equity Network. THEnet’s Social accountability evaluation framework Version 1. Monograph I (1 ed). The Training for Health Equity Network, 2011. The Training for Health Equity Network. THEnet’s Social accountability evaluation framework Version 1. Monograph I (1 ed). The Training for Health Equity Network, 2011.
4.
go back to reference Meili R, Ganem-Cuenca A, Leung JW, Zaleschuk D. The CARE Model of Social Accountability: Promoting Cultural change. Acad Med. 2011;86:1114–9. Meili R, Ganem-Cuenca A, Leung JW, Zaleschuk D. The CARE Model of Social Accountability: Promoting Cultural change. Acad Med. 2011;86:1114–9.
5.
go back to reference World Health Organization. Transforming and scaling up health professionals’ education and training. Guidelines, Vol. 2013. Geneva, Switzerland: World Health Organization: World Health Organization; 2013. World Health Organization. Transforming and scaling up health professionals’ education and training. Guidelines, Vol. 2013. Geneva, Switzerland: World Health Organization: World Health Organization; 2013.
6.
go back to reference Sandhu G, Garcha I, Sleeth J, Yeates K, Walker GRAIDER. A model for social accountability in medical education and practice. Med Teach. 2013;35:e1403–e8. Sandhu G, Garcha I, Sleeth J, Yeates K, Walker GRAIDER. A model for social accountability in medical education and practice. Med Teach. 2013;35:e1403–e8.
9.
go back to reference Woollard RF. Caring for a common future: medical schools’ social accountability. Med Educ. 2006;40:301–13. Woollard RF. Caring for a common future: medical schools’ social accountability. Med Educ. 2006;40:301–13.
10.
go back to reference Leinster S. Evaluation and assessment of social accountability in medical schools. Med Teach. 2011;33:673–6. Leinster S. Evaluation and assessment of social accountability in medical schools. Med Teach. 2011;33:673–6.
11.
go back to reference Mcrea ML, Murdoch-Eaton D. How do undergraduate medical students perceive social accountability? Med Teach. 2014;36:867–75. Mcrea ML, Murdoch-Eaton D. How do undergraduate medical students perceive social accountability? Med Teach. 2014;36:867–75.
13.
go back to reference Murdoch-Eaton D, Whittle S. Generic skills in medical education: developing the tools for successful lifelong learning. Med Educ. 2012;46:120–8. Murdoch-Eaton D, Whittle S. Generic skills in medical education: developing the tools for successful lifelong learning. Med Educ. 2012;46:120–8.
14.
go back to reference Maudsley G, Williams EMI, Taylor DCM. Junior medical students’ notions of a ‘good doctor’ and related expectations: a mixed methods study. Med Educ. 2007;41:476–86. Maudsley G, Williams EMI, Taylor DCM. Junior medical students’ notions of a ‘good doctor’ and related expectations: a mixed methods study. Med Educ. 2007;41:476–86.
15.
go back to reference Crandall SJS, Volk RJ, Cacy DA. Longitudinal investigation of medical student attitudes toward the medically indigent. Teach Learn Med. 1997;9:254–60. Crandall SJS, Volk RJ, Cacy DA. Longitudinal investigation of medical student attitudes toward the medically indigent. Teach Learn Med. 1997;9:254–60.
16.
go back to reference Dunham L, Dekhtyar M, Gruener G, et al. Medical student perceptions of the learning environment in medical school change as students transition to clinical training in undergraduate medical school. Teach Learn Med. 2017;29:383–91. Dunham L, Dekhtyar M, Gruener G, et al. Medical student perceptions of the learning environment in medical school change as students transition to clinical training in undergraduate medical school. Teach Learn Med. 2017;29:383–91.
17.
go back to reference Zinn WM, Sullivan AM, Zotov N, et al. The effect of medical education on primary care orientation: results of two national surveys of students’ and residents’ perspectives. Acad Med. 2001;76:355–65. Zinn WM, Sullivan AM, Zotov N, et al. The effect of medical education on primary care orientation: results of two national surveys of students’ and residents’ perspectives. Acad Med. 2001;76:355–65.
18.
go back to reference Philips JP, Wilbanks DM, Rodriguez-Salinas DF, Doberneck DM. Speciality income and career decision-making: a qualitative study of medical student perceptions. Med Educ. 2019;53:593–604. Philips JP, Wilbanks DM, Rodriguez-Salinas DF, Doberneck DM. Speciality income and career decision-making: a qualitative study of medical student perceptions. Med Educ. 2019;53:593–604.
19.
go back to reference Boelen C, Woollard B. Social accountability: The extra leap to excellence for educational institutions. Med Teach. 2011;33:614–9. Boelen C, Woollard B. Social accountability: The extra leap to excellence for educational institutions. Med Teach. 2011;33:614–9.
20.
go back to reference Parlow J, Rothman AIATSIM. a scale to measure attitudes toward psychosocial factors in health care. Acad Med. 1974;49:385–7. Parlow J, Rothman AIATSIM. a scale to measure attitudes toward psychosocial factors in health care. Acad Med. 1974;49:385–7.
21.
go back to reference Crandall SJ, Volk RJ, Loemker V. Medical students’ attitudes toward providing care for the underserved: are we training socially responsible physicians? JAMA. 1993;269:2519–23. Crandall SJ, Volk RJ, Loemker V. Medical students’ attitudes toward providing care for the underserved: are we training socially responsible physicians? JAMA. 1993;269:2519–23.
22.
go back to reference Harris P, Snell L, Talbot M, Harden RM. for The International CBME Collaborators. Competency-based medical education: implications for undergraduate programs. Med Teach. 2010;32:646–50. Harris P, Snell L, Talbot M, Harden RM. for The International CBME Collaborators. Competency-based medical education: implications for undergraduate programs. Med Teach. 2010;32:646–50.
23.
go back to reference Frank JR, Danoff D. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2007;29:642–7. Frank JR, Danoff D. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2007;29:642–7.
24.
go back to reference Van Heerden B. Effectively addressing the health needs of South Africa’s population: The role of health professions education in the 21st century. S Afr Med J. 2013;103:21–2. Van Heerden B. Effectively addressing the health needs of South Africa’s population: The role of health professions education in the 21st century. S Afr Med J. 2013;103:21–2.
25.
go back to reference Rademakers J, De Rooy N, Cate OT. Senior medical students’ appraisal of CanMEDs competencies. Med Educ. 2007;41:990–4. Rademakers J, De Rooy N, Cate OT. Senior medical students’ appraisal of CanMEDs competencies. Med Educ. 2007;41:990–4.
26.
go back to reference Dharamsi S, Ho A, Spadafora SM, Woollard R. The physician as health advocate: Translating the quest for social responsibility into medical education and practice. Acad Med. 2011;86:1108–13. Dharamsi S, Ho A, Spadafora SM, Woollard R. The physician as health advocate: Translating the quest for social responsibility into medical education and practice. Acad Med. 2011;86:1108–13.
27.
go back to reference Buchman S, Woollard R, Meili R, Goel R. Practising social accountability: From theory to action. Can Fam Phys. 2016;62:15–8. Buchman S, Woollard R, Meili R, Goel R. Practising social accountability: From theory to action. Can Fam Phys. 2016;62:15–8.
28.
go back to reference Wong C‑S, Law KS, Huang GE. On the importance of conducting construct-level analysis for multidimensional constructs in theory development and testing. J Manag. 2008;34:744–64. Wong C‑S, Law KS, Huang GE. On the importance of conducting construct-level analysis for multidimensional constructs in theory development and testing. J Manag. 2008;34:744–64.
29.
go back to reference Ryan K, Gannon-Slater N, Culbertson MJ. Improving survey methods with cognitive interviews in small- and medium-scale evaluation. Am J Eval. 2012;33:414–30. Ryan K, Gannon-Slater N, Culbertson MJ. Improving survey methods with cognitive interviews in small- and medium-scale evaluation. Am J Eval. 2012;33:414–30.
30.
go back to reference Coste J, Guillemin F, Pouchot J, Fermanian J. Methodological approaches to shortening composite measurement scales. J Clin Epidemiol. 1997;50:247–52. Coste J, Guillemin F, Pouchot J, Fermanian J. Methodological approaches to shortening composite measurement scales. J Clin Epidemiol. 1997;50:247–52.
31.
go back to reference Robinson GF, Switzer GE, Cohen ED, et al. A shortened version of the Clinical Research Appraisal Inventory: CRAI-12. Acad Med. 2013;88:1340–5. Robinson GF, Switzer GE, Cohen ED, et al. A shortened version of the Clinical Research Appraisal Inventory: CRAI-12. Acad Med. 2013;88:1340–5.
32.
go back to reference Eller LS, Lev EL, Bakken LL. Development and testing of the Clinical Research Appraisal Inventory-Short Form. J Nurs Meas. 2014;22:106–19. Eller LS, Lev EL, Bakken LL. Development and testing of the Clinical Research Appraisal Inventory-Short Form. J Nurs Meas. 2014;22:106–19.
34.
go back to reference Validity DS. on the meaningful interpretation of assessment data. Med Educ. 2003;37:830–7. Validity DS. on the meaningful interpretation of assessment data. Med Educ. 2003;37:830–7.
35.
go back to reference Steiner DL, Validity NGR. In Health Measurement Scales: A practical guide to their development and use. Oxford: Oxford University Press; 2008. Steiner DL, Validity NGR. In Health Measurement Scales: A practical guide to their development and use. Oxford: Oxford University Press; 2008.
36.
go back to reference Watson JC. Establishing evidence for internal structure using exploratory factor analysis. Meas Eval Couns Dev. 2007;50:232–8. Watson JC. Establishing evidence for internal structure using exploratory factor analysis. Meas Eval Couns Dev. 2007;50:232–8.
37.
go back to reference Krabbe PFM, Validity I, Krabbe PFM. The measurement of health and health status. Amsterdam: Elsevier; 2017. Krabbe PFM, Validity I, Krabbe PFM. The measurement of health and health status. Amsterdam: Elsevier; 2017.
38.
go back to reference Russell DW. In search of underlying dimensions: The use (and abuse) of factor analysis in PSPB. Person Soc. Psychol Bull. 2002;28:1629–46. Russell DW. In search of underlying dimensions: The use (and abuse) of factor analysis in PSPB. Person Soc. Psychol Bull. 2002;28:1629–46.
39.
go back to reference Law KS, Wong CS, Mobley WH. Toward a taxonomy of multidimensional constructs. Acad Manag Rev. 1998;23:741–55. Law KS, Wong CS, Mobley WH. Toward a taxonomy of multidimensional constructs. Acad Manag Rev. 1998;23:741–55.
40.
go back to reference Edwards J. Multidimensional constructs in organizational behaviour research: An integrative analytical framework. Organ Res Method. 2001;4:144–92. Edwards J. Multidimensional constructs in organizational behaviour research: An integrative analytical framework. Organ Res Method. 2001;4:144–92.
41.
go back to reference Department of Education. Education statistics in South Africa. DoE, Vol. 2013. Pretoria: DoE; 2011. Department of Education. Education statistics in South Africa. DoE, Vol. 2013. Pretoria: DoE; 2011.
43.
go back to reference Williams B, Onsman A, Brown T. Exploratory factor analysis: A five-step guide for novices. J Emerg Prim Health Care. 2010;8(3):990399. Williams B, Onsman A, Brown T. Exploratory factor analysis: A five-step guide for novices. J Emerg Prim Health Care. 2010;8(3):990399.
44.
go back to reference Norman G. CanMEDS and other outcomes. Adv Health Sci Educ. 2011;16:547–51. Norman G. CanMEDS and other outcomes. Adv Health Sci Educ. 2011;16:547–51.
45.
go back to reference Ortwein H, Knigge M, Rehberg B, Hein OV, Spies C. Validation of core competencies during residency training in anaesthesiology. Ger Med Sci. 2011;9:23. Ortwein H, Knigge M, Rehberg B, Hein OV, Spies C. Validation of core competencies during residency training in anaesthesiology. Ger Med Sci. 2011;9:23.
46.
go back to reference Woloshuk W, Harasym PH, Temple W. Attitude change during medical school: a cohort study. Med Educ. 2004;38:522–34. Woloshuk W, Harasym PH, Temple W. Attitude change during medical school: a cohort study. Med Educ. 2004;38:522–34.
47.
go back to reference Wright KB, Bylund C, Ware J, Parker P, Query JL, Baile W. Medical student attitudes toward communication skills training and knowledge of appropriate provider-patient communication: A comparison of first-year and fourth-year medical students. Med Educ. 2006;11:18–27. Wright KB, Bylund C, Ware J, Parker P, Query JL, Baile W. Medical student attitudes toward communication skills training and knowledge of appropriate provider-patient communication: A comparison of first-year and fourth-year medical students. Med Educ. 2006;11:18–27.
48.
go back to reference Löffler-Stastka H, Seitz T, Billeth S, Pastner B, Preusche I, Seidman C. Significance of gender in the attitude towards doctor-patient communication in medical students and physicians. Wien Klin Wochenschr. 2016;128:663–8. Löffler-Stastka H, Seitz T, Billeth S, Pastner B, Preusche I, Seidman C. Significance of gender in the attitude towards doctor-patient communication in medical students and physicians. Wien Klin Wochenschr. 2016;128:663–8.
49.
go back to reference Johnston J, Cupples M, McGlade K, Steele K. Medical students’ attitudes to professionalism: an opportunity for the GP tutor? Educ Prim Care. 2011;22:321–7. Johnston J, Cupples M, McGlade K, Steele K. Medical students’ attitudes to professionalism: an opportunity for the GP tutor? Educ Prim Care. 2011;22:321–7.
50.
go back to reference Birden H, Glass N, Wilson I, et al. Defining professionalism in medical education: A systematic review. Med Teach. 2014;36:47–61. Birden H, Glass N, Wilson I, et al. Defining professionalism in medical education: A systematic review. Med Teach. 2014;36:47–61.
51.
go back to reference Crandall SJ, Reboussin BA, Michielutte R, Anthony JE, Naughton MJ. Medical students’ attitudes toward underserved patients: a longitudinal comparison of problem-based and traditional medical curricula. Adv Health Sci Educ. 2007;12:71–86. Crandall SJ, Reboussin BA, Michielutte R, Anthony JE, Naughton MJ. Medical students’ attitudes toward underserved patients: a longitudinal comparison of problem-based and traditional medical curricula. Adv Health Sci Educ. 2007;12:71–86.
52.
go back to reference Neumann M, Scheffer C, Tauschel D, Lutz G, Wirtz M, Edelhäuser F. Physician empathy: Definition, outcome-relevance and its measurement in patient care and medical education. GMS Z Med Ausbild. 2012;29:1–21. Neumann M, Scheffer C, Tauschel D, Lutz G, Wirtz M, Edelhäuser F. Physician empathy: Definition, outcome-relevance and its measurement in patient care and medical education. GMS Z Med Ausbild. 2012;29:1–21.
53.
go back to reference Mahoney S, Sladek R, Neild T. A longitudinal study of empathy in pre-clinical and clinical medical students and clinical supervisors. BMC Med Educ. 2016;16:270. Mahoney S, Sladek R, Neild T. A longitudinal study of empathy in pre-clinical and clinical medical students and clinical supervisors. BMC Med Educ. 2016;16:270.
54.
go back to reference Magalhães E, Salgueira AP, Costa P, Costa MJ. Empathy in senior year and first year medical students: A cross-sectional study. BMC Med Educ. 2011;11:52. Magalhães E, Salgueira AP, Costa P, Costa MJ. Empathy in senior year and first year medical students: A cross-sectional study. BMC Med Educ. 2011;11:52.
55.
go back to reference Archer E, Turner R. Measuring empathy in a. Group South African Undergrad Med Students Using Student Version Jefferson Scale Empathy Afr J Prm Health Care Fam Med. 2019;11(1):a1956. Archer E, Turner R. Measuring empathy in a. Group South African Undergrad Med Students Using Student Version Jefferson Scale Empathy Afr J Prm Health Care Fam Med. 2019;11(1):a1956.
56.
go back to reference Katoue MG, Awad AI, Al-Jarallah A, Al-Ozairi E, Schwinghammer TL. Medical and pharmacy students’ attitudes towards physician-pharmacist collaboration in Kuwait. Pharm Prac. 2017;15:1029. Katoue MG, Awad AI, Al-Jarallah A, Al-Ozairi E, Schwinghammer TL. Medical and pharmacy students’ attitudes towards physician-pharmacist collaboration in Kuwait. Pharm Prac. 2017;15:1029.
57.
go back to reference Hansson A, Arvemo T, Marklund B, Gedda B, Mattsson B. Working together—primary care doctors’ and nurses’ attitudes to collaboration. Scand J Public Health. 2010;38:78–85. Hansson A, Arvemo T, Marklund B, Gedda B, Mattsson B. Working together—primary care doctors’ and nurses’ attitudes to collaboration. Scand J Public Health. 2010;38:78–85.
58.
go back to reference Wilhemsson M, Ponzer S, Dahlgren L‑O, Timpka T, Faresjö. Are female students in general and nursing students more ready for teamwork and interprofessional collaboration in healthcare? BMC Med Educ. 2011;11:15. Wilhemsson M, Ponzer S, Dahlgren L‑O, Timpka T, Faresjö. Are female students in general and nursing students more ready for teamwork and interprofessional collaboration in healthcare? BMC Med Educ. 2011;11:15.
61.
go back to reference Torres-Harding SR, Siers B, Olson BD. Development and psychometric evaluation of the Social Justice Scale (SJS). Am J Commun Psychol. 2012;50:77–88. Torres-Harding SR, Siers B, Olson BD. Development and psychometric evaluation of the Social Justice Scale (SJS). Am J Commun Psychol. 2012;50:77–88.
62.
go back to reference Fietzer AW, Ponterotto J. A Psychometric Review of Instruments for Social Justice and Advocacy Attitudes. J Soc Action Couns Psychol. 2015;7:19–40. Fietzer AW, Ponterotto J. A Psychometric Review of Instruments for Social Justice and Advocacy Attitudes. J Soc Action Couns Psychol. 2015;7:19–40.
63.
go back to reference Norman G. Likert scales, levels of measurement and the “laws” of statistics. Adv Health Sci Edu. 2010;15:625–32. Norman G. Likert scales, levels of measurement and the “laws” of statistics. Adv Health Sci Edu. 2010;15:625–32.
Metadata
Title
Development of a CanMEDS-based instrument for evaluating medical students’ perceptions of the key competencies of a socially accountable healthcare practitioner
Authors
Claudia Naidu
Steve Reid
Vanessa Burch
Publication date
01-04-2020
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 2/2020
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-020-00564-6

Other articles of this Issue 2/2020

Perspectives on Medical Education 2/2020 Go to the issue