Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

A scoping review of the potential for chart stimulated recall as a clinical research method

Authors: Carol Sinnott, Martina A. Kelly, Colin P. Bradley

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Chart-stimulated recall (CSR) is a case-based interviewing technique, which is used in the assessment of clinical decision-making in medical education and professional certification. Increasingly, clinical decision-making is a concern for clinical research in primary care. In this study, we review the prior application and utility of CSR as a technique for research interviews in primary care.

Methods

Following Arksey & O’Malley’s method for scoping reviews, we searched seven databases, grey literature, reference lists, and contacted experts in the field. We excluded studies on medical education or competence assessment. Retrieved citations were screened by one reviewer and full texts were ordered for all potentially relevant abstracts. Two researchers independently reviewed full texts and performed data extraction and quality appraisal if inclusion criteria were met. Data were collated and summarised using a published framework on the reporting of qualitative interview techniques, which was chosen a priori. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines informed the review report.

Results

From an initial list of 789 citations, eight studies using CSR in research interviews were included in the review: six from North America, one from the Netherlands, and one from Ireland. The most common purpose of included studies was to examine the influence of guidelines on physicians’ decisions. The number of interviewees ranged from seven to twenty nine, while the number of charts discussed per interview ranged from one to twelve. CSR gave insights into physicians’ reasoning for actions taken or not taken; the unrecorded social and clinical influences on decisions; and discrepancies between physicians’ real and perceived practice. Ethical concerns and the training and influence of the researcher were poorly discussed in most of the studies. Potential pitfalls included the risk of recall, selection and observation biases.

Conclusions

Despite the proven validity, reliability and acceptability of CSR in assessment interviews in medical education, its use in clinical research is limited. Application of CSR in qualitative research brings interview data closer to the reality of practice. Although further development of the approach is required, we recommend a role for CSR in research interviews on decision-making in clinical practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Goulet F, Jacques A, Gagnon R, Racette P, Sieber W. Assessment of family physicians’ performance using patient charts: interrater reliability and concordance with chart-stimulated recall interview. Evaluation & the health professions. 2007;30(4):376–92.CrossRef Goulet F, Jacques A, Gagnon R, Racette P, Sieber W. Assessment of family physicians’ performance using patient charts: interrater reliability and concordance with chart-stimulated recall interview. Evaluation & the health professions. 2007;30(4):376–92.CrossRef
2.
go back to reference Jennett P, Affleck L. Chart audit and chart stimulated recall as methods of needs assessment in continuing professional health education. J Contin Educ Health Prof. 1998;18(3):163–71.CrossRef Jennett P, Affleck L. Chart audit and chart stimulated recall as methods of needs assessment in continuing professional health education. J Contin Educ Health Prof. 1998;18(3):163–71.CrossRef
3.
go back to reference Norman GR, Davis DA, Lamb S, Hanna E, Caulford P, Kaigas T. Competency assessment of primary care physicians as part of a peer review program. JAMA. 1993;270(9):1046–51.CrossRefPubMed Norman GR, Davis DA, Lamb S, Hanna E, Caulford P, Kaigas T. Competency assessment of primary care physicians as part of a peer review program. JAMA. 1993;270(9):1046–51.CrossRefPubMed
4.
go back to reference Cunnington JP, Hanna E, Turnhbull J, Kaigas TB, Norman GR. Defensible assessment of the competency of the practicing physician. Acad Med. 1997;72(1):9–12.PubMed Cunnington JP, Hanna E, Turnhbull J, Kaigas TB, Norman GR. Defensible assessment of the competency of the practicing physician. Acad Med. 1997;72(1):9–12.PubMed
5.
go back to reference Norcini JJ, McKinley DW. Assessment methods in medical education. Teach Teach Educ. 2007;23(3):239–50.CrossRef Norcini JJ, McKinley DW. Assessment methods in medical education. Teach Teach Educ. 2007;23(3):239–50.CrossRef
6.
go back to reference Schipper S, Ross S. Structured teaching and assessment: a new chart-stimulated recall worksheet for family medicine residents. Canadian family physician Medecin de famille canadien. 2010;56(9):958–9. e352-954PubMedPubMedCentral Schipper S, Ross S. Structured teaching and assessment: a new chart-stimulated recall worksheet for family medicine residents. Canadian family physician Medecin de famille canadien. 2010;56(9):958–9. e352-954PubMedPubMedCentral
8.
go back to reference Eddy DM. Variations in physician practice: the role of uncertainty. Health affairs (Project Hope). 1984;3(2):74–89.CrossRef Eddy DM. Variations in physician practice: the role of uncertainty. Health affairs (Project Hope). 1984;3(2):74–89.CrossRef
9.
go back to reference Salisbury C, Procter S, Stewart K, Bowen L, Purdy S, Ridd M, Valderas J, Blakeman T, Reeves D. The content of general practice consultations: cross-sectional study based on video recordings. Br J Gen Pract. 2013;63(616):e751–9.CrossRefPubMedPubMedCentral Salisbury C, Procter S, Stewart K, Bowen L, Purdy S, Ridd M, Valderas J, Blakeman T, Reeves D. The content of general practice consultations: cross-sectional study based on video recordings. Br J Gen Pract. 2013;63(616):e751–9.CrossRefPubMedPubMedCentral
10.
go back to reference Majeed A, Car J, Sheikh A. Accuracy and completeness of electronic patient records in primary care. Fam Pract. 2008;25(4):213–4.CrossRefPubMed Majeed A, Car J, Sheikh A. Accuracy and completeness of electronic patient records in primary care. Fam Pract. 2008;25(4):213–4.CrossRefPubMed
11.
go back to reference Stewart M, Fortin M, Britt HC, Harrison CM, Maddocks HL. Comparisons of multi-morbidity in family practice--issues and biases. Fam Pract. 2013;30(4):473–80.CrossRefPubMedPubMedCentral Stewart M, Fortin M, Britt HC, Harrison CM, Maddocks HL. Comparisons of multi-morbidity in family practice--issues and biases. Fam Pract. 2013;30(4):473–80.CrossRefPubMedPubMedCentral
13.
go back to reference Sinnott C, Hugh SM, Boyce MB, Bradley CP. What to give the patient who has everything? A qualitative study of prescribing for multimorbidity in primary care. Br J Gen Pract. 2015;65(632):e184–91.CrossRefPubMedPubMedCentral Sinnott C, Hugh SM, Boyce MB, Bradley CP. What to give the patient who has everything? A qualitative study of prescribing for multimorbidity in primary care. Br J Gen Pract. 2015;65(632):e184–91.CrossRefPubMedPubMedCentral
14.
go back to reference Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef
16.
go back to reference Stedman TL: Stedman's medical dictionary: Lippincott Williams & Wilkins; 2000. Stedman TL: Stedman's medical dictionary: Lippincott Williams & Wilkins; 2000.
17.
go back to reference Collins J. Medical education research: challenges and opportunities. Radiology. 2006;240(3):639–47.CrossRefPubMed Collins J. Medical education research: challenges and opportunities. Radiology. 2006;240(3):639–47.CrossRefPubMed
18.
go back to reference McWhinney IR: William pickles lecture 1996. The importance of being different. Br J Gen Pract 1996, 46(408):433-436. McWhinney IR: William pickles lecture 1996. The importance of being different. Br J Gen Pract 1996, 46(408):433-436.
19.
go back to reference Kendall M, Murray SA, Carduff E, Worth A, Harris F, Lloyd A, Cavers D, Grant L, Boyd K, Sheikh A. Use of multiperspective qualitative interviews to understand patients’ and carers’ beliefs, experiences, and needs. BMJ. 2009;339:b4122.CrossRefPubMed Kendall M, Murray SA, Carduff E, Worth A, Harris F, Lloyd A, Cavers D, Grant L, Boyd K, Sheikh A. Use of multiperspective qualitative interviews to understand patients’ and carers’ beliefs, experiences, and needs. BMJ. 2009;339:b4122.CrossRefPubMed
20.
go back to reference Murray SA, Kendall M, Carduff E, Worth A, Harris FM, Lloyd A, Cavers D, Grant L, Sheikh A. Use of serial qualitative interviews to understand patients’ evolving experiences and needs. BMJ. 2009;339:b3702.CrossRefPubMed Murray SA, Kendall M, Carduff E, Worth A, Harris FM, Lloyd A, Cavers D, Grant L, Sheikh A. Use of serial qualitative interviews to understand patients’ evolving experiences and needs. BMJ. 2009;339:b3702.CrossRefPubMed
21.
go back to reference Critical Appraisal Skills Programme Checklist. In: Critical Appraisal Skills Programme. England: Public Health Resource Unit; 2006. Critical Appraisal Skills Programme Checklist. In: Critical Appraisal Skills Programme. England: Public Health Resource Unit; 2006.
22.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRefPubMedPubMedCentral
23.
go back to reference Guerra C, Schwartz JS, Armstrong K, Brown JS, Halbert CH, Shea JA. Barriers of and facilitators to physician recommendation of colorectal cancer screening. J Gen Intern Med. 2007;22(12):1681–8.CrossRefPubMedPubMedCentral Guerra C, Schwartz JS, Armstrong K, Brown JS, Halbert CH, Shea JA. Barriers of and facilitators to physician recommendation of colorectal cancer screening. J Gen Intern Med. 2007;22(12):1681–8.CrossRefPubMedPubMedCentral
24.
go back to reference Guerra CE, Jacobs SE, Holmes JH, Shea JA. Are physicians discussing prostate cancer screening with their patients and why or why not? A pilot study. J Gen Intern Med. 2007;22(7):901–7.CrossRefPubMedPubMedCentral Guerra CE, Jacobs SE, Holmes JH, Shea JA. Are physicians discussing prostate cancer screening with their patients and why or why not? A pilot study. J Gen Intern Med. 2007;22(7):901–7.CrossRefPubMedPubMedCentral
25.
go back to reference Ab E, Denig P, van Vliet T, Dekker JH. Reasons of general practitioners for not prescribing lipid-lowering medication to patients with diabetes: a qualitative study. BMC Fam Pract. 2009;10 Ab E, Denig P, van Vliet T, Dekker JH. Reasons of general practitioners for not prescribing lipid-lowering medication to patients with diabetes: a qualitative study. BMC Fam Pract. 2009;10
26.
go back to reference Rochefort CM, Morlec J, Tamblyn RM. What differentiates primary care physicians who predominantly prescribe diuretics for treating mild to moderate hypertension from those who do not? A comparative qualitative study. BMC Fam Pract. 2012;13:9.CrossRefPubMedPubMedCentral Rochefort CM, Morlec J, Tamblyn RM. What differentiates primary care physicians who predominantly prescribe diuretics for treating mild to moderate hypertension from those who do not? A comparative qualitative study. BMC Fam Pract. 2012;13:9.CrossRefPubMedPubMedCentral
27.
go back to reference Dee C, Blazek R. Information needs of the rural physician: a descriptive study. Bull Med Libr Assoc. 1993;81(3):259–64.PubMedPubMedCentral Dee C, Blazek R. Information needs of the rural physician: a descriptive study. Bull Med Libr Assoc. 1993;81(3):259–64.PubMedPubMedCentral
28.
go back to reference Lockyer JM, McMillan DD, Magnan L, Akierman A, Parboosingh JT. Stimulated case recall interviews applied to a national protocol for hyperbilirubinemia. J Contin Educ Heal Prof. 1991;11(2):129–37.CrossRef Lockyer JM, McMillan DD, Magnan L, Akierman A, Parboosingh JT. Stimulated case recall interviews applied to a national protocol for hyperbilirubinemia. J Contin Educ Heal Prof. 1991;11(2):129–37.CrossRef
29.
go back to reference Jennett PA, Scott SM, Atkinson MA, Crutcher RA, Hogan DB, Elford RW, MacCannell KL, Baumber JS. Patient charts and physician office management decisions: chart audit and chart stimulated recall. J Contin Educ Heal Prof. 1995;15(1):31–9.CrossRef Jennett PA, Scott SM, Atkinson MA, Crutcher RA, Hogan DB, Elford RW, MacCannell KL, Baumber JS. Patient charts and physician office management decisions: chart audit and chart stimulated recall. J Contin Educ Heal Prof. 1995;15(1):31–9.CrossRef
30.
go back to reference Tulving E, Thomson DM. Encoding specificity and retrieval processes in episodic memory. Psychol Rev. 1973;80(5):352–73.CrossRef Tulving E, Thomson DM. Encoding specificity and retrieval processes in episodic memory. Psychol Rev. 1973;80(5):352–73.CrossRef
31.
go back to reference MacDermid JC, Law M, Buckley N, Haynes RB. “push” versus “pull” for mobilizing pain evidence into practice across different health professions: a protocol for a randomized trial. Implementation science: IS. 2012;7:115.CrossRefPubMedPubMedCentral MacDermid JC, Law M, Buckley N, Haynes RB. “push” versus “pull” for mobilizing pain evidence into practice across different health professions: a protocol for a randomized trial. Implementation science: IS. 2012;7:115.CrossRefPubMedPubMedCentral
32.
go back to reference Chew-Graham CA, May CR, Perry MS. Qualitative research and the problem of judgement: lessons from interviewing fellow professionals. Fam Pract. 2002;19(3):285–9.CrossRefPubMed Chew-Graham CA, May CR, Perry MS. Qualitative research and the problem of judgement: lessons from interviewing fellow professionals. Fam Pract. 2002;19(3):285–9.CrossRefPubMed
33.
go back to reference Barry CA, Britten N, Barber N, Bradley C, Stevenson F. Using reflexivity to optimize teamwork in qualitative research. Qual Health Res. 1999;9(1):26–44.CrossRefPubMed Barry CA, Britten N, Barber N, Bradley C, Stevenson F. Using reflexivity to optimize teamwork in qualitative research. Qual Health Res. 1999;9(1):26–44.CrossRefPubMed
34.
go back to reference Miller PA, Nayer M, Eva KW. Psychometric properties of a peer-assessment program to assess continuing competence in physical therapy. Phys Ther. 2010;90(7):1026–38.CrossRefPubMed Miller PA, Nayer M, Eva KW. Psychometric properties of a peer-assessment program to assess continuing competence in physical therapy. Phys Ther. 2010;90(7):1026–38.CrossRefPubMed
35.
go back to reference Salvatori P, Simonavicius N, Moore J, Rimmer G, Patterson M. Meeting the challenge of assessing clinical competence of occupational therapists within a program management environment. Canadian journal of occupational therapy. Revue canadienne d'ergotherapie. 2008;75(1):51–60.CrossRefPubMed Salvatori P, Simonavicius N, Moore J, Rimmer G, Patterson M. Meeting the challenge of assessing clinical competence of occupational therapists within a program management environment. Canadian journal of occupational therapy. Revue canadienne d'ergotherapie. 2008;75(1):51–60.CrossRefPubMed
36.
go back to reference Lundgren-Laine H, Salantera S. Think-aloud technique and protocol analysis in clinical decision-making research. Qual Health Res. 2010;20(4):565–75.CrossRefPubMed Lundgren-Laine H, Salantera S. Think-aloud technique and protocol analysis in clinical decision-making research. Qual Health Res. 2010;20(4):565–75.CrossRefPubMed
37.
go back to reference Guan Z, Lee S, Cuddihy E, Ramey J. The validity of the stimulated retrospective think-aloud method as measured by eye tracking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Montréal, Québec. Canada: ACM; 2006. p. 1253–62.CrossRef Guan Z, Lee S, Cuddihy E, Ramey J. The validity of the stimulated retrospective think-aloud method as measured by eye tracking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Montréal, Québec. Canada: ACM; 2006. p. 1253–62.CrossRef
38.
go back to reference Evans SC, Roberts MC, Keeley JW, Blossom JB, Amaro CM, Garcia AM, Stough CO, Canter KS, Robles R, Reed GM: Vignette methodologies for studying clinicians’ decision-making: validity, utility, and application in ICD-11 field studies. Int J Clin Health Psychol. 2015;15(2):160–70. Evans SC, Roberts MC, Keeley JW, Blossom JB, Amaro CM, Garcia AM, Stough CO, Canter KS, Robles R, Reed GM: Vignette methodologies for studying clinicians’ decision-making: validity, utility, and application in ICD-11 field studies. Int J Clin Health Psychol. 2015;15(2):160–70.
39.
go back to reference Bradley CP. Turning anecdotes into data--the critical incident technique. Fam Pract. 1992;9(1):98–103.CrossRefPubMed Bradley CP. Turning anecdotes into data--the critical incident technique. Fam Pract. 1992;9(1):98–103.CrossRefPubMed
40.
go back to reference Paskins Z, McHugh G, Hassell AB. Getting under the skin of the primary care consultation using video stimulated recall: a systematic review. BMC Med Res Methodol. 2014;14(1):101.CrossRefPubMedPubMedCentral Paskins Z, McHugh G, Hassell AB. Getting under the skin of the primary care consultation using video stimulated recall: a systematic review. BMC Med Res Methodol. 2014;14(1):101.CrossRefPubMedPubMedCentral
41.
go back to reference Cape J, Geyer C, Barker C, Pistrang N, Buszewicz M, Dowrick C, Salmon P. Facilitating understanding of mental health problems in GP consultations: a qualitative study using taped-assisted recall. Br J Gen Pract. 2010;60(580):837–45.CrossRefPubMedPubMedCentral Cape J, Geyer C, Barker C, Pistrang N, Buszewicz M, Dowrick C, Salmon P. Facilitating understanding of mental health problems in GP consultations: a qualitative study using taped-assisted recall. Br J Gen Pract. 2010;60(580):837–45.CrossRefPubMedPubMedCentral
42.
go back to reference De Leon JP, Cohen JH. Object and walking probes in ethnographic interviewing. Field Methods. 2005;17(2):200–4.CrossRef De Leon JP, Cohen JH. Object and walking probes in ethnographic interviewing. Field Methods. 2005;17(2):200–4.CrossRef
43.
go back to reference Harper D. Talking about pictures: a case for photo elicitation. Vis Stud. 2002;17(1):13–26.CrossRef Harper D. Talking about pictures: a case for photo elicitation. Vis Stud. 2002;17(1):13–26.CrossRef
Metadata
Title
A scoping review of the potential for chart stimulated recall as a clinical research method
Authors
Carol Sinnott
Martina A. Kelly
Colin P. Bradley
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2539-y

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue