Skip to main content
Top
Published in: BMC Primary Care 1/2013

Open Access 01-12-2013 | Research article

Family physicians’ diagnostic gut feelings are measurable: construct validation of a questionnaire

Authors: Christiaan F Stolper, Margje WJ Van de Wiel, Henrica CW De Vet, Alexander LB Rutten, Paul Van Royen, Marloes A Van Bokhoven, Trudy Van der Weijden, Geert Jan Dinant

Published in: BMC Primary Care | Issue 1/2013

Login to get access

Abstract

Background

Family physicians perceive that gut feelings, i.e. a ‘sense of reassurance’ or a ‘sense of alarm’, play a substantial role in diagnostic reasoning. A measuring instrument is desirable for further research. Our objective is to validate a questionnaire measuring the presence of gut feelings in diagnostic reasoning.

Methods

We constructed 16 case vignettes from real practice situations and used the accompanying ‘sense of reassurance’ or the ‘sense of alarm’ as reference labels. Based on the results of an initial study (26 family physicians), we divided the case vignettes into a group involving a clear role for the sense of reassurance or the sense of alarm and a group involving an ambiguous role. 49 experienced family physicians evaluated each 10 vignettes using the questionnaire. Construct validity was assessed by testing hypotheses and an internal consistency procedure was performed.

Results

As hypothesized we found that the correlations between the reference labels and corresponding items were high for the clear-case vignettes (0.59 – 0.72) and low for the ambiguous-case vignettes (0.08 – 0.23). The agreement between the classification in clear sense of reassurance, clear sense of alarm and ambiguous case vignettes as derived from the initial study and the study population’s judgments was substantial (Kappa = 0.62). Factor analysis showed one factor with opposites for sense of reassurance and sense of alarm items. The questionnaire’s internal consistency was high (0.91). We provided a linguistic validated English-language text of the questionnaire.

Conclusions

The questionnaire appears to be valid. It enables quantitative research into the role of gut feelings and their diagnostic value in family physicians’ diagnostic reasoning.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dinant GJ, et al: Diagnosis and decision. Undifferentiated illness and uncertainty in diagnosis and management. Oxford Textbook of Primary Medical Care. Edited by: Jones R, Britten N, Gulpepper L, Gass D, Grol R, Mant D. 2004, Oxford: Oxford University Press, 201-203. Dinant GJ, et al: Diagnosis and decision. Undifferentiated illness and uncertainty in diagnosis and management. Oxford Textbook of Primary Medical Care. Edited by: Jones R, Britten N, Gulpepper L, Gass D, Grol R, Mant D. 2004, Oxford: Oxford University Press, 201-203.
2.
go back to reference Griffiths F, Green E, Tsouroufli M: The nature of medical evidence and its inherent uncertainty for the clinical consultation: qualitative study. BMJ. 2005, 330: 511-517. 10.1136/bmj.38336.482720.8F.CrossRefPubMedPubMedCentral Griffiths F, Green E, Tsouroufli M: The nature of medical evidence and its inherent uncertainty for the clinical consultation: qualitative study. BMJ. 2005, 330: 511-517. 10.1136/bmj.38336.482720.8F.CrossRefPubMedPubMedCentral
3.
go back to reference Bruyninckx R, Van den Bruel A, Hannes K, Buntinx F, Aertgeerts B: GPs' reasons for referral of patients with chest pain: a qualitative study. BMC Fam Pract. 2009, 10: 55-10.1186/1471-2296-10-55.CrossRefPubMedPubMedCentral Bruyninckx R, Van den Bruel A, Hannes K, Buntinx F, Aertgeerts B: GPs' reasons for referral of patients with chest pain: a qualitative study. BMC Fam Pract. 2009, 10: 55-10.1186/1471-2296-10-55.CrossRefPubMedPubMedCentral
4.
go back to reference Hani MA, Keller H, Vandenesch J, Sonnichsen AC, Griffiths F, Donner-Banzhoff N: Different from what the textbooks say: how GPs diagnose coronary heart disease. Fam Pract. 2007, 24: 622-627. 10.1093/fampra/cmm053.CrossRefPubMed Hani MA, Keller H, Vandenesch J, Sonnichsen AC, Griffiths F, Donner-Banzhoff N: Different from what the textbooks say: how GPs diagnose coronary heart disease. Fam Pract. 2007, 24: 622-627. 10.1093/fampra/cmm053.CrossRefPubMed
5.
go back to reference Johansen ML, Holtedahl KA, Rudebeck CE: How does the thought of cancer arise in a general practice consultation? Interviews with GPs. Scand J Prim Health Care. 2012, 30: 135-140. 10.3109/02813432.2012.688701.CrossRefPubMedPubMedCentral Johansen ML, Holtedahl KA, Rudebeck CE: How does the thought of cancer arise in a general practice consultation? Interviews with GPs. Scand J Prim Health Care. 2012, 30: 135-140. 10.3109/02813432.2012.688701.CrossRefPubMedPubMedCentral
6.
go back to reference Bruyninckx R, Aertgeerts B, Bruyninckx P, Buntinx F: Signs and symptoms in diagnosing acute myocardial infarction and acute coronary syndrome: a diagnostic meta-analysis. Br J Gen Pract. 2008, 58: 105-111.CrossRefPubMed Bruyninckx R, Aertgeerts B, Bruyninckx P, Buntinx F: Signs and symptoms in diagnosing acute myocardial infarction and acute coronary syndrome: a diagnostic meta-analysis. Br J Gen Pract. 2008, 58: 105-111.CrossRefPubMed
7.
go back to reference Buntinx F, Truyen J, Embrechts P, Moreel G, Peeters R: Chest pain: an evaluation of the initial diagnosis made by 25 Flemish general practitioners. Fam Pract. 1991, 8: 121-124. 10.1093/fampra/8.2.121.CrossRefPubMed Buntinx F, Truyen J, Embrechts P, Moreel G, Peeters R: Chest pain: an evaluation of the initial diagnosis made by 25 Flemish general practitioners. Fam Pract. 1991, 8: 121-124. 10.1093/fampra/8.2.121.CrossRefPubMed
8.
go back to reference Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D: Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. 2010, 375: 834-845. 10.1016/S0140-6736(09)62000-6.CrossRefPubMed Van den Bruel A, Haj-Hassan T, Thompson M, Buntinx F, Mant D: Diagnostic value of clinical features at presentation to identify serious infection in children in developed countries: a systematic review. Lancet. 2010, 375: 834-845. 10.1016/S0140-6736(09)62000-6.CrossRefPubMed
9.
go back to reference Van den Bruel A, Aertgeerts B, Bruyninckx R, Aerts M, Buntinx F: Signs and symptoms for diagnosis of serious infections in children: a prospective study in primary care. Br J Gen Pract. 2007, 57: 538-546.PubMedPubMedCentral Van den Bruel A, Aertgeerts B, Bruyninckx R, Aerts M, Buntinx F: Signs and symptoms for diagnosis of serious infections in children: a prospective study in primary care. Br J Gen Pract. 2007, 57: 538-546.PubMedPubMedCentral
10.
go back to reference Lykke K, Christensen P, Reventlow S: "This is not normal … "–signs that make the GP question the child's well-being. Fam Pract. 2008, 25: 146-153. 10.1093/fampra/cmn021.CrossRefPubMed Lykke K, Christensen P, Reventlow S: "This is not normal … "–signs that make the GP question the child's well-being. Fam Pract. 2008, 25: 146-153. 10.1093/fampra/cmn021.CrossRefPubMed
11.
go back to reference Stolper CF, Van Bokhoven MA, Houben PHH, Van Royen P, Van de Wiel M, Van der Weijden T, et al: The diagnostic role of gut feelings in general practice. A focus group study of the concept and its determinants. BMC Fam Pract. 2009, 10: 17-10.1186/1471-2296-10-17.CrossRefPubMedPubMedCentral Stolper CF, Van Bokhoven MA, Houben PHH, Van Royen P, Van de Wiel M, Van der Weijden T, et al: The diagnostic role of gut feelings in general practice. A focus group study of the concept and its determinants. BMC Fam Pract. 2009, 10: 17-10.1186/1471-2296-10-17.CrossRefPubMedPubMedCentral
12.
go back to reference Stolper CF, Legemaate J, Dinant GJ: How do disciplinary tribunals judge the 'gut feelings' of doctors? An analysis of Dutch tribunal decisions 2000-2008. J Law and Medicine. 2010, 18: 68-75. Stolper CF, Legemaate J, Dinant GJ: How do disciplinary tribunals judge the 'gut feelings' of doctors? An analysis of Dutch tribunal decisions 2000-2008. J Law and Medicine. 2010, 18: 68-75.
13.
go back to reference Stolper CF, Van de Wiel M, Van Royen P, Van Bokhoven MA, Van der Weijden T, Dinant GJ: Gut feelings as a third track in general practitioners' diagnostic reasoning. J Gen Intern Med. 2011, 26: 197-203. 10.1007/s11606-010-1524-5.CrossRefPubMed Stolper CF, Van de Wiel M, Van Royen P, Van Bokhoven MA, Van der Weijden T, Dinant GJ: Gut feelings as a third track in general practitioners' diagnostic reasoning. J Gen Intern Med. 2011, 26: 197-203. 10.1007/s11606-010-1524-5.CrossRefPubMed
14.
go back to reference Kahneman D, Klein G: Conditions for intuitive expertise: a failure to disagree. Am Psychol. 2009, 64: 515-526.CrossRefPubMed Kahneman D, Klein G: Conditions for intuitive expertise: a failure to disagree. Am Psychol. 2009, 64: 515-526.CrossRefPubMed
15.
go back to reference Pelaccia T, Tardif J, Triby E, Charlin B: An analysis of clinical reasoning through a recent and comprehensive approach: the dual-process theory. 2011, Online: Med Educ, 16- Pelaccia T, Tardif J, Triby E, Charlin B: An analysis of clinical reasoning through a recent and comprehensive approach: the dual-process theory. 2011, Online: Med Educ, 16-
16.
go back to reference Slovic P, Finucane M, Peters E, MacGregor DG: The Affect Heuristic. Heuristics and biases. Edited by: Gilovich T, Griffin D, Kahneman D. 2002, New York: Cambridge University Press, 397-420.CrossRef Slovic P, Finucane M, Peters E, MacGregor DG: The Affect Heuristic. Heuristics and biases. Edited by: Gilovich T, Griffin D, Kahneman D. 2002, New York: Cambridge University Press, 397-420.CrossRef
17.
go back to reference Finucane M, Peters E, Slovic P: Judgement and decision making: The dance of affect and reason. Emerging Perspectives on Judgement and Decision Research. Edited by: Schneider SL, Shanteau J. 2003, Cambridge, UK: Cambridge University Press, 327-364.CrossRef Finucane M, Peters E, Slovic P: Judgement and decision making: The dance of affect and reason. Emerging Perspectives on Judgement and Decision Research. Edited by: Schneider SL, Shanteau J. 2003, Cambridge, UK: Cambridge University Press, 327-364.CrossRef
18.
go back to reference Epstein S: Integration of the cognitive and the psychodynamic unconscious. Am Psychol. 1994, 49: 709-724.CrossRefPubMed Epstein S: Integration of the cognitive and the psychodynamic unconscious. Am Psychol. 1994, 49: 709-724.CrossRefPubMed
19.
go back to reference Mikels JA, Maglio SJ, Reed AE, Kaplowitz LJ: Should I go with my gut? Investigating the benefits of emotion-focused decision making. Emotion. 2011, 11: 743-753.CrossRefPubMed Mikels JA, Maglio SJ, Reed AE, Kaplowitz LJ: Should I go with my gut? Investigating the benefits of emotion-focused decision making. Emotion. 2011, 11: 743-753.CrossRefPubMed
20.
go back to reference Craig AD: How do you feel–now? The anterior insula and human awareness. Nat Rev Neurosci. 2009, 10: 59-70. 10.1038/nrn2555.CrossRefPubMed Craig AD: How do you feel–now? The anterior insula and human awareness. Nat Rev Neurosci. 2009, 10: 59-70. 10.1038/nrn2555.CrossRefPubMed
21.
go back to reference Naqvi N, Shiv B, Bechara A: The Role of Emotions in Decision Making: a Cognitive Neuroscience Perspective. Curr Dir Psychol Sci. 2006, 15: 260-264. 10.1111/j.1467-8721.2006.00448.x.CrossRef Naqvi N, Shiv B, Bechara A: The Role of Emotions in Decision Making: a Cognitive Neuroscience Perspective. Curr Dir Psychol Sci. 2006, 15: 260-264. 10.1111/j.1467-8721.2006.00448.x.CrossRef
22.
go back to reference Damasio AR: Descartes' Error: Emotion, Reason, and the Human Brain. 1994, New York: Avon Damasio AR: Descartes' Error: Emotion, Reason, and the Human Brain. 1994, New York: Avon
23.
go back to reference Buntinx F, Mant D, Van den Bruel A, Donner-Banzhof N, Dinant GJ: Dealing with low-incidence serious diseases in general practice. Br J Gen Pract. 2011, 61: 43-46. 10.3399/bjgp11X548974.CrossRefPubMedPubMedCentral Buntinx F, Mant D, Van den Bruel A, Donner-Banzhof N, Dinant GJ: Dealing with low-incidence serious diseases in general practice. Br J Gen Pract. 2011, 61: 43-46. 10.3399/bjgp11X548974.CrossRefPubMedPubMedCentral
24.
go back to reference Stolper CF, Van Leeuwen Y, Van Royen P, Van de Wiel M, van Bokhoven MA, Houben PHH, et al: Establishing an international research agenda on gut feelings in general practice using the nominal group technique. Eur J of Gen Pract. 2010, 2: 75-79.CrossRef Stolper CF, Van Leeuwen Y, Van Royen P, Van de Wiel M, van Bokhoven MA, Houben PHH, et al: Establishing an international research agenda on gut feelings in general practice using the nominal group technique. Eur J of Gen Pract. 2010, 2: 75-79.CrossRef
25.
go back to reference Smith AJ: The development and psychometric testing of an instrument measuring the use of intuition by nursing students. 2003, University of San Diego: Dissertation Smith AJ: The development and psychometric testing of an instrument measuring the use of intuition by nursing students. 2003, University of San Diego: Dissertation
26.
go back to reference Smith A: Measuring the use of intuition by registered nurses in clinical practice. Nurs Stand. 2007, 21: 35-41. 10.1007/BF03079502.CrossRefPubMed Smith A: Measuring the use of intuition by registered nurses in clinical practice. Nurs Stand. 2007, 21: 35-41. 10.1007/BF03079502.CrossRefPubMed
27.
go back to reference Smith AJ, Thurkettle MA, dela Cruz FA: Use of intuition by nursing students: instrument development and testing. J Adv Nurs. 2004, 47: 614-622. 10.1111/j.1365-2648.2004.03149.x.CrossRefPubMed Smith AJ, Thurkettle MA, dela Cruz FA: Use of intuition by nursing students: instrument development and testing. J Adv Nurs. 2004, 47: 614-622. 10.1111/j.1365-2648.2004.03149.x.CrossRefPubMed
28.
go back to reference Miller VG: Measurement of self-perception of intuitiveness. West J Nurs Res. 1993, 15: 595-606. 10.1177/019394599301500506.CrossRefPubMed Miller VG: Measurement of self-perception of intuitiveness. West J Nurs Res. 1993, 15: 595-606. 10.1177/019394599301500506.CrossRefPubMed
29.
go back to reference Rew L: Acknowledging intuition in clinical decision making. J Holist Nurs. 2000, 18: 94-13. 10.1177/089801010001800202.CrossRefPubMed Rew L: Acknowledging intuition in clinical decision making. J Holist Nurs. 2000, 18: 94-13. 10.1177/089801010001800202.CrossRefPubMed
30.
go back to reference Miller VG: The development of an instrument to measure self-perception of intuitiveness of practicing nurses. 1990, University of Texas at Austin: Dissertation Miller VG: The development of an instrument to measure self-perception of intuitiveness of practicing nurses. 1990, University of Texas at Austin: Dissertation
31.
go back to reference Stolper CF, Van Royen P, Van Bokhoven MA, Houben PHH, Van de Wiel M, Van der Weijden T, et al: Consensus on gut feelings in general practice. BMC Family Practice. 2009, 10: 66-10.1186/1471-2296-10-66.CrossRefPubMedPubMedCentral Stolper CF, Van Royen P, Van Bokhoven MA, Houben PHH, Van de Wiel M, Van der Weijden T, et al: Consensus on gut feelings in general practice. BMC Family Practice. 2009, 10: 66-10.1186/1471-2296-10-66.CrossRefPubMedPubMedCentral
32.
go back to reference Smith GT: On Construct Validity: Issues of Method and Measurement. Psychol Assess. 2005, 17: 396-408.CrossRefPubMed Smith GT: On Construct Validity: Issues of Method and Measurement. Psychol Assess. 2005, 17: 396-408.CrossRefPubMed
33.
go back to reference Vet de HCW, Terwee CW, Mokkink LB, Knol DL: Measurement in Medicine. A practical guide. 2011, Cambridge: Cambridge University PressCrossRef Vet de HCW, Terwee CW, Mokkink LB, Knol DL: Measurement in Medicine. A practical guide. 2011, Cambridge: Cambridge University PressCrossRef
34.
go back to reference Baks M: Pulmonary embolism often not immediately evident [Longembolie lang niet altijd direct duidelijk]. Huisarts 24/7. 2009, 28-29. Baks M: Pulmonary embolism often not immediately evident [Longembolie lang niet altijd direct duidelijk]. Huisarts 24/7. 2009, 28-29.
36.
go back to reference Cohen J: The significance of a product moment r. Statistical power analysis for the behavioural sciences. 1988, Hillsdale, New Yersey: Erlbaum, 75-107. Cohen J: The significance of a product moment r. Statistical power analysis for the behavioural sciences. 1988, Hillsdale, New Yersey: Erlbaum, 75-107.
37.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1978, 33: 159-174.CrossRef Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1978, 33: 159-174.CrossRef
39.
go back to reference Acquadro C, Conway K, Hareendran A, Aaronson N: Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health. 2008, 11: 509-521. 10.1111/j.1524-4733.2007.00292.x.CrossRefPubMed Acquadro C, Conway K, Hareendran A, Aaronson N: Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health. 2008, 11: 509-521. 10.1111/j.1524-4733.2007.00292.x.CrossRefPubMed
40.
go back to reference Streiner DL, Norman GR: Health Measurement Scales. A practical guide to their development and use. 2006, Oxford: Oxford University Press, 3 Streiner DL, Norman GR: Health Measurement Scales. A practical guide to their development and use. 2006, Oxford: Oxford University Press, 3
41.
go back to reference Acquadro C, Conway K, Giroudet C, Mear I: Linguistic validation manual for patient-reported outcomes (PRO) instruments. 2004, Lyon: MAPI Research Institute Acquadro C, Conway K, Giroudet C, Mear I: Linguistic validation manual for patient-reported outcomes (PRO) instruments. 2004, Lyon: MAPI Research Institute
42.
go back to reference Cone KJ: The development and testing of an instrument to measure decision making in emergency department triage nurses. 2000, Saint Louis University: Dissertation Cone KJ: The development and testing of an instrument to measure decision making in emergency department triage nurses. 2000, Saint Louis University: Dissertation
Metadata
Title
Family physicians’ diagnostic gut feelings are measurable: construct validation of a questionnaire
Authors
Christiaan F Stolper
Margje WJ Van de Wiel
Henrica CW De Vet
Alexander LB Rutten
Paul Van Royen
Marloes A Van Bokhoven
Trudy Van der Weijden
Geert Jan Dinant
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2013
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/1471-2296-14-1

Other articles of this Issue 1/2013

BMC Primary Care 1/2013 Go to the issue