Skip to main content
Top
Published in: BMC Health Services Research 1/2002

Open Access 01-12-2002 | Research article

Accuracy of responses from postal surveys about continuing medical education and information behavior: experiences from a survey among German diabetologists

Author: Sven Trelle

Published in: BMC Health Services Research | Issue 1/2002

Login to get access

Abstract

Background

Postal surveys are a popular instrument for studies about continuing medical education habits. But little is known about the accuracy of responses in such surveys. The objective of this study was to quantify the magnitude of inaccurate responses in a postal survey among physicians.

Methods

A sub-analysis of a questionnaire about continuing medical education habits and information management was performed. The five variables used for the quantitative analysis are based on a question about the knowledge of a fictitious technical term and on inconsistencies in contingency tables of answers to logically connected questions.

Results

Response rate was 52%. Non-response bias is possible but seems not very likely since an association between demographic variables and inconsistent responses could not be found. About 10% of responses were inaccurate according to the definition.

Conclusion

It was shown that a sub-analysis of a questionnaire makes a quantification of inaccurate responses in postal surveys possible. This sub-analysis revealed that a notable portion of responses in a postal survey about continuing medical education habits and information management was inaccurate.
Appendix
Available only for authorised users
Literature
2.
go back to reference Detlefson EG: The information behaviors of life and health scientists and care providers: characteristics of the research literature:. Bull Med Libr Assoc. 1998, 86: 385-390. Detlefson EG: The information behaviors of life and health scientists and care providers: characteristics of the research literature:. Bull Med Libr Assoc. 1998, 86: 385-390.
3.
go back to reference Kaner EFS, Haighton CA, McAvoy BR: 'So much post, so busy with practice – so, no time!': a telephone survey of general practitioners' reasons for not participating in postal questionnaire surveys. Br J Gen Pract. 1998, 48: 1067-1069.PubMedPubMedCentral Kaner EFS, Haighton CA, McAvoy BR: 'So much post, so busy with practice – so, no time!': a telephone survey of general practitioners' reasons for not participating in postal questionnaire surveys. Br J Gen Pract. 1998, 48: 1067-1069.PubMedPubMedCentral
4.
go back to reference Armstrong D, Ashworth M: When questionnaire response rates do matter: a survey of general practitioner and their views of NHS changes. Br J Gen Pract. 2000, 50: 479-480.PubMedPubMedCentral Armstrong D, Ashworth M: When questionnaire response rates do matter: a survey of general practitioner and their views of NHS changes. Br J Gen Pract. 2000, 50: 479-480.PubMedPubMedCentral
5.
go back to reference Alreck PL, Settle RB: The survey research handbook. Boston (Mass): Irwin/McGraw-Hill. 1995, 2 Alreck PL, Settle RB: The survey research handbook. Boston (Mass): Irwin/McGraw-Hill. 1995, 2
6.
go back to reference Embree BG, Whitehead PC: Validity and reliability of self-reported drinking behavior: dealing with the problem of response bias. J Stud Alcohol. 1993, 54: 334-344.CrossRefPubMed Embree BG, Whitehead PC: Validity and reliability of self-reported drinking behavior: dealing with the problem of response bias. J Stud Alcohol. 1993, 54: 334-344.CrossRefPubMed
7.
go back to reference Knowles ES, Nathan KT: Acquiescent responding in self-reports: cognitive style or social concern?. Journal of Research in Personality. 1997, 31: 293-301. 10.1006/jrpe.1997.2180.CrossRef Knowles ES, Nathan KT: Acquiescent responding in self-reports: cognitive style or social concern?. Journal of Research in Personality. 1997, 31: 293-301. 10.1006/jrpe.1997.2180.CrossRef
8.
go back to reference Guyatt GH, Cook DJ, King D, Norman GR, Kane SL, VanIneveld C: Effect of the framing of questionnaire items regarding satisfaction with training on residents' responses. Acad Med. 1999, 74: 192-194.CrossRefPubMed Guyatt GH, Cook DJ, King D, Norman GR, Kane SL, VanIneveld C: Effect of the framing of questionnaire items regarding satisfaction with training on residents' responses. Acad Med. 1999, 74: 192-194.CrossRefPubMed
9.
go back to reference Wulff HR, Andersen B, Brandehoff P, Guttler F: What do doctors know about statistics?. Stat Med. 1987, 6: 3-10.CrossRefPubMed Wulff HR, Andersen B, Brandehoff P, Guttler F: What do doctors know about statistics?. Stat Med. 1987, 6: 3-10.CrossRefPubMed
10.
go back to reference Covell DG, Uman GC, Manning PR: Information needs in office practice: are they being met?. Ann Intern Med. 1985, 103: 596-599.CrossRefPubMed Covell DG, Uman GC, Manning PR: Information needs in office practice: are they being met?. Ann Intern Med. 1985, 103: 596-599.CrossRefPubMed
11.
go back to reference Schmidt HG, VanDerMolen HT: Self-reported competency ratings of graduates of a problem-based curriculum. Acad Med. 2001, 76: 466-468.CrossRefPubMed Schmidt HG, VanDerMolen HT: Self-reported competency ratings of graduates of a problem-based curriculum. Acad Med. 2001, 76: 466-468.CrossRefPubMed
12.
go back to reference Avorn J, Chen M, Hartley R: Scientific versus commercial sources of influence on the prescribing behaviour of physicians. Am J Med. 1982, 73: 4-8.CrossRefPubMed Avorn J, Chen M, Hartley R: Scientific versus commercial sources of influence on the prescribing behaviour of physicians. Am J Med. 1982, 73: 4-8.CrossRefPubMed
13.
go back to reference Curry L, Purkis IE: Validity of self-reports of behavior changes by participants after a CME course. J Med Educ. 1986, 61: 579-584.PubMed Curry L, Purkis IE: Validity of self-reports of behavior changes by participants after a CME course. J Med Educ. 1986, 61: 579-584.PubMed
14.
go back to reference Rosser WW, Palmer WH, on behalf of the Ontario Task Force On The Use And Provision Of Medical Services: Dissemination of guidelines on cholesterol. Can Fam Physician. 1993, 39: 280-284.PubMedPubMedCentral Rosser WW, Palmer WH, on behalf of the Ontario Task Force On The Use And Provision Of Medical Services: Dissemination of guidelines on cholesterol. Can Fam Physician. 1993, 39: 280-284.PubMedPubMedCentral
15.
go back to reference Saver BG, Taylor TR, Treadwell JR, Cole WG: Do physicians do as they say? The case of mammography. Arch Fam Med. 1997, 6: 543-546. 10.1001/archfami.6.6.543.CrossRefPubMed Saver BG, Taylor TR, Treadwell JR, Cole WG: Do physicians do as they say? The case of mammography. Arch Fam Med. 1997, 6: 543-546. 10.1001/archfami.6.6.543.CrossRefPubMed
16.
go back to reference Wennberg DE, Dickens JD, Biener L, Fowler FJ, Soule DN, Keller RB: Do physicians do what they say? The inclination to test and its association with coronary angiography rates. J Gen Intern Med. 1997, 12: 172-176. 10.1046/j.1525-1497.1997.012003172.x.PubMedPubMedCentral Wennberg DE, Dickens JD, Biener L, Fowler FJ, Soule DN, Keller RB: Do physicians do what they say? The inclination to test and its association with coronary angiography rates. J Gen Intern Med. 1997, 12: 172-176. 10.1046/j.1525-1497.1997.012003172.x.PubMedPubMedCentral
17.
go back to reference Adams AS, Soumerai SB, Lomas J, Ross-Degnan D: Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health Care. 1999, 11: 187-192. 10.1093/intqhc/11.3.187.CrossRefPubMed Adams AS, Soumerai SB, Lomas J, Ross-Degnan D: Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health Care. 1999, 11: 187-192. 10.1093/intqhc/11.3.187.CrossRefPubMed
18.
go back to reference Fletcher P: Continuing medical education in a district general hospital: a snapshot. Med Educ. 2001, 35: 967-972. 10.1046/j.1365-2923.2001.01025.x.CrossRefPubMed Fletcher P: Continuing medical education in a district general hospital: a snapshot. Med Educ. 2001, 35: 967-972. 10.1046/j.1365-2923.2001.01025.x.CrossRefPubMed
19.
go back to reference McColl A, Smith H, White P, Field J: General practitioners' perceptions of the route to evidence based medicine: a questionnaire survey. BMJ. 1998, 316: 361-365.CrossRefPubMedPubMedCentral McColl A, Smith H, White P, Field J: General practitioners' perceptions of the route to evidence based medicine: a questionnaire survey. BMJ. 1998, 316: 361-365.CrossRefPubMedPubMedCentral
20.
go back to reference Williamson JW, Pearl SG, Weiss R, Skinner EA, Bowes F: Health science information management and continuing education of physicians: a survey of US primary care practitioners and their opinion leaders. Ann Intern Med. 1989, 110: 151-160.CrossRefPubMed Williamson JW, Pearl SG, Weiss R, Skinner EA, Bowes F: Health science information management and continuing education of physicians: a survey of US primary care practitioners and their opinion leaders. Ann Intern Med. 1989, 110: 151-160.CrossRefPubMed
21.
go back to reference Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habits of internists. J Gen Intern Med. 2001, 15: 881-884. 10.1046/j.1525-1497.2000.00202.x.CrossRef Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habits of internists. J Gen Intern Med. 2001, 15: 881-884. 10.1046/j.1525-1497.2000.00202.x.CrossRef
22.
go back to reference Trelle S: Information management and reading habits of German diabetologists: a questionnaire survey. Diabetologia. 2002, 45: 764-774. 10.1007/s00125-002-0807-8.CrossRefPubMed Trelle S: Information management and reading habits of German diabetologists: a questionnaire survey. Diabetologia. 2002, 45: 764-774. 10.1007/s00125-002-0807-8.CrossRefPubMed
23.
go back to reference Deibler G: Fortbildungsverhalten niedergelassener Internisten im Raum Suedwuerttemberg [dissertation]. Tuebingen: Eberhard-Karls Universitaet; [German]. 1995 Deibler G: Fortbildungsverhalten niedergelassener Internisten im Raum Suedwuerttemberg [dissertation]. Tuebingen: Eberhard-Karls Universitaet; [German]. 1995
24.
go back to reference Bortz J, Lienert GA, Boehnke K: Verteilungsfreie Methoden in der Biostatistik. Berlin: Springer; [German]. 2000, 2 Bortz J, Lienert GA, Boehnke K: Verteilungsfreie Methoden in der Biostatistik. Berlin: Springer; [German]. 2000, 2
25.
go back to reference Cummings SM, Savitz LA, Konrad TR: Reported response rates to mailed physician questionnaires. Health Serv Res. 2001, 35: 1347-1355.PubMedPubMedCentral Cummings SM, Savitz LA, Konrad TR: Reported response rates to mailed physician questionnaires. Health Serv Res. 2001, 35: 1347-1355.PubMedPubMedCentral
26.
go back to reference Asch DA, Jedrziewski MK, Christakis NA: Response rates to mail surveys published in medical journals. J Clin Epidemio. 1997, 50: 1129-1136. 10.1016/S0895-4356(97)00126-1.CrossRef Asch DA, Jedrziewski MK, Christakis NA: Response rates to mail surveys published in medical journals. J Clin Epidemio. 1997, 50: 1129-1136. 10.1016/S0895-4356(97)00126-1.CrossRef
27.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. New York: McGraw-Hill. 1994, 3 Nunnally JC, Bernstein IH: Psychometric theory. New York: McGraw-Hill. 1994, 3
28.
go back to reference Young JM, Glasziou P, Ward JE: General practitioners' self ratings of skills in evidence based medicine: validation study. BMJ. 2002, 324: 950-951. 10.1136/bmj.324.7343.950.CrossRefPubMedPubMedCentral Young JM, Glasziou P, Ward JE: General practitioners' self ratings of skills in evidence based medicine: validation study. BMJ. 2002, 324: 950-951. 10.1136/bmj.324.7343.950.CrossRefPubMedPubMedCentral
29.
go back to reference Jackson DN: Acquiescent response styles: problems of identification and control. In: Response set in personality assessment. Edited by: Berg IA. 1967, Chicago, Aldine, 71-114. Jackson DN: Acquiescent response styles: problems of identification and control. In: Response set in personality assessment. Edited by: Berg IA. 1967, Chicago, Aldine, 71-114.
Metadata
Title
Accuracy of responses from postal surveys about continuing medical education and information behavior: experiences from a survey among German diabetologists
Author
Sven Trelle
Publication date
01-12-2002
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2002
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-2-15

Other articles of this Issue 1/2002

BMC Health Services Research 1/2002 Go to the issue