Skip to main content
Top
Published in: The Journal of Headache and Pain 1/2014

Open Access 01-12-2014 | Research article

Fraud in a population-based study of headache: prevention, detection and correction

Authors: Bilal Ahmed, Ali Ahmad, Akbar A Herekar, Umer L Uqaili, Jahanzeb Effendi, S Zia Alvi, Arif D Herekar, Timothy J Steiner

Published in: The Journal of Headache and Pain | Issue 1/2014

Login to get access

Abstract

Background

In medicine, research misconduct is historically associated with laboratory or pharmaceutical research, but the vulnerability of epidemiological surveys should be recognized. As these surveys underpin health policy and allocation of limited resources, misreporting can have far-reaching implications. We report how fraud in a nationwide headache survey occurred and how it was discovered and rectified before it could cause harm.

Methods

The context was a door-to-door survey to estimate the prevalence and burden of headache disorders in Pakistan. Data were collected from all four provinces of Pakistan by non-medical interviewers and collated centrally. Measures to ensure data integrity were preventative, detective and corrective. We carefully selected and trained the interviewers, set rules of conduct and gave specific warnings regarding the consequences of falsification. We employed two-fold fraud detection methods: comparative data analysis, and face-to-face re-contact with randomly selected participants. When fabrication was detected, data shown to be unreliable were replaced by repeating the survey in new samples according to the original protocol.

Results

Comparative analysis of datasets from the regions revealed unfeasible prevalences and gender ratios in one (Multan). Data fabrication was suspected. During a surprise-visit to Multan, of a random sample of addresses selected for verification, all but one had been falsely reported. The data (from 840 cases) were discarded, and the survey repeated with new interviewers. The new sample of 800 cases was demographically and diagnostically consistent with other regions.

Conclusion

Fraud in community-based surveys is seldom reported, but no less likely to occur than in other fields of medical research. Measures should be put in place to prevent, detect and, where necessary, correct it. In this instance, had the data from Multan been pooled with those from other regions before analysis, a damaging fraud might have escaped notice.
Literature
1.
go back to reference United States Department of Health and Human Services Office of Research Integrity: Definition of research misconduct. 2011. United States Department of Health and Human Services Office of Research Integrity: Definition of research misconduct. 2011.
2.
go back to reference Fanelli D: How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS One 2009, 4: e5738. 10.1371/journal.pone.0005738PubMedCentralCrossRefPubMed Fanelli D: How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS One 2009, 4: e5738. 10.1371/journal.pone.0005738PubMedCentralCrossRefPubMed
3.
go back to reference Wilmshurst P: Dishonesty in medical research. Medicolegal J 2007, 75: 3–12. PubMed: 17506338PubMed Wilmshurst P: Dishonesty in medical research. Medicolegal J 2007, 75: 3–12. PubMed: 17506338PubMed
4.
go back to reference Dyer C: Consultant struck off over research fraud. BMJ 1997, 315: 205–210. PubMed: 11644983PubMed Dyer C: Consultant struck off over research fraud. BMJ 1997, 315: 205–210. PubMed: 11644983PubMed
7.
go back to reference Weissmann G: Science fraud: from patchwork mouse to patchwork data. FASEB J 2006, 20: 587–590. 10.1096/fj.06-0401ufmCrossRefPubMed Weissmann G: Science fraud: from patchwork mouse to patchwork data. FASEB J 2006, 20: 587–590. 10.1096/fj.06-0401ufmCrossRefPubMed
9.
go back to reference Godlee F, Smith J, Marcovitch H: Wakefield’s article linking MMR vaccine and autism was fraudulent. BMJ 2011, 342: c7452. 10.1136/bmj.c7452CrossRefPubMed Godlee F, Smith J, Marcovitch H: Wakefield’s article linking MMR vaccine and autism was fraudulent. BMJ 2011, 342: c7452. 10.1136/bmj.c7452CrossRefPubMed
10.
go back to reference United States Department of Health and Human Services Office of Research Integrity: Findings of research misconduct. 2011. United States Department of Health and Human Services Office of Research Integrity: Findings of research misconduct. 2011.
11.
go back to reference Toho University: Disciplinary decision concerning Dr. Yoshitaka Fujii. 2012. Toho University: Disciplinary decision concerning Dr. Yoshitaka Fujii. 2012.
12.
go back to reference Stovner LJ, Al Jumah M, Birbeck GL, Gururaj G, Jensen R, Katsarava Z, Queiroz LP, Scher AI, Tekle-Haimanot R, Wang SJ, Steiner TJ: The methodology of population surveys of headache prevalence, burden and cost: Principles and recommendations from the Global Campaign against Headache. J Headache Pain 2014, 15: 5. doi:10.1186/1129–2377–15–5 10.1186/1129-2377-15-5PubMedCentralCrossRefPubMed Stovner LJ, Al Jumah M, Birbeck GL, Gururaj G, Jensen R, Katsarava Z, Queiroz LP, Scher AI, Tekle-Haimanot R, Wang SJ, Steiner TJ: The methodology of population surveys of headache prevalence, burden and cost: Principles and recommendations from the Global Campaign against Headache. J Headache Pain 2014, 15: 5. doi:10.1186/1129–2377–15–5 10.1186/1129-2377-15-5PubMedCentralCrossRefPubMed
13.
go back to reference Herekar AD, Herekar AA, Ahmad A, Uqaili UL, Ahmed B, Effendi JA, Alvi SZ, Steiner TJ: The burden of headache disorders in Pakistan: methodology of a population-based nationwide study, and questionnaire validation. J Headache Pain 2013, 14: 73. 10.1186/1129-2377-14-73PubMedCentralCrossRefPubMed Herekar AD, Herekar AA, Ahmad A, Uqaili UL, Ahmed B, Effendi JA, Alvi SZ, Steiner TJ: The burden of headache disorders in Pakistan: methodology of a population-based nationwide study, and questionnaire validation. J Headache Pain 2013, 14: 73. 10.1186/1129-2377-14-73PubMedCentralCrossRefPubMed
14.
go back to reference Pakistan Federal Bureau of Statistics: Pakistan statistical pocket book. FBS, Islamabad; 2006. Pakistan Federal Bureau of Statistics: Pakistan statistical pocket book. FBS, Islamabad; 2006.
15.
go back to reference Khajuria A, Agha R: Fraud in scientific research – birth of the Concordat to uphold research integrity in the United Kingdom. J Roy Soc Med 2014, 107: 61–65. 10.1177/0141076813511452CrossRefPubMed Khajuria A, Agha R: Fraud in scientific research – birth of the Concordat to uphold research integrity in the United Kingdom. J Roy Soc Med 2014, 107: 61–65. 10.1177/0141076813511452CrossRefPubMed
17.
go back to reference American Association for Public Opinion Research: Interviewer falsification in survey research: Current best methods for prevention, detection and repair of its effects. 2003. American Association for Public Opinion Research: Interviewer falsification in survey research: Current best methods for prevention, detection and repair of its effects. 2003.
18.
go back to reference Rao GN, Kulkarni GB, Gururaj G, Rajesh K, Subbakrishna DK, Steiner TJ, Stovner LJ: The burden of headache disorders in India: methodology and questionnaire validation for a community-based survey in Karnataka State. J Headache Pain 2012, 13: 543–550. doi:10.1007/s10194–012–0474–1. Epub 2012 Aug 22 10.1007/s10194-012-0474-1PubMedCentralCrossRefPubMed Rao GN, Kulkarni GB, Gururaj G, Rajesh K, Subbakrishna DK, Steiner TJ, Stovner LJ: The burden of headache disorders in India: methodology and questionnaire validation for a community-based survey in Karnataka State. J Headache Pain 2012, 13: 543–550. doi:10.1007/s10194–012–0474–1. Epub 2012 Aug 22 10.1007/s10194-012-0474-1PubMedCentralCrossRefPubMed
Metadata
Title
Fraud in a population-based study of headache: prevention, detection and correction
Authors
Bilal Ahmed
Ali Ahmad
Akbar A Herekar
Umer L Uqaili
Jahanzeb Effendi
S Zia Alvi
Arif D Herekar
Timothy J Steiner
Publication date
01-12-2014
Publisher
Springer Milan
Published in
The Journal of Headache and Pain / Issue 1/2014
Print ISSN: 1129-2369
Electronic ISSN: 1129-2377
DOI
https://doi.org/10.1186/1129-2377-15-37

Other articles of this Issue 1/2014

The Journal of Headache and Pain 1/2014 Go to the issue