Skip to main content
Top
Published in: Emerging Themes in Epidemiology 1/2010

Open Access 01-12-2010 | Methodology

Testing bias in clinical databases: methodological considerations

Authors: Karin J Velthove, Hubert GM Leufkens, Patrick C Souverein, René C Schweizer, Wouter W van Solinge

Published in: Emerging Themes in Epidemiology | Issue 1/2010

Login to get access

Abstract

Background

Laboratory testing in clinical practice is never a random process. In this study we evaluated testing bias for neutrophil counts in clinical practice by using results from requested and non-requested hematological blood tests.

Methods

This study was conducted using data from the Utrecht Patient Oriented Database. This clinical database is unique, as it contains physician requested data, but also data that are not requested by the physician, but measured as result of requesting other hematological parameters. We identified adult patients, hospitalized in 2005 with at least two blood tests during admission, where requests for general blood profiles and specifically for neutrophil counts were contrasted in scenario analyses. Possible effect modifiers were diagnosis and glucocorticoid use.

Results

A total of 567 patients with requested neutrophil counts and 1,439 patients with non-requested neutrophil counts were analyzed. The absolute neutrophil count at admission differed with a mean of 7.4 × 109/l for requested counts and 8.3 × 109/l for non-requested counts (p-value < 0.001). This difference could be explained for 83.2% by the occurrence of cardiovascular disease as underlying disease and for 4.5% by glucocorticoid use.

Conclusion

Requests for neutrophil counts in clinical databases are associated with underlying disease and with cardiovascular disease in particular. The results from our study show the importance of evaluating testing bias in epidemiological studies obtaining data from clinical databases.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lawrenson R, Williams T, Farmer R: Clinical information for research; the use of general practice databases. J Public Health Med. 1999, 21: 299-304. 10.1093/pubmed/21.3.299CrossRefPubMed Lawrenson R, Williams T, Farmer R: Clinical information for research; the use of general practice databases. J Public Health Med. 1999, 21: 299-304. 10.1093/pubmed/21.3.299CrossRefPubMed
2.
go back to reference Flouris AD, Duffy J: Applications of artificial intelligence systems in the analysis of epidemiological data. Eur J Epidemiol. 2006, 21: 167-70. 10.1007/s10654-006-0005-yCrossRefPubMed Flouris AD, Duffy J: Applications of artificial intelligence systems in the analysis of epidemiological data. Eur J Epidemiol. 2006, 21: 167-70. 10.1007/s10654-006-0005-yCrossRefPubMed
3.
go back to reference Schneeweiss S, Avorn J: A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005, 58: 323-37. 10.1016/j.jclinepi.2004.10.012CrossRefPubMed Schneeweiss S, Avorn J: A review of uses of health care utilization databases for epidemiologic research on therapeutics. J Clin Epidemiol. 2005, 58: 323-37. 10.1016/j.jclinepi.2004.10.012CrossRefPubMed
4.
go back to reference Hartz A, Bentler S, Charlton M, Lanska D, Butani Y, Soomro GM, Benson K: Assessing observational studies of medical treatments. Emerg Themes Epidemiol. 2005, 2: 8. 10.1186/1742-7622-2-8PubMedCentralCrossRefPubMed Hartz A, Bentler S, Charlton M, Lanska D, Butani Y, Soomro GM, Benson K: Assessing observational studies of medical treatments. Emerg Themes Epidemiol. 2005, 2: 8. 10.1186/1742-7622-2-8PubMedCentralCrossRefPubMed
5.
go back to reference Strom BL: Methodologic challenges to studying patient safety and comparative effectiveness. Med Care. 2007, 45: S13-5. 10.1097/MLR.0b013e318041f752CrossRefPubMed Strom BL: Methodologic challenges to studying patient safety and comparative effectiveness. Med Care. 2007, 45: S13-5. 10.1097/MLR.0b013e318041f752CrossRefPubMed
6.
go back to reference De Luise C, Lanes SF, Jacobsen J, Pedersen L, Sorensen HT: Cardiovascular and respiratory hospitalizations and mortality among users of tiotropium in Denmark. Eur J Epidemiol. 2007, 22: 267-72. 10.1007/s10654-007-9106-5CrossRefPubMed De Luise C, Lanes SF, Jacobsen J, Pedersen L, Sorensen HT: Cardiovascular and respiratory hospitalizations and mortality among users of tiotropium in Denmark. Eur J Epidemiol. 2007, 22: 267-72. 10.1007/s10654-007-9106-5CrossRefPubMed
7.
go back to reference Rosso S, Ricceri F, Terracini L, Zanetti R: Methodological issues in estimating survival in patients with multiple primary cancers: an application to women with breast cancer as a first tumour. Emerg Themes Epidemiol. 2009, 6:2. 10.1186/1742-7622-6-2PubMedCentralCrossRefPubMed Rosso S, Ricceri F, Terracini L, Zanetti R: Methodological issues in estimating survival in patients with multiple primary cancers: an application to women with breast cancer as a first tumour. Emerg Themes Epidemiol. 2009, 6:2. 10.1186/1742-7622-6-2PubMedCentralCrossRefPubMed
8.
go back to reference Oostenbrink R, Moons KG, Bleeker SE, Moll HA, Grobbee DE: Diagnostic research on routine care data: prospects and problems. J Clin Epidemiol. 2003, 56:501-6. 10.1016/S0895-4356(03)00080-5CrossRefPubMed Oostenbrink R, Moons KG, Bleeker SE, Moll HA, Grobbee DE: Diagnostic research on routine care data: prospects and problems. J Clin Epidemiol. 2003, 56:501-6. 10.1016/S0895-4356(03)00080-5CrossRefPubMed
9.
go back to reference Bloemenkamp KW, Rosendaal FR, Buller HR, Helmerhorst FM, Colly LP, Vandenbroucke JP: Risk of venous thrombosis with use of current low-dose oral contraceptives is not explained by diagnostic suspicion and referral bias. Arch Intern Med. 1999, 159: 65-70. 10.1001/archinte.159.1.65CrossRefPubMed Bloemenkamp KW, Rosendaal FR, Buller HR, Helmerhorst FM, Colly LP, Vandenbroucke JP: Risk of venous thrombosis with use of current low-dose oral contraceptives is not explained by diagnostic suspicion and referral bias. Arch Intern Med. 1999, 159: 65-70. 10.1001/archinte.159.1.65CrossRefPubMed
10.
go back to reference Simons P, Algra A, Laak Van de M, Grobbee D, Graaf Van der Y: Second manifestations of ARTerial disease (SMART) study: rationale and design. Eur J Epidemiol. 1999, 15: 773-81. 10.1023/A:1007621514757CrossRefPubMed Simons P, Algra A, Laak Van de M, Grobbee D, Graaf Van der Y: Second manifestations of ARTerial disease (SMART) study: rationale and design. Eur J Epidemiol. 1999, 15: 773-81. 10.1023/A:1007621514757CrossRefPubMed
11.
go back to reference Wilson CB, Jones PW, O'Leary CJ, Hansell DM, Dowling RB, Cole PJ, Wilson R: Systemic markers of inflammation in stable bronchiectasis. Eur Respir J. 1998, 12: 820-4. 10.1183/09031936.98.12040820CrossRefPubMed Wilson CB, Jones PW, O'Leary CJ, Hansell DM, Dowling RB, Cole PJ, Wilson R: Systemic markers of inflammation in stable bronchiectasis. Eur Respir J. 1998, 12: 820-4. 10.1183/09031936.98.12040820CrossRefPubMed
12.
go back to reference Jatakanon A, Uasuf C, Maziak W, Lim S, Chung K, Barnes P: Neutrophilic inflammation in severe persistent asthma. Am J Respir Crit Care Med. 1999, 160: 1532-9.CrossRefPubMed Jatakanon A, Uasuf C, Maziak W, Lim S, Chung K, Barnes P: Neutrophilic inflammation in severe persistent asthma. Am J Respir Crit Care Med. 1999, 160: 1532-9.CrossRefPubMed
13.
go back to reference Haumer M, Amighi J, Exner M, Mlekusch W, Sabeti S, Schlager O, Schwarzinger I, Wagner O, Minar E, Schillinger M: Association of neutrophils and future cardiovascular events in patients with peripheral artery disease. J Vasc Surg. 2005, 41: 610-7. 10.1016/j.jvs.2005.01.013CrossRefPubMed Haumer M, Amighi J, Exner M, Mlekusch W, Sabeti S, Schlager O, Schwarzinger I, Wagner O, Minar E, Schillinger M: Association of neutrophils and future cardiovascular events in patients with peripheral artery disease. J Vasc Surg. 2005, 41: 610-7. 10.1016/j.jvs.2005.01.013CrossRefPubMed
14.
go back to reference Velthove KJ, Van Solinge WW, Lammers JW, Leufkens HG, Schweizer RC, Bracke M: Hematocytometry analysis as discriminative marker for asthma phenotypes. Clin Chem Lab Med. 2009, 47: 573-8. 10.1515/CCLM.2009.139CrossRefPubMed Velthove KJ, Van Solinge WW, Lammers JW, Leufkens HG, Schweizer RC, Bracke M: Hematocytometry analysis as discriminative marker for asthma phenotypes. Clin Chem Lab Med. 2009, 47: 573-8. 10.1515/CCLM.2009.139CrossRefPubMed
15.
go back to reference Ten Berg MJ, Huisman A, Bemt Van den PM, Schobben AF, Egberts AC, Van Solinge WW: Linking laboratory and medication data: new opportunities for pharmacoepidemiological research. Clin Chem Lab Med. 2007, 45: 13-9. 10.1515/CCLM.2007.009CrossRefPubMed Ten Berg MJ, Huisman A, Bemt Van den PM, Schobben AF, Egberts AC, Van Solinge WW: Linking laboratory and medication data: new opportunities for pharmacoepidemiological research. Clin Chem Lab Med. 2007, 45: 13-9. 10.1515/CCLM.2007.009CrossRefPubMed
16.
go back to reference Anonymous, International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM):National Center for Health Statistics; 2006. Anonymous, International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM):National Center for Health Statistics; 2006.
17.
go back to reference Wenzel SE: Asthma: defining of the persistent adult phenotypes. Lancet. 2006, 368: 804-13. 10.1016/S0140-6736(06)69290-8CrossRefPubMed Wenzel SE: Asthma: defining of the persistent adult phenotypes. Lancet. 2006, 368: 804-13. 10.1016/S0140-6736(06)69290-8CrossRefPubMed
18.
go back to reference Chung K, Godard P, Adelroth E, Ayres J, Barnes N, Barnes P, Bel E, Burney P, Chanez P, Connett G, Corrigan C, De Blic J, Fabbri L, Holgate S, Ind P, Joos G, Kerstjens H, Leuenberger P, Lofdahl C-G, McKenzie S, Magnussen H, Postma D, Saetta M, Salmeron S, Silverman M, Sterk P: Difficult/therapy-resistant asthma. The need for an integrated approach to define clinical phenotypes, evaluate risk factors, understand pathophysiology and find novel therapies. ERS Task Force on Difficult/Therapy-resistant asthma. Eur Respir J. 1999, 13: 1198-208.PubMed Chung K, Godard P, Adelroth E, Ayres J, Barnes N, Barnes P, Bel E, Burney P, Chanez P, Connett G, Corrigan C, De Blic J, Fabbri L, Holgate S, Ind P, Joos G, Kerstjens H, Leuenberger P, Lofdahl C-G, McKenzie S, Magnussen H, Postma D, Saetta M, Salmeron S, Silverman M, Sterk P: Difficult/therapy-resistant asthma. The need for an integrated approach to define clinical phenotypes, evaluate risk factors, understand pathophysiology and find novel therapies. ERS Task Force on Difficult/Therapy-resistant asthma. Eur Respir J. 1999, 13: 1198-208.PubMed
19.
go back to reference Pinto EM, Huppert FA, Morgan K, Mrc C, Brayne C: Neutrophil counts, monocyte counts and cardiovascular disease in the elderly. Exp Gerontol. 2004, 39: 615-9. 10.1016/j.exger.2003.12.011CrossRefPubMed Pinto EM, Huppert FA, Morgan K, Mrc C, Brayne C: Neutrophil counts, monocyte counts and cardiovascular disease in the elderly. Exp Gerontol. 2004, 39: 615-9. 10.1016/j.exger.2003.12.011CrossRefPubMed
20.
go back to reference Mehta J, Dinerman J, Mehta P, Saldeen TG, Lawson D, Donnelly WH, Wallin R: Neutrophil function in ischemic heart disease. Circulation. 1989, 79: 549-56.CrossRefPubMed Mehta J, Dinerman J, Mehta P, Saldeen TG, Lawson D, Donnelly WH, Wallin R: Neutrophil function in ischemic heart disease. Circulation. 1989, 79: 549-56.CrossRefPubMed
21.
go back to reference Delaney JA, Moodie EE, Suissa S: Validating the effects of drug treatment on blood pressure in the General Practice Research Database. Pharmacoepidemiol Drug Saf. 2008, 17: 535-45. 10.1002/pds.1553CrossRefPubMed Delaney JA, Moodie EE, Suissa S: Validating the effects of drug treatment on blood pressure in the General Practice Research Database. Pharmacoepidemiol Drug Saf. 2008, 17: 535-45. 10.1002/pds.1553CrossRefPubMed
22.
go back to reference Lewis JD, Brensinger C: Agreement between GPRD smoking data: a survey of general practitioners and a population-based survey. Pharmacoepidemiol Drug Saf. 2004, 13: 437-41. 10.1002/pds.902CrossRefPubMed Lewis JD, Brensinger C: Agreement between GPRD smoking data: a survey of general practitioners and a population-based survey. Pharmacoepidemiol Drug Saf. 2004, 13: 437-41. 10.1002/pds.902CrossRefPubMed
23.
go back to reference Vessey MP, Doll R: Investigation of relation between use of oral contraceptives and thromboembolic disease. BMJ. 1968, 2: 199-205. 10.1136/bmj.2.5599.199PubMedCentralCrossRefPubMed Vessey MP, Doll R: Investigation of relation between use of oral contraceptives and thromboembolic disease. BMJ. 1968, 2: 199-205. 10.1136/bmj.2.5599.199PubMedCentralCrossRefPubMed
24.
go back to reference Sackett DL: Bias in analytic research. J Chronic Dis. 1979, 32: 51-63. 10.1016/0021-9681(79)90012-2CrossRefPubMed Sackett DL: Bias in analytic research. J Chronic Dis. 1979, 32: 51-63. 10.1016/0021-9681(79)90012-2CrossRefPubMed
Metadata
Title
Testing bias in clinical databases: methodological considerations
Authors
Karin J Velthove
Hubert GM Leufkens
Patrick C Souverein
René C Schweizer
Wouter W van Solinge
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Emerging Themes in Epidemiology / Issue 1/2010
Electronic ISSN: 1742-7622
DOI
https://doi.org/10.1186/1742-7622-7-2

Other articles of this Issue 1/2010

Emerging Themes in Epidemiology 1/2010 Go to the issue