Skip to main content
Top
Published in: BMC Medicine 1/2016

Open Access 01-12-2016 | Research article

Development and external validation of a faecal immunochemical test-based prediction model for colorectal cancer detection in symptomatic patients

Authors: Joaquín Cubiella, Pablo Vega, María Salve, Marta Díaz-Ondina, Maria Teresa Alves, Enrique Quintero, Victoria Álvarez-Sánchez, Fernando Fernández-Bañares, Jaume Boadas, Rafel Campo, Luis Bujanda, Joan Clofent, Ángel Ferrandez, Leyanira Torrealba, Virginia Piñol, Daniel Rodríguez-Alcalde, Vicent Hernández, Javier Fernández-Seara, on behalf of the COLONPREDICT study investigators

Published in: BMC Medicine | Issue 1/2016

Login to get access

Abstract

Background

Risk prediction models for colorectal cancer (CRC) detection in symptomatic patients based on available biomarkers may improve CRC diagnosis. Our aim was to develop, compare with the NICE referral criteria and externally validate a CRC prediction model, COLONPREDICT, based on clinical and laboratory variables.

Methods

This prospective cross-sectional study included consecutive patients with gastrointestinal symptoms referred for colonoscopy between March 2012 and September 2013 in a derivation cohort and between March 2014 and March 2015 in a validation cohort. In the derivation cohort, we assessed symptoms and the NICE referral criteria, and determined levels of faecal haemoglobin and calprotectin, blood haemoglobin, and serum carcinoembryonic antigen before performing an anorectal examination and a colonoscopy. A multivariate logistic regression analysis was used to develop the model with diagnostic accuracy with CRC detection as the main outcome.

Results

We included 1572 patients in the derivation cohort and 1481 in the validation cohorts, with a 13.6 % and 9.1 % CRC prevalence respectively. The final prediction model included 11 variables: age (years) (odds ratio [OR] 1.04, 95 % confidence interval [CI] 1.02–1.06), male gender (OR 2.2, 95 % CI 1.5–3.4), faecal haemoglobin ≥20 μg/g (OR 17.0, 95 % CI 10.0–28.6), blood haemoglobin <10 g/dL (OR 4.8, 95 % CI 2.2–10.3), blood haemoglobin 10–12 g/dL (OR 1.8, 95 % CI 1.1–3.0), carcinoembryonic antigen ≥3 ng/mL (OR 4.5, 95 % CI 3.0–6.8), acetylsalicylic acid treatment (OR 0.4, 95 % CI 0.2–0.7), previous colonoscopy (OR 0.1, 95 % CI 0.06–0.2), rectal mass (OR 14.8, 95 % CI 5.3–41.0), benign anorectal lesion (OR 0.3, 95 % CI 0.2–0.4), rectal bleeding (OR 2.2, 95 % CI 1.4–3.4) and change in bowel habit (OR 1.7, 95 % CI 1.1–2.5). The area under the curve (AUC) was 0.92 (95 % CI 0.91–0.94), higher than the NICE referral criteria (AUC 0.59, 95 % CI 0.55–0.63; p < 0.001). On the basis of the thresholds with 90 % (5.6) and 99 % (3.5) sensitivity, we divided the derivation cohort into three risk groups for CRC detection: high (30.9 % of the cohort, positive predictive value [PPV] 40.7 %, 95 % CI 36.7–45.9 %), intermediate (29.5 %, PPV 4.4 %, 95 % CI 2.8–6.8 %) and low (39.5 %, PPV 0.2 %, 95 % CI 0.0–1.1 %). The discriminatory ability was equivalent in the validation cohort (AUC 0.92, 95 % CI 0.90–0.94; p = 0.7).

Conclusions

COLONPREDICT is a highly accurate prediction model for CRC detection.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, Abraham J, Adair T, Aggarwal R, Ahn SY, Alvarado M, Anderson HR, Anderson LM, Andrews KG, Atkinson C, Baddour LM, Barker–Collo S, Bartels DH, Bell ML, Benjamin EJ, Bennett D, Bhalla K, Bikbov B, Bin Abdulhak A, Birbeck G, Blyth F, Bolliger I, Boufous S, Bucello C, Burch M, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2095–128.CrossRefPubMed Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, Abraham J, Adair T, Aggarwal R, Ahn SY, Alvarado M, Anderson HR, Anderson LM, Andrews KG, Atkinson C, Baddour LM, Barker–Collo S, Bartels DH, Bell ML, Benjamin EJ, Bennett D, Bhalla K, Bikbov B, Bin Abdulhak A, Birbeck G, Blyth F, Bolliger I, Boufous S, Bucello C, Burch M, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2095–128.CrossRefPubMed
2.
go back to reference Atkin WS, Valori R, Kuipers EJ, Hoff G, Senore C, Segnan N, Jover R, Schmiegel W, Lambert R, Pox C, International Agency for Research on Cancer. European guidelines for quality assurance in colorectal cancer screening and diagnosis. First Edition--Colonoscopic surveillance following adenoma removal. Endoscopy. 2012;44 Suppl 3(SUPPL3):SE151–63.PubMed Atkin WS, Valori R, Kuipers EJ, Hoff G, Senore C, Segnan N, Jover R, Schmiegel W, Lambert R, Pox C, International Agency for Research on Cancer. European guidelines for quality assurance in colorectal cancer screening and diagnosis. First Edition--Colonoscopic surveillance following adenoma removal. Endoscopy. 2012;44 Suppl 3(SUPPL3):SE151–63.PubMed
6.
go back to reference Vega-Villaamil P, Salve-Bouzo M, Cubiella J, Valentín-Gómez F, Sánchez-Hernández E, Gómez-Fernández I, Fernández-Seara J. Evaluation of the implementation of Galician Health Service indications and priority levels for colonoscopy in symptomatic patients: prospective, cross-sectional study. Rev Esp Enferm Dig. 2013;105:600–8.CrossRefPubMed Vega-Villaamil P, Salve-Bouzo M, Cubiella J, Valentín-Gómez F, Sánchez-Hernández E, Gómez-Fernández I, Fernández-Seara J. Evaluation of the implementation of Galician Health Service indications and priority levels for colonoscopy in symptomatic patients: prospective, cross-sectional study. Rev Esp Enferm Dig. 2013;105:600–8.CrossRefPubMed
7.
go back to reference Jellema P, van der Windt DA, Bruinvels DJ, Mallen CD, van Weyenberg SJB, Mulder CJ, de Vet HCW. Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis. BMJ. 2010;340:c1269.CrossRefPubMedPubMedCentral Jellema P, van der Windt DA, Bruinvels DJ, Mallen CD, van Weyenberg SJB, Mulder CJ, de Vet HCW. Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis. BMJ. 2010;340:c1269.CrossRefPubMedPubMedCentral
8.
go back to reference Cubiella J, Salve M, Díaz-Ondina M, Vega P, Alves MT, Iglesias F, Sánchez E, Macía P, Blanco I, Bujanda L, Fernández-Seara J. Diagnostic accuracy of the faecal immunochemical test for colorectal cancer in symptomatic patients: comparison with NICE and SIGN referral criteria. Colorectal Dis. 2014;16:O273–82.CrossRefPubMed Cubiella J, Salve M, Díaz-Ondina M, Vega P, Alves MT, Iglesias F, Sánchez E, Macía P, Blanco I, Bujanda L, Fernández-Seara J. Diagnostic accuracy of the faecal immunochemical test for colorectal cancer in symptomatic patients: comparison with NICE and SIGN referral criteria. Colorectal Dis. 2014;16:O273–82.CrossRefPubMed
9.
go back to reference Thorne K, Hutchings HA, Elwyn G. The effects of the Two-Week Rule on NHS colorectal cancer diagnostic services: a systematic literature review. BMC Health Serv Res. 2006;6:43.CrossRefPubMedPubMedCentral Thorne K, Hutchings HA, Elwyn G. The effects of the Two-Week Rule on NHS colorectal cancer diagnostic services: a systematic literature review. BMC Health Serv Res. 2006;6:43.CrossRefPubMedPubMedCentral
10.
go back to reference Williams TGS, Cubiella J, Griffin SJ, Walter FM, Usher-Smith JA. Risk prediction models for colorectal cancer in people with symptoms: a systematic review. BMC Gastroenterol. 2016;16:63.CrossRefPubMedPubMedCentral Williams TGS, Cubiella J, Griffin SJ, Walter FM, Usher-Smith JA. Risk prediction models for colorectal cancer in people with symptoms: a systematic review. BMC Gastroenterol. 2016;16:63.CrossRefPubMedPubMedCentral
11.
go back to reference Hodder RJ, Ballal M, Selvachandran SN, Cade D. Pitfalls in the construction of cancer guidelines demonstrated by the analyses of colorectal referrals. Ann R Coll Surg Engl. 2005;87:419–26.CrossRefPubMedPubMedCentral Hodder RJ, Ballal M, Selvachandran SN, Cade D. Pitfalls in the construction of cancer guidelines demonstrated by the analyses of colorectal referrals. Ann R Coll Surg Engl. 2005;87:419–26.CrossRefPubMedPubMedCentral
12.
go back to reference Rai S, Ballal M, Thomas WM, Miller AS, Jameson JS, Steward WP. Assessment of a patient consultation questionnaire-based scoring system for stratification of outpatient risk of colorectal cancer. Br J Surg. 2008;95:369–74.CrossRefPubMed Rai S, Ballal M, Thomas WM, Miller AS, Jameson JS, Steward WP. Assessment of a patient consultation questionnaire-based scoring system for stratification of outpatient risk of colorectal cancer. Br J Surg. 2008;95:369–74.CrossRefPubMed
13.
go back to reference Ballal MS, Selvachandran SN, Maw A. Use of a patient consultation questionnaire and weighted numerical scoring system for the prediction of colorectal cancer and other colorectal pathology in symptomatic patients: a prospective cohort validation study of a Welsh population. Colorectal Dis. 2010;12:407–14.CrossRefPubMed Ballal MS, Selvachandran SN, Maw A. Use of a patient consultation questionnaire and weighted numerical scoring system for the prediction of colorectal cancer and other colorectal pathology in symptomatic patients: a prospective cohort validation study of a Welsh population. Colorectal Dis. 2010;12:407–14.CrossRefPubMed
14.
go back to reference Oono Y, Iriguchi Y, Doi Y, Tomino Y, Kishi D, Oda J, Takayanagi S, Mizutani M, Fujisaki T, Yamamura A, Hosoi T, Taguchi H, Kosaka M, Delgado P. A retrospective study of immunochemical fecal occult blood testing for colorectal cancer detection. Clin Chim Acta. 2010;411:802–5.CrossRefPubMed Oono Y, Iriguchi Y, Doi Y, Tomino Y, Kishi D, Oda J, Takayanagi S, Mizutani M, Fujisaki T, Yamamura A, Hosoi T, Taguchi H, Kosaka M, Delgado P. A retrospective study of immunochemical fecal occult blood testing for colorectal cancer detection. Clin Chim Acta. 2010;411:802–5.CrossRefPubMed
15.
go back to reference McDonald PJ, Digby J, Innes C, Strachan JA, Carey FA, Steele RJC, Fraser CG. Low faecal haemoglobin concentration potentially rules out significant colorectal disease. Colorectal Dis. 2013;15:e151–9.CrossRefPubMed McDonald PJ, Digby J, Innes C, Strachan JA, Carey FA, Steele RJC, Fraser CG. Low faecal haemoglobin concentration potentially rules out significant colorectal disease. Colorectal Dis. 2013;15:e151–9.CrossRefPubMed
16.
go back to reference Mowat C, Digby J, Strachan JA, Wilson R, Carey FA, Fraser CG, Steele RJC. Faecal haemoglobin and faecal calprotectin as indicators of bowel disease in patients presenting to primary care with bowel symptoms. Gut. 2016;65:1463–9.CrossRefPubMed Mowat C, Digby J, Strachan JA, Wilson R, Carey FA, Fraser CG, Steele RJC. Faecal haemoglobin and faecal calprotectin as indicators of bowel disease in patients presenting to primary care with bowel symptoms. Gut. 2016;65:1463–9.CrossRefPubMed
17.
go back to reference Rodríguez-Alonso L, Rodríguez-Moranta F, Ruiz-Cerulla A, Lobatón T, Arajol C, Binefa G, Moreno V, Guardiola J. An urgent referral strategy for symptomatic patients with suspected colorectal cancer based on a quantitative immunochemical faecal occult blood test. Dig Liver Dis. 2015;47:797–804.CrossRefPubMed Rodríguez-Alonso L, Rodríguez-Moranta F, Ruiz-Cerulla A, Lobatón T, Arajol C, Binefa G, Moreno V, Guardiola J. An urgent referral strategy for symptomatic patients with suspected colorectal cancer based on a quantitative immunochemical faecal occult blood test. Dig Liver Dis. 2015;47:797–804.CrossRefPubMed
18.
go back to reference Godber IM, Todd LM, Fraser CG, MacDonald LR, Younes HB. Use of a faecal immunochemical test for haemoglobin can aid in the investigation of patients with lower abdominal symptoms. Clin Chem Lab Med. 2016;54(4):595–602.CrossRefPubMed Godber IM, Todd LM, Fraser CG, MacDonald LR, Younes HB. Use of a faecal immunochemical test for haemoglobin can aid in the investigation of patients with lower abdominal symptoms. Clin Chem Lab Med. 2016;54(4):595–602.CrossRefPubMed
19.
go back to reference Usher-Smith JA, Walter FM, Emery J, Win AK, Griffin SJ. Risk prediction models for colorectal cancer: a systematic review. Cancer Prev Res (Phila). 2016;9(1):13–26.CrossRef Usher-Smith JA, Walter FM, Emery J, Win AK, Griffin SJ. Risk prediction models for colorectal cancer: a systematic review. Cancer Prev Res (Phila). 2016;9(1):13–26.CrossRef
20.
go back to reference Adelstein B-A, Irwig L, Macaskill P, Katelaris PH, Jones DB, Bokey L. A self administered reliable questionnaire to assess lower bowel symptoms. BMC Gastroenterol. 2008;8:8.CrossRefPubMedPubMedCentral Adelstein B-A, Irwig L, Macaskill P, Katelaris PH, Jones DB, Bokey L. A self administered reliable questionnaire to assess lower bowel symptoms. BMC Gastroenterol. 2008;8:8.CrossRefPubMedPubMedCentral
21.
go back to reference Jover R, Herráiz M, Alarcón O, Brullet E, Bujanda L, Bustamante M, Campo R, Carreño R, Castells A, Cubiella J, García-Iglesias P, Hervás AJ, Menchén P, Ono A, Panadés A, Parra-Blanco A, Pellisé M, Ponce M, Quintero E, Reñé JM, Sánchez del Río A, Seoane A, Serradesanferm A, Soriano Izquierdo A, Vázquez Sequeiros E. Clinical practice guidelines: quality of colonoscopy in colorectal cancer screening. Endoscopy. 2012;44:444–51.CrossRefPubMed Jover R, Herráiz M, Alarcón O, Brullet E, Bujanda L, Bustamante M, Campo R, Carreño R, Castells A, Cubiella J, García-Iglesias P, Hervás AJ, Menchén P, Ono A, Panadés A, Parra-Blanco A, Pellisé M, Ponce M, Quintero E, Reñé JM, Sánchez del Río A, Seoane A, Serradesanferm A, Soriano Izquierdo A, Vázquez Sequeiros E. Clinical practice guidelines: quality of colonoscopy in colorectal cancer screening. Endoscopy. 2012;44:444–51.CrossRefPubMed
22.
go back to reference Edge SB, Byrd DR, Compton CC, Fritz AG, Greene FL, Trotti A (Ed). AJCC Cancer Staging Manual. 7th ed. New York: Springer; 2010. Edge SB, Byrd DR, Compton CC, Fritz AG, Greene FL, Trotti A (Ed). AJCC Cancer Staging Manual. 7th ed. New York: Springer; 2010.
23.
go back to reference Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement. Ann Intern Med. 2015;162:55–63.CrossRefPubMed Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement. Ann Intern Med. 2015;162:55–63.CrossRefPubMed
25.
27.
go back to reference Rex DK, Schoenfeld PS, Cohen J, Pike IM, Adler DG, Fennerty MB, Lieb JG, Park WG, Rizk MK, Sawhney MS, Shaheen NJ, Wani S, Weinberg DS. Quality indicators for colonoscopy. Gastrointest Endosc. 2015;81:31–53.CrossRefPubMed Rex DK, Schoenfeld PS, Cohen J, Pike IM, Adler DG, Fennerty MB, Lieb JG, Park WG, Rizk MK, Sawhney MS, Shaheen NJ, Wani S, Weinberg DS. Quality indicators for colonoscopy. Gastrointest Endosc. 2015;81:31–53.CrossRefPubMed
28.
go back to reference Grupo de trabajo de la guía de práctica clínica sobre rectorragia. Manejo del paciente con rectorragia. Guía de Práctica Clínica. Actualización 2007. (Management of patients with rectal bleeding. Clinical practice guideline. 2007 update. Clinical Practice Guideline Working Group on rectal bleeding). Grupo de trabajo de la guía de práctica clínica sobre rectorragia. Manejo del paciente con rectorragia. Guía de Práctica Clínica. Actualización 2007. (Management of patients with rectal bleeding. Clinical practice guideline. 2007 update. Clinical Practice Guideline Working Group on rectal bleeding).
29.
go back to reference Adelstein B-A, Macaskill P, Turner RM, Katelaris PH, Irwig L. The value of age and medical history for predicting colorectal cancer and adenomas in people referred for colonoscopy. BMC Gastroenterol. 2011;11:97.CrossRefPubMedPubMedCentral Adelstein B-A, Macaskill P, Turner RM, Katelaris PH, Irwig L. The value of age and medical history for predicting colorectal cancer and adenomas in people referred for colonoscopy. BMC Gastroenterol. 2011;11:97.CrossRefPubMedPubMedCentral
30.
go back to reference Nishihara R, Wu K, Lochhead P, Morikawa T, Liao X, Qian ZR, Inamura K, Kim SA, Kuchiba A, Yamauchi M, Imamura Y, Willett WC, Rosner BA, Fuchs CS, Giovannucci E, Ogino S, Chan AT. Long-term colorectal-cancer incidence and mortality after lower endoscopy. N Engl J Med. 2013;369:1095–105.CrossRefPubMed Nishihara R, Wu K, Lochhead P, Morikawa T, Liao X, Qian ZR, Inamura K, Kim SA, Kuchiba A, Yamauchi M, Imamura Y, Willett WC, Rosner BA, Fuchs CS, Giovannucci E, Ogino S, Chan AT. Long-term colorectal-cancer incidence and mortality after lower endoscopy. N Engl J Med. 2013;369:1095–105.CrossRefPubMed
Metadata
Title
Development and external validation of a faecal immunochemical test-based prediction model for colorectal cancer detection in symptomatic patients
Authors
Joaquín Cubiella
Pablo Vega
María Salve
Marta Díaz-Ondina
Maria Teresa Alves
Enrique Quintero
Victoria Álvarez-Sánchez
Fernando Fernández-Bañares
Jaume Boadas
Rafel Campo
Luis Bujanda
Joan Clofent
Ángel Ferrandez
Leyanira Torrealba
Virginia Piñol
Daniel Rodríguez-Alcalde
Vicent Hernández
Javier Fernández-Seara
on behalf of the COLONPREDICT study investigators
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2016
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-016-0668-5

Other articles of this Issue 1/2016

BMC Medicine 1/2016 Go to the issue