Skip to main content
Top
Published in: Journal of Neuro-Oncology 1/2017

01-05-2017 | Clinical Study

Defining optimal cutoff value of MGMT promoter methylation by ROC analysis for clinical setting in glioblastoma patients

Authors: Guoqiang Yuan, Liang Niu, Yinian Zhang, Xiaoqing Wang, Kejun Ma, Hang Yin, Junqiang Dai, Wangning Zhou, Yawen Pan

Published in: Journal of Neuro-Oncology | Issue 1/2017

Login to get access

Abstract

Resistance to temozolomide (TMZ) chemotherapy poses a significant challenge in the treatment of glioblastoma (GBM). Hypermethylation in O6-methylguanine-DNA methyltransferase (MGMT) promoter is thought to play a critical role in this resistance. Pyrosequencing (PSQ) has been shown to be accurate and robust for MGMT promoter methylation testing. The unresolved issue is the determination of a cut-off value for dichotomization of quantitative MGMT PSQ results into “MGMT methylated” and “MGMT unmethylated” patient subgroups as a basis for further treatment decisions. In this study, receiver operating characteristic (ROC) curve analysis was used to identify an optimal cutoff of MGMT promoter methylation by testing mean percentage of methylation of 4 CpG islands (76–79) within MGMT exon 1. The area under the ROC (AUC) as well as the best cutoff to classify the methylation were calculated. Positive likelihood ratio (LR+) was chosen as a diagnostic parameter for defining an optimal cut-off. Meanwhile, we also analyzed whether mean percentage of methylation at the investigated CpG islands could be regarded as a marker for evaluating prognostication. ROC analysis showed that the optimal threshold was 12.5% (sensitivity: 60.87%; specificity: 76%) in response to the largest LR+ 2.54. 12.5% was established to distinguish MGMT promoter methylation, which was confirmed using validation set. According to the cutoff value, the MGMT promoter methylation was found in 58.3% of GBM. Mean methylation level of the investigated CpG sites strong correlated with overall survival (OS), which means GBM patients with a high level of methylation survived longer than those with low level of methylation(log-rank test, P = 0.017). In conclusion, ROC curve analysis enables the best cutoff for discriminating MGMT promoter methylation status. LR+ can be used as a key factor that evaluates cutoff. The promoter methylation level of MGMT by PSQ in GBM patients had prognostic value.
Literature
2.
go back to reference Stupp R, Mason WP, van den Bent MJ, Weller M, Fisher B, Taphoorn MJ, Belanger K, Brandes AA, Marosi C, Bogdahn U, Curschmann J, Janzer RC, Ludwin SK, Gorlia T, Allgeier A, Lacombe D, Cairncross JG, Eisenhauer E, Mirimanoff RO (2005) Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. N Engl J Med 352(10):987–996. doi:10.1056/NEJMoa043330 CrossRefPubMed Stupp R, Mason WP, van den Bent MJ, Weller M, Fisher B, Taphoorn MJ, Belanger K, Brandes AA, Marosi C, Bogdahn U, Curschmann J, Janzer RC, Ludwin SK, Gorlia T, Allgeier A, Lacombe D, Cairncross JG, Eisenhauer E, Mirimanoff RO (2005) Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. N Engl J Med 352(10):987–996. doi:10.​1056/​NEJMoa043330 CrossRefPubMed
3.
go back to reference Hegi ME, Liu L, Herman JG, Stupp R, Wick W, Weller M, Mehta MP, Gilbert MR (2008) Correlation of O6-methylguanine methyltransferase (MGMT) promoter methylation with clinical outcomes in glioblastoma and clinical strategies to modulate MGMT activity. J Clin Oncol 26(25):4189–4199. doi:10.1200/JCO.2007.11.5964 CrossRefPubMed Hegi ME, Liu L, Herman JG, Stupp R, Wick W, Weller M, Mehta MP, Gilbert MR (2008) Correlation of O6-methylguanine methyltransferase (MGMT) promoter methylation with clinical outcomes in glioblastoma and clinical strategies to modulate MGMT activity. J Clin Oncol 26(25):4189–4199. doi:10.​1200/​JCO.​2007.​11.​5964 CrossRefPubMed
4.
go back to reference Malley DS, Hamoudi RA, Kocialkowski S, Pearson DM, Collins VP, Ichimura K (2011) A distinct region of the MGMT CpG island critical for transcriptional regulation is preferentially methylated in glioblastoma cells and xenografts. Acta Neuropathol 121(5):651–661. doi:10.1007/s00401-011-0803-5 CrossRefPubMed Malley DS, Hamoudi RA, Kocialkowski S, Pearson DM, Collins VP, Ichimura K (2011) A distinct region of the MGMT CpG island critical for transcriptional regulation is preferentially methylated in glioblastoma cells and xenografts. Acta Neuropathol 121(5):651–661. doi:10.​1007/​s00401-011-0803-5 CrossRefPubMed
5.
go back to reference Dunn J, Baborie A, Alam F, Joyce K, Moxham M, Sibson R, Crooks D, Husband D, Shenoy A, Brodbelt A, Wong H, Liloglou T, Haylock B, Walker C (2009) Extent of MGMT promoter methylation correlates with outcome in glioblastomas given temozolomide and radiotherapy. Br J Cancer 101(1):124–131. doi:10.1038/sj.bjc.6605127 CrossRefPubMedPubMedCentral Dunn J, Baborie A, Alam F, Joyce K, Moxham M, Sibson R, Crooks D, Husband D, Shenoy A, Brodbelt A, Wong H, Liloglou T, Haylock B, Walker C (2009) Extent of MGMT promoter methylation correlates with outcome in glioblastomas given temozolomide and radiotherapy. Br J Cancer 101(1):124–131. doi:10.​1038/​sj.​bjc.​6605127 CrossRefPubMedPubMedCentral
8.
go back to reference Quillien V, Lavenu A, Karayan-Tapon L, Carpentier C, Labussière M, Lesimple T, Chinot O, Wager M, Honnorat J, Saikali S, Fina F, Sanson M, Figarella-Branger D (2012) Comparative assessment of 5 methods (methylation-specific polymerase chain reaction, MethyLight, pyrosequencing, methylation-sensitive high-resolution melting, and immunohistochemistry) to analyze O6-methylguanine-DNA-methyltranferase in a series of 100 glioblastoma patients. Cancer 118(17):4201–4211. doi:10.1002/cncr.27392 CrossRefPubMed Quillien V, Lavenu A, Karayan-Tapon L, Carpentier C, Labussière M, Lesimple T, Chinot O, Wager M, Honnorat J, Saikali S, Fina F, Sanson M, Figarella-Branger D (2012) Comparative assessment of 5 methods (methylation-specific polymerase chain reaction, MethyLight, pyrosequencing, methylation-sensitive high-resolution melting, and immunohistochemistry) to analyze O6-methylguanine-DNA-methyltranferase in a series of 100 glioblastoma patients. Cancer 118(17):4201–4211. doi:10.​1002/​cncr.​27392 CrossRefPubMed
9.
go back to reference Hao X, Raymond T, Bin Y (2015) Detection of MGMT promoter methylation in glioblastoma using pyrosequencing. Int J Clin Exp Pathol 8(2):1790–1796 Hao X, Raymond T, Bin Y (2015) Detection of MGMT promoter methylation in glioblastoma using pyrosequencing. Int J Clin Exp Pathol 8(2):1790–1796
10.
go back to reference Sun Y, Li S, Shen K, Ye S, Cao D, Yang J (2015) DAPK1, MGMT and RARB promoter methylation as biomarkers for high-grade cervical lesions. Int J Clin Exp Pathol 8(11):14939–14945PubMedPubMedCentral Sun Y, Li S, Shen K, Ye S, Cao D, Yang J (2015) DAPK1, MGMT and RARB promoter methylation as biomarkers for high-grade cervical lesions. Int J Clin Exp Pathol 8(11):14939–14945PubMedPubMedCentral
11.
go back to reference Florkowski CM (2008) Sensitivity, specificity, receiver-operating characteristic (ROC) curves and likelihood ratios: communicating the performance of diagnostic tests. Clin Biochem Rev 29(Suppl1):83–87 Florkowski CM (2008) Sensitivity, specificity, receiver-operating characteristic (ROC) curves and likelihood ratios: communicating the performance of diagnostic tests. Clin Biochem Rev 29(Suppl1):83–87
13.
go back to reference Quillien V, Lavenu A, Sanson M, Legrain M, Dubus P, Karayan-Tapon L, Mosser J, Ichimura K, Figarella-Branger D (2014) Outcome-based determination of optimal pyrosequencing assay for MGMT methylation detection in glioblastoma patients. J Neurooncol 116:487–496. doi:10.1007/s11060-013-1332-y CrossRefPubMedPubMedCentral Quillien V, Lavenu A, Sanson M, Legrain M, Dubus P, Karayan-Tapon L, Mosser J, Ichimura K, Figarella-Branger D (2014) Outcome-based determination of optimal pyrosequencing assay for MGMT methylation detection in glioblastoma patients. J Neurooncol 116:487–496. doi:10.​1007/​s11060-013-1332-y CrossRefPubMedPubMedCentral
14.
go back to reference Preusser M, Berghoff AS, Manzl C, Filipits M, Weinhäusel A, Pulverer W, Dieckmann K, Widhalm G, Wöhrer A, Knosp E, Marosi C, Hainfellner JA (2014) Clinical Neuropathology practice news 1-2014: pyrosequencing meets clinical and analytical performance criteria for routine testing of MGMT promoter methylation status in glioblastoma. Clin Neuropathol 33(1):6–14. doi:10.5414/NP300730 CrossRefPubMed Preusser M, Berghoff AS, Manzl C, Filipits M, Weinhäusel A, Pulverer W, Dieckmann K, Widhalm G, Wöhrer A, Knosp E, Marosi C, Hainfellner JA (2014) Clinical Neuropathology practice news 1-2014: pyrosequencing meets clinical and analytical performance criteria for routine testing of MGMT promoter methylation status in glioblastoma. Clin Neuropathol 33(1):6–14. doi:10.​5414/​NP300730 CrossRefPubMed
16.
go back to reference Wick W, Platten M, Meisner C, Felsberg J, Tabatabai G, Simon M, Nikkhah G, Papsdorf K, Steinbach JP, Sabel M, Combs SE, Vesper J, Braun C, Meixensberger J, Ketter R, Mayer-Steinacker R, Reifenberger G, Weller M, NOA-08 Study Group of Neuro-oncology Working Group (NOA) of German Cancer Society (2012) Temozolomide chemotherapy alone versus radiotherapy alone for malignant astrocytoma in the elderly: the NOA-08 randomised, phase 3 trial. Lancet Oncol 13:707–715. doi:10.1016/S1470-2045(12)70164-X CrossRefPubMed Wick W, Platten M, Meisner C, Felsberg J, Tabatabai G, Simon M, Nikkhah G, Papsdorf K, Steinbach JP, Sabel M, Combs SE, Vesper J, Braun C, Meixensberger J, Ketter R, Mayer-Steinacker R, Reifenberger G, Weller M, NOA-08 Study Group of Neuro-oncology Working Group (NOA) of German Cancer Society (2012) Temozolomide chemotherapy alone versus radiotherapy alone for malignant astrocytoma in the elderly: the NOA-08 randomised, phase 3 trial. Lancet Oncol 13:707–715. doi:10.​1016/​S1470-2045(12)70164-X CrossRefPubMed
17.
go back to reference Malmström A, Grønberg BH, Marosi C, Stupp R, Frappaz D, Schultz H, Abacioglu U, Tavelin B, Lhermitte B, Hegi ME, Rosell J, Henriksson R, Nordic Clinical Brain Tumour Study Group (NCBTSG) (2012) Temozolomide versus standard 6-week radiotherapy versus hypofractionated radiotherapy in patients older than 60 years with glioblastoma: the Nordic randomised, phase 3 trial. Lancet Oncol 13:916–926. doi:10.1016/S1470-2045(12)70265-6 CrossRefPubMed Malmström A, Grønberg BH, Marosi C, Stupp R, Frappaz D, Schultz H, Abacioglu U, Tavelin B, Lhermitte B, Hegi ME, Rosell J, Henriksson R, Nordic Clinical Brain Tumour Study Group (NCBTSG) (2012) Temozolomide versus standard 6-week radiotherapy versus hypofractionated radiotherapy in patients older than 60 years with glioblastoma: the Nordic randomised, phase 3 trial. Lancet Oncol 13:916–926. doi:10.​1016/​S1470-2045(12)70265-6 CrossRefPubMed
18.
go back to reference Weller M, van den Bent M, Hopkins K, Tonn JC, Stupp R, Falini A, Cohen-Jonathan-Moyal E, Frappaz D, Henriksson R, Balana C, Chinot O, Ram Z, Reifenberger G, Soffetti R, Wick W, European Association for Neuro-Oncology (EANO) Task Force on Malignant Glioma (2014) EANO guideline for the diagnosis and treatment of anaplastic gliomas and glioblastoma. Lancet Oncol 15:e395–e403. doi:10.1016/S1470-2045(14)70011-7 CrossRefPubMed Weller M, van den Bent M, Hopkins K, Tonn JC, Stupp R, Falini A, Cohen-Jonathan-Moyal E, Frappaz D, Henriksson R, Balana C, Chinot O, Ram Z, Reifenberger G, Soffetti R, Wick W, European Association for Neuro-Oncology (EANO) Task Force on Malignant Glioma (2014) EANO guideline for the diagnosis and treatment of anaplastic gliomas and glioblastoma. Lancet Oncol 15:e395–e403. doi:10.​1016/​S1470-2045(14)70011-7 CrossRefPubMed
19.
go back to reference Hsu CY, Ho HL, Lin SC, Chen MH, Hsu SP, Yen YS, Guo WY, Ho DM (2016) Comparative assessment of 4 methods to analyze MGMT status in a series of 121 glioblastoma patients. Appl Immunohistochem Mol Morphol. doi:10.1097/PAI.0000000000000331 Hsu CY, Ho HL, Lin SC, Chen MH, Hsu SP, Yen YS, Guo WY, Ho DM (2016) Comparative assessment of 4 methods to analyze MGMT status in a series of 121 glioblastoma patients. Appl Immunohistochem Mol Morphol. doi:10.​1097/​PAI.​0000000000000331​
20.
go back to reference Christians A, Hartmann C, Benner A, Meyer J, von Deimling A, Weller M, Wick W, Weiler M (2012) Prognostic value of three different methods of MGMT promoter methylation analysis in a prospective trial on newly diagnosed glioblastoma. PLoS ONE. doi:10.1371/journal.pone.0033449 Christians A, Hartmann C, Benner A, Meyer J, von Deimling A, Weller M, Wick W, Weiler M (2012) Prognostic value of three different methods of MGMT promoter methylation analysis in a prospective trial on newly diagnosed glioblastoma. PLoS ONE. doi:10.​1371/​journal.​pone.​0033449
21.
go back to reference Bienkowski M, Berghoff AS, Marosi C, Wöhrer A, Heinzl H, Hainfellner JA, Preusser M (2015) Practice guide 5-2015: MGMT methylation pyrosequencing in glioblastoma: unresolved issues and open questions. Clin Neuropathol 34(5):250–257. doi:10.5414/NP300904 CrossRefPubMedPubMedCentral Bienkowski M, Berghoff AS, Marosi C, Wöhrer A, Heinzl H, Hainfellner JA, Preusser M (2015) Practice guide 5-2015: MGMT methylation pyrosequencing in glioblastoma: unresolved issues and open questions. Clin Neuropathol 34(5):250–257. doi:10.​5414/​NP300904 CrossRefPubMedPubMedCentral
22.
go back to reference Reifenberger G, Hentschel B, Felsberg J, Schackert G, Simon M, Schnell O, Westphal M, Wick W, Pietsch T, Loeffler M, Weller M, German Glioma Network (2012) Predictive impact of MGMT promoter methylation in glioblastoma of the elderly. Int J Cancer 131(6):1342–1350. doi:10.1002/ijc.-27385 CrossRefPubMed Reifenberger G, Hentschel B, Felsberg J, Schackert G, Simon M, Schnell O, Westphal M, Wick W, Pietsch T, Loeffler M, Weller M, German Glioma Network (2012) Predictive impact of MGMT promoter methylation in glioblastoma of the elderly. Int J Cancer 131(6):1342–1350. doi:10.​1002/​ijc.​-27385 CrossRefPubMed
24.
25.
go back to reference Greiner M, Pfeiffer D, Smith RD (2000) Principles and practical application of the receiver operating characteristic analysis for diagnostic test. Prev Vet Med 45(1–2):23–41CrossRefPubMed Greiner M, Pfeiffer D, Smith RD (2000) Principles and practical application of the receiver operating characteristic analysis for diagnostic test. Prev Vet Med 45(1–2):23–41CrossRefPubMed
26.
go back to reference Steurer J, Fischer JE, Bachmann LM, Koller M, ter Riet G (2002) Communicating accuracy of tests to general practitioners: a controlled study. BMJ 324(7341):824–826CrossRefPubMedPubMedCentral Steurer J, Fischer JE, Bachmann LM, Koller M, ter Riet G (2002) Communicating accuracy of tests to general practitioners: a controlled study. BMJ 324(7341):824–826CrossRefPubMedPubMedCentral
27.
go back to reference Bandos AI, Rockette HE, Gur D (2010) Use of likelihood ratios for comparisons of binary diagnostic tests: underlying ROC curves. Med Phys 37(11):5821–5830CrossRefPubMedPubMedCentral Bandos AI, Rockette HE, Gur D (2010) Use of likelihood ratios for comparisons of binary diagnostic tests: underlying ROC curves. Med Phys 37(11):5821–5830CrossRefPubMedPubMedCentral
28.
go back to reference Biggerstaff BJ (2000) Comparing diagnostic tests: a simple graphic using likelihood ratios. Stat Med 19(5):649–663CrossRefPubMed Biggerstaff BJ (2000) Comparing diagnostic tests: a simple graphic using likelihood ratios. Stat Med 19(5):649–663CrossRefPubMed
30.
go back to reference Irwig L, Macaskill P, Glasziou P, Fahey M (1995) Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol 48:119–130 (discussion 31–2)CrossRefPubMed Irwig L, Macaskill P, Glasziou P, Fahey M (1995) Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol 48:119–130 (discussion 31–2)CrossRefPubMed
32.
go back to reference Begg CB (1991) Advances in statistical methodology for diagnostic medicine in the 1980’s. Stat Med 10:1887–1895CrossRefPubMed Begg CB (1991) Advances in statistical methodology for diagnostic medicine in the 1980’s. Stat Med 10:1887–1895CrossRefPubMed
33.
go back to reference Brigliadori G, Foca F, Dall’Agata M, Rengucci C, Melegari E, Cerasoli S, Amadori D, Calistri D, Faedi M (2016) Defining the cutoff value of MGMT gene promoter methylation and its predictive capacity in glioblastoma. J Neurooncol 128(2):333–339. doi:10.1007/s11060-016-2116-y CrossRefPubMed Brigliadori G, Foca F, Dall’Agata M, Rengucci C, Melegari E, Cerasoli S, Amadori D, Calistri D, Faedi M (2016) Defining the cutoff value of MGMT gene promoter methylation and its predictive capacity in glioblastoma. J Neurooncol 128(2):333–339. doi:10.​1007/​s11060-016-2116-y CrossRefPubMed
34.
go back to reference Collins VP, Ichimura K, Di Y, Pearson D, Chan R, Thompson LC, Gabe R, Brada M, Stenning SP (2014) Prognostic and predictive markers in recurrent high grade glioma; results from the BR12 randomised trial. Acta Neuropathol Commun. doi:10.1186/2051-5960-2-68 PubMedPubMedCentral Collins VP, Ichimura K, Di Y, Pearson D, Chan R, Thompson LC, Gabe R, Brada M, Stenning SP (2014) Prognostic and predictive markers in recurrent high grade glioma; results from the BR12 randomised trial. Acta Neuropathol Commun. doi:10.​1186/​2051-5960-2-68 PubMedPubMedCentral
Metadata
Title
Defining optimal cutoff value of MGMT promoter methylation by ROC analysis for clinical setting in glioblastoma patients
Authors
Guoqiang Yuan
Liang Niu
Yinian Zhang
Xiaoqing Wang
Kejun Ma
Hang Yin
Junqiang Dai
Wangning Zhou
Yawen Pan
Publication date
01-05-2017
Publisher
Springer US
Published in
Journal of Neuro-Oncology / Issue 1/2017
Print ISSN: 0167-594X
Electronic ISSN: 1573-7373
DOI
https://doi.org/10.1007/s11060-017-2433-9

Other articles of this Issue 1/2017

Journal of Neuro-Oncology 1/2017 Go to the issue