Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 3/2020

Open Access 01-07-2020 | Research

ECCParaCorp: a cross-lingual parallel corpus towards cancer education, dissemination and application

Authors: Hetong Ma, Feihong Yang, Jiansong Ren, Ni Li, Min Dai, Xuwen Wang, An Fang, Jiao Li, Qing Qian, Jie He

Published in: BMC Medical Informatics and Decision Making | Special Issue 3/2020

Login to get access

Abstract

Background

The increasing global cancer incidence corresponds to serious health impact in countries worldwide. Knowledge-powered health system in different languages would enhance clinicians’ healthcare practice, patients’ health management and public health literacy. High-quality corpus containing cancer information is the necessary foundation of cancer education. Massive non-structural information resources exist in clinical narratives, electronic health records (EHR) etc. They can only be used for training AI models after being transformed into structured corpus. However, the scarcity of multilingual cancer corpus limits the intelligent processing, such as machine translation in medical scenarios. Thus, we created the cancer specific cross-lingual corpus and open it to the public for academic use.

Methods

Aiming to build an English-Chinese cancer parallel corpus, we developed a workflow of seven steps including data retrieval, data parsing, data processing, corpus implementation, assessment verification, corpus release, and application. We applied the workflow to a cross-lingual, comprehensive and authoritative cancer information resource, PDQ (Physician Data Query). We constructed, validated and released the parallel corpus named as ECCParaCorp, made it openly accessible online.

Results

The proposed English-Chinese Cancer Parallel Corpus (ECCParaCorp) consists of 6685 aligned text pairs in Xml, Excel, Csv format, containing 5190 sentence pairs, 1083 phrase pairs and 412 word pairs, which involved information of 6 cancers including breast cancer, liver cancer, lung cancer, esophageal cancer, colorectal cancer, and stomach cancer, and 3 cancer themes containing cancer prevention, screening, and treatment. All data in the parallel corpus are online, available for users to browse and download (http://​www.​phoc.​org.​cn/​ECCParaCorp/​).

Conclusions

ECCParaCorp is a parallel corpus focused on cancer in a cross-lingual form, which is openly accessible. It would make up the imbalance of scarce multilingual corpus resources, bridge the gap between human readable information and machine understanding data resources, and would contribute to intelligent technology application as a preparatory data foundation e.g. cancer-related machine translation, cancer system development towards medical education, and disease-oriented knowledge extraction.
Literature
2.
go back to reference Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019. CA Cancer J Clin. 2019;69(1):7–34.CrossRef Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019. CA Cancer J Clin. 2019;69(1):7–34.CrossRef
5.
go back to reference Jin H, Li C, Zhang J, Hou L, Zhang P. XLORE2: large-scale cross-lingual knowledge graph construction and application; 2019. Jin H, Li C, Zhang J, Hou L, Zhang P. XLORE2: large-scale cross-lingual knowledge graph construction and application; 2019.
7.
go back to reference Hirschberg J, Manning CD. Advances in natural language processing. Science. 2015;349(6245):261–6.CrossRef Hirschberg J, Manning CD. Advances in natural language processing. Science. 2015;349(6245):261–6.CrossRef
8.
go back to reference Zeroual I, Lakhouaja A. MulTed: A multilingual aligned and tagged parallel corpus. Applied Computing and Informatics; 2018. Zeroual I, Lakhouaja A. MulTed: A multilingual aligned and tagged parallel corpus. Applied Computing and Informatics; 2018.
9.
go back to reference Ma H, Ren J, Wang X, Fang A, Li J, Qian Q. A cross-lingual effort towards managing English-Chinese Cancer education resources. Stud Health Technol Inform. 2019;264:1534–5.PubMed Ma H, Ren J, Wang X, Fang A, Li J, Qian Q. A cross-lingual effort towards managing English-Chinese Cancer education resources. Stud Health Technol Inform. 2019;264:1534–5.PubMed
10.
go back to reference Kors JA, Clematide S, Akhondi SA, van Mulligen EM, Rebholz-Schuhmann D. A multilingual gold-standard corpus for biomedical concept recognition: the mantra GSC. JAMIA. 2015;22(5):948–56.PubMed Kors JA, Clematide S, Akhondi SA, van Mulligen EM, Rebholz-Schuhmann D. A multilingual gold-standard corpus for biomedical concept recognition: the mantra GSC. JAMIA. 2015;22(5):948–56.PubMed
11.
go back to reference Dalianis H, Xing H-c, Zhang X, editors. Creating a reusable English-Chinese parallel Corpus for bilingual dictionary construction. Seventh conference on international language resources and evaluation (LREC’10). Valletta: European Languages Resources Association (ELRA); 2010. Dalianis H, Xing H-c, Zhang X, editors. Creating a reusable English-Chinese parallel Corpus for bilingual dictionary construction. Seventh conference on international language resources and evaluation (LREC’10). Valletta: European Languages Resources Association (ELRA); 2010.
12.
go back to reference Koehn P. Europarl: A Parallel Corpus for Statistical Machine Translation. tenth Machine Translation Summit: Phuket, AAMT; 2005. p. 79–86. Koehn P. Europarl: A Parallel Corpus for Statistical Machine Translation. tenth Machine Translation Summit: Phuket, AAMT; 2005. p. 79–86.
13.
go back to reference Chen X, Ge S. The construction of English-Chinese parallel Corpus of medical works based on self-coded Python programs. Procedia Engineering. 2011;24:598–603.CrossRef Chen X, Ge S. The construction of English-Chinese parallel Corpus of medical works based on self-coded Python programs. Procedia Engineering. 2011;24:598–603.CrossRef
14.
go back to reference Alexandre Rafalovitch RD, editor. United Nations General Assembly Resolutions : a six-language parallel corpus. Machine Translation Summit. Ottawa: International Association of Machine Translation; 2009. Alexandre Rafalovitch RD, editor. United Nations General Assembly Resolutions : a six-language parallel corpus. Machine Translation Summit. Ottawa: International Association of Machine Translation; 2009.
15.
go back to reference Tyers FM, Alperen MS. South-East European Times: A parallel corpus of Balkan languages; 2010. Tyers FM, Alperen MS. South-East European Times: A parallel corpus of Balkan languages; 2010.
16.
go back to reference Federico MCCGM. WIT 3 : Web Inventory of Transcribed and Translated Talks. 16th EAMT Conference: Trento, European Association for Machine Translation; 2012. Federico MCCGM. WIT 3 : Web Inventory of Transcribed and Translated Talks. 16th EAMT Conference: Trento, European Association for Machine Translation; 2012.
17.
go back to reference Mohamed MZ, Ihalapathirana A, Hameed RA, Pathirennehelage N, Ranathunga S, Jayasena S, et al. Automatic creation of a word aligned Sinhala-Tamil parallel corpus. 2017 Moratuwa engineering research conference (MERCon); 2017. p. 29–31. May 2017. Mohamed MZ, Ihalapathirana A, Hameed RA, Pathirennehelage N, Ranathunga S, Jayasena S, et al. Automatic creation of a word aligned Sinhala-Tamil parallel corpus. 2017 Moratuwa engineering research conference (MERCon); 2017. p. 29–31. May 2017.
18.
go back to reference Gale WA, Church KW. A program for aligning sentences in bilingual corpora. Comput Linguist. 1993;19(1):75–102. Gale WA, Church KW. A program for aligning sentences in bilingual corpora. Comput Linguist. 1993;19(1):75–102.
19.
go back to reference Moore RC. Fast and Accurate Sentence Alignment of Bilingual Corpora, vol. 2499; 2002. p. 135–44. Moore RC. Fast and Accurate Sentence Alignment of Bilingual Corpora, vol. 2499; 2002. p. 135–44.
20.
go back to reference Thomas C. Chuang KCY, editor Aligning Parallel Bilingual Corpora Statistically with Punctuation Criteria. Computational Linguistics and Chinese Language Processing; 2005: The Association for Computational Linguistics and Chinese Language Processing. Thomas C. Chuang KCY, editor Aligning Parallel Bilingual Corpora Statistically with Punctuation Criteria. Computational Linguistics and Chinese Language Processing; 2005: The Association for Computational Linguistics and Chinese Language Processing.
21.
go back to reference Wu D, Aligning a parallel English-Chinese corpus statistically with lexical criteria. Proceedings of the 32nd annual meeting on Association for Computational Linguistics. Las Cruces: 981744: Association for Computational Linguistics; 1994. p. 80–7.CrossRef Wu D, Aligning a parallel English-Chinese corpus statistically with lexical criteria. Proceedings of the 32nd annual meeting on Association for Computational Linguistics. Las Cruces: 981744: Association for Computational Linguistics; 1994. p. 80–7.CrossRef
22.
go back to reference Varga D, Halácsy P, Kornai A, Nagy V, Németh L, Trón V. Parallel corpora for medium density languages, vol. 292; 2007. p. 247–58. Varga D, Halácsy P, Kornai A, Nagy V, Németh L, Trón V. Parallel corpora for medium density languages, vol. 292; 2007. p. 247–58.
23.
go back to reference Sennrich R, Volk M. Iterative, MT-based sentence alignment of parallel texts; 2011. p. 175–82. Sennrich R, Volk M. Iterative, MT-based sentence alignment of parallel texts; 2011. p. 175–82.
Metadata
Title
ECCParaCorp: a cross-lingual parallel corpus towards cancer education, dissemination and application
Authors
Hetong Ma
Feihong Yang
Jiansong Ren
Ni Li
Min Dai
Xuwen Wang
An Fang
Jiao Li
Qing Qian
Jie He
Publication date
01-07-2020
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s12911-020-1116-1

Other articles of this Special Issue 3/2020

BMC Medical Informatics and Decision Making 3/2020 Go to the issue