Skip to main content
Top
Published in: Journal of Digital Imaging 2/2009

01-04-2009

A Knowledge-Anchored Integrative Image Search and Retrieval System

Authors: Selnur Erdal, Umit V. Catalyurek, Philip R. O. Payne, Joel Saltz, Jyoti Kamal, Metin N. Gurcan

Published in: Journal of Imaging Informatics in Medicine | Issue 2/2009

Login to get access

Abstract

Clinical data that may be used in a secondary capacity to support research activities are regularly stored in three significantly different formats: (1) structured, codified data elements; (2) semi-structured or unstructured narrative text; and (3) multi-modal images. In this manuscript, we will describe the design of a computational system that is intended to support the ontology-anchored query and integration of such data types from multiple source systems. Additional features of the described system include (1) the use of Grid services-based electronic data interchange models to enable the use of our system in multi-site settings and (2) the use of a software framework intended to address both potential security and patient confidentiality concerns that arise when transmitting or otherwise manipulating potentially privileged personal health information. We will frame our discussion within the specific experimental context of the concept-oriented query and integration of correlated structured data, narrative text, and images for cancer research.
Literature
1.
go back to reference Cimino JJ: From data to knowledge through concept-oriented terminologies: experience with the Medical Entities Dictionary. J Am Med Inform Assoc 7(3):288–297, 2000PubMed Cimino JJ: From data to knowledge through concept-oriented terminologies: experience with the Medical Entities Dictionary. J Am Med Inform Assoc 7(3):288–297, 2000PubMed
2.
go back to reference Sujansky W: Heterogeneous database integration in biomedicine. J Biomed Inform 34(4):285–298, 2001PubMedCrossRef Sujansky W: Heterogeneous database integration in biomedicine. J Biomed Inform 34(4):285–298, 2001PubMedCrossRef
3.
go back to reference Kamal J, et al: Information warehouse as a tool to analyze computerized physician order entry order set utilization: opportunities for improvement. AMIA Annu Symp Proc 2003:336–340, 2003 Kamal J, et al: Information warehouse as a tool to analyze computerized physician order entry order set utilization: opportunities for improvement. AMIA Annu Symp Proc 2003:336–340, 2003
4.
go back to reference Prather JC, et al: Medical data mining: knowledge discovery in a clinical data warehouse. Proc AMIA Annu Fall Symp 1997:101–105, 1997 Prather JC, et al: Medical data mining: knowledge discovery in a clinical data warehouse. Proc AMIA Annu Fall Symp 1997:101–105, 1997
5.
go back to reference Brown M, et al: CAD in clinical trials: current role and architectural requirements. Comput Med Imaging Graph 31(4–5):332–337, 2007PubMedCrossRef Brown M, et al: CAD in clinical trials: current role and architectural requirements. Comput Med Imaging Graph 31(4–5):332–337, 2007PubMedCrossRef
6.
go back to reference Kamauu AW, et al: Informatics in radiology (infoRAD): vendor-neutral case input into a server-based digital teaching file system. Radiographics 26(6):1877–1885, 2006PubMedCrossRef Kamauu AW, et al: Informatics in radiology (infoRAD): vendor-neutral case input into a server-based digital teaching file system. Radiographics 26(6):1877–1885, 2006PubMedCrossRef
8.
go back to reference Sigal R: PACS as an e-academic tool International Congress series 2005, 1281, CARS 2005: Computer Assisted Radiology and Surgery, pp. 900–904 Sigal R: PACS as an e-academic tool International Congress series 2005, 1281, CARS 2005: Computer Assisted Radiology and Surgery, pp. 900–904
9.
go back to reference Boochever SS: HIS/RIS/PACS integration: getting to the gold standard. Radiol Manage 26:16–24, 2004PubMed Boochever SS: HIS/RIS/PACS integration: getting to the gold standard. Radiol Manage 26:16–24, 2004PubMed
10.
go back to reference Gruber TR: Toward principles for the design of ontologies used for knowledge sharing. In: Guarino N, Poli R Eds. Formal Ontology in Conceptual Analysis and Knowledge RepresentationNorwell: Kluwer, 1993 Gruber TR: Toward principles for the design of ontologies used for knowledge sharing. In: Guarino N, Poli R Eds. Formal Ontology in Conceptual Analysis and Knowledge RepresentationNorwell: Kluwer, 1993
11.
go back to reference Joseph P, Bruce GB: Ontology-guided knowledge discovery in databases. In: Proceedings of the international conference on knowledge capture. Victoria, British Columbia, Canada: ACM Press, 2001 Joseph P, Bruce GB: Ontology-guided knowledge discovery in databases. In: Proceedings of the international conference on knowledge capture. Victoria, British Columbia, Canada: ACM Press, 2001
12.
go back to reference Smith B, Kumar A: On controlled vocabularies in bioinformatics: a case study in the gene ontology. Biosilico: Drug Discovery Today 2(1):246–252, 2004CrossRef Smith B, Kumar A: On controlled vocabularies in bioinformatics: a case study in the gene ontology. Biosilico: Drug Discovery Today 2(1):246–252, 2004CrossRef
13.
go back to reference Gurcan MN, et al: Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002PubMedCrossRef Gurcan MN, et al: Lung nodule detection on thoracic computed tomography images: preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002PubMedCrossRef
14.
go back to reference Ebbert JO, Dupras DM, Erwin PJ: Searching the medical literature using PubMed: a tutorial. Mayo Clin Proc 78(1):87–91, 2003PubMedCrossRef Ebbert JO, Dupras DM, Erwin PJ: Searching the medical literature using PubMed: a tutorial. Mayo Clin Proc 78(1):87–91, 2003PubMedCrossRef
15.
go back to reference Olson GM, et al: Collaboratories to support distributed science: the example of international HIV/AIDS research. In: Proceedings of SAICSIT, South Africa. Victoria, British Columbia, Canada: ACM Press, 2002 Olson GM, et al: Collaboratories to support distributed science: the example of international HIV/AIDS research. In: Proceedings of SAICSIT, South Africa. Victoria, British Columbia, Canada: ACM Press, 2002
17.
go back to reference Marks RG, Conlon M, Ruberg SJ: Paradigm shifts in clinical trials enabled by information technology. Stat Med 20(17–18):2683–2696, 2001PubMedCrossRef Marks RG, Conlon M, Ruberg SJ: Paradigm shifts in clinical trials enabled by information technology. Stat Med 20(17–18):2683–2696, 2001PubMedCrossRef
18.
go back to reference Payne PR, Greaves AW, Kipps TJ: CRC clinical trials management system (CTMS): an integrated information management solution for collaborative clinical research. AMIA Annu Symp Proc 2003:967, 2003 Payne PR, Greaves AW, Kipps TJ: CRC clinical trials management system (CTMS): an integrated information management solution for collaborative clinical research. AMIA Annu Symp Proc 2003:967, 2003
19.
go back to reference Kuchenbecker J, et al: Use of internet technologies for data acquisition in large clinical trials. Telemed J E Health 7(1):73–76, 2001PubMedCrossRef Kuchenbecker J, et al: Use of internet technologies for data acquisition in large clinical trials. Telemed J E Health 7(1):73–76, 2001PubMedCrossRef
20.
go back to reference Marks L, Power E: Using technology to address recruitment issues in the clinical trial process. Trends Biotechnol 20(3):105–109, 2002PubMedCrossRef Marks L, Power E: Using technology to address recruitment issues in the clinical trial process. Trends Biotechnol 20(3):105–109, 2002PubMedCrossRef
21.
go back to reference Bates DW, et al: A proposal for electronic medical records in U.S. primary care. J Am Med Inform Assoc 10(1):1–10, 2003PubMedCrossRef Bates DW, et al: A proposal for electronic medical records in U.S. primary care. J Am Med Inform Assoc 10(1):1–10, 2003PubMedCrossRef
22.
go back to reference Sung NS, et al: Central challenges facing the national clinical research enterprise. JAMA 289(10):1278–1287, 2003PubMedCrossRef Sung NS, et al: Central challenges facing the national clinical research enterprise. JAMA 289(10):1278–1287, 2003PubMedCrossRef
23.
go back to reference Bates DW, et al: Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 280(15):1311–1316, 1998PubMedCrossRef Bates DW, et al: Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA 280(15):1311–1316, 1998PubMedCrossRef
24.
go back to reference Huang H, et al: Picture archiving and communication systems (PACS) in medicine, New York: Springer, 1991 Huang H, et al: Picture archiving and communication systems (PACS) in medicine, New York: Springer, 1991
25.
go back to reference Duerinckx AJ, Pisa EJ: Filmless picture archiving and communication system (PACS) in diagnostic radiology. Proc SPIE 318:9–18, 1982 Duerinckx AJ, Pisa EJ: Filmless picture archiving and communication system (PACS) in diagnostic radiology. Proc SPIE 318:9–18, 1982
26.
go back to reference Gurcan MN, et al: GridImage: a novel use of grid computing to support interactive human and computer-assisted detection decision support. J Digit Imaging 20:160–171, 2007PubMedCrossRef Gurcan MN, et al: GridImage: a novel use of grid computing to support interactive human and computer-assisted detection decision support. J Digit Imaging 20:160–171, 2007PubMedCrossRef
27.
go back to reference Craver JM, Gold RS: Research collaboratories: their potential for health behavior researchers. Am J Health Behav 26(6):504–509, 2002PubMed Craver JM, Gold RS: Research collaboratories: their potential for health behavior researchers. Am J Health Behav 26(6):504–509, 2002PubMed
28.
go back to reference Kukafka R, et al: Grounding a new information technology implementation framework in behavioral science: a systematic analysis of the literature on IT use. J Biomed Inform 36(3):218–227, 2003PubMedCrossRef Kukafka R, et al: Grounding a new information technology implementation framework in behavioral science: a systematic analysis of the literature on IT use. J Biomed Inform 36(3):218–227, 2003PubMedCrossRef
29.
go back to reference Johnson MS, Gonzales MN, Bizila S: Responsible conduct of radiology research part V. The health insurance portability and accountability act and research. Radiology 237(3):757–764, 2005PubMedCrossRef Johnson MS, Gonzales MN, Bizila S: Responsible conduct of radiology research part V. The health insurance portability and accountability act and research. Radiology 237(3):757–764, 2005PubMedCrossRef
30.
go back to reference Liu BJ, Zhou Z, Huang HK: A HIPAA-compliant architecture for securing clinical images. J Digit Imaging 19(2):172–180, 2006PubMedCrossRef Liu BJ, Zhou Z, Huang HK: A HIPAA-compliant architecture for securing clinical images. J Digit Imaging 19(2):172–180, 2006PubMedCrossRef
31.
go back to reference Amendolia SR, et al: MammoGrid: a service oriented architecture based medical grid application. In: 3rd International Conference on Grid and Cooperative Computing, Wuhan, China, 2004 Amendolia SR, et al: MammoGrid: a service oriented architecture based medical grid application. In: 3rd International Conference on Grid and Cooperative Computing, Wuhan, China, 2004
32.
go back to reference Blanquer I, et al: A Middleware grid for storing, retrieving and processing DICOM medical images. In: Workshop on Distributed Databases and Processing in Medical Image Computing (DIDAMIC), Rennes, France, 2004 Blanquer I, et al: A Middleware grid for storing, retrieving and processing DICOM medical images. In: Workshop on Distributed Databases and Processing in Medical Image Computing (DIDAMIC), Rennes, France, 2004
33.
go back to reference Espert IB, Garcaa VH, Quilis JD: An OGSA middleware for managing medical images using ontologies. J Clin Monit Comput 19(4–5):295–305, 2005PubMedCrossRef Espert IB, Garcaa VH, Quilis JD: An OGSA middleware for managing medical images using ontologies. J Clin Monit Comput 19(4–5):295–305, 2005PubMedCrossRef
34.
go back to reference Montagnat J, et al: Medical image content-based queries using the grid. In: HealthGrid’03, France, Lyon, 2003 Montagnat J, et al: Medical image content-based queries using the grid. In: HealthGrid’03, France, Lyon, 2003
35.
go back to reference Power D, et al: A relational approach to the capture of DICOM files for Grid-enabled medical imaging databases. In: ACM symposium on applied computing, Cyprus, Nicosia, 2004, pp 272–279 Power D, et al: A relational approach to the capture of DICOM files for Grid-enabled medical imaging databases. In: ACM symposium on applied computing, Cyprus, Nicosia, 2004, pp 272–279
36.
go back to reference Foster I, Kesselman C: The Grid 2: blueprint for a new computing infrastructure, 2nd edition. New York: Morgan Kaufman, 2003, p. 748 Foster I, Kesselman C: The Grid 2: blueprint for a new computing infrastructure, 2nd edition. New York: Morgan Kaufman, 2003, p. 748
37.
go back to reference Payne PR, et al: Conceptual knowledge acquisition in biomedicine: a methodological review. J Biomed Inform 40:582–602, 2007PubMedCrossRef Payne PR, et al: Conceptual knowledge acquisition in biomedicine: a methodological review. J Biomed Inform 40:582–602, 2007PubMedCrossRef
39.
go back to reference Bodenreider O: Using UMLS semantics for classification purposes. Proc AMIA Symp 2000:86–90, 2000 Bodenreider O: Using UMLS semantics for classification purposes. Proc AMIA Symp 2000:86–90, 2000
40.
go back to reference Campbell KE, et al: Representing thoughts, words, and things in the UMLS. J Am Med Inform Assoc 5(5):421–431, 1998PubMed Campbell KE, et al: Representing thoughts, words, and things in the UMLS. J Am Med Inform Assoc 5(5):421–431, 1998PubMed
41.
go back to reference Thomas BJ, et al: Automated computer-assisted categorization of radiology reports. Am J Roentgenol 184(2):687–690, 2005 Thomas BJ, et al: Automated computer-assisted categorization of radiology reports. Am J Roentgenol 184(2):687–690, 2005
42.
go back to reference Tsui F-C, et al: Value of ICD-9-coded chief complaints for detection of epidemics. J Am Med Inform Assoc 9:S41–S47, 2002CrossRef Tsui F-C, et al: Value of ICD-9-coded chief complaints for detection of epidemics. J Am Med Inform Assoc 9:S41–S47, 2002CrossRef
43.
go back to reference Friedman C, et al: Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc 11(5):392–402, 2004PubMedCrossRef Friedman C, et al: Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc 11(5):392–402, 2004PubMedCrossRef
44.
go back to reference Srinivasan S, et al: Finding UMLS Metathesaurus concepts in MEDLINE. In: American Medical Informatics Association Annual Symposium, 2002, pp 727–731 Srinivasan S, et al: Finding UMLS Metathesaurus concepts in MEDLINE. In: American Medical Informatics Association Annual Symposium, 2002, pp 727–731
45.
go back to reference Taira RK, Soderland SG, Jakobovits RM: Automatic structuring of radiology free-text reports. Radiographics 21:237–245, 2001PubMed Taira RK, Soderland SG, Jakobovits RM: Automatic structuring of radiology free-text reports. Radiographics 21:237–245, 2001PubMed
46.
go back to reference Zou Q, et al: IndexFinder: a method of extracting key concepts from clinical texts for indexing. In: American Medical Informatics Association Annual Symposium, 2003, pp 763–767 Zou Q, et al: IndexFinder: a method of extracting key concepts from clinical texts for indexing. In: American Medical Informatics Association Annual Symposium, 2003, pp 763–767
50.
go back to reference Ferrucci D, Lally A: Building an example application with the unstructured information management architecture. IBM Syst J 43(3):455–475, 2004CrossRef Ferrucci D, Lally A: Building an example application with the unstructured information management architecture. IBM Syst J 43(3):455–475, 2004CrossRef
51.
go back to reference Baecker R, Small I, Mander R: Bringing icons to life. Proceedings of the SIGCHI conference on human factors in computing systems: reaching through technology. New Orleans, Louisiana, USA: ACM Press, 1991, pp 1–6 Baecker R, Small I, Mander R: Bringing icons to life. Proceedings of the SIGCHI conference on human factors in computing systems: reaching through technology. New Orleans, Louisiana, USA: ACM Press, 1991, pp 1–6
53.
go back to reference Armato III, SG, et al: Lung image database consortium: developing a resource for the medical imaging research community. Radiology 232:739–748, 2004PubMedCrossRef Armato III, SG, et al: Lung image database consortium: developing a resource for the medical imaging research community. Radiology 232:739–748, 2004PubMedCrossRef
54.
go back to reference Sigal R: PACS as an e-academic tool. In CARS 2005: computer assisted radiology and surgery. 2005 Sigal R: PACS as an e-academic tool. In CARS 2005: computer assisted radiology and surgery. 2005
55.
go back to reference Toms AP, et al: Building an anonymized catalogued radiology museum in PACS: a feasibility study. Br J Radiol 79:661–671, 2006CrossRef Toms AP, et al: Building an anonymized catalogued radiology museum in PACS: a feasibility study. Br J Radiol 79:661–671, 2006CrossRef
56.
go back to reference Cohen S, Gilboa F, Uri S: PACS and electronic health records, San Diego, CA: SPIE, 2002 Cohen S, Gilboa F, Uri S: PACS and electronic health records, San Diego, CA: SPIE, 2002
57.
go back to reference Lehmann T, Wein B, Greenspan H: Integration of content-based image retrieval to picture archiving and communication systems. In: Medical Informatics Europe Conference, 2003 Lehmann T, Wein B, Greenspan H: Integration of content-based image retrieval to picture archiving and communication systems. In: Medical Informatics Europe Conference, 2003
58.
go back to reference Traina A, Rosa NA, Traina C. Integrating images to patient electronic medical records through content-based retrieval techniques. In: 16th IEEE Symposium on Computer-Based Medical Systems, 2003 Traina A, Rosa NA, Traina C. Integrating images to patient electronic medical records through content-based retrieval techniques. In: 16th IEEE Symposium on Computer-Based Medical Systems, 2003
59.
go back to reference Leoni L, et al: A virtual data grid architecture for medical data using SRB. In: EuroPACS-MIR 2004, Trieste, Italy, 2004 Leoni L, et al: A virtual data grid architecture for medical data using SRB. In: EuroPACS-MIR 2004, Trieste, Italy, 2004
60.
go back to reference Erdal S, et al: Flexible patient information search and retrieval framework: pilot implementation. In: Proceedings of the SPIE Medical Imaging, San Diego, CA, 2007 Erdal S, et al: Flexible patient information search and retrieval framework: pilot implementation. In: Proceedings of the SPIE Medical Imaging, San Diego, CA, 2007
61.
go back to reference Erdal S, et al: Information warehouse application of caGrid: a prototype implementation. In: caBIG 2007 Annual Meeting, Washington, DC, 2007 Erdal S, et al: Information warehouse application of caGrid: a prototype implementation. In: caBIG 2007 Annual Meeting, Washington, DC, 2007
62.
go back to reference Erdal S, et al: Integrating a PACS system to grid: a de-identification and integration framework. In: Annual Meeting of the Society for Imaging Informatics in Medicine (SIIM) 2007, Providence, RI, 2007 Erdal S, et al: Integrating a PACS system to grid: a de-identification and integration framework. In: Annual Meeting of the Society for Imaging Informatics in Medicine (SIIM) 2007, Providence, RI, 2007
63.
go back to reference Lindberg C: The unified medical language system (UMLS) of the national library of medicine. J Am Med Rec Assoc 61(5):40–42, 1990PubMed Lindberg C: The unified medical language system (UMLS) of the national library of medicine. J Am Med Rec Assoc 61(5):40–42, 1990PubMed
64.
go back to reference Lindberg DA, Humphreys BL, McCray AT: The unified medical language system. Methods Inf Med 32(4):281–291, 1993PubMed Lindberg DA, Humphreys BL, McCray AT: The unified medical language system. Methods Inf Med 32(4):281–291, 1993PubMed
66.
go back to reference Eckerson WW: Three tier client/server architecture: achieving scalability, performance, and efficiency in client server applications. Open Inf Syst 10:1–12, 1995 Eckerson WW: Three tier client/server architecture: achieving scalability, performance, and efficiency in client server applications. Open Inf Syst 10:1–12, 1995
67.
go back to reference Gallaugher J, Ramanathan S: Choosing a client/server architecture. A comparison of two-tier and three-tier systems. Inf Syst Manage Mag 13(2):7–13 Gallaugher J, Ramanathan S: Choosing a client/server architecture. A comparison of two-tier and three-tier systems. Inf Syst Manage Mag 13(2):7–13
68.
go back to reference Clunie DA: DICOM structured reporting, Bangor, Pennsylvania: PixelMed, 2000 Clunie DA: DICOM structured reporting, Bangor, Pennsylvania: PixelMed, 2000
69.
go back to reference Payne PR, et al: Breaking the translational barriers: the value of integrating biomedical informatics and translational research. J Investig Med 53(4):192–200, 2005PubMedCrossRef Payne PR, et al: Breaking the translational barriers: the value of integrating biomedical informatics and translational research. J Investig Med 53(4):192–200, 2005PubMedCrossRef
Metadata
Title
A Knowledge-Anchored Integrative Image Search and Retrieval System
Authors
Selnur Erdal
Umit V. Catalyurek
Philip R. O. Payne
Joel Saltz
Jyoti Kamal
Metin N. Gurcan
Publication date
01-04-2009
Publisher
Springer-Verlag
Published in
Journal of Imaging Informatics in Medicine / Issue 2/2009
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-007-9086-8

Other articles of this Issue 2/2009

Journal of Digital Imaging 2/2009 Go to the issue