Skip to main content
Top
Published in: Neurosurgical Review 4/2017

01-10-2017 | Review

Augmented reality in neurosurgery: a systematic review

Authors: Antonio Meola, Fabrizio Cutolo, Marina Carbone, Federico Cagnazzo, Mauro Ferrari, Vincenzo Ferrari

Published in: Neurosurgical Review | Issue 4/2017

Login to get access

Abstract

Neuronavigation has become an essential neurosurgical tool in pursuing minimal invasiveness and maximal safety, even though it has several technical limitations. Augmented reality (AR) neuronavigation is a significant advance, providing a real-time updated 3D virtual model of anatomical details, overlaid on the real surgical field. Currently, only a few AR systems have been tested in a clinical setting. The aim is to review such devices. We performed a PubMed search of reports restricted to human studies of in vivo applications of AR in any neurosurgical procedure using the search terms “Augmented reality” and “Neurosurgery.” Eligibility assessment was performed independently by two reviewers in an unblinded standardized manner. The systems were qualitatively evaluated on the basis of the following: neurosurgical subspecialty of application, pathology of treated lesions and lesion locations, real data source, virtual data source, tracking modality, registration technique, visualization processing, display type, and perception location. Eighteen studies were included during the period 1996 to September 30, 2015. The AR systems were grouped by the real data source: microscope (8), hand- or head-held cameras (4), direct patient view (2), endoscope (1), and X-ray fluoroscopy (1) head-mounted display (1). A total of 195 lesions were treated: 75 (38.46 %) were neoplastic, 77 (39.48 %) neurovascular, and 1 (0.51 %) hydrocephalus, and 42 (21.53 %) were undetermined. Current literature confirms that AR is a reliable and versatile tool when performing minimally invasive approaches in a wide range of neurosurgical diseases, although prospective randomized studies are not yet available and technical improvements are needed.
Literature
1.
go back to reference Badiali G, Ferrari V, Cutolo F, Freschi C, Caramella D, Bianchi A, Marchetti C (2014) Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. J Cranio-Maxillofac Surg. doi:10.1016/j.jcms.2014.09.001 Badiali G, Ferrari V, Cutolo F, Freschi C, Caramella D, Bianchi A, Marchetti C (2014) Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. J Cranio-Maxillofac Surg. doi:10.​1016/​j.​jcms.​2014.​09.​001
6.
go back to reference Craig AB (2013) Understanding augmented reality: concepts and applications. Morgan Kaufmann, Waltham Craig AB (2013) Understanding augmented reality: concepts and applications. Morgan Kaufmann, Waltham
7.
go back to reference Cutolo F, Badiali G, Ferrari V (2015) Human-PnP: ergonomic AR interaction paradigm for manual placement of rigid bodies. In: Augmented environments for computer-assisted interventions. Springer International Publishing, pp 50–60 Cutolo F, Badiali G, Ferrari V (2015) Human-PnP: ergonomic AR interaction paradigm for manual placement of rigid bodies. In: Augmented environments for computer-assisted interventions. Springer International Publishing, pp 50–60
10.
go back to reference Drouin S, Kersten-Oertel M, Collins DL (2015) Interaction-based registration correction for improved augmented reality overlay in neurosurgery. In: Linte C, Yaniv Z, Fallavollita P (eds) Augmented environments for computer-assisted interventions, vol 9365. Lecture Notes in Computer Science. Springer International Publishing, pp 21–29. doi:10.1007/978-3-319-24601-7_3 Drouin S, Kersten-Oertel M, Collins DL (2015) Interaction-based registration correction for improved augmented reality overlay in neurosurgery. In: Linte C, Yaniv Z, Fallavollita P (eds) Augmented environments for computer-assisted interventions, vol 9365. Lecture Notes in Computer Science. Springer International Publishing, pp 21–29. doi:10.​1007/​978-3-319-24601-7_​3
11.
go back to reference Edwards PJ, Johnson LG, Hawkes DJ, Fenlon MR, Strong A, Gleeson M (2004) Clinical experience and perception in stereo augmented reality surgical navigation. In: YG Z, Jiang T (eds) MIAR. Springer-Verlag, Berlin, pp 369–376 Edwards PJ, Johnson LG, Hawkes DJ, Fenlon MR, Strong A, Gleeson M (2004) Clinical experience and perception in stereo augmented reality surgical navigation. In: YG Z, Jiang T (eds) MIAR. Springer-Verlag, Berlin, pp 369–376
12.
go back to reference Ferrari V, Cutolo F (2016) Letter to the Editor on “Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique”. Accepted by Journal of Neurosurgery Ferrari V, Cutolo F (2016) Letter to the Editor on “Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique”. Accepted by Journal of Neurosurgery
14.
go back to reference Inoue D, Cho B, Mori M, Kikkawa Y, Amano T, Nakamizo A, Yoshimoto K, Mizoguchi M, Tomikawa M, Hong J, Hashizume M, Sasaki T (2013) Preliminary study on the clinical application of augmented reality neuronavigation. J Neurol Surg Part A, Central European Neurosurg 74:71–76. doi:10.1055/s-0032-1333415 CrossRef Inoue D, Cho B, Mori M, Kikkawa Y, Amano T, Nakamizo A, Yoshimoto K, Mizoguchi M, Tomikawa M, Hong J, Hashizume M, Sasaki T (2013) Preliminary study on the clinical application of augmented reality neuronavigation. J Neurol Surg Part A, Central European Neurosurg 74:71–76. doi:10.​1055/​s-0032-1333415 CrossRef
15.
go back to reference Iseki H, Masutani Y, Iwahara M, Tanikawa T, Muragaki Y, Taira T, Dohi T, Takakura K (1997) Volumegraph (overlaid three-dimensional image-guided navigation). Clinical application of augmented reality in neurosurgery. Stereotact Funct Neurosurg 68:18–24. doi:10.1159/000099897 CrossRefPubMed Iseki H, Masutani Y, Iwahara M, Tanikawa T, Muragaki Y, Taira T, Dohi T, Takakura K (1997) Volumegraph (overlaid three-dimensional image-guided navigation). Clinical application of augmented reality in neurosurgery. Stereotact Funct Neurosurg 68:18–24. doi:10.​1159/​000099897 CrossRefPubMed
16.
go back to reference Kantelhardt SR, Gutenberg A, Neulen A, Keric N, Renovanz M, Giese A (2015) Video-assisted navigation for adjustment of image-guidance accuracy to slight brain shift. Neurosurgery. doi:10.1227/NEU.0000000000000921 Kantelhardt SR, Gutenberg A, Neulen A, Keric N, Renovanz M, Giese A (2015) Video-assisted navigation for adjustment of image-guidance accuracy to slight brain shift. Neurosurgery. doi:10.​1227/​NEU.​0000000000000921​
17.
go back to reference Kawamata T, Iseki H, Shibasaki T, Hori T (2002) Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 50:1393–1397PubMed Kawamata T, Iseki H, Shibasaki T, Hori T (2002) Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 50:1393–1397PubMed
19.
go back to reference Kersten-Oertel M, Jannin P, Collins DL (2010) DVV: towards a taxonomy for mixed reality visualization in image guided surgery. Lect Notes Comput Sc 6326:334–343CrossRef Kersten-Oertel M, Jannin P, Collins DL (2010) DVV: towards a taxonomy for mixed reality visualization in image guided surgery. Lect Notes Comput Sc 6326:334–343CrossRef
22.
go back to reference King AP, Edwards PJ, Maurer CR Jr, de Cunha DA, Hawkes DJ, Hill DL, Gaston RP, Fenlon MR, Strong AJ, Chandler CL, Richards A, Gleeson MJ (1999) A system for microscope-assisted guided interventions. Stereotact Funct Neurosurg 72:107–111CrossRefPubMed King AP, Edwards PJ, Maurer CR Jr, de Cunha DA, Hawkes DJ, Hill DL, Gaston RP, Fenlon MR, Strong AJ, Chandler CL, Richards A, Gleeson MJ (1999) A system for microscope-assisted guided interventions. Stereotact Funct Neurosurg 72:107–111CrossRefPubMed
24.
go back to reference Kruijff E, Swan JE, Feiner S Perceptual issues in augmented reality revisited. In: Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on, 13–16 Oct. 2010 2010. pp 3–12. doi:10.1109/ISMAR.2010.5643530 Kruijff E, Swan JE, Feiner S Perceptual issues in augmented reality revisited. In: Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on, 13–16 Oct. 2010 2010. pp 3–12. doi:10.​1109/​ISMAR.​2010.​5643530
25.
go back to reference Le Moigne J, Netanyahu NS, Eastman RD (2010) Image registration for remote sensing. Cambridge University Press, Cambridge Le Moigne J, Netanyahu NS, Eastman RD (2010) Image registration for remote sensing. Cambridge University Press, Cambridge
26.
go back to reference Levoy M (2006) Light fields and computational imaging. Computer:46–55 Levoy M (2006) Light fields and computational imaging. Computer:46–55
27.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339:b2700. doi:10.1136/bmj.b2700 CrossRefPubMedPubMedCentral Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339:b2700. doi:10.​1136/​bmj.​b2700 CrossRefPubMedPubMedCentral
28.
go back to reference Lippmann G (1908) Epreuves reversibles donnant la sensation du relief. J Phys Theor Appl 7:821–825CrossRef Lippmann G (1908) Epreuves reversibles donnant la sensation du relief. J Phys Theor Appl 7:821–825CrossRef
29.
go back to reference Lovo EE, Quintana JC, Puebla MC, Torrealba G, Santos JL, Lira IH, Tagle P (2007) A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Neurosurgery 60:366–371. doi:10.1227/01.NEU.0000255360.32689.FA, discussion 371–362PubMed Lovo EE, Quintana JC, Puebla MC, Torrealba G, Santos JL, Lira IH, Tagle P (2007) A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Neurosurgery 60:366–371. doi:10.​1227/​01.​NEU.​0000255360.​32689.​FA, discussion 371–362PubMed
30.
33.
go back to reference Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. Ieice T Inf Syst E77d:1321–1329 Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. Ieice T Inf Syst E77d:1321–1329
34.
35.
go back to reference Perneczky A, Reisch R, Tschabitscher M (2008) Keyhole approaches in neurosurgery. Springer, Wien Perneczky A, Reisch R, Tschabitscher M (2008) Keyhole approaches in neurosurgery. Springer, Wien
36.
go back to reference Reichelt S, Häussler R, Fütterer G, Leister N Depth cues in human visual perception and their realization in 3D displays. In: SPIE Defense, Security, and Sensing, 2010. International Society for Optics and Photonics, pp 76900B-76900B-76912 Reichelt S, Häussler R, Fütterer G, Leister N Depth cues in human visual perception and their realization in 3D displays. In: SPIE Defense, Security, and Sensing, 2010. International Society for Optics and Photonics, pp 76900B-76900B-76912
37.
go back to reference Rhoton AL, Rhoton AL, Congress of Neurological Surgeons. (2003) Rhoton cranial anatomy and surgical approaches. Neurosurgery,, vol 53. Lippincott Williams & Wilkins, Philadelphia Rhoton AL, Rhoton AL, Congress of Neurological Surgeons. (2003) Rhoton cranial anatomy and surgical approaches. Neurosurgery,, vol 53. Lippincott Williams & Wilkins, Philadelphia
38.
go back to reference Stadie AT, Reisch R, Kockro RA, Fischer G, Schwandt E, Boor S, Stoeter P (2009) Minimally invasive cerebral cavernoma surgery using keyhole approaches—solutions for technique-related limitations. Minimally Invasive Neurosurgery: MIN 52:9–16. doi:10.1055/s-0028-1103305 CrossRefPubMed Stadie AT, Reisch R, Kockro RA, Fischer G, Schwandt E, Boor S, Stoeter P (2009) Minimally invasive cerebral cavernoma surgery using keyhole approaches—solutions for technique-related limitations. Minimally Invasive Neurosurgery: MIN 52:9–16. doi:10.​1055/​s-0028-1103305 CrossRefPubMed
39.
go back to reference Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61:1295–1304. doi:10.1109/TBME.2014.2301191 CrossRefPubMed Wang J, Suenaga H, Hoshi K, Yang L, Kobayashi E, Sakuma I, Liao H (2014) Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng 61:1295–1304. doi:10.​1109/​TBME.​2014.​2301191 CrossRefPubMed
40.
go back to reference Zhang X, Chen G, Liao H A High-accuracy surgical augmented reality system using enhanced integral videography image overlay. In: 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society EMBC, Milano, 2015. Zhang X, Chen G, Liao H A High-accuracy surgical augmented reality system using enhanced integral videography image overlay. In: 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society EMBC, Milano, 2015.
Metadata
Title
Augmented reality in neurosurgery: a systematic review
Authors
Antonio Meola
Fabrizio Cutolo
Marina Carbone
Federico Cagnazzo
Mauro Ferrari
Vincenzo Ferrari
Publication date
01-10-2017
Publisher
Springer Berlin Heidelberg
Published in
Neurosurgical Review / Issue 4/2017
Print ISSN: 0344-5607
Electronic ISSN: 1437-2320
DOI
https://doi.org/10.1007/s10143-016-0732-9

Other articles of this Issue 4/2017

Neurosurgical Review 4/2017 Go to the issue