Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 6/2016

01-06-2016 | Original Article

Preclinical usability study of multiple augmented reality concepts for K-wire placement

Authors: Marius Fischer, Bernhard Fuerst, Sing Chun Lee, Javad Fotouhi, Severine Habert, Simon Weidert, Ekkehard Euler, Greg Osgood, Nassir Navab

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 6/2016

Login to get access

Abstract

Purpose

In many orthopedic surgeries, there is a demand for correctly placing medical instruments (e.g., K-wire or drill) to perform bone fracture repairs. The main challenge is the mental alignment of X-ray images acquired using a C-arm, the medical instruments, and the patient, which dramatically increases in complexity during pelvic surgeries. Current solutions include the continuous acquisition of many intra-operative X-ray images from various views, which will result in high radiation exposure, long surgical durations, and significant effort and frustration for the surgical staff. This work conducts a preclinical usability study to test and evaluate mixed reality visualization techniques using intra-operative X-ray, optical, and RGBD imaging to augment the surgeon’s view to assist accurate placement of tools.

Method

We design and perform a usability study to compare the performance of surgeons and their task load using three different mixed reality systems during K-wire placements. The three systems are interventional X-ray imaging, X-ray augmentation on 2D video, and 3D surface reconstruction augmented by digitally reconstructed radiographs and live tool visualization.

Results

The evaluation criteria include duration, number of X-ray images acquired, placement accuracy, and the surgical task load, which are observed during 21 clinically relevant interventions performed by surgeons on phantoms. Finally, we test for statistically significant improvements and show that the mixed reality visualization leads to a significantly improved efficiency.

Conclusion

The 3D visualization of patient, tool, and DRR shows clear advantages over the conventional X-ray imaging and provides intuitive feedback to place the medical tools correctly and efficiently.
Literature
1.
go back to reference Boszczyk BM, Bierschneider M, Panzer S, Panzer W, Harstall R, Schmid K, Jaksche H (2006) Fluoroscopic radiation exposure of the kyphoplasty patient. Eur Spine J 15(3):347–355CrossRefPubMedPubMedCentral Boszczyk BM, Bierschneider M, Panzer S, Panzer W, Harstall R, Schmid K, Jaksche H (2006) Fluoroscopic radiation exposure of the kyphoplasty patient. Eur Spine J 15(3):347–355CrossRefPubMedPubMedCentral
2.
go back to reference Routt ML Jr, Simonian PT, Grujic L (1995) The retrograde medullary superior public ramus screw for the treatment of anterior pelvic ring disruptions: a new technique. J Orthop Trauma 9(1):35–44CrossRefPubMed Routt ML Jr, Simonian PT, Grujic L (1995) The retrograde medullary superior public ramus screw for the treatment of anterior pelvic ring disruptions: a new technique. J Orthop Trauma 9(1):35–44CrossRefPubMed
3.
go back to reference Diotte B, Fallavollita P, Wang L, Weidert S, Thaller P-H, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: Ayache N, Delingette H, Golland P, Mori K (eds) Medical Image Computing and Computer-Assisted Intervention–MICCAI 2012, Springer, Berlin, Heidelberg, pp 18–25. doi:10.1007/978-3-642-33415-3_3 Diotte B, Fallavollita P, Wang L, Weidert S, Thaller P-H, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: Ayache N, Delingette H, Golland P, Mori K (eds) Medical Image Computing and Computer-Assisted Intervention–MICCAI 2012, Springer, Berlin, Heidelberg, pp 18–25. doi:10.​1007/​978-3-642-33415-3_​3
4.
go back to reference Friedman M (1940) A comparison of alternative tests of significance for the problem of m rankings. Ann Math Stat 11(1):86–92CrossRef Friedman M (1940) A comparison of alternative tests of significance for the problem of m rankings. Ann Math Stat 11(1):86–92CrossRef
5.
go back to reference Gay SB, Sistrom C, Wang GJ, Kahler DA, Boman T, McHugh N, Goitz HT (1992) Percutaneous screw fixation of acetabular fractures with ct guidance: preliminary results of a new technique. AJR Am J Roentgenol 158(4):819–822CrossRefPubMed Gay SB, Sistrom C, Wang GJ, Kahler DA, Boman T, McHugh N, Goitz HT (1992) Percutaneous screw fixation of acetabular fractures with ct guidance: preliminary results of a new technique. AJR Am J Roentgenol 158(4):819–822CrossRefPubMed
6.
go back to reference Gebhard FT, Kraus MD, Schneider E, Liener UC, Kinzl L, Arand M (2006) Does computer-assisted spine surgery reduce intraoperative radiation doses? Spine 31(17):2024–2027CrossRefPubMed Gebhard FT, Kraus MD, Schneider E, Liener UC, Kinzl L, Arand M (2006) Does computer-assisted spine surgery reduce intraoperative radiation doses? Spine 31(17):2024–2027CrossRefPubMed
7.
go back to reference Gras F, Marintschev I, Klos K, Mückley T, Hofmann GO, Kahler DM (2012) Screw placement for acetabular fractures: which navigation modality (2-dimensional vs. 3-dimensional) should be used? An experimental study. J Orthop Trauma 26(8):466–473CrossRefPubMed Gras F, Marintschev I, Klos K, Mückley T, Hofmann GO, Kahler DM (2012) Screw placement for acetabular fractures: which navigation modality (2-dimensional vs. 3-dimensional) should be used? An experimental study. J Orthop Trauma 26(8):466–473CrossRefPubMed
8.
go back to reference Guy P, Al-Otaibi M, Harvey EJ, Helmy N (2010) The “safe zone” for extra-articular screw placement during intra-pelvic acetabular surgery. J Orthop Trauma 24(5):279–283CrossRefPubMed Guy P, Al-Otaibi M, Harvey EJ, Helmy N (2010) The “safe zone” for extra-articular screw placement during intra-pelvic acetabular surgery. J Orthop Trauma 24(5):279–283CrossRefPubMed
9.
go back to reference Habert S, Gardiazabal J, Fallavollita P, Navab N (2015) Rgbdx: first design and experimental validation of a mirror-based rgbd x-ray imaging system. In: International symposium on Mixed and Augmented Reality (ISMAR), IEEE, Fukuoka, pp 13–18. doi:10.1109/ISMAR.2015.17 Habert S, Gardiazabal J, Fallavollita P, Navab N (2015) Rgbdx: first design and experimental validation of a mirror-based rgbd x-ray imaging system. In: International symposium on Mixed and Augmented Reality (ISMAR), IEEE, Fukuoka, pp 13–18. doi:10.​1109/​ISMAR.​2015.​17
10.
go back to reference Habert S, Meng M, Kehl W, Wang X, Tombari F, Fallavollita P, Navab N Augmenting mobile c-arm fluoroscopes via stereo-rgbd sensors for multimodal visualization. In: International Symposium on Mixed and Augmented Reality (ISMAR). Fukuoka, Japan (2015) Habert S, Meng M, Kehl W, Wang X, Tombari F, Fallavollita P, Navab N Augmenting mobile c-arm fluoroscopes via stereo-rgbd sensors for multimodal visualization. In: International Symposium on Mixed and Augmented Reality (ISMAR). Fukuoka, Japan (2015)
11.
go back to reference Härtl R, Lam KS, Wang J, Korge A, Kandziora F, Audigé L (2013) Worldwide survey on the use of navigation in spine surgery. World Neurosurg 79(1):162–172CrossRefPubMed Härtl R, Lam KS, Wang J, Korge A, Kandziora F, Audigé L (2013) Worldwide survey on the use of navigation in spine surgery. World Neurosurg 79(1):162–172CrossRefPubMed
12.
go back to reference Hüfner T, Stübig T, Gösling T, Kendoff D, Geerling J, Krettek C (2007) Cost-benefit analysis of intraoperative 3D imaging. Der Unfallchirurg 110(1):14–21. doi:10.1007/s00113-006-1202-6 Hüfner T, Stübig T, Gösling T, Kendoff D, Geerling J, Krettek C (2007) Cost-benefit analysis of intraoperative 3D imaging. Der Unfallchirurg 110(1):14–21. doi:10.​1007/​s00113-006-1202-6
13.
go back to reference Kraus M, von dem Berge S, Schöll H, Krischak G, Gebhard F (2013) Integration of fluoroscopy-based guidance in orthopaedic trauma surgery—a prospective cohort study. Injury 44(11):1486–1492CrossRefPubMed Kraus M, von dem Berge S, Schöll H, Krischak G, Gebhard F (2013) Integration of fluoroscopy-based guidance in orthopaedic trauma surgery—a prospective cohort study. Injury 44(11):1486–1492CrossRefPubMed
14.
go back to reference Kraus M, Weiskopf J, Dreyhaupt J, Krischak G, Gebhard F (2015) Computer-aided surgery does not increase the accuracy of dorsal pedicle screw placement in the thoracic and lumbar spine: a retrospective analysis of 2,003 pedicle screws in a level I trauma center. Global Spine J 5(2):93PubMedPubMedCentral Kraus M, Weiskopf J, Dreyhaupt J, Krischak G, Gebhard F (2015) Computer-aided surgery does not increase the accuracy of dorsal pedicle screw placement in the thoracic and lumbar spine: a retrospective analysis of 2,003 pedicle screws in a level I trauma center. Global Spine J 5(2):93PubMedPubMedCentral
15.
go back to reference Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N (2016) Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization. Manuscript submitted for publication. Draft attached for reviewers Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N (2016) Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization. Manuscript submitted for publication. Draft attached for reviewers
16.
go back to reference Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2015) Intra-operative augmented reality in distal locking. Int J Comput Assist Radiol Surg 10(9):1–9 Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2015) Intra-operative augmented reality in distal locking. Int J Comput Assist Radiol Surg 10(9):1–9
17.
go back to reference Mears DC (1999) Surgical treatment of acetabular fractures in elderly patients with osteoporotic bone. J Am Acad Orthop Surg 7(2):128–141CrossRefPubMed Mears DC (1999) Surgical treatment of acetabular fractures in elderly patients with osteoporotic bone. J Am Acad Orthop Surg 7(2):128–141CrossRefPubMed
18.
go back to reference Navab N, Blum T, Wang L, Okur A, Wendler T (2012) First deployments of augmented reality in operating rooms. Computer 7:48–55CrossRef Navab N, Blum T, Wang L, Okur A, Wendler T (2012) First deployments of augmented reality in operating rooms. Computer 7:48–55CrossRef
19.
go back to reference Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRefPubMed Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRefPubMed
20.
go back to reference Navab N, Mitschke M, Schütz O (1999) Camera-augmented mobile c-arm (camc) application: 3d reconstruction using a low-cost mobile c-arm. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI99, Springer, pp 688–697 Navab N, Mitschke M, Schütz O (1999) Camera-augmented mobile c-arm (camc) application: 3d reconstruction using a low-cost mobile c-arm. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI99, Springer, pp 688–697
21.
go back to reference Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A Kinectfusion (2011) Real-time dense surface mapping and tracking. In: 10th IEEE international symposium on Mixed and Augmented Reality (ISMAR), 2011, pp 127–136. doi:10.1109/ISMAR.2011.6092378 Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, Kohi P, Shotton J, Hodges S, Fitzgibbon A Kinectfusion (2011) Real-time dense surface mapping and tracking. In: 10th IEEE international symposium on Mixed and Augmented Reality (ISMAR), 2011, pp 127–136. doi:10.​1109/​ISMAR.​2011.​6092378
22.
go back to reference Nicolau S, Lee P, Wu H, Huang M, Lukang R, Soler L, Marescaux J (2011) Fusion of C-arm X-ray image on video view to reduce radiation exposure and improve orthopedic surgery planning: first in-vivo evaluation. In: Proceedings of 15th annual conference of the international society for computer aided surgery. Computer assisted radiology and surgery Nicolau S, Lee P, Wu H, Huang M, Lukang R, Soler L, Marescaux J (2011) Fusion of C-arm X-ray image on video view to reduce radiation exposure and improve orthopedic surgery planning: first in-vivo evaluation. In: Proceedings of 15th annual conference of the international society for computer aided surgery. Computer assisted radiology and surgery
24.
go back to reference Pauly O, Diotte B, Fallavollita P, Weidert S, Euler E, Navab N (2015) Machine learning-based augmented reality for improved surgical scene understanding. Comput Med Imaging Graph 41:55–60 Pauly O, Diotte B, Fallavollita P, Weidert S, Euler E, Navab N (2015) Machine learning-based augmented reality for improved surgical scene understanding. Comput Med Imaging Graph 41:55–60
25.
go back to reference Reaungamornrat S, Otake Y, Uneri A, Schafer S, Mirota D, Nithiananthan S, Stayman JW, Kleinszig G, Khanna AJ, Taylor RH, Siewerdsen J (2012) An on-board surgical tracking and video augmentation system for C-arm image guidance. Int J Comput Assist Radiol Surg 7(5):647–665CrossRefPubMed Reaungamornrat S, Otake Y, Uneri A, Schafer S, Mirota D, Nithiananthan S, Stayman JW, Kleinszig G, Khanna AJ, Taylor RH, Siewerdsen J (2012) An on-board surgical tracking and video augmentation system for C-arm image guidance. Int J Comput Assist Radiol Surg 7(5):647–665CrossRefPubMed
26.
go back to reference Routt MC Jr, Nork SE, Mills WJ (2000) Percutaneous fixation of pelvic ring disruptions. Clin Orthop Relat Res 375:15–29CrossRefPubMed Routt MC Jr, Nork SE, Mills WJ (2000) Percutaneous fixation of pelvic ring disruptions. Clin Orthop Relat Res 375:15–29CrossRefPubMed
27.
go back to reference Routt MC Jr, Simonian PT, Mills WJ (1997) Iliosacral screw fixation: early complications of the percutaneous technique. J Orthop Trauma 11(8):584–589CrossRefPubMed Routt MC Jr, Simonian PT, Mills WJ (1997) Iliosacral screw fixation: early complications of the percutaneous technique. J Orthop Trauma 11(8):584–589CrossRefPubMed
28.
go back to reference Schweitzer D, Zylberberg A, Córdova M, Gonzalez J (2008) Closed reduction and iliosacral percutaneous fixation of unstable pelvic ring fractures. Injury 39(8):869–874CrossRefPubMed Schweitzer D, Zylberberg A, Córdova M, Gonzalez J (2008) Closed reduction and iliosacral percutaneous fixation of unstable pelvic ring fractures. Injury 39(8):869–874CrossRefPubMed
29.
go back to reference Starr A, Jones A, Reinert C, Borer D (2001) Preliminary results and complications following limited open reduction and percutaneous screw fixation of displaced fractures of the actabulum. Injury 32:45–50CrossRef Starr A, Jones A, Reinert C, Borer D (2001) Preliminary results and complications following limited open reduction and percutaneous screw fixation of displaced fractures of the actabulum. Injury 32:45–50CrossRef
30.
go back to reference Starr AJ, Reinert CM, Jones AL (1998) Percutaneous fixation of the columns of the acetabulum: a new technique. J Orthop Trauma 12(1):51–58CrossRefPubMed Starr AJ, Reinert CM, Jones AL (1998) Percutaneous fixation of the columns of the acetabulum: a new technique. J Orthop Trauma 12(1):51–58CrossRefPubMed
32.
go back to reference Synowitz M, Kiwit J (2006) Surgeon’s radiation exposure during percutaneous vertebroplasty. J Neurosurg Spine 4(2):106–109CrossRefPubMed Synowitz M, Kiwit J (2006) Surgeon’s radiation exposure during percutaneous vertebroplasty. J Neurosurg Spine 4(2):106–109CrossRefPubMed
33.
go back to reference Traub J, Heibel TH, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2007, Springer, pp 18–25 Traub J, Heibel TH, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2007, Springer, pp 18–25
34.
go back to reference Tsai RY (1987) A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE J Robot Autom 3(4):323–344CrossRef Tsai RY (1987) A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE J Robot Autom 3(4):323–344CrossRef
35.
go back to reference Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics Bull 1(6):80–83 Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics Bull 1(6):80–83
36.
go back to reference Wilson MR, Poolton JM, Malhotra N, Ngo K, Bright E, Masters RS (2011) Development and validation of a surgical workload measure: the surgery task load index (surg-tlx). World J Surg 35(9):1961–1969CrossRefPubMedPubMedCentral Wilson MR, Poolton JM, Malhotra N, Ngo K, Bright E, Masters RS (2011) Development and validation of a surgical workload measure: the surgery task load index (surg-tlx). World J Surg 35(9):1961–1969CrossRefPubMedPubMedCentral
Metadata
Title
Preclinical usability study of multiple augmented reality concepts for K-wire placement
Authors
Marius Fischer
Bernhard Fuerst
Sing Chun Lee
Javad Fotouhi
Severine Habert
Simon Weidert
Ekkehard Euler
Greg Osgood
Nassir Navab
Publication date
01-06-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 6/2016
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1363-x

Other articles of this Issue 6/2016

International Journal of Computer Assisted Radiology and Surgery 6/2016 Go to the issue