Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 3/2016

01-03-2016 | Original Article

Vision-based real-time position control of a semi-automated system for robot-assisted joint fracture surgery

Authors: Giulio Dagnino, Ioannis Georgilas, Payam Tarassoli, Roger Atkins, Sanja Dogramadzi

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2016

Login to get access

Abstract

Purpose

Joint fracture surgery quality can be improved by robotic system with high-accuracy and high-repeatability fracture fragment manipulation. A new real-time vision-based system for fragment manipulation during robot-assisted fracture surgery was developed and tested.

Methods

The control strategy was accomplished by merging fast open-loop control with vision-based control. This two-phase process is designed to eliminate the open-loop positioning errors by closing the control loop using visual feedback provided by an optical tracking system. Evaluation of the control system accuracy was performed using robot positioning trials, and fracture reduction accuracy was tested in trials on ex vivo porcine model.

Results

The system resulted in high fracture reduction reliability with a reduction accuracy of 0.09 mm (translations) and of \(0.15^{\circ }\) (rotations), maximum observed errors in the order of 0.12 mm (translations) and of \(0.18^{\circ }\) (rotations), and a reduction repeatability of 0.02 mm and \(0.03^{\circ }\).

Conclusions

The proposed vision-based system was shown to be effective and suitable for real joint fracture surgical procedures, contributing a potential improvement of their quality.
Literature
1.
go back to reference Finkelstein EA, Corso PS, Miller TR (2006) The incidence and economic burden of injuries in the United States. Oxford University Press, New YorkCrossRef Finkelstein EA, Corso PS, Miller TR (2006) The incidence and economic burden of injuries in the United States. Oxford University Press, New YorkCrossRef
2.
go back to reference Hernlund E, Svedbom A, Ivergård M, Compston J, Cooper C, Stenmark J, McCloskey EV, Jönsson B, Kanis JA (2013) Osteoporosis in the European Union: medical management, epidemiology and economic burden. A report prepared in collaboration with the International Osteoporosis Foundation (IOF) and the European Federation of Pharmaceutical Industry Associations (EFPIA). Arch Osteoporos 8:136. doi:10.1007/s11657-013-0136-1 Hernlund E, Svedbom A, Ivergård M, Compston J, Cooper C, Stenmark J, McCloskey EV, Jönsson B, Kanis JA (2013) Osteoporosis in the European Union: medical management, epidemiology and economic burden. A report prepared in collaboration with the International Osteoporosis Foundation (IOF) and the European Federation of Pharmaceutical Industry Associations (EFPIA). Arch Osteoporos 8:136. doi:10.​1007/​s11657-013-0136-1
3.
go back to reference Kulkarni GS (2008) Textbook of orthopaedics and trauma. Jaypee Brothers, New DelhiCrossRef Kulkarni GS (2008) Textbook of orthopaedics and trauma. Jaypee Brothers, New DelhiCrossRef
5.
go back to reference Malizos KN, Bargiotas K, Papatheodorou L, Dimitroulias A, Karachalios T (2006) The Below-the-Ankle circular frame: a new technique for the treatment of displaced calcaneal fractures. J Foot Ankle Surg 45:295–299CrossRefPubMed Malizos KN, Bargiotas K, Papatheodorou L, Dimitroulias A, Karachalios T (2006) The Below-the-Ankle circular frame: a new technique for the treatment of displaced calcaneal fractures. J Foot Ankle Surg 45:295–299CrossRefPubMed
7.
go back to reference Gaston P, Will EM, Keating JF (2005) Recovery of knee function following fracture of the tibial plateau. J Bone Joint Surg Br 87:1233–6CrossRefPubMed Gaston P, Will EM, Keating JF (2005) Recovery of knee function following fracture of the tibial plateau. J Bone Joint Surg Br 87:1233–6CrossRefPubMed
9.
go back to reference Berlinger NT (2006) Robotic surgery–squeezing into tight places. N Engl J Med 354:2009–2101CrossRef Berlinger NT (2006) Robotic surgery–squeezing into tight places. N Engl J Med 354:2009–2101CrossRef
11.
go back to reference Westphal R, Winkelbach S, Wahl F, Gösling T, Oszwald M, Hüfner T, Krettek C (2009) Robot-assisted long bone fracture reduction. Int J Robot Res 28:1259–1278CrossRef Westphal R, Winkelbach S, Wahl F, Gösling T, Oszwald M, Hüfner T, Krettek C (2009) Robot-assisted long bone fracture reduction. Int J Robot Res 28:1259–1278CrossRef
12.
go back to reference Warisawa S, Ishizuka T, Mitsuishi M, Sugano N, Yonenobu K, Nakazawa T (2004) Development of a femur fracture reduction robot. IEEE International Conference Robot Autom. doi:10.1109/ROBOT.2004.1308896 Warisawa S, Ishizuka T, Mitsuishi M, Sugano N, Yonenobu K, Nakazawa T (2004) Development of a femur fracture reduction robot. IEEE International Conference Robot Autom. doi:10.​1109/​ROBOT.​2004.​1308896
13.
go back to reference Wang J, Han W, Lin H (2013) Femoral fracture reduction with a parallel manipulator robot on a traction table. Int J Med Robotics Comput Assist Surg. doi:10.1002/rcs.1550 Wang J, Han W, Lin H (2013) Femoral fracture reduction with a parallel manipulator robot on a traction table. Int J Med Robotics Comput Assist Surg. doi:10.​1002/​rcs.​1550
14.
go back to reference Tang P, Hu L, Du H, Gong M, Zhang L (2012) Novel 3D hexapod computer-assisted orthopaedic surgery system for closed diaphyseal fracture reduction. Int J Med Robot 8:17–24. doi:10.1002/rcs.417 CrossRefPubMed Tang P, Hu L, Du H, Gong M, Zhang L (2012) Novel 3D hexapod computer-assisted orthopaedic surgery system for closed diaphyseal fracture reduction. Int J Med Robot 8:17–24. doi:10.​1002/​rcs.​417 CrossRefPubMed
16.
17.
go back to reference Dagnino G, Georgilas I, Tarassoli P, Atkins R, Dogramadzi S (2015) Design and real-time control of a robotic system for fracture manipulation. In: Annual Conference of the IEEE Engineering in Medicine and Biology Society-EMBC 2015. Milan Dagnino G, Georgilas I, Tarassoli P, Atkins R, Dogramadzi S (2015) Design and real-time control of a robotic system for fracture manipulation. In: Annual Conference of the IEEE Engineering in Medicine and Biology Society-EMBC 2015. Milan
18.
go back to reference Georgilas I, Dagnino G, Tarassoli P, Atkins R, Dogramadzi S (2015) Robot-assisted system for joint fracture surgery. In: International Society for Computer-Assisted Orthopaedic Surgery Conference-CAOS 2015. Vancouver Georgilas I, Dagnino G, Tarassoli P, Atkins R, Dogramadzi S (2015) Robot-assisted system for joint fracture surgery. In: International Society for Computer-Assisted Orthopaedic Surgery Conference-CAOS 2015. Vancouver
19.
go back to reference Knoll A, Staub C, Osa T, Bauernschmitt R (2010) Autonomous high precision positioning of surgical instruments in robot-assisted minimally invasive surgery under visual guidance. 6th Int Conf Auton Auton Syst. doi:10.1109/ICAS.2010.18 Knoll A, Staub C, Osa T, Bauernschmitt R (2010) Autonomous high precision positioning of surgical instruments in robot-assisted minimally invasive surgery under visual guidance. 6th Int Conf Auton Auton Syst. doi:10.​1109/​ICAS.​2010.​18
20.
go back to reference Krupa A, Doignon C, de Mathelin MF, Morel G, Leroy J, Soler L, Marescaux J (2003) Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing. In: IEEE Trans Robot Autom, pp 842–853 Krupa A, Doignon C, de Mathelin MF, Morel G, Leroy J, Soler L, Marescaux J (2003) Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing. In: IEEE Trans Robot Autom, pp 842–853
21.
go back to reference Krettek C, Helfet D (2009) Fracture of the distal femur. In: Skeletal Trauma: BasicScience, Management, and Reconstruction, 4th edn. Elesvier, Philadelphia Krettek C, Helfet D (2009) Fracture of the distal femur. In: Skeletal Trauma: BasicScience, Management, and Reconstruction, 4th edn. Elesvier, Philadelphia
22.
go back to reference Marsh JL (2015) Tibial plateau fractures. In: Rockwood Greens fractures in adults, 8th edn. Wolters Kluwer, Philadelphia, pp 2303–2367 Marsh JL (2015) Tibial plateau fractures. In: Rockwood Greens fractures in adults, 8th edn. Wolters Kluwer, Philadelphia, pp 2303–2367
23.
go back to reference Collinge CA, Wiss DA (2015) Distal femur fractures. In: Rockwood Greens fractures in adults, 8th edn. Wolters Kluwer, Philadelphia, pp 2229–2268 Collinge CA, Wiss DA (2015) Distal femur fractures. In: Rockwood Greens fractures in adults, 8th edn. Wolters Kluwer, Philadelphia, pp 2229–2268
24.
go back to reference Dagnino G, Georgilas I, Tarassoli P, Atkins R, Dogramadzi S (2015) Force–Torque Measurement System for fracture surgery. In: International Society for Computer-Assisted Orthopaedic Surgery Conference-CAOS 2015. Vancouver Dagnino G, Georgilas I, Tarassoli P, Atkins R, Dogramadzi S (2015) Force–Torque Measurement System for fracture surgery. In: International Society for Computer-Assisted Orthopaedic Surgery Conference-CAOS 2015. Vancouver
25.
go back to reference Georgilas I, Dagnino G, Tarassoli P, Atkins R, Dogramadzi S (2015) Preliminary analysis of Force–Torque measurements for robot-assisted fracture surgery. In: Annual Conference of the IEEE Engineering in Medicine and Biology Society-EMBC 2015. Milan Georgilas I, Dagnino G, Tarassoli P, Atkins R, Dogramadzi S (2015) Preliminary analysis of Force–Torque measurements for robot-assisted fracture surgery. In: Annual Conference of the IEEE Engineering in Medicine and Biology Society-EMBC 2015. Milan
26.
go back to reference Merlet JP (2006) Parallel robots. Springer, Dordrecht Merlet JP (2006) Parallel robots. Springer, Dordrecht
27.
go back to reference Faschingbauer M, Heuer HJD, Seide K, Wendlandt R, Münch M, Jürgens C, Kirchner R (2014) Accuracy of a hexapod parallel robot kinematics based external fixator. Int J Med Robot Comput Assist Surg MRCAS. doi:10.1002/rcs.1620 Faschingbauer M, Heuer HJD, Seide K, Wendlandt R, Münch M, Jürgens C, Kirchner R (2014) Accuracy of a hexapod parallel robot kinematics based external fixator. Int J Med Robot Comput Assist Surg MRCAS. doi:10.​1002/​rcs.​1620
28.
go back to reference Mruthyunjaya TSDB (1998) The Stewart platform manipulator: a review. Mech Mach Theory 35:15–40 Mruthyunjaya TSDB (1998) The Stewart platform manipulator: a review. Mech Mach Theory 35:15–40
29.
go back to reference Graham AE, Xie SQ, Xu WL, Mukherjee S (2008) Robotic long bone fracture reduction. In: Medical Robotics. I-Tech Education and Publishing. doi:10.5772/54929 Graham AE, Xie SQ, Xu WL, Mukherjee S (2008) Robotic long bone fracture reduction. In: Medical Robotics. I-Tech Education and Publishing. doi:10.​5772/​54929
30.
go back to reference Taghirad HD (2013) Parallel Robots: Mechanics and Control. CRC Press, Boca Raton Taghirad HD (2013) Parallel Robots: Mechanics and Control. CRC Press, Boca Raton
31.
go back to reference Grabowski ASR (2012) Combined measurements—a way to improve the measurement accuracy of an additive quantity. Measurement 45:1165–1169CrossRef Grabowski ASR (2012) Combined measurements—a way to improve the measurement accuracy of an additive quantity. Measurement 45:1165–1169CrossRef
33.
go back to reference Hawkins KP (2013) Analytic inverse kinematics for the universal robots UR-5/UR-10 arms. Georgia Institute of Technology, Atlanta Hawkins KP (2013) Analytic inverse kinematics for the universal robots UR-5/UR-10 arms. Georgia Institute of Technology, Atlanta
35.
go back to reference Phillips CL, Nagle T, Chakrabortty A (2015) Digital control system analysis and design, 4th edn. Prentice Hall, Englewood Cliffs Phillips CL, Nagle T, Chakrabortty A (2015) Digital control system analysis and design, 4th edn. Prentice Hall, Englewood Cliffs
36.
go back to reference Chung WKCY (2008) PID trajectory tracking control for mechanical systems. Springer, Berlin Chung WKCY (2008) PID trajectory tracking control for mechanical systems. Springer, Berlin
37.
go back to reference Silva AJ, Ramirez OAD, Vega VP, Oliver JPO (2009) Phantom omni haptic device: kinematic and manipulability. In: Electron. Robot. Automot. Mech. Conf. Cuernavaca, Morelos, México, pp 193–198 Silva AJ, Ramirez OAD, Vega VP, Oliver JPO (2009) Phantom omni haptic device: kinematic and manipulability. In: Electron. Robot. Automot. Mech. Conf. Cuernavaca, Morelos, México, pp 193–198
39.
go back to reference Kirk RE (2006) Statistics: an introduction. Wadsworth Publishing Co Inc, Belmont Kirk RE (2006) Statistics: an introduction. Wadsworth Publishing Co Inc, Belmont
40.
go back to reference Baron S, Eilers H, Munske B, Toennies JL, Balachandran R, Labadie RF, Ortmaier T, Webster RJ (2010) Percutaneous inner-ear access via an image-guided industrial robot system. Proc Inst Mech Eng Part H 224:633–649 Baron S, Eilers H, Munske B, Toennies JL, Balachandran R, Labadie RF, Ortmaier T, Webster RJ (2010) Percutaneous inner-ear access via an image-guided industrial robot system. Proc Inst Mech Eng Part H 224:633–649
41.
go back to reference Kotlarski J, Baron S, Eilers H, Hofschulte J, Heimann B (2007) Improving the performance of an optical tracking system using data fusion with an inertial measurement unit. Ulsan, Korea, pp 225–230 Kotlarski J, Baron S, Eilers H, Hofschulte J, Heimann B (2007) Improving the performance of an optical tracking system using data fusion with an inertial measurement unit. Ulsan, Korea, pp 225–230
Metadata
Title
Vision-based real-time position control of a semi-automated system for robot-assisted joint fracture surgery
Authors
Giulio Dagnino
Ioannis Georgilas
Payam Tarassoli
Roger Atkins
Sanja Dogramadzi
Publication date
01-03-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 3/2016
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1296-9

Other articles of this Issue 3/2016

International Journal of Computer Assisted Radiology and Surgery 3/2016 Go to the issue