Skip to main content
Top
Published in: Journal of NeuroEngineering and Rehabilitation 1/2020

Open Access 01-12-2020 | Research

Continuous supplementary tactile feedback can be applied (and then removed) to enhance precision manipulation

Authors: Leonardo Cappello, Waleed Alghilan, Massimiliano Gabardi, Daniele Leonardis, Michele Barsotti, Antonio Frisoli, Christian Cipriani

Published in: Journal of NeuroEngineering and Rehabilitation | Issue 1/2020

Login to get access

Abstract

Background

Human sensorimotor control of dexterous manipulation relies on afferent sensory signals. Explicit tactile feedback is generally not available to prosthetic hand users, who have to rely on incidental information sources to partly close the control loop, resulting in suboptimal performance and manipulation difficulty. Recent studies on non-invasive supplementary sensory feedback indicated that time-discrete vibrational feedback delivered upon relevant mechanical events outperforms continuous tactile feedback. However, we hypothesize that continuous tactile feedback can be more effective in non-routine manipulation tasks (i.e., tasks where the grip force is modified reactively in response to the sensory feedback due to the unpredictable behavior of the manipulated object, such as picking and holding a virtual fragile object) if delivered to highly sensitive areas. We further hypothesize that this continuous tactile feedback is not necessary during all the duration of the manipulation task, since adaptation occurs.

Methods

We investigated the effectiveness of continuous tactile feedback in precision manipulation, together with a new sensory feedback policy, where the continuous tactile feedback is gradually removed when the grasp reaches a steady state (namely, transient tactile feedback). We carried out an experiment in a virtual-reality setting with custom tactile feedback devices, which can apply continuous pressure and vibrations, attached to the thumb and index finger. We enrolled 24 healthy participants and instructed them to pick and hold a fragile virtual cube without breaking it. We compared their manipulation performance when using four different sensory feedback methods, i.e., no tactile feedback, discrete vibrations, continuous tactile feedback, and transient tactile feedback. The latter consisted of gradually removing the continuous feedback in the static phase of the grasp.

Results

Continuous tactile feedback leads to a significantly larger number of successful trials than discrete vibrational cues and no feedback conditions, yet the gradual removal of the continuous feedback yields to comparable outcomes. Moreover, the participants preferred the continuous stimuli over the vibrational cues and the removal in the static phase did not significantly impact their appreciation of the continuous tactile feedback.

Conclusions

These results advocate for the use of continuous supplementary tactile feedback for fine manipulation control and indicate that it can seamlessly be removed in the static phase of the grasp, possibly due to the mechanism of sensory adaptation. This encourages the development of energy-efficient supplementary feedback devices for prosthetic and telemanipulation applications, where encumbrance and power consumption are burdensome constraints.
Literature
4.
go back to reference Johansson RS, Häger C, Bäckström L. Somatosensory control of precision grip during unpredictable pulling loads. Exp Brain Res. 1992;89(1):204–13.CrossRef Johansson RS, Häger C, Bäckström L. Somatosensory control of precision grip during unpredictable pulling loads. Exp Brain Res. 1992;89(1):204–13.CrossRef
13.
go back to reference Engels LF, Cappello L, Cipriani C. Digital Extensions with Bi-axial Fingertip Sensors for Supplementary Tactile Feedback Studies; 2018. p. 1–6. Engels LF, Cappello L, Cipriani C. Digital Extensions with Bi-axial Fingertip Sensors for Supplementary Tactile Feedback Studies; 2018. p. 1–6.
14.
go back to reference Ernst MO, Banks MS. Ernst 2002 Humans integrate visual and haptic information in a. Nature. 2002;415:429–33.CrossRef Ernst MO, Banks MS. Ernst 2002 Humans integrate visual and haptic information in a. Nature. 2002;415:429–33.CrossRef
20.
go back to reference Carterette EC, Friedman MP. Pain and touch. San Diego, London, Boston, New York, Sydney, Tokyo, Toronto: Academic Press; 1996. Carterette EC, Friedman MP. Pain and touch. San Diego, London, Boston, New York, Sydney, Tokyo, Toronto: Academic Press; 1996.
22.
go back to reference Zigler MJ. Pressure adaptation-time : a function of intensity and extensity. Am J Psychol. 1932;44(4):709–20.CrossRef Zigler MJ. Pressure adaptation-time : a function of intensity and extensity. Am J Psychol. 1932;44(4):709–20.CrossRef
23.
go back to reference Cohen RH. Population estimates for responses of cutaneous mechanoreceptors to a vertically indenting probe on the glabrous skin of monkeys. Exp Brain Res. 1993;94:105–19.CrossRef Cohen RH. Population estimates for responses of cutaneous mechanoreceptors to a vertically indenting probe on the glabrous skin of monkeys. Exp Brain Res. 1993;94:105–19.CrossRef
24.
go back to reference Johansson RS, Edin BB. Predictive feed-forward sensory control during grasping and manipulation in man. Biomed Res. 1993;14(4):95–106. Johansson RS, Edin BB. Predictive feed-forward sensory control during grasping and manipulation in man. Biomed Res. 1993;14(4):95–106.
25.
go back to reference Flanagan JR, Johansson RS. Hand Movements. In: Ramachandran VS, editor. Encyclopedia of the human brain, vol. 2. San Diego, CA: Academic Press; 2002. p. 399–414.CrossRef Flanagan JR, Johansson RS. Hand Movements. In: Ramachandran VS, editor. Encyclopedia of the human brain, vol. 2. San Diego, CA: Academic Press; 2002. p. 399–414.CrossRef
29.
go back to reference Iggo A, Muir AR. The structure and function of a slowly adapting touch corpuscle in hairy skin. J Physiol. 1969;200(3):763–96.CrossRef Iggo A, Muir AR. The structure and function of a slowly adapting touch corpuscle in hairy skin. J Physiol. 1969;200(3):763–96.CrossRef
33.
go back to reference Johansson R, Westling G. “Afferent signals during manipulative tasks in humans,” Information Processing in the Somatosensory System; 1991. p. 25–48.CrossRef Johansson R, Westling G. “Afferent signals during manipulative tasks in humans,” Information Processing in the Somatosensory System; 1991. p. 25–48.CrossRef
38.
go back to reference Flash T, Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 1985;5(7):1688–703 doi: 4020415.CrossRef Flash T, Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 1985;5(7):1688–703 doi: 4020415.CrossRef
Metadata
Title
Continuous supplementary tactile feedback can be applied (and then removed) to enhance precision manipulation
Authors
Leonardo Cappello
Waleed Alghilan
Massimiliano Gabardi
Daniele Leonardis
Michele Barsotti
Antonio Frisoli
Christian Cipriani
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Journal of NeuroEngineering and Rehabilitation / Issue 1/2020
Electronic ISSN: 1743-0003
DOI
https://doi.org/10.1186/s12984-020-00736-9

Other articles of this Issue 1/2020

Journal of NeuroEngineering and Rehabilitation 1/2020 Go to the issue