Development of a new image manipulation system based on detection of electroencephalogram signals from the operator’s brain: a feasibility study

Physicians require an adequate display system with a console within arm’s reach to view images during surgical operations and interventional radiological examinations. However, manipulation of the console by physicians themselves may not be possible because their hands may be otherwise engaged. In this study, an image manipulation system using an electroencephalogram (EEG) sensor mounted on the operator’s head was developed. In this system, data acquired by the device is used to manipulate images, and the output can be converted to commands for various actions such as paging, which can be controlled by the operator’s eye-blink, and zooming of a region indicated by the cursor, which can be controlled by the operator’s mental concentration. In this study, the MindWave Mobile headset was used as EEG sensor, and AZEWIN for the display system. Ten observers were enrolled and fitted with EEG device to determine the threshold values of blink strength and attention; threshold value of 100 for blink strength and 65 for attention were determined. Thirty-one observers were enrolled and fitted with EEG device to investigate average response-time; the average response time for detecting paging was 0.43 ± 0.02 s, and that for zooming was 5.85 ± 0.56 s. Thus, the proposed image manipulation system using the operator’s EEG signals enabled physicians to assess and manipulate images without using their hands.