”Holding your brain in the palm of your hand…”
We demonstrate a fully functional smartphone brain scanner consisting of a low-cost 14-channel EEG headset with a wireless connection to a smartphone or tablet, which is available opensource for multiple platforms, enabling minimally invasive EEG monitoring in naturalistic settings. The smartphone provides a touch-based interface with real-time brain state decoding and 3D reconstruction.
Our system provides a fully portable EEG based real-time functional brain scanner including stimulus delivery, data acquisition, logging, brain state decoding and 3D activity visualization. The software is realized in Qt. The raw EEG data is obtained from a wireless Emotiv 14 channel Neuroheadset with a sampling rate of 128Hz and electrodes positioned at AF3, F7, F3, FC5, T7, P7, O1, O2, P8, T8, FC6, F4, F8, AF4 (the international 10-20 system). The headset transmits the EEG data to a receiver module connected to a Nokia N900 phone. The binary data is decrypted directly on the phone, filtered and passed to the source reconstruction module that outputs the colors of model vertices for the visualization. The source reconstruction is performed over number of samples (default over 16 samples resulting in 8Hz visualization). The delay between the signal appearing in the headset and being visualized on the screen depends on the used source reconstruction window and is between 130 and 150 msec for 8Hz visualization. The framerate of the visualization (realized in OpenGL) is around 30fps.
The video demonstrates the smartphone brain scanner with the Emotiv 14-channel EEG headset worn by a subject and a real-time 3D brain reconstruction and activity visualization on the N900 smartphone.
Source code and additional information is available on the smartphonebrainscanner2 project website.
A. Stopczynski, J. E. Larsen, C. Stahlhut, M. K. Petersen, & L. K. Hansen (2011) A smartphone interface for a wireless EEG headset with real-time 3D reconstruction. Affective Computing and Intelligent Interaction (ACII 2011)
Abstract We demonstrate a fully functional handheld brain scanner consisting of a low-cost 14-channel EEG headset with a wireless connection to a smartphone, enabling minimally invasive EEG monitoring in naturalistic settings. The smartphone provides a touch-based interface with real-time brain state decoding and 3D reconstruction.
M. K. Petersen, C. Stahlhut, A. Stopczynski, J. E. Larsen, & L. K. Hansen (2011). Smartphones get emotional: mind reading images and reconstructing the neural sources, 1st workshop on machine learning for affective computing (MLAC) at the Affective Computing and Intelligent Interaction (ACII 2011)
Abstract Combining a wireless EEG headset with a smartphone offers new opportunities to capture brain imaging data reflecting our everyday social behavior in a mobile context. However processing the data on a portable device will require novel approaches to analyze and interpret significant patterns in order to make them available for runtime interaction. Applying a Bayesian approach to reconstruct the neural sources we demonstrate the ability to distinguish among emotional responses reflected in different scalp potentials when viewing pleasant and unpleasant pictures compared to neutral content. Rendering the activations in a 3D brain model on a smartphone may not only facilitate differentiation of emotional responses but also provide an intuitive interface for touch based interaction, allowing for both modeling the mental state of users as well as providing a basis for novel bio-feedback applications.