BioCombat is "played" by two performers whose heart rate, galvanic skin response and EEG data are tracked live. The left screen shows the game element of the piece: the computer demands a new emotion to be felt by the performers for each new one-minute interval, and after twenty seconds decides who is best at feeling the requested emotion. Points are scored when the correct arousal and valence are measured. This is then updated live until the next emotion is requested. The winner is rewarded by having their electroacoustic material play louder than their opponents'. The right screen shows animations that are meant to express the target emotion in an abstract way. This projection consists of two animated shapes: the left one uses features of the biosignals of the left performer to directly influence the animations and the right shape does the same for the right performer. Both animations are also using live features in the sound, such as loudness, rhythm, dissonance and frequency distribution in the energy spectrum.
The graphics used are based on drawings by Adinda van 't Klooster. She evaluated the emotional expressiveness of the graphics through an online survey and used the most successful graphics in the animations of BioCombat.
In order to gain 'emotional intelligence' the system has been trained through previous sessions where the performers listened to pieces of music that made them feel either happy, sad, tender, scared, calm, excited, annoyed or angry. Whilst they were listening, their EEG, GSR and heart rate data was recorded. Two-minute data recordings were created for each of the emotions and this was done five times at different points throughout various days. This data was then used to train neural network classifiers for each of the performers. In trial rehearsal sessions, the most successful neural networks for the live situation were selected. It was found after various testing sessions that having seperate neural networks for arousal and for valence worked best. The eight target emotions were placed in Russell's arousal valence circle and when both arousal and valence were in the right quadrant, the performer gained a point. If only arousal or valence was in the right quadrant half a point could be scored. To watch the MOVIE visit https://drive.google.com/open?id=0BxA-cDInVvxRbGNyLUEzMlRmSFE
More information can be found at the
credits: Animation, concept and graphics by Adinda van ’t Klooster, System programming by Nick Collins, Electroacoustic composition by Nick Collins and Adinda van ’t Klooster