Dear fellow researcher,
in a project we aim to measure emotions in real-time to loop this information back into a gamification module. We plan to integrate mainly body cues and facial expressions, but at least in the lab we also look at GSR, heartrate and brain signals. Can anyone recommend a solution (software library, development kit etc. - not a lab software) which integrates such signals and generates emotional states? We search for something like the SHORE kit (facial expressions), only with more modalities.
Best, Oliver
Dear Oliver,
I believe that our package, EventIDE (www.okazolab.com), can carry all functions that you need alone. It 1) can be used to build rich, interactive games (including 3D graphics and VR), 2) ensures millisecond accuracy, 3) supports acquisition, synchronization and online processing of multiple bio-signals (GSR, HRV, EEG, eye-tracking, etc). Real-time emotion recognition via a web-cam is in development and will be available shortly. You can contact me for a demo on [email protected]
Hello Mr. Oliver Korn,
At this time I do not know of any existing solution available that can integrate multiple signals to predict emotional state. Possibly what Ilia Korjoukov said might be a solution. At out lab, we had developed a multimedia system controlled by facial expressions and hand gestures in REAL TIME. The same framework may be used for gaming also. You may take at look at the corresponding paper. I have attached it for you. We have developed another real-time system that recognizes the emotions in real-time using webcam. This paper recently got accepted. If you need, I can send you this second paper also.
Hi, you can try using Unity3d software for generating real time gaming environment and use google card board for manipulating your emotions in real-time.
- Badges
- Science topic