File(s) under permanent embargo
An online human-agent interaction system: a brain-controlled agent playing games in unity
Human-agent interactions present people guide an object or agent to act as human intentions. This demonstration work develops an online human-agent interaction system, particularly targeting the brain-computer interface (BCI), which uses real-time brain cortex signals: electroencephalogram (EEG) to control the agent in Unity3D game platform. The developed system also provides the online visualisation of EEG signals, including pre-processed temporal data and power spectral in three frequency bands (theta, alpha, and beta). To build this systematic work, we firstly collect wireless EEG signals via the Bluetooth transmission from a commercially available 14-channel brainware headset (Emotiv). EEG signals are then pre-processed and fed into a trained deep learning model to predict the human intentions, which will be sent to Unity3D platform to control an agent’s movements in game playing, such as a karting game scenario. The online testing results show the feasibility of our systematic work that will benefit for human-agent interaction community. The demonstration video can be viewed at the following link: https://youtu.be/9AWKHeatc6I
History
Publication title
Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2021)Pagination
1758-1760ISBN
978-1-4503-8307-3Department/School
School of Information and Communication TechnologyPublisher
International Foundation for Autonomous Agents and Multiagent SystemsPlace of publication
Richland, SCEvent title
20th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2021)Event Venue
London, UKDate of Event (Start Date)
2021-05-03Date of Event (End Date)
2021-05-07Rights statement
Copyright 2021 International Foundation for Autonomous Agents and Multiagent SystemsRepository Status
- Restricted