Three computer science students from Fachhochschule Dortmund have secured first place at the 24-hour hackathon of the "Virtual Reality (VR) Summit 2024" at Ruhr-Universität Bochum.
As members of the winning team, UAS students Yahya Asadi (Master Digital Transformation), Sachin Kumar and Raghuveer Dani (both Master Embedded Systems Engineering) developed an exemplary VR application: a prototype with state-of-the-art brain-computer interface (BCI) technology. "Our solution enables people with paralysis and disabilities to virtually participate in events, move around and communicate using only their brain waves," explains Raghuveer Dani. "The prototype demonstrates a new way for people with mobility impairments to interact in virtual spaces."
The system uses the EEG device "Unicorn Hybrid Black" to measure brain waves. Anyone who puts it on can focus on virtual circles that serve as buttons to trigger movements and actions in the VR environment. This allows users to navigate and engage with the virtual world without having to physically move.
AI assistant fetches coffee
In addition to the VR prototype, the team developed an AI assistant ("NPC avatar") to improve the quality of experience during an event. The AI speaks five different languages and provides detailed event information. Powered by the "GPT-4o mini" model, the assistant can take on tasks such as guiding visitors through the virtual venue or fetching a virtual cup of coffee.
The jury rewarded the successful combination of VR and BCI technology with a prize of 1,000 euros, the EEG device used, tickets to the "data:unplugged" AI festival and internships at Unyted Ltd, a company that designs virtual worlds.