EEGscape is a groundbreaking project designed to make gaming accessible to individuals with disabilities while also offering unique challenges to able-bodied users. By utilizing EEG (electroencephalogram) technology, we enable players to interact with games using head movements, concentration, and blinks, creating an immerse and inclusive gaming experience.
EEGscape started with a simple idea: let’s make gaming something everyone can enjoy, no matter what challenges they face. Traditional controllers can be tough for people who don’t have full motor control, so we thought, "Why not use your brain instead?" But wait, there’s more! EEGscape isn’t just about accessibility—it’s a workout for your brain, too. Think of it as leveling up your focus and memory while playing awesome games. We’re just scratching the surface of what tech can do to make gaming fun, inclusive, and maybe even a little mind-bending.
EEGscape uses EEG-powered headset like Muse to translate brain activity and physical gestures into in-game commands. Players can control a suite of interactive video games through:
- Head Tilts: Gyroscope data is used to detect head orientation for directional inputs.
- Concentration: Cognitive effort influences actions such progress in certain games.
- Blinking: Deliberate eye blinks are mapped to specific controls like stacking towers. These innovative input uses controls such as gyroscopes, brainwaves, and other actions that are built into the EEG headset.
EEGscape combines cutting-edge hardware and modern web technologies to deliver an engaging experience:
- Frontend Development: The React framework serves as the foundation of our user interface, ensuring a dynamic and responsive experience.
- Real-Time EEG Data: We used the MuseJS library to interpret raw signals from the EEG headset, including gyroscopic data, brainwave frequencies, and blink patterns.
- Game Development: Games were built using JavaScript to provide seamless interaction and integrate with the EEG-powered input methods.
- Styling: Tailwind CSS and DaisyUI were used to create a visually appealing and user-friendly interface.
The headset provides raw data streams from various sensors, and this involved:
- Filtering noise from brainwave signals.
- Establishing thresholds for actions like blinks or head tilts.
- Mapping concentration levels to meaningful in-game responses.
Seamlessly linking the EEG headset's output with the React frontend was a challenge, particularly ensuring that the input methods felt intuitive and lag-free.
Developing engaging games that effectively utilized the limited input methods required careful design and iteration.
EEGscape was a journey of discovery. Along the way, we:
- Explored EEG Technology: We gained hands-on experience with interpreting brain activity and linking it to software applications. Most of our team members were working with this technology for the first time.
- Refined Game Development Techniques: Designing games that are both fun and accessible required out-of-the-box thinking.
EEGscape is a platform with immense potential for future development. Here’s what’s on the horizon:
Adding more games to provide diverse and engaging experiences for players with different preferences.
Incorporating the headset’s heart rate sensor to create adaptive game mechanics, such as:
- Increasing game difficulty during moments of high stress.
- Introducing relaxation modes to help players unwind.
Encouraging contributions from developers and players to create custom games and features that enrich the EEGscape ecosystem. Using Dojo from Starknet to allow users to deploy custom mini games on the application.
- React: Frontend framework for building the user interface.
- Vite: Fast build tool for modern web development.
- Tailwind CSS: Utility-first CSS framework for styling.
- DaisyUI: UI components for enhanced visuals.
- MuseJS: Library for interfacing with Muse EEG headsets.
- A Muse EEG headset compatible with MuseJS.
- Node.js installed on your system.
- Clone the repository:
git clone https://github.com/your-username/EEGscape.git cd EEGscape - Install dependencies:
npm install
- Run the application:
npm run dev
This project was created for Hack Western 11 by the following people: