‘Thought-controlled’ gaming technologies gaining traction, experts say

Mind-based game interfaces could become more prevalent within a few years following the debut of a “thought-controlled” video game from Toronto software company InteraXon Inc., industry observers say. InteraXon unveiled a thought-controlled version of Zen Bound 2 at the Consumer Electronics Show (CES) in Las Vegas in January. “In five days we had something like 13,000 hits on a YouTube video about it that wasn’t even promoted,” Ariel Garten, InteraXon’s CEO, said in an interview. InteraXon develops custom hardware and software for businesses looking to incorporate thought-controlled interfaces into their products. Garten started the business in 2007 to commercialize thought-controlled computing technology developed by University of Toronto cyberneticists Steve Mann and James Fung. Electroencephalogram (EEG) technology converts brainwaves into digital signals that can be interpreted by special software built into mobile phones and portable gaming systems. EEG picks up on the electrical patterns that resonate outside the head of the person wearing a headset, reading overall brain-pattern activity and monitoring how alert or relaxed the user is. The interface translates the brainwaves into binary language, which can control devices and software applications. Over time, users learn to control the brainwave pattern, allowing them to manipulate an application with their brainwave activity. InteraXon partnered with Zen Bound 2 developer Secret Exit Ltd. and EEG headset maker NeuroSky Inc. to make a thought-controlled iPhone/iPad app. “We create the algorithms around the interaction,” Garten said. In the game, players twirl a wooden figure on the screen, wrapping a rope around it tightly to use as little rope as possible. Users can adjust the angle of the rope by tilting the screen, but they use their minds to control the speed at which the wooden figure turns. At the end, the game displays stats such as the amount of brainpower and “Zen” the user has. InteraXon says the game helps people learn to focus, which could be useful in business and school settings. The system is not on the market yet. Garten said InteraXon is now working with Secret Exit and NeuroSky on commercialization. But it will be a number of years before the technology is ubiquitous, she added. “From now until then, there’s a very important role that brain-based technologies play in helping you understand yourself and the way you interact with the world: what happens to your mind when you react to something, when you’re learning, when you’re focusing, relaxed, all these states.” Regan Mandryk, an assistant professor of computer science at the University of Saskatchewan, said thought-controlled interfaces could be the next big shift in gaming. A number of simple, brain-controlled products are already on the market, largely designed for children. “The key is going to be breaking away from these toy applications that are very simple and taking it to the next level,” said Mandryk, who is also a member of the Graphics, Animation and New Media Network Centre of Excellence (GRAND NCE), which researches new media, games, animation, graphics and imaging. “The way to do that is by augmenting game control, but not replacing it, because there are things traditional game controllers are very good at doing.” Mandryk said she and her research team plan to present a paper at an Association of Computing Machinery conference in Vancouver in May, which looks at integrating brain and body inputs into games. Her research team looked at the use of muscle controls, breathing, EEGs and other mechanisms as potential inputs. “The takeaway message from our work was users preferred directly controlled interfaces like flexing your muscles and breathing deeply for controlling action in the game,” Mandryk said. “But the indirectly controlled sensors were much better for controlling things like environmental changes or dramatic effects in the game ... It creates an engaging experience.” Sean MacPhedran, director of creative strategy at Ottawa game developer Fuel Industries Inc., said his company looked into using neural interfaces for a gaming client a few years ago, but didn’t go forward with it. “When we’re doing branded games for the most part we want to have as much reach as possible,” MacPhedran said, explaining that the headset was a problem. “Because you need the hardware, it works well as a console peripheral or, if you have an event, like a concert or a conference. But it doesn’t work well from a traditional, promotional game standpoint.” But that could change as the technology evolves. “I think it’s a matter of cost and size,” MacPhedran said. “It’s like Moore’s Law. Things get cheaper and they get smaller. I’m sure at some point you’ll be able to fit it in a pair of sunglasses. Then you’ll get people experimenting with it and the console developers will want to integrate it into their systems. All the major consoles now have motion control. I’m sure in five years this will be the next big evolution.” InteraXon is going to the Game Developer Conference (GDC) in San Francisco in March to showcase Zen Bound 2 and the NeuroSky headset. The company is also working with partners on brain-based interfaces for medical purposes. In collaboration with the University Health Network, including Toronto General Hospital and Toronto Western Hospital, InteraXon is developing an EEG-based system for people with epilepsy. The system is designed to monitor, detect and warn of an oncoming seizure. news@thewirereport.ca

‘Thought-controlled’ gaming technologies gaining traction, experts say

Broadcast | February 7, 2011

Unlock all the Canadian telecom, broadcasting and digital media news you need.

FREE TRIAL

SUBSCRIBE

Inside The Wire Report

Information

Hill Times Publishing

Get in Touch With Us