Eye movement controls gaming console
November 05, 2010 // R. Colin Johnson
Waterloo Labs, a team of engineers inside National Instruments (NI), have unveiled the LabView source code to "EyeMario," which demonstrates how video gamers can use their eyes to control Nintendo gaming consoles.
Marrying NI software with electrically isolated data converters from Analog Devices (ADI), enabled the EyeMario reference design, which NI is making available as a free download. Besides gaming, EyeMario will also being adapted to use in the treatment for amblyopia (lazy eye) as well as to empower people who have lost the use of their hands.
"Medically, these measurements are not new, but our use of them for control is," said Chris Culver, an analog hardware engineer and Waterloo Labs team member. "The movie Beowulf used this technique to track the eye movement of actors, which was mapped onto its computer generated characters."
The technique works because the eyeball is polarized like a dipole, with the more negative polarity at the back of the eye where the optic nerve exits. By placing adhesive electrodes around the eye, then measuring its electrical polarity as it rotates to different orientations, the specific on-screen objects that the eye is aiming as can be deduced. Beta testers in Waterloo Labs have been able to control the direction and actions of the on-screen Mario character in Nintendo's games completely hands free.
To safely monitor the delicate dipole-like polarity of the eye—without endangering the user—NI (Austin, Texas) had to use ADI's iCoupler technology, which converts the analog input signal into a 1-bit data stream using sigma-delta modulation. Even an electrical short on the circuit board cannot shock the user, because iCoupler uses on-chip transformers that isolate the sensor's inputs.
"Our data converter is fully isolated—a part of our iCoupler technology," said Steve Hinderliter, converter marketing director at ADI (Norwood, Mass.). "This completely isolates the gamer from the 110 volts power supply in the game console."
The EyeMario prototype used the AD8221 precision instrumentation amplifier to pass the signal from the user's eye to the AD7401analog-to-digital converter on a daughter board with a reconfigurable field-programmable gate array (FPGA). NIs LabView app then measured the eye's orientation, as it moves, and translates that into the signals recognized by the Nintendo game console.
The engineering desk-to-bench ratio
November 21, 2014
Dennis Feucht discusses the right and wrong, senior and junior ways to organize the theoretical and practical work of an ...
Rohm's European Design Center in growth phase
Combo inertial sensor market on 19% CAGR, says Yole.
US, China pushing industrial chip market growth, says IHS
LA Auto Show: Hydrogen fuel cell drive is back
Opening up the IoT data flood gates
November 21, 2014
Only a few days after their LoRa long range communication demo at electronica, IBM and Semtech are making the LoRa MAC protocol ...
Polarizing filter reduces energy drain from smartphone displays
From warm to cool white: colour-temperature tunable LEDs
System provides high-volume solution for flexible OLED displays
- Halogen-free options and increased performance for terminal blocks
- Wireless Power User Guide
- Secure is the New Smart
- 5 Best Practices for Designing Flexible Test Stations
InterviewFreescale CEO: 'IoT isn't just buzz'
Coming after the solid third quarter results that produced higher operating margins and improving cash flow, Freescale Semiconductor's CEO Gregg Lowe had every reason to be chipper and lively when EE Times ...
Filter WizardCheck out the Filter Wizard Series of articles by Filter Guru Kendall Castor-Perry which provide invaluable practical Analog Design guidelines.
Linear video channel
READER OFFERRead more
This month, Cherry is giving away five of its Energy Harvesting Evaluation kits, worth over 266 Euros each, for EETimes Europe's readers to win. Cherry's energy harvesting technology benefit mostly applications where a complex wire assembly and/or batteries would be inappropriate.
The required RF-energy is created by the mechanical actuation of the switch and the data is transmitted...MORE INFO AND LAST MONTH' WINNERS...
December 15, 2011 | Texas instruments | 222901974
Unique Ser/Des technology supports encrypted video and audio content with full duplex bi-directional control channel over a single wire interface.
Most popular news
- Could magnesium battery innovation end lithium's dominance?
- From warm to cool white: colour-temperature tunable LEDs
- Li-Fi communication module wirelessly transfers data at 1-Gbps
- Supercapacitor innovation promises panel-powered cars in five years
- Rebranding the revolution: the future of IoT is embedded