Assistive Technology: Eye Gaze, Face Tracking, and HeadMouse Open Source, Free, and Low-Cost Alternatives

I'm working with a few students who have multiple special needs who are in need of assistive communication technologies that are not expensive. Although my first idea was to look at eye gaze technology, the possibility of face tracking is also appealing. Take a look at the following video from SeeingMachines, a commercial company:



SeeingMachines offers a free version that doesn't provide all of the features I'd need.

The HeadMouse concept is something that I think has potential.

The $$$ option is the HeadMouse Extreme. It provides head-controlled wireless computer access, and uses a wireless optical sensor that tracks a disposable target that can be affixed to glasses, a forehead, or hat.  The resolution is very precise, and allows control over a range of activities such as graphics work, CAD, and gaming, in addition to typical productivity tasks.

 

Photos are from the Origin Instruments website, where you can find additional information about the HeadMouse Extreme system as well as other assistive technology and augmentative communication systems.

Alternative to HeadMouse Extreme:

HeadMouse2 is an open-source project from the Grupo de Robotica at the University of Lleida in Spain. The free software works with Virtual Keyboard, another free application.



Here are the links:
HeadMouse2

Virtual Keyboard



FREE, LOW-COST, AND OPENSOURCE ALTERNATIVES


COGAIN

COGAIN stands for Communication by Gaze Interaction.  This group was created to overcome the current problems in research and development in the field that include software that works solely with a certain eye tracking device, and in the process, contribute to bringing down the price of eye tracking systems so that more people will benefit from this technology.

The COGAIN website provides a list of open-source gaze tracking, freeware, and low-cost eye tracking resources. There is enough information available for DYI purposes:

Open Source Resources

COGAIN's Early Language and Literacy Resources


Links to books and games can be found on the COGAIN Early Literacy web-page. Children in the Picture  collaborated with COGAIN for some of the literacy resources.

• Note:  "Scope's In The Picture campaign is about encouraging publishers, illustrators and writers to embrace diversity - so that disabled children, who have been virtually invisible until recently, are included alongside others in illustrations and story lines in books for young readers."

COGAIN's Bibliography:  Eye Tracker Development and Gaze Tracking Implementation:  Systems, Hardware, Software, Algorithms

Gaze-Aware Systems, Attentive Interfaces, and Applied Eye Tracking

Research Papers, Bibliographies, Article Collections

COGAIN's Links

COGAIN's Downloads

More to come!

Gaze system developed by IT University of Copenhagen provides low-cost means interacting with computers via large-screen displays.

The ITU Gaze Group at the IT University of Copenhagen has been doing some very interesting work to develop a low-cost eye-tracking system that can benefit people who have severe mobility limitations. The source code is free and open-source, which is a good thing, since commercial gaze tracking systems can run up in the thousands of dollars. The project was sponsored by COGAIN, a network of people working on interface technologies to benefit people with disabilities.

The following video shows how a web-cam based gaze system can be used along with a large interactive display:

Gazetyping on large projected displays:


ITU Gazetracker Quick Guide - provides demonstrations of how set up the gaze tracker remotely and also how to set it up using a web camera that is near the user's eye:




This shows how you can calibrate and set up the tracker system:
ITU Gaze Tracker:







I have a new student at my school who might benefit from this system!