how to simulate the mouse click by eye tracker

[johnyang]

hi,
I just wonder how to simulate the mouse click by eye tracker? can anyone give some good advice?

The scenario is that for the handicapped persons, they have no capability to operate the computer by keyboard or mouse. eye control only.

Basd on my preliminary study of the gadget , the server only feed the coordinates to the client, looks like there is no other useful API to accomplish a confirmtion acton (mouse left click)

The simple solution coming into my mind is to gaze at a screen spot for a few seconds to be treated as a confirmation action, but it's not very user friendly.

[john]

Motion controllers like the Kinect have settled on the concept of holding a position for a few seconds as confirmation, although I agree that it is not user friendly and it seems like we should come up with a better design. Blinking as a form of confirmation could also work - something like storing the initial eye position, noting the loss of position when eyes are closed, and registration of the same stored point when eyes are reopened - although it also may not be the friendliest approach. As far as I'm concerned, eye control is a new design opportunity whose guidelines and best practices have not yet been determined, so this requires some experimentation.

In addition, for relevant use cases, we should also not overlook hybrid interfaces that can use mouse/keyboard/controller/touchscreen along with eye control to enhance the user experience.

[Martin]

For a quick solution to the question how to click please see this post.

The interaction by gaze-only has a couple of challenges. This stems from the fact that most computer user interfaces has been designed with the mouse in mind. Lacking the ability to click those small targets becomes problematic.

For the general population eye tracking is best combined with other "modalities" such as buttons, voice, gestures etc.

Traditionally the method for selecting with eyes-only is dwelling on a button for a specific amount of time. I developed a couple of other interaction methods during my masters which can be seen in this Youtube video.

[13701178292]

thanks for your guys‘ reply. due to our program would be used for ALS patients, so hybrid control doesn't work for our case. due to my eyetribe tracker was out of work yesterday, so I haven't got a chance to try the general purpose gazemouse program, once the new tracker arrived, we will try it. and let you guys know if it works perfect with eyetribe tracker.