Welcome new user! You can search existing questions and answers without registering, but please register to post new questions and receive answers. Note that due to large amounts of spam attempts, your first three posts will be manually moderated, so please be patient.
We have moved to a new forum at http://jevois.usc.edu, please check it out. The forum at jevois.org/qa will not allow new user registrations but is maintained alive for its useful past questions and answers.

Eye Tracking Module

0 votes
Hello, I'd like to find a tutorial for achieving the eye tracking demo:


Are there any resources, tutorials that can show me how to accomplish this?

asked May 3, 2017 in User questions by wmetellus (130 points)

1 Answer

+1 vote
You need to select this videmo mode in your video capture software (guvcview, etc):

GREY 176x144 @ 120.0 fps

and the eye tracker module will start. Under windows, there are issues with AMCap and other software not being able to grab in greyscale mode (this is called Y800 in USB video jargon). So for now this is a Linux only thing but wi will work on it soon.

That's pretty much all there is to it from the machine vision standpoint. To make a full eye-tracking system, you then need:

- some optics, like a telephoto lens of sorts that you would place in front of JeVois, so that you can place JeVois farther away from the eye

- write some software that will capture the text strings issued by JeVois over serial port (hardware serial or serial-over-USB). On every frame, you get a description of the ellipse that was fit to the pupil.

- decide on a calibration procedure and implement it (e.g., you flash some dots in various knowl locations on your screen, then ask people to look at them, then get the ellipses from JeVois, then implement some mapping from ellipse coordinates to screen coordinates). The OpenEyes software that the module is based on, or other open-source eye-tracking framework will help.

- then you will be good to go.

So, some work is necessary, but resources are available online to help (look for various open source eye-tracking frameworks to help with calibration, coordinate transforms, etc).
answered May 4, 2017 by JeVois (46,580 points)
Thank you so much for this detailed, helpful answer. I would love to make a full eye-tracking system but I must admit I am that technically savvy to pull it off.

A tutorial on this would be great and my best hope at accomplishing it. Lol