Looking for eyes! (to improve a gaze tracker)


#1

Dear Lwavers!

I’m looking for realistic-looking (or realistic-enough) eyes and eye region of the face.

A quick prelude:
I’m wrapping up my phd thesis on computer vision assisted diagnosis of autism. In my lab we developed a miniature camera that you place on the head of children and films the field of view of the child AND his/her eyes via a small mirror. From the eyes we can determine the direction of the gaze of the child inside the whole FOV we’re recording. This is useful because we can get the children to play with their parents/caretakers and measure a bunch of stuff such as frequencies of eye contacts, time spent looking at the parents, etc. . Children with autism tend to interact in a completely different way and this pops up on our monitors. (I work with ~2-3 year old children mostly)

A couple of examples of the system in action:
http://lasa.epfl.ch/research/toys/wearcam/video/downloads/gazegame_xvid.avi
http://lasa.epfl.ch/research/toys/wearcam/video/downloads/face_gaze_object_scene.avi
(sorry for the bad quality)

However:
In order to measure/evaluate/train etc the system i need proper training data, and since you can’t ask a 2 year old child with autism “please look in regular patterns throughout your whole field of view”, I’m looking for some way to generate the appearance of the eyes corresponding to fixed direction of the gaze. So I’m gonna do this in 3d.

The system is actually calibrated for every child, but the methods used to create a mapping between the appearance of the eyes and the direction of the gaze can be improved if I have proper calibration data. If I had a realistic enough model of eyes and face (i actually use only a small region: bridge of the nose, eyelids etc) this would be sufficient to determine all the parameters of the machine learning tools i’m using right now, even if the “real” eyes of the children appear to be slightly different.

The Question:
If somebody has a usable “face” (doesnt need to be a whole face) with eyes and a rig that takes into account eyelids, and is interested in helping out, I’d be very happy.

Unfortunately this is not a commercial enterprise so this would be entirely up to your generosity.

Thanks in advance…


#2

This thread has been automatically closed as it remained inactive for 12 months. If you wish to continue the discussion, please create a new thread in the appropriate forum.