The invention relates to a system comprising an oculometer for measuring movements of at least one eye of an operator.
The invention also relates to a method implemented on such a system, and a corresponding computer program product.
Systems are known comprising an oculometer for measuring movements of at least one eye of the operator, who has for example lost movement of his upper limbs, for selecting objects offered by a display, for example for written communication.
The objects offered on known displays are for example letters and/or numerals and/or keyboard commands, for example of the kind on a computer keyboard.
The known selection of each object offered is accomplished by a sequence generally comprising:
The foregoing techniques, however, do have disadvantages.
They allow only the selection of objects offered in a predefined form, and not the generation of objects in the form of a personalized trace. Indeed, psychologically, eye movements consist virtually entirely of saccadic movements between targets (on the order of two to three saccadic movements per second), and cannot therefore be used for generating objects in the form of a personalized trace.
Moreover, they required strong concentration and sustained effort on the part of the operator for controlling the saccadic movements.
Moreover, the aforementioned selection is slow.
Finally, known systems require repeated and very accurate calibration of the oculometer because they use the gaze direction of the eye to designate as a target the object to be selected.
The invention proposes to offset at least one of these disadvantages.
To this end, a system is proposed according to the invention comprising an oculometer for measuring the movements of at least one eye of an operator, characterized in that it also comprises a display for displaying, for the eye, a frame of at least one point performing a blinking, such that the operator is able to carry out at least one smooth tracking movement of the eye while looking at the display while it operates.
The invention is advantageously supplemented by the following features, taken alone or in any technically possible combination:
The invention also relates to a method implemented on such a system, and a corresponding computer program product.
The invention has numerous advantages.
It allows the operator to carry out smooth tracking movements of the eye.
It allows the generation of objects in the form of a personalized trace, the trace resulting from a smooth tracking movement of the eye of the operator measured by the oculometer. The personalized trace allows the generation
The operator is therefore no longer limited to objects having a predefined shape, but can free his creativity and generate objects stamped with his personality (such as for example personal cursive writing and/or a signature), particularly with a view to authenticating the operator.
In addition, it requires relatively little concentration and shorter training time and relies on prior learning, by manual formation of cursive writing for example.
It requires relatively little effort on the part of the operator for eye movements, and a reference point displayed on the display can allow a further augmentation of the control of smooth eye tracking movements, for maximum operator comfort.
Moreover, the generation of objects is quick, for a communication throughput that is also quick.
Finally, the invention requires a less accurate calibration because it uses relative movements of the eye to form the object to be generated, and not the direction of the gaze of the eye to designate as a target the object to be selected as in the prior art.
The invention has numerous fields of application. It is possible to cite, by way of non-limiting examples:
Other features, objects and advantages of the invention will appear from the description that follows, which is purely illustrative and not limiting, and which must be read with reference to the appended drawings wherein:
In all the figures, similar elements bear identical numerical references.
The system principally comprises an oculometer 1 for measuring, during step E1, movements of at least one eye O of the operator.
The oculometer 1 is a device for measuring eye movements, known to a person skilled in the art and available commercially.
It also comprises at least one camera 10 oriented toward the eye O of the operator for directly observing the eye O and measuring movements of the eye O in an orbit of the operator.
The camera 10 is connected to a processor 11 of the oculometer 1, for recording and processing movements of the eye O of the operator. It is carried on a helmet 12 on the operator.
A non-limiting example of an oculometer 1 which can be used is the Eye-Link II brand oculometer by the company called SR-Research.
As shown by
The frame T is any pattern consisting of at least the point P, visible to the operator. The frame T preferably comprises a plurality of points P.
The points P can for example be distributed at random on the display 2. The points P can be of unequal sizes, and the frame T can have several densities of points P on the display 2.
Blinking refers to flickering of the frame T, perceptible by the eye O, on the display 2.
The frame T has low contrast compared with a screen background of the display 2, to avoid excessive fatigue of the eye O of the operator.
The screen background can for example be a medium grey color, but any other color can of course be considered.
The blinking is obtained by rhythmic inversion of a shade of the points of the frame T. Thus,
And so on.
The blinking frequency is thus for example comprised between 10 Hz and 40 Hz, preferably comprised between 20 Hz and 30 Hz, with a preferred value at 25 Hz for example.
The display 2 can be a computer or television monitor, or a passive screen whereon the frame T is projected by a projector for example.
The system comprises a processing unit 3 (preferably but without limitation in the form of a computer processor), connected to the monitor or connected to the aforementioned projector, and allowing control of the display of the frame T on the display 2. The processing unit 3 also controls an interface 31 (for example in the form of a graphic control screen of the system, the interface 31 allowing the operator to adjust the contrast and/or the blinking frequency of the frame T.
The operator can carry out at least one smooth tracking movement of the eye O, while looking at the display 2 operating, that is displaying the blinking of the frame T. A smooth tracking movement is a continuous movement of the eye in its orbit, and not a saccadic movement.
In fact, the blinking of the frame constitutes a visual stimulus perceptible by the eye O and allowing such a smooth tracking motion, the latter being impossible in the absence of blinking (only saccadic movements being indeed performed in the absence of blinking). This phenomenon has been observed experimentally, and reference can be made to Sato, T. (1989), Reversed apparent motion with random dot patterns, Vision Research, 29, 1749-1758, or to Spillmann, L. et al. (1997), Reversed visual motion and self-sustaining eye oscillations, Perception, 26(7): 823-30.
Smooth tracking movements of the eye O are continuously measured in real time by the oculometer 1: the processor 11 records and processes the movements of the eye O measured by the camera 10.
As shown by
The movements of the eye are interpreted as a trajectory by the unit 3 and recorded in a memory of the processing unit 3. The trajectory is reconstituted as a graphic trace which can be processed by the unit 3.
Processing the movements of the eye O comprises taking into account separation of the trace into different consecutive segments. The separation can be controlled by the computer for example, either by stopping eye movements for a predetermined period or by blinking the eyelids.
As shown by the set of
The unit 3 can be connected to a device 4, taking into account the generation coming from the unit 3.
The device 4 can be of any type, such as for example a computer comprising
The graphic of
As explained above, the words of the expression “eye on line” of
The expression of
In the case where the device 4 is a computer comprising a word and/or drawing processing program, processing by the unit 3 also comprises reduction and/or formatting and/or page layout of the segments of the graphic trace. The smooth tracking movements of the eye O when looking at the display 2 are in fact of considerable magnitude, for greater comfort in moving the eye O, and do not correspond generally to a conventional format such as an A4 format in portrait mode.
The aforementioned processing can also be carried out, entirely or in part, by the device 4.
In the case where the device also comprises a sound generating program and a speaker, the device 4 can also emit a sound that is modulated, in intensity and/or in pitch and/or in timbre for example, depending on the object generated by the movements of the eye O.
In the case where the device comprises in combination the word and/or drawing processing program and the sound generating program and a speaker, the device 4 can also emit a sound corresponding to a letter generated by the movements of the eye O.
Finally,
The sensor 21 thus allows calibration of the oculometer 1 in relation to the display 2. The calibration, however, can be relatively inaccurate, and therefore can be rapidly carried out during initialization of the system, the calibration not being used for generating objects, the latter using mainly the smooth tracking movements of the eye O.
The display 2 is moreover advantageously designed to display, during step E3, a reference point R in the frame T, the position of the reference point R on the display 2 depending on the coordinates (x,y) of the projection C of the direction DR of the gaze of the eye O into the display 2. Thus the reference point R constitutes a real-time indicator, perceptible by the operator, allowing the latter control of the displacement and of the speed of his eye O.
The reference point R can have any shape, but is very preferably peripheral in relation to the projection C of the direction DR of the gaze of the eye O onto the display 2.
It consists for example of peripheral discs (having for example a diameter comparable to that of the points P) and forming a circular ring centered around the projection C. The crown can have any diameter, but advantageously has between 1/16th and ⅛th of the surface area of the display 2 for example.
The reference point R can be continuously displayed during the operation of the display 2, but can also be blinking.
The reference point R must be perceptible to the eye, and has consequently more contrast than the frame T relative to the screen background of the display 2.
The shape, the size and the contrast of the reference point can be adjusted by the operator via the system interface 31.
According to one advantageous variation, the oculometer 1 is designed to also measure a diameter of the pupil of the eye O of the operator, the unit 3 is designed to modulate the graphic and/or the letter and/or the numeral and/or the sound and/or the command according to the diameter of the pupil of the eye O of the operator.
The thickness of the stroke of the trace can also increase when the diameter of the pupil increases, to increase the expressivity of writing, because the diameter of the pupil of the eye manifests the emotions of the operator.
It is understood that
The invention also relates to a computer program product comprising instructions which, once loaded into a memory of a computer, allow the implementation of a method according to the invention. The product can be on any computer medium, such as for example memory or a CD-ROM.
Number | Date | Country | Kind |
---|---|---|---|
11/01695 | Jun 2011 | FR | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2012/060309 | 5/31/2012 | WO | 00 | 3/3/2014 |