The present invention discloses a nose pad eye/gaze tracking module applicable to smartglasses/head wearable devices implementing extended reality technology (augmented/virtual/mixed reality AR, VR, MR) in general. The invention further deals with a method for fastening the module to said smart eyeglasses/head wearable device (also referred to as a head wearable device herein) and with an eye/gaze tracking device (also referred to as a gaze tracking device herein) comprising smart eyeglasses/head wearable device provided with the nose pad eye/gaze tracking module.
Eye-tracking devices and in particular spectacles usually comprise a camera, which is oriented onto the eye of the spectacles wearer; such a camera is able to detect the pupil of the user in order to ascertain the coordinates of the pupil in the space. Gaze tracking devices further comprise a front camera able to capture the scenario in front of the user, in this case, the device is able to determine the viewing direction of the user's eyes which can be displayed on a correspondent display computer device to a second user remotely connected via internet live streaming.
US2016/0206196 discloses gaze-tracking spectacles comprising two eye cameras arranged in the nose frame of the glasses and a field of view camera in the middle of the glasses, showing the front scenery of the user.
The field of view camera is provided to record a field of view, video including individual and successive field of view images. The recordings of the two eye acquisition cameras and the at least one field of view camera can thus be entered in correlation in the field of view video of the respective gaze point.
Unfortunately, this prior art document discloses eye tracking glasses having a frame similar to normal pair of glasses.
Furthermore are known augmented/virtual/mixed reality glasses, have a very minimal spectacles frame, including a horizontal upper part provided with an element constituting the nose frame, in order to have the device placed stably and supported by the nose of the user.
WO2021/164867 discloses an eye tracking module applicable to smart glasses and goggles and the head wearable device mounting that module. This document is focused on connecting the module to head-wearable devices from the wearer's side (see
The document furthermore only generally mentions in paragraph 62 that “alternatively, the electric connector may be arranged on a top surface of the module”, without describing in detail any specific embodiment of this type of connection. In particular, it is only mentioned a possible position of electronic connector but not any mechanical interface able to connect stably in place the module on the head-mounted device, in order to avoid accidental or unwanted disconnection, or even worse any signal losses due to inappropriate connection, when the module is connected to the head-mounted device.
One objective of the present invention, according to a first of its aspects, is obtaining an eye/gaze tracking module, being a finished product, ready to be used once mechanically connected to the smart glasses, like augmented or virtual, or mixed reality glasses, able to minimize the impact space-wise of the module once connected to the head-worn device.
A second objective of the present invention is to obtain an eye/gaze tracking module with no connector, thus further minimizing the dimension of the module.
A third objective of the present invention is giving the possibility to make augmented or virtual or mixed reality glasses able to be customized and to fit immediately to different somatic features typical of different ethnic groups for instance Asian people, and European people, avoiding the necessity to create different and specific smart glasses models. A fourth objective of the present invention is giving the possibility to the user to easily fasten and unfasten an eye/gaze tracking module to/from his/her own smart eyeglasses/head wearable device.
A fifth objective of the present invention is to provide an eye/gaze tracking module easily adaptable to different smart glasses frames, easy to be cleaned, and at the same time firmly attachable to said smart glasses.
A further objective of the present invention is to provide an eye/gaze tracking module able to not interfere with the user's nose, being not in contact with it and/or with the user's field of view, once fastened to the smart glasses.
A further objective of the present invention is to provide an eye/gaze tracking module very light weighted, compact, and characterized by reduced dimensions, comfortable for the user.
Another objective of the present invention is to provide an eye/gaze tracking device reliable, and easy to be used by the user, with a reduced cost with respect to known eye tracking devices.
Another objective of the present invention is to provide a fastening method easy to be implemented by users.
Hereinafter are summarized some technical aspects of the present inventions which enable some of the most important purposes to be achieved.
According to a first aspect this invention relates to an eye/gaze tracking module configured to be easily fastened/unfastened to/from a pair of smart spectacles or working eye glasses not having any nose pads, thus creating an eye/gaze tracking device, said module comprising a first part, having a U-shaped portion, housing at least one left eye sensor and one right eye sensor to detect pupil positions of the user in a plurality of images, said module further comprising a second part, housing a mechanical interface configured to connect the module to the smart/working spectacles, said module further comprising electronic components namely at least a data processing unit, a memory, a data interface, enclosed in the first part frame or in the second part frame, said electroniccomponent configured to connect the module to a computer device remotely connected or to other devices in general, and to send to said computer device eye movement information of the user wearing the spectacles to which is fastened the module, wherein the mechanical interface, arranged on the second part frame, comprises a specific upward section shape connectable to a correspondent downward section shape of the central portion or of a further extension at the central portion of the smart eye glasses/head wearable device, thus making the module configured to be bottom-up connectable to the smart eye glasses/head wearable device.
In this case the bottom-up connection between the module and the smart eye glasses/head wearable device at the central portion, implies a very reduced space occupied by the module when in use, which is compact and very small.
According to a second aspect this invention relates to a module further comprising a PCB configured to further be the mechanical interface connectable to the smart eye glasses/head wearable device.
In this case the further mechanical connection provided by the PCB prevent the need to have a real or physical connector on the module, this solution contributing to minimize the overall dimension of the module.
According to further aspects, this invention relates to further module, product and method feature claimed in the dependent claims of the present specification.
The structural and functional features of the present invention and its advantages with respect to the known prior art, will become even clearer from the underlying claims, and in particular from an examination of the following description, made with reference to the attached figures which show a preferred but not limited schematic embodiment of the invented method, system, device, in which:
In general, this disclosure describes a nose pad eye/gaze tracking module 1, a method for fastening/unfastening the module to/from different kinds of smart eyeglasses/head wearable device 8, and an eye/gaze tracking device comprising smart eyeglasses/head wearable device 8 provided with the nose pad eye tracking module 1.
The specifications “right” or “left” or “high” or “low” or “front” or “back” relate to the intended manner of wearing eyeglasses and the eye tracking module by a human being.
Regarding smart eyeglasses/head wearable device 8 in general, it shall be highlighted that they have at least an upper part of their frame having the purpose to hold the temples and if necessary retaining the lenses, which could be sun lenses or specific filtering/protective lenses or lenses in general. Furthermore, they may have at least a portion, so-called nose bridge, acting as a spacer between the two lenses, able to create space for the user's nose.
The nose bridge is a portion necessary in all eyeglasses, but in some cases, this portion is not clearly detectable, for example in head wearable device or head-mounted headset. In some cases, like smart glasses provided with extended technology (see
The nose pad eye tracking module 1, according to the present invention, comprises a first part 10, comprising a first part frame 11, having, in turn, a U-shaped portion 110. In said U-shaped portion 110 are preferably located a right eye acquisition sensor 4 and a left eye acquisition sensor 3, which have the purpose of taking images of each user's eye, in order for the position of the pupil in the space to be detected (see
The left and right eye sensors 3, and 4 may be preferably eye cameras but may be different kinds of technologies like lasers able to scan the user's eyes to detect the position of pupils or microelectromechanical systems like for instance MEMS-based scanning elements.
The module furthermore comprises a second part 12, having a second part frame 13, housing—in a preferred embodiment—a mechanical interface 7 (see
Said mechanical interface 7 in all the embodiments described in the present specification is provided also with an electrical/electronic interface, in order to electrically/electronically connect the nose pad eye/gaze tracking module 1 with the smart eyeglasses/head wearable device 8.
In a preferred embodiment the mechanical interface 7 on top of the second part frame 13 exploits the action of the laminated insulating material forming part of a PCB (see
It's important to highlight that the bottom-up connection between the module 1 and the smart eyeglasses/head wearable device 8 at the central portion 88, implies a very reduced space occupied by the module 1, because the available space is very small between the smart eyeglasses/head wearable device 8 and head of the human being, when between the smart eyeglasses/head wearable device 8 and the nose pad eye/gaze tracking module 1 are connected together and in use.
The U-shaped portion 110 comprises two arms 100, and is particularly designed for being used as nose pads, thus being configured to make the smart eyeglasses/head wearable device 8 easily customizable on different nose shapes when the module is fastened to said smart eyeglasses/head wearable device. The nose pad eye/gaze tracking module 1 of the present invention is used, replacing, the nose pads of the smart eyeglasses/head wearable device 8, without interfering with the user's nose.
The U-shaped part 110 may be made of soft materials, and in particular, the arms 100 may be made with flexible material, in order to further better adapt the arm 100 shapes to the nose of the user and to cooperate fastening the module on the smart eyeglasses/head wearable device 8 as described hereinafter.
As mentioned before, in a preferred solution, the right eye acquisition sensor 4 is arranged in the right arm 100, and the left eye acquisition sensor 3 is arranged in the left arm 100 of the U-shaped portion 110. When the two eye acquisition sensors 3, and 4 are designed as digital cameras they may have an objective lens. The two eye acquisition cameras 3, and 4 are each configured to prepare an eye video including individual eye images or individual images of the eyes of the human wearing the eye tracking module. Said eye acquisition cameras 3, 4 must be directed towards the position of the eyeball of the wearer.
In a possible configuration (see
At least one field of view camera (not present in the drawings) is arranged on and/or in the module 1, in each embodiment disclosed in the present specification. The field of view camera records a field of view video, including individual and successive field of view images. In that case, the recordings of the two eye acquisition sensors 3, 4 and the at least one field of view camera can thus be entered in correlation in the field of view video of the respective gaze point of the user (when the module is fastened to the smart eyeglasses/head wearable device.
More than one field of view cameras may also be arranged in and/or the nose pad eye tracking module 1, in each embodiment disclosed in the present specification.
Furthermore, the module has electronic components like a data processing unit (like a microprocessor), a connected storage medium, and a data interface, the data processing unit being connected to the right eye acquisition sensor 4 and the left eye acquisition sensor 3. The module furthermore may have an energy accumulator for the energy supply of the eye sensors 3, 4, and also the data processing unit, memory, and the data interface. The module furthermore may have an external power supply via cable, or an internal battery and a correspondent power interface, not shown in the schematic drawings.
In each embodiment disclosed in the present specification the electroniccomponents, including a data processing unit (like a microprocessor) and a connected storage medium, and at least a data processing unit, a memory, a data interface, a power unit/interface, may be arranged in the first part 10, or in the second part 12 or some of them in the first part 10 and other ones in the second part 12.
Furthermore because of these electronic components are enclosed inside the relevant module frames and the module frame shapes are sealed and have no sharp edges, the module disclosed in the present invention is also easy to be cleaned. Furthermore, the frame of each part where these electronic parts are arranged, encloses them, conferring them protection against accidental hits, dust, or in general external agents which might compromise said part operations (the drawings provided are schematic and do not have limiting purposes).
In each embodiment disclosed in the present specification a data processing unit may be preferably designed as a combination of a microcontroller or processor together with memory. The data processing unit is connected in a signal-conduction manner to a data interface. The data interface and the data processing unit may be formed jointly in hardware, for example, by an ASIC or an FPGA. The interface is preferably designed as a wireless interface, for example, according to the Bluetooth standard or IEEE 802.x, or as a wired interface. Additional sensors might be inserted in the eye tracking module and connected to the data processing unit.
In each embodiment disclosed in the present specification the data processing unit, the memory and the data interface may be connected at least indirectly to an energy accumulator by circuitry, and are connected in a signal-conduction manner to the field of view camera (when present), the right eye acquisition sensor 4, and the left eye acquisition sensor 3.
It shall be highlighted that in each embodiment disclosed in the present specification, the entire recording, initial analysis, and storage of the recorded videos may thus be performed in or by the eye tracking module itself or by a computer device connected (wireless or via cable) to the module.
Regarding the U-shaped portion 110 where are arranged at least one left eye sensor 3 and one right eye sensor 4, in each embodiment disclosed in the present specification also a left Infrared LED illuminator 30 and a right Infrared LED illuminator 40 may be arranged in said U-shaped portion 110. Said illuminators 30, 40 help to better detect pupil positions of the wearer's eyes, when in use.
In order to connect the module the nose pad eye/gaze tracking module 1 to the smart eyeglasses/head wearable device 8, is already mentioned above that the mechanical interface 7 on top of the second part frame 13, comprises the action of the laminated insulating structure forming part of a PCB (see
In a preferred embodiment an ending portion 70 of the PCB included in the nose pad eye/gaze tracking module 1 is shaped like a female connection (see
The ending portion 70 may have a rectangular cross-section, comprising two parallel elements 700, spaced apart from one another. The space between the two parallel elements forms a suitable seat 704 for a correspondent ending portion 880 (in this case a male part) of a PCB included in the smart eyeglasses/head wearable device 8. The seat 704 comprises a suitable number of conduction traces 770, corresponding to the number of conduction traces 882 of the ending portion 880. When the ending portion 880 of the smart eyeglasses/head wearable device 8 is connected stably with the ending portion 70 of the nose pad eye/gaze tracking module 1, then both devices have established electrical and electronic connections, being able to communicate with each other. The ending portion 880 may further be shaped with two parallel elements spaced apart from one another and defining a space 884, allowing the two parallel elements to get close to each other when both are inserted in the seat 704 of the ending portion 70. In this case, the two parallel elements 700 are less forced to bend outwardly when the two devices are connected because that movement is compensated by the opposite movement of the two parallel elements of the ending portion 880 (see
In all the embodiments described in the present invention, the ending portion 70 of the PCB of the nose pad eye/gaze tracking module 1 is designed to firmly and stably hold in place the correspondent ending portion 80, maintaining the continuity of the signal between the two devices and preventing any loss of communication between them. It shall be highlighted furthermore that, being established a bottom-up connection between the two devices and acting the nose pad eye/gaze tracking module 1 as the nose pad of the smart eyeglasses/head wearable device 8 when both are connected together. The connection between the two devices is forced to be maintained stable due to the weight of the smart eyeglasses/head wearable device 8 itself. This particular aspect is peculiar to all the embodiments of the present invention.
In a further preferred embodiment the ending portion 70 of the PCB included in the nose pad eye/gaze tracking module 1 is shaped in the same way as the already mentioned embodiment like a female connection (see
A further embodiment not described in the figures may have a plurality of longitudinal apertures aiming to physically separate each conductive trace between one another either on the ending portion 70 and on the ending portion 80, in order to allow a certain flexibility in tolerances during the connection between the two devices.
In a further preferred embodiment (see
This embodiment may also be configured with the second part frame 13 acting as the counterpart of the snap-fit profile, instead of the PCB (see
The embodiment of
In a further preferred embodiment (see
In this case, the mechanical retaining force needed when the two devices are connected together is provided by a magnet 5, designed to bounder the ending portion 70, being able to attract a correspondent magnet 890 arranged on the ending portion 80, in order to hold in position the nose pad eye/gaze tracking module 1 on the smart eyeglasses/head wearable device 8 when in use. The use of a magnet 5 surrounding the ending portion 70 to improve the stability of the connection of the two devices, may be arranged in all the embodiments described in the present specification.
The last embodiment described may be further improved, arranging the second part frame 13 further totally bounding the magnet 5 and further creating a boundary seat 705 around the very ending portion 70, said boundary seat 705 configured to match a congruent protrusion 885 of the ending portion 80, thus offering a guide for an easy connection of the two devices together (see
An improvement of the embodiment shown in
Another improvement of the embodiment shown in
It must be highlighted that in all the embodiments described so far, the ending portion 70 of the PCB of the nose pad eye/gaze tracking module 1 is designed as the female part of the connection between the two devices and the ending portion 880 of the PCB of the smart eyeglasses/head wearable device 8 as the male part, but the two ending parts 70, 880 may be exchanged in the opposite way in order to better meet specific technical requirements of the smart eyeglasses/head wearable device 8 manufacturers. Therefore the ending portion 70 may be designed as a male part of the connection as already described in each embodiment and the ending portion 880 as the correspondent female part.
In the embodiment shown in
Finally, it may be provided an embodiment where the ending portion 70 has physically separated support of conductive traces, with they arranged on a lateral side of their respective support. In this case, expecting the same configuration on the correspondent counterpart ending portion is obtained an embodiment able to provide a rotating mounting connection between the two devices.
As already described, when the module comprises a field of view camera, it is able to detect a plurality of images, such as video images, of the field of view of the wearer the nose pad eye tracking module, once fastened when in use. Said field of view camera may be arranged in a part of the frame of the module 1 facing outwardly the smart eyeglasses/head wearable device 8 when in use, or may be arranged in a portion of the frame, which may be configured to be higher than the upper portion of the frame of the smart eyeglasses/head wearable device 8, when the eye tracking module is fastened to the smart eyeglasses/head wearable device 8.
It shall be highlighted that in each embodiment disclosed in the present invention the two arms 100 are designed in such a way to be used as nose pads configured to make the smart eyeglasses/head wearable device 8 customizable on different nose shapes when the module is fastened to said smart eyeglasses/head wearable device 8.
The nose pad eye/gaze tracking module 1 disclosed in the present invention, due to its dimension reduced size and its described configuration, results in a very light weighted module, not affecting the user's comfort, when he is wearing his/her smart eyeglasses/head wearable device 8 to which is fastened the module.
The present invention further relates to a method for fastening the nose pad eye tracking module 1 to a smart eyeglasses/head wearable device 8, wherein the eyeglasses 8 and module 1 have structures already described in this specification, according to all the embodiments described. The method comprises the following steps:
The present invention further relates to an eye/gaze tracking device comprising a pair of smart eyeglasses/head wearable device 8 and the nose pad eye tracking module 1, wherein the smart eyeglasses/head wearable device 8 and the nose pad eye/gaze tracking module 1 have structures already described in this specification, according to all the embodiments described.
Number | Date | Country | Kind |
---|---|---|---|
PCT/EP2021/074787 | Sep 2021 | WO | international |
The present application is a national phase application of PCT Application No. PCT/EP2022/075073, filed Sep. 9, 2022, entitled “NOSE PAD EYE/GAZE TRACKING MODULE APPLICABLE TO SMART GLASSES OR HEAD WEARABLE DEVICE”, which claims the benefit of PCT/EP2021/074787, filed Sep. 9, 2021, entitled “NOSE PAD EYE/GAZE TRACKING MODULE APPLICABLE TO SMART GLASSES”, each of which is incorporated by reference in its entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2022/075073 | 9/9/2022 | WO |