Patent Application
20190149703
This disclosure generally relates to an eye tracking device for the detection of a driver's visual behavior.
Drowsiness and fatigue of an automobile driver may reduce the driver's abilities of vehicle control, natural reflex, recognition and perception. Such diminished vigilance level of a driver may for example be observed at night driving or caused by overdriving, finally leading to increased risks. It is known to employ driver assistance systems that can detect drowsiness and fatigue of the driver, in order to reduce the risks of accidents. Such driver assistance systems may use the eye tracking technology, since human eyes contain information about the person's condition such as gaze, attention level, and fatigue level.
The accuracy and robustness of eye tracking driver assistance systems depends on the consistency of image acquisition of the person's face in real time and under variable and complex background. For this purpose, the person's face may be illuminated during image acquisition. However, illumination may cause light leaks between the respective illuminator and the imaging device, thereby limiting the performance of image acquisition.
Light leaks may be caused by a cover for the illuminator and the imaging device, said cover being arranged primarily for improved appearance and protection of the illuminator and/or the imaging device. Light emitted by the illuminator may approach the cover at different angles and at least some rays may get trapped between bottom and upper surface of the cover due to internal reflections, finally leading to light leaks. This holds particularly true for arrangements, in which the illuminators are arranged close to the imaging device, for example, to achieve the so-called bright pupil effect. To prevent such light leaks, it is known to arrange shield elements made of light blocking material within the cover. This requires a two-component design of the cover, which is, however, difficult to manufacture and may cause an increased risk for visual defects within the cover, particularly due to weld lines, contaminations, sink marks and/or an unfavorable gating position. Such visual defects may again affect the performance and/or precision of image acquisition.
Described herein an eye tracking device, which allows an improved image acquisition while at the same time allowing cost effective manufacturing, appropriate protection of the device's functional components as well as an appropriate appearance. It is also an object to provide a cover, preferably for such eye tracking device.
According to a first aspect of the present invention, an eye tracking device is particularly configured for the detection of a driver's visual behavior. The eye tracking device is therefore preferably mountable within a vehicle, for example in the instrument panel, driving mirror or roof of a vehicle.
The eye tracking device according to the present teaching comprises an illuminator for illuminating a person's eye, an imaging device for detecting light reflected by the person's eye, and a cover for covering the illuminator and the imaging device. Furthermore, the cover comprises a light leak prevention structure for preventing light leaks between the illuminator and the imaging device through the cover, said light leak prevention structure being provided by and/or on at least a surface section of a cover portion being made of a material permeable to light emitted from the illuminator.
In the present teaching, the term light may generally visible light, thus light being visible to the human eye, and also light not visible to the human eye, for example electromagnetic radiation in the form of infrared light.
By providing an illuminator for the illumination of a person's eye, the impact of different ambient light conditions may be reduced, and hence the image quality generated by the imaging device may be ensured, also under varying real-world conditions including poor illumination, including different conditions at day and night.
Furthermore, by providing a light leak prevention structure by and/or on at least a surface section of a cover portion, the respective cover portion may be formed without interruptions by components or portions made of different material. That is, the light leak prevention is already ensured by and/or on the surface of the respective cover portion, such that the inner portions or the inner volume of the cover are not required to provide a shielding functionality. Accordingly, components or portions made of different material than the rest of cover may particularly be avoided within the inner volume of the cover. At least in portions being crucial to the optical characteristics of the cover, such as portions opposite to the imaging device, the inner volume of the cover may be free of components made of different material. Visual defects due to weld lines, contaminations, sink marks and/or unfavorable gating positions may thus be avoided.
The cover may have a one-component design or be continuously formed of a single material along portions being crucial to the optical characteristics of the cover. Components or layers made of different material, for example a light blocking material, may for example be arranged on the surface of the cover or used to provide a cover frame for holding and/or fixing the cover to a case or the like.
According to a preferred embodiment, the light leak prevention structure is provided by a shape, contour, orientation and/or texture of the respective surface section, namely the surface section of a cover portion being made of a material permeable to light emitted from the illuminator. Such surface may easily be provided during manufacturing of the cover, particularly by injection molding. At the same time the light leak prevention structure being provided by a shape, contour, orientation and/or texture of the respective surface, a high level of functional safety may be ensured. Preferably, the shape, contour, orientation and/or texture of the respective surface section is different to the shape, contour, orientation and/or texture of an adjacent surface section. Thereby, a variation of the surface may be achieved, which allows a specific adaptation of the light leak prevention structure to the individual arrangement of components of the eye tracking device.
According to a further embodiment, the at least one surface section of the light leak prevention structure is a directing surface section, preferably configured to direct and/or refract light into directions away from the imaging device and/or into directions causing further reflections and/or refractions away from the imaging device. That is, the surface section may be configured and/or shaped to allow light to be directed and/or refracted into an appropriate direction, particularly in order to avoid light leaks from the illuminator through the cover into the imaging device. The respective rays are either directed and/or refracted away from the imaging device or the directing surface causes a redirecting and/or refraction into a direction which causes further reflections and/or refractions, which are advantageous for preventing light leaks. Such directing surface may achieve the respective light leak preventing functionality without the arrangement of additional light blocking elements or layers on the surface of the cover. Manufacturing may thereby be simplified.
According to yet another embodiment, the at least one surface section of the light leak prevention structure is provided on a protrusion and/or a recess of the respective cover section. A protrusion may have a curved, preferably convex, or angular, preferably prismatic and/or triangular, cross sectional shape. Accordingly, a recess may have a curved, preferably concave, or angular, preferably prismatic and/or triangular, cross sectional shape. Protrusions and recesses may be easily formed, for example, by injection molding of the cover, while at the same time enabling a high degree of light leak prevention functionality.
According to a further embodiment, the light leak prevention structure comprises a light blocking layer arranged on and/or attached to the at least one surface section of the respective cover portion. The light blocking layer is preferably impermeable to light emitted from the illuminator. Thus, a light blocking layer may for example be attached to specifically defined portions of the cover, thereby preventing certain light rays to enter the interior of the cover. Internal reflections of these rays are thereby suppressed. Light blocking layers may form part of the light leak prevention structure. The arrangement of a light blocking layer does not exclude that the light leak prevention structure additionally comprises a surface section, which itself provides a light leak prevention functionality, such as a directing surface, for example. Thus, the light leak prevention structure may comprise a surface section, for example a directing surface, and in addition to this also a light blocking layer arranged and/or attached on a surface section, for example, a surface section adjacent to a directing surface.
According to yet a further embodiment, the at least one surface section of the light leak prevention structure extends along the respective cover portion in a linear and/or curved manner. In a plan view onto the respective surface section, said surface section may be curved or linear. Preferably, the protrusion and/or the recess may have a specific cross sectional shape. In a direction orthogonal to said cross sectional shape, the protrusion and/or the recess may have curved or linear shape. Dependent on the dimension and/or position of the illuminator and/or the imaging device, the light leak prevention may thereby be optimized.
In a further embodiment, the light leak prevention structure is provided by and/or on a plurality of surface sections, wherein said surface sections are preferably arranged symmetrically relative to the imaging device. Thus, different surface sections may be provided in view of different rays from the same and/or different light sources. Even in case of an intense illumination, for example by a large number of light sources, light leaks may be securely prevented.
According to yet a further embodiment, the at least one surface of the light leak prevention structure faces the illuminator and/or the imaging device and/or is formed on the side of the cover facing the illuminator and/or the imaging device. Thereby, the opposite surface of the cover, namely the surface facing away from the illuminator and/or the imaging device and/or facing the person's eye to be tracked, may be designed flat and/or smooth. The appearance of the cover may thereby be improved, as the person being subject to eye tracking by the eye tracking device will merely recognize a flat and/or smooth cover surface. However, it is also possible, that the light leak prevention structure comprises surface sections being arranged on the side of the cover facing away from the illuminator and/or the imaging device.
According to a further embodiment of the present invention, the cover has a varying thickness, preferably along the cover portion comprising the light leak prevention structure. Varying thicknesses may affect the path of rays inside the cover volume and therewith further improve the light leak prevention. Preferably, the cover may have a smaller thickness along a portion being opposite the imaging device than along adjacent portions. The distance between the surface of the cover portion opposite the imaging device and said imaging device may thereby be enhanced. Therefore, rays which exit the cover from a portion being opposite the imaging device are, dependent on the exit angle, less likely to enter the imaging device.
According to a further embodiment, the imaging device is configured to record the person's eye. Recording in the present context shall mean that data generated by the imaging device may be collected and/or saved. The data generated by the imaging device may be used for real time processing or also for processing with a certain time-delay. The imaging device may comprise a camera and/or a lens and/or an optical sensor. This allows a reliable detection of light reflected by the person's eye and/or reliable recording during operation.
The imaging device may be separated from the illuminator by a shield structure, which is impermeable to light emitted from the illuminator and/or sealed to the cover. More specifically, the light leak prevention structure may be configured to prevent light leaks through the cover around the shield structure. Accordingly, the shield structure may prevent rays from the illuminator to directly enter into the imaging device, thus, provides a shielding functionality. The light leak prevention structure may particularly be configured for preventing light leaks around said shield, namely through the cover into the imaging device.
The light leak preventing structure may be adapted to the dimensions and/or the position of the imaging device relative to the cover and/or adapted to the dimensions and/or position of the illuminator relative to the cover and/or to the dimensions and/or the position of the imaging device relative to the dimensions and/or the position of the illuminator. The specific design and/or arrangement of light leak preventing structure may therefore by chosen in view of the arrangement of the components of the eye tracking device. The light leak prevention may thereby be further optimized.
In a further embodiment, the illuminator is configured to emit infrared light, preferably near-infrared light. This allows producing the so-called bright pupil effect, which may further improve the detection and tracking of a person's eye, particular eye movements and/or blinks. That is, in case human eyes are illuminated with an infrared illuminator at certain wavelength, particularly a near-infrared illuminator, beaming light along the optical axis of the imaging device may cause a bright pupil. At the near-infrared wavelength, almost all infrared light is reflected from the pupils along the path back to the imaging device. Furthermore, near-infrared light is barely visible to the person subject to eye tracking and any interference with the person's activity, such as driving a vehicle, may be minimized.
According to a further embodiment, the illuminator comprises a plurality of light sources, preferably evenly and/or symmetrically arranged relative to the imaging device. The light sources may be designed as infrared LEDs. The light sources may be arranged close to the optical axis of the imaging device, particularly as close as possible in view of any geometrical restrictions.
According to another embodiment, the cover portion comprising the light leak prevention structure, in particular the entire cover, is permeable to infrared light, preferably near infrared light. Thereby, the cover may effectively protect the illuminator and/or the imaging device, without affecting illumination and/or detection by the imaging device. The cover may be impermeable to visible light. Thus, the cover may appear black or dark colored to a person. Structures behind the cover will not be recognized by the person, whereby the overall appearance of the eye tracking device may be improved. The cover may be made of a plastic material, e.g. by injection molding, which ensures low manufacturing costs and a reliable quality of the cover. The wall thickness of the cover may be chosen such that plastic flow during the injection process is enabled.
According to a second aspect of the present invention, a cover device is configured for an above described eye tracking device. The cover device comprises a cover for covering an illuminator and an imaging device arrangeable adjacent to the cover, and a light leak prevention structure for preventing light leaks between an illuminator and an imaging device through the cover, said light leak prevention structure being provided by and/or on at least a surface section of a cover portion being permeable to light emitted from the illuminator.
The further features mentioned above may likewise be applied to the cover device according to the second aspect of the present invention.
The present invention also refers to a driver assistant system including the above described eye tracking device and/or the above described cover device. An according driver assistant system may furthermore be equipped with a calculation unit such as a CPU and also a storage device, particularly for software. Such a system may enable eye tracking under variable and realistic lighting conditions and allows real-time acquisition of images of a driver's eye as well as processing and/or assessment of the acquired image data with improved performance.
The eye tracking device and/or the driver assistant system comprising such an eye tracking device may be configured as a stand-alone unit or as built-in unit.
The present invention is also directed to vehicles including an eye tracking device and/or a cover device and/or a driver assistance system mentioned above. The eye tracking device and/or the cover device may be installed in a vehicle dashboard, driving mirror and/or vehicle roof.
Further features and advantages will appear more clearly on a reading of the following detailed description of the preferred embodiment, which is given by way of non-limiting example only and with reference to the accompanying drawings.
The present invention will now be described, by way of example with reference to the accompanying drawings, in which:
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described embodiments. However, it will be apparent to one of ordinary skill in the art that the various described embodiments may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
‘One or more’ includes a function being performed by one element, a function being performed by more than one element, e.g., in a distributed fashion, several functions being performed by one element, several functions being performed by several elements, or any combination of the above.
It will also be understood that, although the terms first, second, etc. are, in some instances, used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first contact could be termed a second contact, and, similarly, a second contact could be termed a first contact, without departing from the scope of the various described embodiments. The first contact and the second contact are both contacts, but they are not the same contact.
The terminology used in the description of the various described embodiments herein is for describing embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
Furthermore, the eye tracking device 10 in
It is known to prevent such light leaks with an eye tracking device 200 shown in
However, the two-component design of the cover 220 of
In the following reference is made to
Due to the light leak prevention structure 22, light rays emitted by the illuminator 12 in the direction indicated by numeral 28 enter the cover 20 from the bottom side 26 at a different angle, which is different to the angle shown in
In the embodiment of
The embodiment of
In the embodiment of
The embodiment of
The cross-sectional shape of the recess 42 and/or of the protrusion 43 may also be different to the illustrations in
In the embodiments of
While this invention has been described in terms of the preferred embodiments thereof, it is not intended to be so limited, but rather only to the extent set forth in the claims that follow.
| Number | Date | Country | Kind |
|---|---|---|---|
| 17202116.4 | Nov 2017 | EP | regional |
