Patent Application
20240025344
The present invention relates generally to the field of interior rearview mirror assemblies for vehicles.
It is known to provide a mirror assembly that is adjustably mounted to an interior portion of a vehicle, such as via a double ball pivot or joint mounting configuration where the mirror casing and reflective element are adjusted relative to the interior portion of a vehicle by pivotal movement about the double ball pivot configuration. The mirror casing and reflective element are pivotable about either or both of the ball pivot joints by a user that is adjusting a rearward field of view of the reflective element.
An interior rearview mirror assembly has a driver monitoring camera and a near infrared light emitter disposed at the mirror head so as to move in tandem with the mirror head when the mirror head is adjusted relative to an interior portion of the vehicle to adjust the driver's rearward view. The camera views the interior cabin of the vehicle through the mirror reflective element and the near infrared light emitter emits near infrared light through the mirror reflective element to illuminate the driver region and/or passenger region of the interior cabin of the vehicle. The near infrared light emitter comprises at least a first light emitting element and a second light emitting element. The first light emitting element is oriented at the mirror head so that a principal axis of a beam of light emitted by the first light emitting element would be directed toward a driver's region of a left hand drive vehicle if the mirror assembly were installed in the left hand drive vehicle and adjusted to provide the driver of the left hand drive vehicle a rearward view, while the second light emitting element is oriented at the mirror head so that a principal axis of a beam of light emitted by the second light emitting element would be directed toward a driver's region of a right hand drive vehicle if the mirror assembly were installed in the right hand drive vehicle and adjusted to provide the driver of the right hand drive vehicle a rearward view. The control circuitry is operable to enable the first light emitting element or the second light emitting element responsive to indication (such as via a signal from a remote device at the mirror assembly plant or at the vehicle or at the vehicle assembly plant or the like) that the vehicular interior rearview mirror assembly is installed or will be installed in a left hand drive vehicle or a right hand drive vehicle. The light emitter is thus software enabled to adapt a common mirror assembly for application to a left hand drive vehicle or to a right hand drive vehicle.
Thus, when the vehicular interior rearview mirror assembly is installed or will be installed in a left hand drive vehicle, the first near infrared light emitter, when electrically powered to emit light, emits light for a driver monitoring function, and when the vehicular interior rearview mirror assembly is installed or will be installed in a right hand drive vehicle, the second near infrared light emitter, when electrically powered to emit light, emits light for the driver monitoring function. When the respective first or second near infrared light emitter is electrically powered for the driver monitoring function, the other near infrared light emitter is not electrically powered for the driver monitoring function.
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
Referring now to the drawings and the illustrative embodiments depicted therein, an interior rearview mirror assembly 10 for a vehicle includes a casing 12 and a reflective element 14 positioned at a front portion of the casing 12 (
The mirror assembly includes or is associated with a driver monitoring system (DMS), with the mirror assembly comprising a driver/occupant monitoring camera 18 disposed at a back plate 20 (and viewing through an aperture of the back plate) behind the reflective element 14 and viewing through the reflective element toward at least a head region of the driver of the vehicle. The DMS includes a near infrared light emitter 24 disposed at the back plate 20 and emitting light through another aperture of the back plate and through the reflective element.
With the DMS camera disposed in the mirror head, the camera moves with the mirror head (including the mirror casing and mirror reflective element that pivot at a pivot joint that pivotally connects the mirror head to the mounting structure of the interior rearview mirror assembly that in turn mounts at a windshield or at a headliner of the equipped vehicle), such that, when the driver aligns the mirror to view rearward, the camera is aligned with the line of sight of the driver. The location of the DMS camera and IR LED(s) at the mirror head provide an unobstructed view to the driver. The DMS preferably is self-contained in the interior rearview mirror assembly and thus may be readily implemented in a variety of vehicles, including existing vehicles and different models of the same vehicle brand (for example, in a BMW 3-series model and in a BMW X3 model and in a BMW 5-series model and in a BMW X5 model and in an BMW 7-series model, etc.). The driver monitoring camera may also provide captured image data for an occupancy monitoring system (OMS) or another separate camera may be disposed at the mirror assembly for the OMS function.
The mirror assembly includes a printed circuit board (PCB) 24 having a control or control unit comprising electronic circuitry (disposed at the circuit board or substrate in the mirror casing), which includes driver circuitry for controlling dimming of the mirror reflective element. The circuit board (or a separate DMS circuit board) includes a processor that processes image data captured by the camera 18 for monitoring the driver and determining, for example, driver attentiveness and/or driver drowsiness. The driver monitoring system includes the driver monitoring camera and may also include an occupant monitoring camera (or the driver monitoring camera may have a sufficiently wide field of view so as to view the occupant or passenger seat of the vehicle as well as the driver region), and may provide occupant detection and/or monitoring functions as part of an occupant monitoring system (OMS).
The mirror assembly may also include one or more infrared (IR) or near infrared light emitters 24 (such as IR or near-IR light emitting diodes (LEDs) or vertical-cavity surface-emitting lasers (VCSEL) or the like) disposed at the back plate 20 behind the reflective element 14 and emitting near infrared light through the aperture of the back plate and through the reflective element toward the head region of the driver of the vehicle. As shown in
Conventional driver monitoring systems (DMS) in likes of BMW, Ford, GM, Tesla, and Subaru vehicles (for example, for GM SuperCruise™ or for Ford's BlueCruise™ as described in https://www.consumerreports.org/car-safety/driver-monitoring-systems-ford-gm-earn-points-in-cr-tests-a6530426322) are “Two-Box” DMS in that (i) the camera used to monitor the driver's head/eyes and the near-IR emitting light sources that illuminate the driver's head/eyes are accommodated in a first box or module (that is usually located at the steering column of an equipped vehicle or in an overhead region of the equipped vehicle) and (ii) the electronics/software used to analyze captured image data to determine the driver's gaze direction or head position or eye movement or alertness or drowsiness is accommodated in a separate second box or module that is located remote from and at a distance from the first box and that connects to the first box typically via a wired connection (the second box typically comprises an ECU that can be part of a head unit of the equipped vehicle and that besides DMS, optionally can provide other features).
Referring now to
The vehicle wire harness also receives outputs/data from the one-box interior rearview mirror assembly DMS, such outputs used for various features, systems and functions of the equipped vehicle. The outputs/data from the one-box interior DMS rearview mirror assembly include data related to head position of a driver of the equipped vehicle, eye gaze direction of the driver of the equipped vehicle, hand position of the driver of the equipped vehicle, drowsiness of the driver of the equipped vehicle, attentiveness of the driver of the equipped vehicle etc., along with other outputs/data relating to some (and preferably all) of the following:
The interior DMS rearview mirror assembly provides a stand-alone One-Box DMS solution that has the camera/illumination near-IR sources/DMS software and its associated data processing chip(s)/automatic dimming circuitry/circuitry used to control an exterior electrochromic mirror reflective element that is part of an exterior sideview mirror of the equipped vehicle/data processing circuitry/communication circuitry/memory/power supplies/associated electronics and hardware/heat sinks, etc. packaged into, integrated into and accommodated by a vehicular interior rearview mirror assembly, and preferably covertly integrated within the mirror head of the vehicular interior rearview mirror assembly behind (and rendered covert to a driver's view by) a transflective mirror reflective element of the vehicular interior rearview mirror assembly.
The interior rearview mirror thus has embedded cameras, IR illuminators and the processor for processing captured image data for the driver monitoring application. The inward facing camera 18 and IR illuminators 24 are fixed within the mirror head, and thus both components are coupled with the mirror body. Hence, the camera's field of view is subject to change from driver to driver as the mirror head is adjusted to set the driver's preferred rearward view.
In the illustrated embodiment of
As shown in
Optionally, the mirror back plate or attachment plate may be molded out of a metal filled injection moldable material (e.g., Stainless Steel (SS) fiber, such as a polycarbonate (PC) Acrylonitrile butadiene styrene (ABS) and SS fiber material) to provide electromagnetic interference (EMI) mitigation (EMC shield). Optionally, the heatsink may be formed via additive manufacturing (3D printing or the like) to provide an additive manufactured heatsink with capillary effect to help transfer heat more uniformly and away from high power components.
The near infrared light emitter 24 includes a circuit board or element 25 that is attached at the chassis 32 via a thermal adhesive, and is disposed at the aperture of the back plate, with an IR longpass filter 36 disposed between the reflective element and the near IR light emitter. The near IR light emitter 24 is disposed at a left side of the mirror head (as viewed by a driver of the vehicle with the mirror head installed at the vehicle) and is configured to illuminate the driver's head region of a left hand drive vehicle.
In the illustrated embodiment, the light emitter 24 has two sets of LEDs disposed on the circuit board. One set of LEDs 24a emits a wider beam of near infrared light when energized (e.g., four wider beam LEDs) and another set of LEDs 24b emits a narrower beam of near infrared light when energized (e.g., four narrower beam LEDs). The narrower beam LEDs may be powered or energized for the driver monitoring function, while the wider beam LEDs may be powered or energized for the occupant monitoring function (and may be episodically energized for illuminating particular frames of captured image data, such as by utilizing aspects of the systems described in International PCT Application No. PCT/US2022/070882, filed Mar. 1, 2022, which published on Sep. 9, 2022 as International Publication No. WO2022187805, which claims the filing benefits of U.S. provisional application Ser. No. 63/267,316, filed Jan. 31, 2022, U.S. provisional application Ser. No. 63/262,642, filed Oct. 18, 2021, U.S. provisional application Ser. No. 63/260,359, filed Aug. 18, 2021, U.S. provisional application Ser. No. 63/201,757, filed May 12, 2021, U.S. provisional application Ser. No. 63/201,371, filed Apr. 27, 2021, U.S. provisional application Ser. No. 63/200,451, filed Mar. 8, 2021, and U.S. provisional application Ser. No. 63/200,315, filed Mar. 1, 2021, which are all hereby incorporated herein by reference in their entireties).
The narrow beam LEDs 24b are angled or canted or biased (e.g., by ten degrees or thereabouts) toward the left and thus toward the driver of a left hand drive vehicle, while the wider beam LEDs 24a are not biased toward either side. When the mirror assembly is installed in a left hand drive vehicle (
Referring now to
Thus, the DMS light emitters are provided in a mirror assembly with two sets of narrow beam LEDs, one set that is for illuminating a driver of a left hand drive vehicle when the mirror assembly is installed in the left hand drive vehicle, and another set that is for illuminating a driver of a right hand drive vehicle when the mirror assembly is installed in the right hand drive vehicle. For example, and with reference to
Thus, when the mirror assembly is disposed in a left hand drive vehicle (
The light emitter is software enabled so that either the first or second narrow beam set of LEDs is enabled (for the driver monitoring function) depending on the type (left hand drive or right hand drive) of vehicle in which the mirror assembly is installed. Thus, when the mirror assembly is installed in a left hand drive vehicle, the first narrow beam set of LEDs is enabled (for the driver monitoring function) so that, when operating for the driver monitoring function, the first narrow beam set of LEDs is energized (and the second narrow beam set of LEDs is not enabled or energized). Alternatively, if the mirror assembly is installed in a right hand drive vehicle, the second narrow beam set of LEDs is enabled (for the driver monitoring function) so that, when operating for the driver monitoring function, the second narrow beam set of LEDs is energized (and the first narrow beam set of LEDs is not enabled or energized).
Although shown as having three sets of LEDs, each set having four individual LEDs, other LED (or other light emitter) arrangements and configurations are contemplated. For example, and with reference to
Optionally, and with reference to
Thus, the driver monitoring system may control the LED control circuit to enable and energize or electrically power the appropriate set of LEDs depending on the type of vehicle and depending on whether the system is capturing image data for the driver monitoring function or the occupant monitoring function. As shown in
Thus, when the mirror assembly is installed in a vehicle (typically at a vehicle assembly line) or installed as a replacement service part, and when the vehicle is powered, a signal or flag input is provided (e.g., via CAN bus signal or the like) to the electronic circuitry of the mirror assembly indicating that the vehicle is either a left hand drive vehicle or a right hand drive vehicle. Optionally, that signal may be provided at initial startup of the vehicle (after the mirror assembly is installed and the vehicle is assembled) or at each ignition cycle. Optionally, the signal may be provided when the mirror assembly is assembled (such as at the mirror assembly plant or mirror manufacturer) and designated for use in the left hand drive vehicle or right hand drive vehicle.
The electro-optic (such as electrochromic (EC)) mirror reflective element sub-assembly transmits near infrared light and reflects visible light. Thus, the mirror reflective element (i.e., a transflective mirror reflector of the mirror reflective element) effectively allows the IR emitters to emit light through the reflective element and allows the camera to ‘view’ through the mirror reflective element, while allowing the mirror reflective element to reflect at least some visible light incident thereat to serve its intended rear viewing purpose. The IR emitters may be activated responsive at least in part to an ambient light level within the vehicle cabin and at the driver's head region, with the light level being determined by a light sensor or by processing of image data captured by the driver monitoring camera. Although shown and described as being disposed behind the mirror reflective element and emitting light through and receiving light through the mirror reflective element, the light emitters and camera may be disposed at a lower region of the mirror head (with the mounting base attached at the interior portion of the left hand drive vehicle or the right hand drive vehicle) and below the mirror reflective element and movable in tandem with the mirror head.
Having the inward viewing driver monitoring camera in a pivotable rearview mirror head poses unique challenges pertaining to the camera's perspective. In order to account for changes in the camera's view when the mirror head is adjusted, the mirror's driver monitoring processor calculates the camera's location and angle within the vehicle based on the image data captured by the camera and processed by the processor. For example, the system may process image data captured by the driver monitoring camera to determine where particular features are located in the field of view of the camera (such as relative to a particular area of the field of view, such as a central region), and thus the driver monitoring system determines the position of the driver's head by the determined position or positions of particular fixed vehicle features, such as the rear windows, pillars, center console or the like, in the captured image data. The system may adjust processing of the image data captured by the camera to accommodate changes in location of the known or particular vehicle features. For example, if a nominal setting of the mirror has a particular feature a predetermined distance laterally and/or vertically from a center of the image data, if it is determined that the particular feature is shifted or offset to one side or the other from the predetermined distance location, the processor shifts or adjusts processing of captured image data to accommodate the lateral and/or vertical shift of the particular feature. Optionally, the field-of-view of the camera may be biased by offsetting/shifting the lens stack of the camera relative to the imager rather than physically aiming the whole Imager PCB and lens stack. Such shifting of the lens relative to the imager may utilize aspects of the systems described in U.S. Pat. Nos. 10,946,798 and/or 10,525,883, and/or U.S. patent application Ser. No. 17/650,255, filed Feb. 8, 2022, which published on Aug. 11, 2022 as U.S. Patent Publication No. US-2022-0254132, and/or U.S. provisional application Ser. No. 63/201,894, filed May 18, 2021, which are all hereby incorporated herein by reference in their entireties.
The driver monitoring system may provide the ability for the algorithms/camera to determine if the driver has the mirror aimed properly (for providing an acceptable rearward view to the particular driver). Such determination may be made by determining (via processing of image data captured by the camera) the presence and position of (i) the driver's face in a given frame, (ii) adequate light in a given frame relative the driver's head mass, or (iii) the rear window and/or other fixed vehicle features (e.g., D pillars or head rests or the like) in the field of view of the camera. If the system determines that the mirror is aimed improperly, the algorithms may trigger the vehicle to alert the driver of improper use of the interior rearview mirror (such as via an audible alert, or such as via a visual alert, such as an indicator light or display on a display screen, or such as via a haptic alert). Optionally, the mirror may include an actuator that may adjust the mirror head toward a nominal or optimal orientation for the particular driver responsive to determining that the mirror head is aimed improperly for that driver.
Optionally, and to reduce stray light or glare at the camera, the mirror head may include a stray light limiting or blocking mechanism. In a DMS/OMS mirror head, the camera lens and the light emitters are closely placed. The camera has wide angle field of view such as, for example, a horizontal field of view 140 degrees and a diagonal field of view of close to 180 degrees. Stray light emitted by the light emitters may leak into the camera lens directly or through reflections from the cover glass or prism glass or EC mirror glass surfaces and create glare/ghost in the captured images. The stray light blocking mechanism is disposed between the camera lens and the glass surface in front of the lens. As shown in
Optionally, the DMS camera may be used to detect ambient light and/or glare light (emanating from headlamps of a trailing vehicle) for use in providing auto-dimming of the EC mirror reflective element. The DMS camera may be disposed in the mirror head and viewing rearward through the mirror reflective element (optionally, the DMS camera may be disposed in the mirror head at a location above or below or sideward of the mirror reflective element). The processing of image data captured by the DMS camera may be adjusted to accommodate the angle of the mirror head so that the ECU or system, via image processing of image data captured by the DMS camera, determines headlamps of a trailing vehicle (behind the equipped vehicle and traveling in the same direction as the equipped vehicle and traveling in the same traffic lane or in an adjacent traffic lane) to determine glare light at the mirror reflective element. The processing of image data captured by the DMS camera is adjusted to accommodate the degree of dimming of the mirror reflective element. For example, the system knows how much the mirror reflective element is dimmed (responsive to the determined glare light intensity and location) and can accommodate for the mirror dimming level when processing captured image data to determine presence and intensity of light sources/headlamps rearward of the vehicle. The intelligent/automatic mirror dimming functions may utilize aspects of the systems described in U.S. Publication Nos. US-2019-0258131 and/or US-2019-0047475, and/or International PCT Application No. PCT/US2022/070062, filed Jan. 6, 2022 and published Jul. 14, 2022 as International Publication No. WO 2022/150826, which are all hereby incorporated herein by reference in their entireties.
Optionally, and particularly for prismatic mirror applications (see
Optionally, a coating, such as an anti-reflective coating, may be disposed at the first surface to reduce the reflections and promote more light exiting the prism glass or higher transmission by utilizing phase changes. Such anti-reflection coatings reduce the light loss and make use of phase changes and the dependence of the reflectivity on the index of refraction of the glass mirror substrate. The anti-reflection coatings create a double interface via a thin film that provides two reflected waves. If the waves are out of phase the at least partially cancel. For example, the coating may have a quarter wavelength thickness and the coating may have an index of refraction of less than that of the glass mirror substrate, such that the two reflections will be 180 degrees out of phase and will cancel each other out.
Optionally, in order to mitigate electromagnetic interference (EMI) of the electronics within the interior rearview mirror assembly and to limit component count, the mirror glass attachment plate (which provides stability and structure for the mirror glass) may also function as one half or portion of a Faraday cage around the electronics in the mirror head. For example, and such as shown in
The attachment plate 420 comprises an EMI mirror attachment plate (which may comprise a polycarbonate (PC) Acrylonitrile butadiene styrene (ABS) and stainless steel (SS) fiber material) that interfaces with the aluminum heatsink 432 (which acts as the other half or portion of the Faraday cage). In the illustrated embodiment, the mirror attachment plate interfaces with the heatsink in a tongue and groove fashion where a peripheral lip 432a of the heatsink 432 is received in a peripheral groove or channel or receiving portion 420a of the attachment plate 420 to join and secure or retain the heatsink 432 at the attachment plate 420 (optionally, a lip of the attachment plate could be received in a groove or channel or receiving portion of the heatsink). The PC ABS+SS fiber material mirror attachment plate construction may reduce overall mass and cost. Optionally, the attachment plate may comprise other suitable materials, such as, for example, aluminum or the like.
The Faraday cage is electrically grounded by one or more spring fingers or flexible metallic or electrically conductive element at the ECU that contact the heatsink when the heatsink is attached at the mirror attachment plate (or the heatsink may have flexible electrically conductive elements that contact the ECU when the heatsink is attached at the mirror attachment plate). The heatsink grounds the EMI attachment plate through a set of metal fasteners 431 (e.g., threaded fasteners, such as screws or the like), which attach and retain the heatsink at the EMI attachment plate. Thus, the mirror attachment plate and the heatsink element function as a Faraday cage that surrounds the camera 418 and light emitter(s) 424 and printed circuit board(s) 430 of the mirror head to reduce or mitigate EMI of the electronics within the mirror head of the interior rearview mirror assembly. The PC/ASA+SS Fiber attachment plate is electrically decoupled from the electronics to limit or avoid the material acting as an EMI material whether grounded or not.
Optionally, the ECU of the vehicle or other system of the vehicle or the DMS/OMS system may utilize signals from DMS/OMS camera or system to determine if a driver or a passenger is reaching for the infotainment system controls of the vehicle (e.g., reaching toward a center touch screen display of the vehicle). Using this information, and responsive to the vehicle's state (e.g., whether the vehicle is moving or in drive or reverse gear or propulsion, or is in park or off, etc.) the system can determine if the inputs to the infotainment system should be allowed. This allows the system to determine when the passenger is accessing the touch screen or infotainment system so that the system can allow the passenger to safely use all the functions of the infotainment system while the vehicle is being driven by the driver, whereas the driver may have limited inputs to prevent distraction (i.e., the system may deactivate some or all of the infotainment inputs when it determines that the driver is accessing the inputs while the vehicle is reversing or moving forward at a speed greater than a threshold speed).
Optionally, using information gathered by the OMS disposed in the interior rearview mirror assembly, such as information pertaining to whether or not one or more occupants are present in the vehicle, a parametric/directional speaker system can be activated to (i) give the driver a private hands-free calling feature and/or (ii) provide a personalized audio experience. For example, if the system determines that there are is an occupant present in the vehicle, the system may provide a calling feature that allows for the driver to take part in a phone conversation that the occupant or occupants cannot hear (i.e., the audio system is adapted so that the speaker for the phone call is directed to the driver only and optionally other speakers of the vehicle are directed to the occupant and emit sound waves that cancel out the sound from the driver's speaker, such as by utilizing aspects of the systems described in U.S. Pat. No. 9,800,983, which is hereby incorporated herein by reference in its entirety). Optionally, the system may provide a personalized audio experience (by tailoring the outputs of the vehicle speakers to provide sound to the individual occupant and not others), such as responsive to a user input provided by the occupant (e.g., via the vehicle touch screen selection or via the occupant's smart phone that is BLUETOOTH® connected or otherwise connected to the vehicle system).
Optionally, the DMS camera or system may be operated or used in conjunction with a garage door opening system of the vehicle. For example, using the DMS camera disposed behind the mirror reflective element and viewing through the mirror reflective element (or using a DMS camera disposed elsewhere in the vehicle cabin), image data captured by the camera may be processed (such as via an algorithm of the system) to determine if the driver/passenger is holding up a one, two or three fingers with their hand or hands. With this information, the system can trigger the garage door opener module (which may also be packaged inside the mirror head or mirror assembly) to transmit a signal to a garage door opener to open or close the garage door. Depending on the proximity of the garage door opener module/vehicle to the garage door opener (antenna/receiver distance), the gesture may or may not be successful in opening the garage door. By utilizing the camera and driver/passenger gestures to actuate the garage door opener system or module, the system saves packaging space by not requiring the human interface buttons in the mirror—which are commonly used to interface with the garage door opening system or module of the vehicle. The system may utilize aspects of the garage door opener systems described in U.S. Pat. Nos. 11,046,251; 10,864,865; 10,189,411; 7,023,322 and/or 6,362,771, which are hereby incorporated herein by reference in their entireties.
Optionally, the camera (and associated illumination source) may be disposed outside of the mirror assembly, such as at an instrument cluster, overhead console, or A-pillar of the vehicle. A camera monitoring system (CMS) video display screen is typically located at a lower region of the A-pillar or at the dashboard outer section for optimized viewing by the driver of the vehicle. The selected position for the driver monitoring camera including its illumination source and camera mirror display is a trade-off between visibility of the driver, thermal considerations, packaging concept, and interior design. Typically, the available space is very restricted. Wire harness routing for power supply and video signals must be considered as well.
Optionally, the camera (and associated illumination source) may be disposed at the CMS video display screen. For example, and with reference to
The driver monitoring camera and the illumination source thus may be integrated at the housing or bezel of the driver side mounted camera mirror display. The location and integration of the camera at the video display screen may be similar to integration such as video-conferencing-cameras on smartphones, tablets or laptops. By locating the DMS/OMS cameras at the respective CMS display screens, the system provides seamless integration of the camera and illumination source and optimal facing relative to the driver's eye-box and head location, since good relative position, visibility and aim between driver and camera/display is required for both products (display and camera). The system also provides an overall reduction of the vehicle wire harness, since the same routing can be used for both products, particularly if all of the processing is performed at a central domain controller or central ECU. Because the display emits visible light, the display provides additional illumination of the driver body and face for better visibility of the visible light spectrum of the driver monitoring camera (which typically uses a combination of visible and infrared light sensitive pixels).
Optionally, the driver monitoring system may control one or more systems responsive to monitoring of the driver and/or occupant of the vehicle. For example, the system may process image data captured by the DMS camera to determine whether or not the driver is looking at an infotainment center or screen in the vehicle. Responsive to determining that the driver is viewing the infotainment center or screen, the system may lock out driver access and use of the infotainment system, while allowing a passenger to access the infotainment center or screen and use the infotainment system. The system may, for example, determine that the driver is looking at the screen, and determine whether the driver's hand is moving toward the screen or if a passenger's hand is moving toward the screen. If the system determines that the driver is looking at the screen and trying to use the infotainment center or screen, the system locks it out. However, if the system determines that the occupant (non-driver) is trying to use the infotainment center or screen, the system does not lock it out and allows the passenger to use the infotainment system.
Thus, a One-Box DMS Interior Rearview Mirror Assembly comprises a plurality of near-IR light emitting sources. The near-IR light sources may comprise a plurality of near-IR light emitting diodes (LEDs) or near-IR emitting vertical-cavity surface-emitting lasers (VCSEL), such as a bank or cluster or set of light sources such as LEDs or VCSEL lasers. The near-IR light sources include a first wide field of view (wFOV) light source, a second narrow field of view (nFOV) light source to one side of the wFOV light source, and a third nFOV light source to the other side of the wFOV light source. The terms “nFOV” and “wFOV” as used herein refer to the field of illumination, or field of view or directivity or full width at half maximum (FWHM) or beam angle at 50% intensity of the respective nFOV light sources and wFOV light source.
A bank or cluster or set of two (or more) narrow field of view (nFOV) near-IR emitting LEDs (which may be horizontally or vertically arranged, or that can be arranged in a matrix of rows and columns or otherwise arranged) is disposed within (or at least partially surrounded by) a near-IR light reflector (e.g., a 14.1 mm×6.92 mm×6.5 mm reflector, such as available from CoreLED Systems, LLC, of Livonia, MI) on a first rigid PCB that board-to-board connects via a flexible multiwire planar ribbon cable (comprising a plurality of individual conducting wires, such as, for example, four wires, lying flat and parallel to one another) connection to a second rigid PCB. A bank or cluster or set of two (or more) wide field of view (wFOV) near-IR emitting LEDs (which may be horizontally or vertically arranged, or that can be arranged in a matrix of rows and columns or otherwise arranged) is disposed on the second rigid PCB. The second rigid PCB connects via a flexible multiwire planar ribbon cable (comprising a plurality of individual conducting wires lying flat and parallel to one another) connection to a third rigid PCB. A bank or cluster or set of two (or more) narrow field of view (nFOV) near-IR emitting LEDs (which may be horizontally or vertically arranged, or that can be arranged in a matrix of rows and columns or otherwise arranged) is disposed within a reflector on the third rigid PCB. The third rigid PCB comprises a flexible multiwire planar ribbon cable that terminates in an electrical connector that connects with a corresponding electrical connector of the PCB of ECU 6. Although shown in some Figures as a set of three near-IR light emitting light sources (an LHD nFOV light source, a wFOV light source, and a RHD nFOV light source) on individual rigid PCBs interconnected via flexible ribbon connection, other disposition of the respective illumination sources in the mirror head is contemplated. For example, all the light sources could be on one PCB, or two banks of light sources may be on one PCB and one bank of light sources may be on another PCB, etc. The reflectors may comprise stamped polished about 0.01 inch thick 260½ hard temper brass that may be post tin plated (e.g., at 5 microns Sn over Cu flash), or other suitable near-IR light reflecting material (such as aluminum) that may be surface mounted/soldered at the respective LED PCBs to guide or direct or concentrate or collimate the near-IR light emitted by the respective LEDs toward the appropriate driver or passenger region or cabin region in the vehicle.
As shown in
The illuminator electrical driver drives the LEDs and functions to prevent a surge (e.g., 2.3A surge) on the power supply from the vehicle by storing energy in a capacitor (see the exemplary schematic of the illuminator driver of
The One-Box DMS Interior Rearview Mirror Assembly includes filters at the LEDs to attenuate or block visible light. For example, the LED filters may comprise a Luminate™ 7276F visible opaque compound that is black and that blocks or filters light from 200-860 nm, and allows transmittance of light greater than 990 nm. The filters comprise a ready-to-mold thermoplastic that has an appearance of black polycarbonate pellets. The target transmittance values are 5% at 875 nm, 50% at 910 nm, 80% at 986 nm, and 85% at 1000 nm. The filters are molded into a rectangular plate or, as desired, into another shape. The plate thickness that transmits the near-IR at 940 nm is at least 0.5 mm thick in its thickness dimension, more preferable is at least 1 mm thick and most preferable is at least 1.25 mm thick, but is preferably less than 6 mm thick, more preferable is less than 4 mm thick and most preferable is less than 2.5 mm thick. For example, the filter may be 63.02 mm wide×23.6 mm tall×1.3 mm thick. The LED filters enhance covertness of the system by limiting visible light to avoid any visible light that may be emitted by the near-IR emitting LEDs from being visible through the mirror reflective element (and thus reduces or avoids LED red glow being visible at the mirror reflective element when the LEDs are powered). The LED filters also block or limit incursion of ambient cabin light into the mirror head at the locations where the LEDs view through the EC Cell to see into the vehicle cabin.
The One-Box DMS Interior Rearview Mirror Assembly also includes an IR blocking filter in front of the EC glare sensor. The IR blocking filter at the EC glare sensor blocks a percentage of IR light from reaching the EC glare sensor. The EC glare sensor IR blocking filter may be 17.28 mm wide×11.85 mm tall×1.02 mm thick.
During operation of the One-Box DMS Interior Rearview Mirror Assembly, the circuitry ECU controls the LEDs and camera. For example, the camera may capture image data at a frame capture rate of 60 frames per second (fps), and the LHD n-FOV LEDs, the w-FOV LEDs and the RHD n-FOV LEDs are pulse width modulated so that some frames of the captured image data are captured when some or all of the LEDs are powered. During DMS operation (and, for example, every other frame of image data), the LHD n-FOV LEDs and the w-FOV LEDs are pulsed on, and during OMS operation (and, for example, every tenth frame of image data), all of the LHD n-FOV LEDs, the w-FOV LEDs and the RHD n-FOV LEDs are pulsed on (such as by utilizing aspects of the DMS mirrors described in International PCT Application No. PCT/US2022/070882, filed Mar. 1, 2022, which published on Sep. 9, 2022 as International Publication No. WO 2022187805, which is hereby incorporated herein by reference in its entirety).
Cameras for likes of security applications typically concomitantly use near-IR floodlighting at around 850 nm IR. However, sensitivity of such conventional cameras decreases at longer wavelengths in the near-IR spectral region. Thus such conventional security cameras are not as sensitive to 940 nm light as they are to 850 nm light; such conventional security cameras can have 50% less range using 940 nm near-IR illuminators compared to when 850 nm near-IR illuminators are used. Moreover, although 850 nm IR is largely not visible to the human eye as “light”, a slight red glow at the LED light source can be perceived. For the in-cabin DMS and ODS, used of 940 nm near-IR illumination is preferred, and especially when the in-mirror camera has a Quantum Efficiency at 940 nm of at least 15%. Compared to illumination at 850 nm, any “red glow” perceivable by the human eye using 940 nm illumination is less, and thus covertness of the near-IR emitting light sources within the mirror head emitting through the mirror transflector is enhanced. Furthermore, water absorbs 940 nm near-IR light, and thus solar radiation exhibits a dip at 940 nm in its irradiation spectrum due to moisture in the atmosphere. Therefore, ambient solar lighting present in the cabin (and especially when driving on a sunny day in a convertible car with the top down) has a dip or valley at 940 nm which reduces any propensity of ambient solar lighting present in the cabin of the vehicle to interfere with DMS/ODS functionality.
The combination of nFOV and wFOV light sources allows the system to meet the illumination requirements for LHD and RHD vehicles by utilizing the different groups. For a LHD vehicle, the LHD nFOV and wFOV LEDs are the primary sources for Driver Monitoring, while the LHD nFOV, the wFOV, and the RHD nFOV LEDs are all used for Occupancy Monitoring to detect front and rear seat passengers, children in child seats, etc.
Irradiance (the radiant flux received by a surface per unit area) at the driver's head (and especially at the driver's eyes for drowsiness detection) is important, and especially during nighttime driving when the interior cabin is dark and where the DMS camera in the mirror head principally relies on near-IR illumination emitted by the near-IR light sources in the mirror head. A near-IR irradiance at the likes of the driver's eyes of at least 1 W/m2 is preferred, with at least 1.8 W/m2 more preferred and at least 2.5 W/m2 most preferred (especially within the 99% eyellipse per SAE J194 for the particular driver seated in the driver's seat of a particular vehicle equipped with a One-Box DMS Interior Rearview Mirror Assembly), while a near-IR irradiance for occupancy detection at the likes of the front passenger-seat seating location of a front passenger of at least 0.15 W/m2 is preferred, with at least 0.25 W/m2 more preferred, and at least 0.4 W/m2 most preferred, and a near-IR irradiance for occupancy detection at the likes of the rear seats of at least 0.1 W/m2 is preferred, with at least 0.15 W/m2 more preferred, and at least 0.2 W/m2 most preferred.
The optical path of the light emitted by the LEDs and reflected by the reflector passes through the red glow filter and through the mirror reflective element to illuminate the driver head region, and reflects toward the camera, passing back through the mirror reflective element and the lens of the camera. The optical path (irradiance) of the narrow FOV (nFOV) LED at 100% LED power, is reduced so that only 74% is reaching the driver. However, as a worst-case scenario, the peak power has to be used. Thus, 178% LED Irradiance power needs to be used for the exposure limit. The irradiance is mostly proportional to the current running through the LED.
The camera views (and the LEDs illuminate) a driver head box or region. The forward vision, near-IR illumination and camera-to-eye visibility may be impacted with some visor positions (showing different sized drivers at different seating positions relative to the One-Box DMS Interior Rearview Mirror Assembly).
The DMS SoC disposed in the mirror head can sense its silicon die temperature and enter “throttle modes” if needed to reduce power output (and thus to reduce operating temperature). “Throttle modes” can include a reduction in algorithm feature sets computed, and/or a reduction in SoC clock frequency, and a reduction in frame rate (60 fps to 30 fps for example). The EC PWM duty cycle and drive voltage can be changed to reduce power dissipation in the mirror. Cell gap can be reduced to allow for a lower drive current. IR power can be reduced as well. Use of an LC optical switch for a DMS/OMS single box version can reduce thermal issues. This reduces the required IR LED drive power. Fans, heat pipes, conductive thermal interface materials (TIMs) and alternative heatsink materials, such as copper, can be used to improve cooling. Heatsink fin design also plays a role in cooling ability.
For example, if the temperature is determined to be above a threshold level, the system may provide thermal management and can pull back or reduce processing operations occurring within the mirror head. The system may determine the temperature within the mirror head via an on board thermistor or external thermistor or via the LED drivers having a thermistor or via a processor within the mirror head having a thermistor. To protect the in-mirror head electronics and/or to avoid exacerbating the outer skin temperature of the mirror housing of the mirror head of a One-Box DMS Interior Rearview Mirror Assembly that has been parked in a high temp/sun loading situation causing the housing of the mirror head to be at 85 degrees Celsius or above, a variety of counter measures can be used. Based on the likes of the on-board thermistor temperature sensing capabilities of chips on the board and/or external thermistors, either for a temporary period (up to 1 minute, up to 5 minutes, up to 10 minutes, up to 15 minutes, etc.) and/or until the thermistor-detected temperature is reduced to below a threshold temperature, DMS operation may be temporarily reduced during that period of time. For example, the system may pulse the LEDs at a slower rate and/or may capture image data at a reduced frame rate, or may power the LEDs at a reduced power level (i.e., the system may de-rate the maximum intensity of the LEDs and/or de-rate the pulsing on and off of the LEDs and/or de-rate the image capture rates). Optionally, the system may output (such as via a CAN communication) a signal to turn on the vehicle's air conditioning. Optionally, if the temperature is above the threshold temperature, the system may provide an alert to the driver that the DMS/OMS functions are temporarily not operable.
During operation, frames of image data are captured by the DMS camera (e.g., at a frame capture rate of 30 fps or 60 fps), and the appropriate LEDs are pulsed on and off for respective frames of captured image data. The LEDs pulse rate is synchronized with the camera frame capture rate; i.e., the LEDs are only powered on (and emitting near-IR illumination) when the imager is exposed and is gathering energy. For example, if the camera captures frames of image data at 30 fps, each frame is about 33 ms in duration, but the imager is only exposed (and gathering light energy that photoelectrically converts incoming photons into electrons) for a portion of such time; for example, 4 ms of that time. The LEDs are electrically repetitively pulsed so that they are powered only during that 4 ms time period that coincides with when the imager is gathering energy (although the LEDs may be powered on for a slightly longer time period to ensure that the LEDs are powered throughout the time period at which the imager is exposed). This is a pulse duty cycle of around 12%. The LEDs are synchronized so that they are not powered on for the entire frame time (33 ms) to reduce their heat generation and enhance thermal management, and to avoid continually directing near-IR illumination into the driver's eyes or passenger's eyes for an extended period of time. For DMS and so as to facilitate videoconferencing and taking of selfies by the driver, the system uses the full color capability (RGB) of the DMS camera, so the system combines three (R, G, B) signals into a single signal or frame. For OMS, the system does not need color and can use the DMS camera as a monochromatic camera, with a concomitant enhancement of sensitivity to incident light by the camera. In terms of duty cycle pulsing of the near-IR sources (such as nFOV LEDs or wFOV LEDs) disposed within the mirror head, a duty cycle of at least 8% is preferred; a duty cycle of at least 10% is more preferred and a duty cycle of at least 12% is most preferred. However, for eye safety and to mitigate thermal load, a duty cycle of less than 40% is preferred; a duty cycle of less than 30% is more preferred and a duty cycle of less than 20% is most preferred.
Optionally, the system may reduce the powering of (current applied to) the LEDs during daytime operation and/or may vary or adjust the pulse duty cycle dynamically in accordance with the prevailing in-cabin conditions (such as time of day or night, or whether by day being driven on a sunny or a cloudy day or whether the equipped vehicle has just recently been started after heat soak on a summers day outdoor in the hot sunshine so that the interior mirror has reached a temperature of 60-80 degrees Celsius or higher). Optionally, the system may increase the powering (current applied) and/or vary or adjust the pulse duty cycle of the LEDs to view through a driver's spectacles and especially a driver's sunglasses.
Regarding the near-IR light sources housed within the interior cavity of the mirror head,
As shown in
in
The angle of the LHD nFOV near-IR illumination source (relative to the planar surface of the mirror reflective element) thus may be different than the angle of the RHD wFOV near-IR illumination source (relative to the planar surface of the mirror reflective element), and in opposite directions (i.e., the principal emission axis of the LHD nFOV near-IR illumination sources is angled toward the left side of the mirror head (and vehicle) and the principal emission axis of the RHD nFOV near-IR illumination sources is angled toward the right side of the mirror head (and vehicle)). Optionally, the angle of the LHD nFOV near-IR illumination source (relative to the planar surface of the mirror reflective element) may be the same as the angle of the RHD wFOV near-IR illumination source (relative to the planar surface of the mirror reflective element), but in a laterally opposite direction than the angle of the RHD wFOV near-IR illumination source. For example, the nFOV near-IR illumination sources may be at an angle relative to the planar surface of the mirror reflective element of between 5 degrees and 25 degrees, such as between 10 degrees and 20 degrees, such as, for example, 15 degrees, with principal emission axis of the LHD nFOV near-IR illumination sources angled toward the left side of the mirror head (and vehicle) and the principal emission axis of the RHD nFOV near-IR illumination sources angled toward the right side of the mirror head (and vehicle). In other words, the LHD nFOV near-IR illumination source may be at, for example, −15 degrees and the RHD nFOV near-IR illumination source may be at, for example, +15 degrees relative to the planar surface of the mirror reflective element.
The principal line of sight of the DMS camera passes perpendicularly through the planar front surface of the mirror reflective element disposed at the mirror head of the One-Box DMS Interior Rearview Mirror Assembly. The field of view of the centrally-located DMS camera includes the head/eyellipse driver's eyes region when the mirror head is adjusted by the driver when the One-Box DMS Interior Rearview Mirror Assembly is installed at either a LHD vehicle or a RHD vehicle. For a variety of reasons, including that the central region of the cavity of the mirror head is crowded by the likes of the DMS camera and the ball-and-socket pivot joint about which the mirror head moves when the driver adjusts the mirror in the equipped vehicle, the nFOV near-IR emitting light source intended to illuminate the head/eyellipse driver's eyes region is located within the mirror head at a distance d mm from a centerline that bisects the center of the length dimension of the mirror reflective element. As shown in
For an LHD application of the One-Box DMS Interior Rearview Mirror Assembly, as the dimension d increases (i.e., as the LHD nFOV near-IR emitting light source is located further away from the centerline of the mirror reflective element), the greater the angle that the principal emission axis of the LHD nFOV near-IR emitting light source must subtend relative to the plane of the planar front side/surface of the mirror reflective element in order to provide the line of illumination toward the driver of the LHD vehicle. However, for a RHD application of the One-Box DMS Interior Rearview Mirror Assembly, as the dimension d increases (i.e., as the RHD nFOV near-IR emitting light source is located further away from the centerline of the mirror reflective element), the lower the angle that the principal emission axis of the RHD nFOV near-IR emitting light source must subtend relative to the plane of the planar front side/surface of the mirror reflective element in order to provide the line of illumination toward the driver of the RHD vehicle. Thus, for applications where the One-Box DMS Interior Rearview Mirror Assembly is installed in a LHD vehicle, the LHD nFOV near-IR emitting light source is angled at, for example, about degrees relative to the planar front side/surface of the mirror reflective element, with a distance d (between the mirror centerline and the LHD nFOV near-IR emitting light source) of about 50 mm. For applications where the One-Box DMS Interior Rearview Mirror Assembly is installed in a RHD vehicle, the RHD nFOV near-IR emitting light source is angled at, for example, about 10 degrees relative to the planar front side/surface of the mirror reflective element, with a distance d (between the mirror centerline and the RHD nFOV near-IR emitting light source) of about 89 mm.
Thus, as the distance d increases, the respective angle of the LHD nFOV near-IR emitting light source (relative to the planar front side/surface of the mirror reflective element) increases, and the respective angle of the RHD nFOV near-IR emitting light source (relative to the planar front side/surface of the mirror reflective element) decreases.
As shown in
Thus,
As can be seen in
The illumination provided by the light sources meets the automotive safety requirements, including the Safety Goal 2 (ASIL B). The system shall be classified as exempt according to IEC 62471:2006. The system operates in a safe state, whereby the system shall emit no IR radiation.
As can be seen in
Thus, upon ignition-on and/or at start-up of the propulsion system (such as an engine in an internal combustion engine vehicle or an electric drive in an electric vehicle) of the equipped vehicle, the One-Box Interior DMS Rearview Mirror Assembly is powered. When powered, the DMS camera captures frames of image data at a frame capture rate of at least 15 fps, preferably at least 30 fps, more preferably at least 60 fps. During driving, the ECU of the One-Box Interior DMS Rearview Mirror Assembly is aware of whether the vehicle is being driven in left hand drive (LHD) country or in a right hand drive (RHD) country. This can be based on data provided by the equipped vehicle based on likes of the current geographic location of the equipped vehicle as determined by the like of a GPS system. Also, when the vehicle first leaves its vehicle assembly plant, the automaker involved will have the steering column at the left side of the front cabin region for a LHD vehicle and will have the steering column at the right side of the front cabin region for a RHD vehicle. When set for a left hand drive vehicle or a right hand drive vehicle/knowing where the vehicle is being driven, the image processing of the image data captured by the DMS camera is set to process image data representative of the driver region (e.g., the left hand front seat region for a left hand drive vehicle or the right hand front seat region for a right hand drive vehicle) for DMS frame capture, and the light sources are controlled or powered to provide enhanced illumination of the driver region for the DMS frame capture. The light sources of the One-Box Interior DMS Rearview Mirror Assembly in a preferred embodiment include a first set of light sources (the wFOV light source) disposed between a second set of light sources (e.g., the left hand (LH) light source) and a third set of light sources (e.g., the right hand (RH) light source).
For a left hand drive vehicle equipped with the One-Box Interior DMS Rearview Mirror Assembly, during capture of a DMS set of captured frames of image data (for a driver monitoring function), the LHD nFOV light source (preferably a plurality of near-IR emitting LEDs comprising at least two LEDs and more preferably comprising four or less LEDs) and the wFOV light source (preferably a plurality of near-IR emitting LEDs comprising at least two LEDs and more preferably comprising four or less LEDs) are energized. The illumination provided by the LHD nFOV light source and the wFOV light source combine to illuminate the head region of the driver (who is seated at the left side of the vehicle) with an irradiance of at least 1.25 W/m2, more preferably at least 1.8 W/m2 and most preferably at least 2.3 W/m2. The LHD nFOV near-IR light source has a narrow field of illumination cone/zone that encompasses/illuminates the driver's head-box region (and thus provides enhanced irradiance at the driver's face. The wFOV near IR light source is also energized during this capture of the DMS set of captured frames of image data for the driver monitoring function, but the LHD nFOV near-IR light source is not energized. This selective energizing of one but not the other of the LHD and RHD light sources (taking a LHD drive as illustrative where the LHD light source is energized but the RHD light source is not energized) avoids wastefully generating heat within the mirror head by energizing the RHD light source that contributes scant illumination of the driver sitting in the left-hand driver's seat. The wFOV light source however adds some level of irradiance to the driver's head box region and also illuminates the area where the driver's hands would be (the steering wheel, center console, etc.) and thus regardless of whether in a LHD or a RHD vehicle, the wFOV light source is energized all the time the vehicle is powered and operated. Thus, for DMS frame capture in a left hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will only power the LHD nFOV light source and the wFOV light source since these are the light sources that will illuminate the driver of the left hand drive vehicle. Light emitted by the RHD nFOV light source, when powered, does not cover in any significance any part of the LH driver so the RHD nFOV light source is not powered during DMS frame capture in a LHD vehicle. Of course in a RHD vehicle, this reverses. For DMS frame capture in a right hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will only power the RHD nFOV light source and the wFOV light source since these are the light sources that will illuminate the driver of the right hand drive vehicle.
For either a left hand drive vehicle or a right hand drive equipped with the One-Box Interior DMS Rearview Mirror Assembly, during capture of an OMS set of captured frames of image data (for an occupant monitoring function), all three sets of near-IR light sources (LHD nFOV and wFOV and RHD nFOV) are energized so that near-IR floodlighting within the vehicle cabin is maximized, and especially to illuminate likes of a second row of rear seats or even a third row of rear seats).
For the left hand drive vehicle equipped with the One-Box Interior DMS Rearview Mirror Assembly, during capture of an OMS set of captured frames of image data (for an occupant monitoring or occupant detection function), the LHD nFOV light source, the wFOV light source and the RHD nFOV light source (preferably a plurality of near-IR emitting LEDs comprising at least two LEDs and more preferably comprising four or less LEDs) are all energized. The illumination provided by the LHD nFOV light source, the wFOV light source and the RHD nFOV light source combine to illuminate the second row or rear seats and the passenger seat region with an irradiance of at least 0.1 W/m2, of preferably at least 0.15 W/m2, and more preferably at least 0.2 W/m2, and the illumination provided by the wFOV light source and the RHD nFOV light source combine to illuminate the front passenger seat region with an irradiance of at least 0.15 W/m2, of preferably at least 0.25 W/m2, and more preferably at least 0.4 W/m2.
Thus, for DMS frame capture in a left hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will only power the LHD nFOV light source and the wFOV light source since these are the light sources that will illuminate the driver of the left hand drive vehicle, and for OMS frame capture in the left hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will power the LHD nFOV light source, the wFOV light source and the RHD nFOV light source.
Similarly, for a right hand drive vehicle equipped with the One-Box Interior DMS Rearview Mirror Assembly, during capture of a DMS set of captured frames of image data (for a driver monitoring function), the RHD nFOV light source (preferably a plurality of near-IR emitting LEDs comprising at least two LEDs and more preferably comprising four or less LEDs) and the wFOV light source (preferably a plurality of near-IR emitting LEDs comprising at least two LEDs and more preferably comprising four or less LEDs) are energized. The illumination provided by the RHD nFOV light source and the wFOV light source combine to illuminate the head region of the driver (at the right side of the vehicle) with an irradiance of at least 1.25 W/m2, more preferably at least 1.8 W/m2 and most preferably at least 2.3 W/m2. The RHD nFOV light source has a narrow field of illumination cone that covers the driver's head box region (and thus provides enhanced irradiance at the driver's face without increasing the input power to the RHD nFOV light source, while also providing reduced heat generation in the system and reducing the number of LEDs needed), while the wFOV light source adds some level of irradiance to the driver's head box region but also illuminates the area where the driver's hands would be (the steering wheel, center console, etc.). Thus, for DMS frame capture in a right hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will only power the RHD nFOV light source and the wFOV light source since these are the light sources that will illuminate the driver of the right hand drive vehicle. Light emitted by the LHD nFOV light source, when powered, does not cover any part of the RH driver so the LHD nFOV light source is not powered during DMS frame capture.
For the right hand drive vehicle equipped with the One-Box Interior DMS Rearview Mirror Assembly, during capture of an OMS set of captured frames of image data (for an occupant monitoring or occupant detection function), the RHD nFOV light source, the wFOV light source and the LHD nFOV light source (preferably a plurality of near-IR emitting LEDs comprising at least two LEDs and more preferably comprising four or less LEDs) are all energized. The illumination provided by the RHD nFOV light source, the wFOV light source and the LHD nFOV light source combine to illuminate the second row or rear seats and the passenger seat region with an irradiance of at least 0.1 W/m2, of preferably at least 0.15 W/m2, and more preferably at least 0.2 W/m2, and the illumination provided by the wFOV light source and the LHD nFOV light source combine to illuminate the front passenger seat region with an irradiance of at least 0.15 W/m2, of preferably at least 0.25 W/m2, and more preferably at least 0.4 W/m2.
Thus, for DMS frame capture in a right hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will only power the RHD nFOV light source and the wFOV light source since these are the light sources that will illuminate the driver of the right hand drive vehicle, and for OMS frame capture in the right hand drive vehicle, the One-Box Interior DMS Rearview Mirror Assembly will power the RHD nFOV light source, the wFOV light source and the LHD nFOV light source.
The illumination protocols/scenarios described herein can be dynamic in that they can adjust to a current driving situation. For example, the illumination protocols can adjust for daytime/nighttime (by time of day or time of night) driving conditions; the illumination protocols can adjust responsive to a level of ambient cabin lighting, such as can occur on a sunny day vs cloudy day or at dawn or dusk; or the illumination protocols can adjust (such as for thermal management) to temporarily de-rate in-cabin illumination for a temporary limited period of time after ignition-on or start-up occurs when the vehicle has been parked out in the sun on a hot sunny day.
Whether the One-Box Interior DMS Rearview Mirror Assembly is disposed in a LHD vehicle or a RHD vehicle, the DMS camera, for purposes of occupancy detection, preferably has a field of illumination that covers the seating positions (front and rear) of occupants of the vehicle. Similarly, to provide near-IR floodlighting of such passengers seated in the interior cabin of the vehicle, the field of illumination by the wFOV near-IR illuminator, whether the One-Box Interior DMS Rearview Mirror Assembly is used in a LHD or a RHD vehicle, covers the seating positions (front and rear) of occupants of the vehicle. However, for DMS functionality, it is desirable that the driver's face/head/body is near-IR illuminated as intensely as possible. Thus, for a LHD vehicle, it is desirable to have the LHD nFOV near-IR illuminator directed toward the driver of the LHD vehicle, while for a RHD vehicle, it is desirable to have the RHD nFOV near-IR illuminator directed toward the driver of the RHD vehicle. Given that the central area of the DMS mirror head has limited space to accommodate the camera, a wFOV near-IR illuminator, an nFOV near-IR illuminator and the mirror pivot joint and similar/associated hardware, the nFOV near-IR illuminators, for practical reasons, are disposed to the left side of the camera or to the right side of the camera.
Thus, and such as shown in
Optionally, for practical reasons, such as manufacturing and packaging and cost reasons, it can be desirable to have the nFOV near-IR illuminators on one side (e.g., the left side) or the other side (e.g., the right side) of the camera centrally disposed in the mirror head or to have the LHD nFOV near-IR illuminator on one side (e.g., the left side) and the RHD nFOV near-IR illuminator on the other side (e.g., the right side). For example, and such as shown in
Optionally, the nFOV near-IR illuminators may be more centrally disposed in the mirror head (such as above or below the centrally located wFOV near-IR illuminator). For example, and such as shown in
Optionally, the wFOV near-IR illuminator may be centrally disposed (e.g., above or below the centrally disposed camera), and both nFOV near-IR illuminators may be disposed at one side or the other of the mirror head. For example, and such as shown in
In a vehicle (whether LHD or RHD), the driver grasps the mirror head to adjust what the interior mirror reflective element views so that the driver sees out the rear window of the equipped vehicle. The camera moves in tandem with movement of the mirror head by the driver. In so doing, the driver moves the mirror head to a position/orientation where the driver-monitoring camera within the mirror head is viewing the head of the driver.
The near-IR signal emitted by the LEDs is preferably at 940 nm wavelength so that it is more readily recognized by the DMS processor (there is a decrease in ambient solar light at that wavelength due to absorption of 940 nm light by water in the atmosphere). The DMS camera includes a filter that allows/passes that wavelength and attenuates other light. The camera will thus operate with an enhanced 940 nm signal, which enhances driver monitoring in situations where the driver is wearing sunglasses. The rest of the in-cabin light (i.e., the ambient light) is filtered so the camera focuses on the 940 nm wavelength and then avoids “seeing” reflection at sunglasses. The DMS function may provide dynamic camera control (increase or decrease exposure time or frame capture rate) and LED control (increase or decrease power to LEDs and/or increase or decrease on time) to accommodate changes in lighting and/or to accommodate driver sunglasses or the like.
The mirror reflector may comprise a stack of coatings specific to the needs related to three basic requirements: (i) reflect much of the visible light to prevent seeing details such as the camera behind the glass (this can also be stated as transmitting less than 25% of visible light, one way through the glass subassembly), (ii) transmit near infrared (NIR) that comes out from NIR LEDs behind the glass, reflects off occupants and comes back to the camera behind the glass (the goal for the coating is greater than 95% transmission at 940 nm wavelength) and (iii) control the color of reflected light incident at the mirror reflective element to be neutral or to the blue side for any manufacturing variance, avoiding red and green shifts. Also, due to fixed as well as variable costs, it is desirable to have the minimum number of layers in the coating as well as minimum total thickness of all layers.
Sodalime glass comprises a planar air-side separated from a tin-side by a thickness dimension of the glass plate or substrate. The glass plate is formed by moving molten glass across a bath of molten tin. As a consequence, the outer glass surface at the tin side of the float sodalime glass plate develops a layer that is rich in/impregnated by/mixed with tin (i.e., Sn) atoms. This tin-rich glass surface constitutes a SodaSn layer at the side/surface of the sodalime substrate.
A visible-light transmitting/visible-light reflecting/near-IR light transmitting transflective substrate suitable for use in One-Box Electrochromic Interior DMS Mirror Assembly is shown in
The transmittance properties and color plot of the transflector are shown in
Photopic visible light reflectivity (measured first-surface in accordance with SAE J964a which is the SAE Recommended Practice for determining total and specular reflectance for vehicular mirrors with flat and curved surfaces and for determining diffuse reflectance and haze for mirrors with a flat surface) for a transflector-coated glass substrate (such as the embodiment that is shown in
One-Box Electrochromic Interior DMS Mirror Assembly preferably comprises a two-substrate laminate-type EC mirror reflective element that has (i) a front glass planar substrate (with a first surface and a second surface that is separated from the first surface by a thickness dimension of the front glass substrate) and (ii) a rear glass planar substrate (with a third surface and a fourth surface that is separated from the third surface by a thickness dimension of the rear glass substrate). In the One-Box Electrochromic Interior DMS Mirror Assembly, the rear substrate comprises the transflective mirror substrate of
Note that in the likes of the alternating multi-layer stack of
The mirror transflector may include a silicon layer due to the high index of refraction (3.5 to 4) of Silicon (but its extinction coefficient is higher than for dielectrics such as NbO or TiO2 or SiO2). Optionally, the mirror transflector could use a layer of Germanium. The layers alternate a high index of refraction layer with a lower index of refraction layer to achieve the best match of transmittance and reflectance. The number of layers is reduced by using a layer of high index silicon or germanium. The layers have different refractive indices, and the amount of such difference relates to how many layers may be required to achieve the desired effect. Larger index differences between layers can lead to requiring less layers. The mirror transflector may use Niobium oxide instead of Titanium oxide because the sputter deposition rate for NbO/Nb2O5 is faster than the sputter deposition rate for TiO2.
The layers are sputter deposited onto the substrate used in the mirror reflective element using pressed oxide ceramic targets. The targets preferably are rotary targets (magnetron). In the vacuum chamber where the layers are deposited, the chamber may include a mixture of Oxygen and Argon. The layers preferably are sputtered via medium frequency (about 40 KHz) sputtering (MF sputtering). Twin rotary magnetrons preferably are used, with two targets side-by-side. A 40 KHz sine wave alternating voltage (positive and negative) is applied. The process may use two (or more) twin-targets per chamber. Silicon may be sputter deposited using a pure Silicon target.
The target optical design for the multi-layer stack is to have transmissivity of at least 20% T for visible light and at least 60% T for near-IR light, and to achieve this in the most economical and effective way. The number of layers and refractivity of layers and sputter rate of layers are balanced to economically achieve the desired effect. The process may utilize aspects of the processes described in U.S. Pat. No. 5,751,489, which is hereby incorporated herein by reference in its entirety.
Mid-frequency AC Sputtering (such as at 40 KHz) in a multi-station/multi-target in-line conveyorized-traylpallet vacuum deposition process is a preferred deposition technology for the dielectric High Index/Low Index film alternating coating layers that make up the multi-layer stack forming the mirror transflector of the mirror reflective element of the One-Box OMS Interior Rearview Mirror Assembly. Mid-frequency AC Sputtering (a.k.a. Medium AC Sputtering) is preferred over RF Sputtering for coating dielectrics because it operates in the kHz rather than MHz range and thus requires less sophisticated and less expensive power sources and is a process that is adaptable to large scale applications. MF or Mid-frequency AC power supplies cover a wide range of voltage outputs between 300 V to 1200 V—generally in the 25 to 300 kW range—at frequencies between 20 to 70 kHz with 40 kHz used most commonly. For forming likes of the Niobium Oxide or Silicon Dioxide layers of the multi-layer transflector, reactive sputtering preferably is used where a reactive gas (oxygen) is introduced into the plasma to form an oxide layer deposited onto the substrate being coated. In Mid-frequency AC Sputtering, two cathodes are used with an AC current switched back and forth between them which cleans the target surface with each reversal to reduce the charge build up on dielectrics that leads to arcing which can spew droplets into the plasma and prevent uniform thin film growth.
As the substrates are moved past the targets, the targets sputter deposit the materials onto the moving substrates. A carrier moving continuously at 1 meter/min under a sputtering target would deposit a film thickness of 25 nm. For ITO: NDDR is (10 nm·m/min)/(KW/m) with about 10 KW/m of target length maximum power density. Generally, for a constant deposition power level and dimensions, the rate of deposition of NbO is around 2.5 times greater than for likes of SiO2 or TiO2. Generally, for a constant deposition power level and dimensions, the rate of deposition of ITO is around 2 times greater than for NbO/Nb2O5 and is around 5 times greater than for likes of SiO2 or TiO2.
Combined with arc detection and suppression circuitry, MF or Mid-frequency AC Sputtering offers the advantages of improving process stability and increasing deposition rates as well as overcoming a problem faced when trying to reactively sputter a dielectric coating with DC sputtering in that the anode can become coated with an insulating coating. In the case of AC sputtering, the cathodes act as an anode every half cycle and provide a “clean” anode surface. Mid-frequency AC Sputtering for the multi-layer HI/LO index coatings for the mirror transflector of the mirror reflective element of the One-Box DIMS Interior Rearview Mirror Assembly preferably employs dual magnetrons to confine the electrons above the target and reduce arcing for process control. Optionally, either “Balanced” or “Unbalanced” magnetrons can be arranged side by side, tilted towards each other, or face to face.
As an alternative to in-line vacuum deposition, deposition of the various thin film dielectric coatings to form the multi-layer HL-stack mirror transflector can be deposited onto glass substrates in a batch vacuum deposition chamber. For example, a plurality of individual cut mirror-shaped glass substrates can be loaded into a planetary fixture in a vacuum deposition chamber. For deposition of, for example, Niobium Oxide and Silicon Oxide layers, a cylindrical vacuum chamber can be equipped with two (one for NbO and one for SiO2) twin Mid-Frequency AC Sputtering deposition targets that sputter the respective layers onto the glass substrates as the glass substrates are rotated past the sputtering targets in the vacuum chamber, such rotation enhancing uniformity of coating onto the plurality of substrates being coated. Alternatively, electron beam evaporation can be used with an electron beam evaporating the likes of Niobium Oxide and Silicon Oxide/Dioxide from individual crucibles in a multiple-crucible turret.
Optionally, the mirror reflective element may comprise a double laminate electrochromic mirror element or construction having a first glass substrate and a second glass substrate with a first electrochromic medium disposed therebetween, and a second electro-optic medium (e.g., an electrochromic medium, such as a solid polymer matrix or SPM) and a third glass substrate behind the second or rear glass substrate. The cold mirror coating visible reflection can be relaxed from the current 60%-67% reflectivity to more like 45% Reflection of visible light because the SPM can block more visible light with reduced effect on near-IR light. The second or rear SPM can be left dark and only cleared or undimmed when visible camera images are needed, which hides the camera behind the glass but allows it to be visible if and when desired. This system has advantages over using a liquid crystal shutter in the transmission of near-IR light. A higher percent of near-IR light can pass through SPM. Also, the range of transmission control for visible light is a much larger range and goes to clear. The LC shutter transmission for near-IR light is about 85% and the visible light range control is from 0% to 25% T. SPM near-IR light transmission is about 100% when clear, about 90% when dark, and SPM visible light transmission is about 100% when clear and about 30% when dark. Thus, the mirror reflective element thus may comprise glass-ITO-SPM-ITO-stack˜R45%-glass-ITO-SPM-ITO-glass.
Therefore, a vehicular driver monitoring system includes a vehicular interior rearview mirror assembly comprising a mirror head adjustably attached at a mounting base, the mounting base configured to attach at an interior portion of a vehicle. The mirror head comprises a mirror reflective element. A driver monitoring camera is accommodated by the mirror head, and the driver monitoring camera moves in tandem with the mirror head when, with the mounting base attached at the interior portion of the vehicle, the mirror head is adjusted relative to the mounting base to adjust a driver's rearward view. A near infrared light emitter is accommodated by the mirror head, and the near infrared light emitter moves in tandem with the mirror head when, with the mounting base attached at the interior portion of the vehicle, the mirror head is adjusted relative to the mounting base to adjust the driver's rearward view. The near infrared light emitter comprises at least a first light emitting element and a second light emitting element. The first light emitting element is oriented at the mirror head so that a beam of light emitted by the first light emitting element would be directed toward a driver's region of a left hand drive vehicle if the vehicular interior rearview mirror assembly were installed in the left hand drive vehicle and adjusted to provide the driver of the left hand drive vehicle a rearward view. The second light emitting element is oriented at the mirror head so that a beam of light emitted by the second light emitting element would be directed toward a driver's region of a right hand drive vehicle if the vehicular interior rearview mirror assembly were installed in the right hand drive vehicle and adjusted to provide the driver of the right hand drive vehicle a rearward view. Control circuitry is operable to enable the first light emitting element or the second light emitting element responsive to indication that the vehicular interior rearview mirror assembly is installed or will be installed in a left hand drive vehicle or a right hand drive vehicle.
The control circuitry may comprise a processor operable to process image data captured by the driver monitoring camera, and, with the mounting base attached at the interior portion of the left hand drive vehicle or the right hand drive vehicle, the processor processes image data captured by the driver monitoring camera to determine at least one selected from the group consisting of (i) driver attentiveness, (ii) driver drowsiness and (iii) driver gaze direction.
The driver monitoring camera and the near infrared light emitter are accommodated by the mirror head behind the mirror reflective element, and the driver monitoring camera views through the mirror reflective element and the near infrared light emitter emits near infrared light through the mirror reflective element.
The driver monitoring camera views through a transflective mirror reflector of the mirror reflective element, and the near infrared light emitter emits near infrared light that passes through the transflective mirror reflector of the mirror reflective element.
The near infrared light emitter may comprise at least one wider beam light emitting element, and the at least one wider beam light emitting element is activated when the driver monitoring camera captures image data for an occupant monitoring function. The first light emitting element is angled relative to the at least one wider beam light emitting element toward a left side of the vehicular interior rearview mirror assembly, and the second light emitting element is angled relative to the at least one wider beam light emitting element toward a right side of the vehicular interior rearview mirror assembly. The first light emitting element may be disposed at the left side of the at least one wider beam light emitting element, and the second light emitting element may be disposed at the right side of the at least one wider beam light emitting element. The first light emitting element may comprise at least two narrower beam light emitting diodes, and the second light emitting element may comprise at least two narrower beam light emitting diodes, and the narrower beam light emitting diodes emit a narrower beam of light, when energized, as compared to the beam of light emitted by the at least one wider beam light emitting element when energized.
The control circuitry may enable the first light emitting element responsive to indication that the vehicular interior rearview mirror assembly is installed in a left hand drive vehicle. The control circuitry may enable the first light emitting element responsive to indication that the vehicular interior rearview mirror assembly will be installed in a left hand drive vehicle.
The control circuitry may enable the second light emitting element responsive to indication that the vehicular interior rearview mirror assembly is installed in a right hand drive vehicle. The control circuitry may enable the second light emitting element responsive to indication that the vehicular interior rearview mirror assembly will be installed in a right hand drive vehicle.
The control circuitry enables the first light emitting element or the second light emitting element responsive to an input signal at a vehicle assembly plant where the vehicle is assembled.
The mirror reflective element is attached at a mirror attachment plate, and the driver monitoring camera and the near infrared light emitter are disposed behind the mirror attachment plate and are aligned with respective apertures through the mirror attachment plate. A heat dissipating element may be attached at the mirror attachment plate. The mirror attachment plate and the heat dissipating element may encase the driver monitoring camera, the near infrared light emitter, and the control circuitry and function to limit electromagnetic interference of the driver monitoring camera, the near infrared light emitter, and the control circuitry.
With the vehicular interior rearview mirror assembly installed in a left hand drive vehicle (so that the first near infrared light emitter is enabled for the driver monitoring function), and when the driver monitoring camera captures image data for the driver monitoring function, the first near infrared light emitter is electrically powered to emit light and the second near infrared light emitter is not electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the driver monitoring camera captures image data for an occupant monitoring function, the second near infrared light emitter is electrically powered to emit light, and the first near infrared light emitter may not be electrically powered to emit light.
With the vehicular interior rearview mirror assembly installed in a right hand drive vehicle (so that the second near infrared light emitter is enabled for the driver monitoring function), and when the driver monitoring camera captures image data for the driver monitoring function, the second near infrared light emitter is electrically powered to emit light and the first near infrared light emitter is not electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for an occupant monitoring function, the first near infrared light emitter is electrically powered to emit light, and the second near infrared light emitter may not be electrically powered to emit light.
Therefore, a vehicular driver monitoring system comprises a vehicular interior rearview mirror assembly comprising a mirror head adjustably attached at a mounting base, the mounting base configured to attach at an interior portion of a vehicle equipped with the vehicular driver monitoring system. The mirror head comprises a mirror reflective element. The mirror head accommodates electronic circuitry. A driver monitoring camera is accommodated by the mirror head, and the driver monitoring camera moves in tandem with the mirror head when, with the mounting base attached at the interior portion of the vehicle, the mirror head is adjusted relative to the mounting base to adjust a rearward view of a driver of the vehicle. A first near infrared light emitter and a second near infrared light emitter are accommodated within the mirror head. The first and second near infrared light emitters move in tandem with the mirror head when, with the mounting base attached at the interior portion of the vehicle, the mirror head is adjusted relative to the mounting base to adjust the driver's rearward view. The first near infrared light emitter is accommodated within the mirror head so that a beam of light emitted by the first near infrared light emitter is directed toward a driver's region of a left hand drive vehicle when the vehicular interior rearview mirror assembly is installed in the left hand drive vehicle and is adjusted by the driver of the vehicle to set the driver's rearward view. The second near infrared light emitter is accommodated within the mirror head so that a beam of light emitted by the second near infrared light emitter, when electrically powered to emit light, is directed toward a driver's region of a right hand drive vehicle when the vehicular interior rearview mirror assembly is installed in the right hand drive vehicle and is adjusted by the driver of the vehicle to set the driver's rearward view. When the vehicular interior rearview mirror assembly is installed or will be installed in a left hand drive vehicle, the first near infrared light emitter, when electrically powered to emit light, emits light for a driver monitoring function. When the vehicular interior rearview mirror assembly is installed or will be installed in a right hand drive vehicle, the second near infrared light emitter, when electrically powered to emit light, emits light for the driver monitoring function.
The electronic circuitry may comprise a processor operable to process image data captured by the driver monitoring camera, and wherein, with the mounting base attached at the interior portion of the left hand drive vehicle or the right hand drive vehicle, the processor processes image data captured by the driver monitoring camera to determine at least one selected from the group consisting of (i) driver attentiveness, (ii) driver drowsiness and (iii) driver gaze direction.
The driver monitoring camera and the first and second near infrared light emitters are accommodated by the mirror head behind the mirror reflective element, and the driver monitoring camera views through the mirror reflective element and the first and second near infrared light emitters, when electrically powered to emit light, emit near infrared light through the mirror reflective element. The driver monitoring camera may view through a transflective mirror reflector of the mirror reflective element, and the first and second near infrared light emitters, when electrically powered to emit light, emit near infrared light that may pass through the transflective mirror reflector of the mirror reflective element.
The mirror reflective element may comprise an electrochromic mirror reflective element having a front planar glass substrate and a rear planar glass substrate. The front planar glass substrate comprises a first planar glass surface separated from a second planar glass surface by a plate thickness dimension of the front planar glass substrate, and the rear planar glass substrate comprises a third planar glass surface separated from a fourth planar glass surface by a plate thickness dimension of the rear planar glass substrate. The second planar glass surface of the front planar glass substrate has a transparent electrically conductive coating disposed thereat, and the third planar glass surface of the rear planar glass substrate has the transflective mirror reflector disposed thereat. An electrochromic medium is disposed between and contacts the transparent electrically conductive coating disposed at the second planar glass surface of the front planar glass substrate and the transflective mirror reflector disposed at the third planar glass surface of the rear planar glass substrate.
The transflective mirror reflector may comprise alternating thin film layers of Nb2O5 and SiO2. The transflective mirror reflector may comprise no more than five layers of Nb2O5 and five layers of SiO2. The transflective mirror reflector may comprise a first layer of Nb2O5 having a physical thickness of 37.62 nm, a first layer of SiO2 having a physical thickness of 77.41 nm, a second layer of Nb2O5 having a physical thickness of 40.67 nm, a second layer of SiO2 having a physical thickness of 83.25 nm, a third layer of Nb2O5 having a physical thickness of 53.29 nm, a third layer of SiO2 having a physical thickness of 96.76 nm, a fourth layer of Nb2O5 having a physical thickness of 64.55 nm, a fourth layer of SiO2 having a physical thickness of 135.11 nm, a fifth layer of Nb2O5 having a physical thickness of 82.21 nm, a fifth layer of SiO2 having a physical thickness of 68.21 nm, and a layer of ITO having a physical thickness of 120 nm.
The mirror reflective element may comprise a prismatic mirror reflective element, and the prismatic mirror reflective element comprises a glass substrate, which has a wedge-shaped cross-section having a first planar glass surface separated from a second planar glass surface, and the plane of first planar glass surface slopes at an angle relative to the plane of the second planar glass surface. The second planar glass surface is an uncoated glass surface, and the transflective mirror reflector is disposed at the second planar glass surface of the glass substrate of the prismatic mirror reflective element.
The mirror head may comprise a stray light blocking element disposed between a lens of the driver monitoring camera and the mirror reflective element. The stray light blocking element circumscribes the lens and engages a rear surface of the mirror reflective element to block stray light from entering the lens. The stray light blocking element may comprise a cone-shaped element attached to the driver monitoring camera. The stray light blocking element may comprise a flexible cone-shaped element attached to the driver monitoring camera.
With the mounting base attached at the interior portion of the left hand drive vehicle or the right hand drive vehicle, the driver monitoring camera and the first and second near infrared light emitters may be disposed at a lower region of the mirror head and below the mirror reflective element.
The vehicular driver monitoring system may comprise at least one wider beam near infrared light emitter accommodated within the mirror head. The at least one wider beam near infrared light emitter is electrically powered to emit light when the driver monitoring camera captures image data for an occupant monitoring function.
The first near infrared light emitter may be angled relative to the at least one wider beam near infrared light emitter toward a left side of the vehicular interior rearview mirror assembly, and the second near infrared light emitter may be angled relative to the at least one wider beam near infrared light emitter toward a right side of the vehicular interior rearview mirror assembly. The first near infrared light emitter may be disposed at the left side of the at least one wider beam near infrared light emitter, and the second near infrared light emitter may be disposed at the right side of the at least one wider beam near infrared light emitter.
The first near infrared light emitter may comprise at least two narrower beam light emitting diodes, and the second near infrared light emitter may comprise at least two narrower beam light emitting diodes. The narrower beam light emitting diodes may emit a narrower beam of light, when electrically powered to emit light, as compared to the beam of light emitted by the at least one wider beam near infrared light emitter when electrically powered to emit light.
With the vehicular interior rearview mirror assembly installed in a left hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the first near infrared light emitter is electrically powered to emit light and the second near infrared light emitter is not electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the at least one wider beam near infrared light emitter may be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the at least one wider beam near infrared light emitter may not be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the driver monitoring camera captures image data for the occupant monitoring function, the second near infrared light emitter and the at least one wider beam near infrared light emitter may be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the driver monitoring camera captures image data for the occupant monitoring function, the first near infrared light emitter may also electrically powered to emit light.
With the vehicular interior rearview mirror assembly installed in a right hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the second near infrared light emitter is electrically powered to emit light and the first near infrared light emitter is not electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the at least one wider beam near infrared light emitter may be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the at least one wider beam near infrared light emitter may not be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for the occupant monitoring function, the first near infrared light emitter and the at least one wider beam near infrared light emitter may be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for the occupant monitoring function, the second near infrared light emitter may also electrically powered to emit light.
The electronic circuitry may enable the first near infrared light emitter for the driver monitoring function responsive to indication that the vehicular interior rearview mirror assembly is installed in or will be installed in a left hand drive vehicle, and the electronic circuitry may enable the second near infrared light emitter for the driver monitoring function responsive to indication that the vehicular interior rearview mirror assembly is installed in or will be installed in a right hand drive vehicle.
The electronic circuitry may enable the first near infrared light emitter for the driver monitoring function responsive to the indication indicating that the vehicular interior rearview mirror assembly is installed in a left hand drive vehicle. The indication may comprise an input provided to the electronic circuitry at a vehicle manufacturing facility where the vehicular interior rearview mirror assembly is installed in the left hand drive vehicle.
The electronic circuitry may enable the first near infrared light emitter for the driver monitoring function responsive to the indication indicating that the vehicular interior rearview mirror assembly will be installed in a left hand drive vehicle. The indication may comprise an input provided to the electronic circuitry at a mirror manufacturing facility where the vehicular interior rearview mirror assembly is assembled.
The electronic circuitry may enable the second near infrared light emitter for the driver monitoring function responsive to indication that the vehicular interior rearview mirror assembly is installed in a right hand drive vehicle. The indication may comprise an input provided to the electronic circuitry at a vehicle manufacturing facility where the vehicular interior rearview mirror assembly is installed in the right hand drive vehicle.
The electronic circuitry may enable the second near infrared light emitter for the driver monitoring function responsive to indication that the vehicular interior rearview mirror assembly will be installed in a right hand drive vehicle. The indication may comprise an input provided to the electronic circuitry at a mirror manufacturing facility where the vehicular interior rearview mirror assembly is manufactured.
The electronic circuitry may set the first near infrared light emitter or the second near infrared light emitter for the driver monitoring function responsive to an input signal at a vehicle assembly plant where the vehicular interior rearview mirror assembly is installed at the vehicle. The electronic circuitry may set the first near infrared light emitter or the second near infrared light emitter for the driver monitoring function responsive to an input signal at a mirror manufacturer assembly plant where the vehicular interior rearview mirror assembly is manufactured.
The interior portion of the vehicle may comprise a portion of a windshield of the vehicle at an in-cabin side of the windshield of the vehicle.
The vehicular driver monitoring system may comprise an occupant monitoring camera disposed at a display screen located at an A-pillar at a passenger side of the vehicle.
The mirror reflective element is attached at a mirror attachment plate, and the driver monitoring camera and the first and second near infrared light emitters may be disposed behind the mirror attachment plate and are aligned with respective apertures through the mirror attachment plate. The vehicular driver monitoring system may comprise a heat dissipating element attached at the mirror attachment plate. The mirror attachment plate and the heat dissipating element encase the driver monitoring camera, the first and second near infrared light emitters, and the electronic circuitry and function to limit electromagnetic interference of the driver monitoring camera, the first and second near infrared light emitters, and the electronic circuitry.
Image data captured by the driver monitoring camera may be used, with the mounting base attached at the interior portion of the vehicle, to determine when the driver attempts to use an infotainment system of the vehicle, and, responsive to determination that the driver is attempting use the infotainment system, and responsive to the vehicle being operated by the driver, the infotainment system does not respond to use by the driver of the infotainment system.
Image data captured by the driver monitoring camera may be processed to determine a driver gesture, and responsive to determination of a driver gesture, a garage door opener system of the vehicle is operated. The determined driver gesture may comprise the driver holding up one, two or three fingers.
The vehicular driver monitoring system may comprise a central near infrared light emitter accommodated within the mirror head and disposed between the first near infrared light emitter and the second near infrared light emitter. The first and second near infrared light emitters may be disposed at a right-side region of the mirror head. The first near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the first near infrared light emitter being at an angle of greater than 10 degrees and less than 30 degrees relative to a line perpendicular to the mirror reflective element. The first near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the first near infrared light emitter being at an angle of greater than 15 degrees and less than 25 degrees relative to a line perpendicular to the mirror reflective element. The second near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the second near infrared light emitter being at an angle of greater than 0 degrees and less than 20 degrees relative to a line perpendicular to the mirror reflective element. The second near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the second near infrared light emitter being at an angle of greater than 5 degrees and less than 15 degrees relative to a line perpendicular to the mirror reflective element.
The first and second near infrared light emitters may be disposed at a left-side region of the mirror head. The second near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the first near infrared light emitter being at an angle of greater than 10 degrees and less than 30 degrees relative to a line perpendicular to the mirror reflective element. The second near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the first near infrared light emitter being at an angle of greater than 15 degrees and less than 25 degrees relative to a line perpendicular to the mirror reflective element. The first near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the second near infrared light emitter being at an angle of greater than 0 degrees and less than 20 degrees relative to a line perpendicular to the mirror reflective element. The first near infrared light emitter may be angled relative to the mirror reflective element with a principal beam axis of light emitted by the second near infrared light emitter being at an angle of greater than 5 degrees and less than 15 degrees relative to a line perpendicular to the mirror reflective element.
When the vehicular driver monitoring system is operating in a driver monitoring mode, the first near infrared light emitter or the second near infrared light emitter may be operated to emit light toward the driver's region. When the vehicular driver monitoring system is operating in an occupant monitoring mode, the central near infrared light emitter and the second near infrared light emitter may be operated to emit light. Image data captured by the driver monitoring camera for occupant monitoring may be captured when the first near infrared light emitter, the central near infrared light emitter and the second near infrared light emitter are emitting light. Image data captured by the driver monitoring camera for driver monitoring may be captured when the first near infrared light emitter and the central near infrared light emitter are emitting light.
With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the vehicular driver monitoring system is operating in a driver monitoring mode, the first near infrared light emitter may be pulsed on and off at a first pulse rate. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the vehicular driver monitoring system is operating in the driver monitoring mode, the central near infrared light emitter may be pulsed on and off at the first pulse rate. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the vehicular driver monitoring system is operating in an occupant monitoring mode, the second near infrared light emitter may be pulsed on and off at a second pulse rate that is different than the first pulse rate. The second pulse rate may be half the first pulse rate. The driver monitoring camera may capture image data at a capture rate that corresponds with the first pulse rate.
With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the vehicular driver monitoring system is operating in a driver monitoring mode, the second near infrared light emitter may be pulsed on and off at a first pulse rate. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the vehicular driver monitoring system is operating in the driver monitoring mode, the central near infrared light emitter may be pulsed on and off at the first pulse rate. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the vehicular driver monitoring system is operating in an occupant monitoring mode, the first near infrared light emitter may be pulsed on and off at a second pulse rate that is different than the first pulse rate. The second pulse rate may be half the first pulse rate. The driver monitoring camera may capture image data at a capture rate that corresponds with the first pulse rate.
When the vehicular interior rearview mirror assembly is installed or will be installed in a left hand drive vehicle, the second near infrared light emitter may not be electrically powered to emit light for the driver monitoring function. When the vehicular interior rearview mirror assembly is installed or will be installed in a right hand drive vehicle, the first near infrared light emitter may not be electrically powered to emit light for the driver monitoring function.
With the vehicular interior rearview mirror assembly installed in a left hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the first near infrared light emitter may be electrically powered to emit light and the second near infrared light emitter may not be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the left hand drive vehicle, and when the driver monitoring camera captures image data for an occupant monitoring function, the second near infrared light emitter may be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for the occupant monitoring function, the first near infrared light emitter may be electrically powered to emit light.
With the vehicular interior rearview mirror assembly installed in a right hand drive vehicle, and when the driver monitoring camera captures image data for the driver monitoring function, the second near infrared light emitter may be electrically powered to emit light and the first near infrared light emitter may not be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for an occupant monitoring function, the first near infrared light emitter may be electrically powered to emit light. With the vehicular interior rearview mirror assembly installed in the right hand drive vehicle, and when the driver monitoring camera captures image data for the occupant monitoring function, the second near infrared light emitter may be electrically powered to emit light.
The driver monitoring system, including the cameras and processor, may utilize aspects of the systems described in U.S. Pat. Nos. 10,065,574; 10,017,114; 9,405,120 and/or 7,914,187, and/or U.S. Publication Nos. US-2021-0323473; US-2021-0291739; US-2020-0202151; US-2020-0143560; US-2017-0274906; US-2017-0217367; US-2016-0209647; US-2016-0137126; US-2015-0352953; US-2015-0296135; US-2015-0294169; US-2015-0232030; US-2015-0092042; US-2015-0022664; US-2015-0015710; US-2015-0009010 and/or US-2014-0336876, and/or U.S. patent application Ser. No. 17/650,255, filed Feb. 8, 2022, which published on Aug. 11, 2022 as U.S. Patent Publication No. US-2022-0254132, Ser. No. 17/649,723, filed Feb. 2, 2022, which published on Aug. 4, 2022 as U.S. Patent Publication No. US-2022-0242438, and/or Ser. No. 17/450,721, filed Oct. 13, 2021, now U.S. Pat. No. 11,518,401, and/or U.S. provisional application Ser. No. 63/260,359, filed Aug. 18, 2021, and/or U.S. provisional application Ser. No. 63/201,894, filed May 18, 2021, and/or International PCT Application No. PCT/US2022/070882, filed Mar. 1, 2022, which published on Sep. 9, 2022 as International Publication No. WO 2022187805, which are all hereby incorporated herein by reference in their entireties.
The mirror assembly may include a mirror actuator that positions the mirror head at a predetermined or preselected or determined orientation relative to the driver's head. The mirror assembly and/or mirror actuator may utilize aspects of the mirror systems described in U.S. Pat. Nos. 9,616,815; 7,722,199 and/or 6,698,905, which are hereby incorporated herein by reference in their entireties. The mirror assembly (such as the mounting base) may be mounted at the in-cabin side of the vehicle windshield or the mirror assembly may be located or attached elsewhere at the vehicle, such as at an overhead console or headliner of the vehicle or the like.
Optionally, the interior mirror assembly may comprise a dual-mode interior rearview video mirror that can switch from a traditional reflection mode to a live-video display mode, such as is by utilizing aspects of the mirror assemblies and systems described in U.S. Pat. Nos. 10,442,360; 10,421,404; 10,166,924 and/or 10,046,706, and/or U.S. Publication Nos. US-2021-0162926; US-2021-0155167; US-2020-0377022; US-2019-0258131; US-2019-0146297; US-2019-0118717 and/or US-2017-0355312, which are all hereby incorporated herein by reference in their entireties. The electrically operated actuator may provide the memory setting function and may also operate to adjust the mirror head between the reflection mode and video display mode, such as responsive to a user actuatable input in the vehicle or at the mirror assembly (e.g., a toggle or switch or button at the mirror head).
Optionally, the driver monitoring system may be integrated with a camera monitoring system (CMS) of the vehicle. The integrated vehicle system incorporates multiple inputs, such as from the inward viewing or driver monitoring camera and from the forward or outward viewing camera, as well as from a rearward viewing camera and sideward viewing cameras of the CMS, to provide the driver with unique collision mitigation capabilities based on full vehicle environment and driver awareness state. The image processing and detections and determinations are performed locally within the interior rearview mirror assembly and/or the overhead console region, depending on available space and electrical connections for the particular vehicle application.
The CMS cameras and system may utilize aspects of the systems described in U.S. Publication Nos. US-2021-0245662; US-2021-0162926; US-2021-0155167; US-2018-0134217 and/or US-2014-0285666, and/or International PCT Application No. PCT/US2022/070062, filed Jan. 6, 2022 and published Jul. 14, 2022 as International Publication No. WO 2022/150826, which are hereby incorporated herein by reference in their entireties. The connections between the cameras and the controller or PCB(s) and/or between the displays and the controllers or PCBs may be made via respective coaxial cables, which may provide power and control of the cameras (by the controller) and which may provide image data from the cameras to the controller, and which may provide video images from the controller to the display devices. The connections and communications may utilize aspects of the systems described in U.S. Pat. Nos. 10,264,219; 9,900,490 and/or 9,609,757, which are hereby incorporated herein by reference in their entireties.
The mirror reflective element may comprise a variable reflectance electro-optic mirror reflective element, such as an electrochromic mirror reflective element or a liquid crystal mirror reflective element. For example, the mirror reflective element may comprise a laminate construction variable reflectance electro-optic (such as electrochromic) reflective element assembly having a front glass substrate and a rear glass substrate with an electro-optic medium (such as electrochromic medium) sandwiched therebetween and bounded by a perimeter seal. The front substrate has a front or first surface (the surface that generally faces the driver of a vehicle when the mirror assembly is normally mounted at the vehicle) and a rear or second surface opposite the front surface, and the rear substrate has a front or third surface and a rear or fourth surface opposite the front surface, with the electro-optic medium disposed between the second surface and the third surface and bounded by the perimeter seal of the reflective element (such as is known in the electrochromic mirror art). The second surface has a transparent conductive coating established thereat (such as an indium tin oxide (ITO) layer, or a doped tin oxide layer or any other transparent electrically semi-conductive layer or coating or the like, such as indium cerium oxide (ICO), indium tungsten oxide (IWO), or indium oxide (10) layers or the like or a zinc oxide layer or coating, or a zinc oxide coating or the like doped with aluminum or other metallic materials, such as silver or gold or the like, or other oxides doped with a suitable metallic material or the like, or such as disclosed in U.S. Pat. No. 7,274,501, which is hereby incorporated herein by reference in its entirety), while the third surface has a metallic reflector coating (or multiple layers or coatings) established thereat. The front or third surface of the rear substrate may include one or more transparent semi-conductive layers (such as an ITO layer or the like), and one or more metallic electrically conductive layers (such as a layer of silver, aluminum, chromium or the like or an alloy thereof), and may include multiple layers such as disclosed in U.S. Pat. Nos. 7,274,501; 7,184,190 and/or 7,255,451, which are hereby incorporated herein by reference in their entireties.
The mirror reflector may comprise any suitable coatings or layers, such as a transflective coating or layer (that is partially transmissive of visible light and/or near infrared light and that is partially reflective of visible light), such as described in U.S. Pat. Nos. 7,626,749; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 6,690,268; 5,140,455; 6,178,034; 6,154,306; 6,002,511; 5,567,360; 5,525,264; 5,610,756; 5,406,414; 5,076,673; 5,073,012; 5,115,346; 5,724,187; 5,668,663; 5,910,854; 5,142,407 and/or 4,712,879, which are hereby incorporated herein by reference in their entireties, disposed at the front surface of the rear substrate (commonly referred to as the third surface of the reflective element) and opposing the electro-optic medium, such as an electrochromic medium disposed between the front and rear substrates and bounded by the perimeter seal. Optionally, the mirror reflector could be disposed at the rear surface of the rear substrate (commonly referred to as the fourth surface of the reflective element). The driver monitoring camera may be accommodated in the mirror head and view through the transflective mirror reflector toward the driver's head region and/or the near IR light emitter may be accommodated in the mirror head and emit light that passes through the transflective mirror reflector to illuminate the driver's head region. The transflective mirror reflector may be spectrally tuned so as to transmit or pass a particular spectral band of light (e.g., near infrared light) while reflecting other spectral bands of light (e.g., visible light). The camera may be sensitive to near infrared light, such that the near IR light emitter can emit near IR light that passes through the transflective mirror reflector and the camera may be sensitive to the near IR light that reflects off of the driver's head and passes back through the transflective mirror reflector.
The third surface defines the active EC area or surface of the rear substrate within the perimeter seal. The coated third surface may also be coated to define a tab-out region (such as by utilizing aspects of the mirror assemblies described in U.S. Pat. Nos. 7,274,501; 7,184,190 and/or 7,255,451, which are hereby incorporated herein by reference in their entireties) for providing electrical connection of the conductive layers to an electrical clip of connector or bus-bar, such as the types described in U.S. Pat. Nos. 5,066,112 and 6,449,082, which are hereby incorporated herein by reference in their entireties.
The reflective element and mirror casing are adjustable relative to a base portion or mounting assembly to adjust the driver's rearward ‘view when the mirror assembly is normally mounted at or in the vehicle. The mounting assembly may comprise a single-ball or single-pivot mounting assembly, whereby the reflective element and casing are adjustable relative to the vehicle windshield (or other interior portion of the vehicle) about a single pivot joint, or the mounting assembly may comprise other types of mounting configurations, such as a double-ball or double-pivot mounting configuration or the like. The socket or pivot element is configured to receive a ball member of the base portion, such as for a single pivot or single ball mounting structure or a double pivot or double ball mounting structure or the like (such as a pivot mounting assembly of the types described in U.S. Pat. Nos. 6,318,870; 6,593,565; 6,690,268; 6,540,193; 4,936,533; 5,820,097; 7,249,860; 6,877,709; 6,329,925; 7,289,037; 7,249,860 and/or 6,483,438, which are hereby incorporated herein by reference in their entireties).
The mirror assembly may comprise any suitable construction, such as, for example, a mirror assembly with the reflective element being nested in the mirror casing and with a bezel portion that circumscribes a perimeter region of the front surface of the reflective element, or with the mirror casing having a curved or beveled perimeter edge around the reflective element and with no overlap onto the front surface of the reflective element (such as by utilizing aspects of the mirror assemblies described in U.S. Pat. Nos. 7,184,190; 7,274,501; 7,255,451; 7,289,037; 7,360,932; 7,626,749; 8,049,640; 8,277,059 and/or 8,529,108, which are hereby incorporated herein by reference in their entireties) or such as a mirror assembly having a rear substrate of an electro-optic or electrochromic reflective element nested in the mirror casing, and with the front substrate having curved or beveled perimeter edges, or such as a mirror assembly having a prismatic reflective element that is disposed at an outer perimeter edge of the mirror casing and with the prismatic substrate having curved or beveled perimeter edges, such as described in U.S. Pat. Nos. 8,508,831; 8,730,553; 9,598,016 and/or 9,346,403, and/or U.S. Publication Nos. US-2014-0313563 and/or US-2015-0097955, which are hereby incorporated herein by reference in their entireties (and with electrochromic and prismatic mirrors of such construction are commercially available from the assignee of this application under the trade name INFINITY™ mirror). Optionally, the mirror reflective element may comprise a variable reflectivity liquid crystal (VRLC) reflective element, such as by utilizing aspects of the mirror assemblies described in U.S. provisional application Ser. No. 63/201,891, filed May 18, 2021, which is hereby incorporated herein by reference in its entirety.
Optionally, the mirror casing may include a bezel portion that circumscribes a perimeter region of the front surface of the reflective element, or the perimeter region of the front surface of the reflective element may be exposed (such as by utilizing aspects of the mirror reflective elements described in U.S. Pat. Nos. 8,508,831 and/or 8,730,553, and/or U.S. Publication Nos. US-2014-0022390; US-2014-0293169 and/or US-2015-0097955, which are hereby incorporated herein by reference in their entireties).
Although shown as an electro-optic mirror application, it is envisioned that the mirror assembly may comprise a prismatic reflective element. The prismatic mirror assembly may be mounted or attached at an interior portion of a vehicle (such as at an interior surface of a vehicle windshield) via the mounting means described above, and the reflective element may be toggled or flipped or adjusted between its daytime reflectivity position and its nighttime reflectivity position via any suitable toggle means, such as by utilizing aspects of the mirror assemblies described in U.S. Pat. Nos. 7,420,756; 7,338,177; 7,289,037; 7,274,501; 7,255,451; 7,249,860; 6,318,870; 6,598,980; 5,327,288; 4,948,242; 4,826,289; 4,436,371 and/or 4,435,042, and/or U.S. Publication No. US-2010-0085653, which are hereby incorporated herein by reference in their entireties.
Optionally, the mirror assembly may include one or more other displays, such as the types disclosed in U.S. Pat. Nos. 5,530,240 and/or 6,329,925, which are hereby incorporated herein by reference in their entireties, and/or display-on-demand transflective type displays, and/or video displays or display screens, such as the types disclosed in U.S. Pat. Nos. 8,890,955; 7,855; 755; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 7,046,448; 5,668,663; 5,724,187; 5,530,240; 6,329,925; 6,690,268; 7,734,392; 7,370,983; 6,902,284; 6,428,172; 6,420,975; 5,416,313; 5,285,060; 5,193,029 and/or 4,793,690, and/or in U.S. Pat. Pub. Nos. US-2006-0050018; US-2009-0015736; US-2009-0015736 and/or US-2010-0097469, which are all hereby incorporated herein by reference in their entireties.
The video display screen may be controlled or operable in response to an input or signal, such as a signal received from one or more cameras or image sensors of the vehicle, such as a video camera or sensor, such as a CMOS imaging array sensor, a CCD sensor or the like, and image processors or image processing techniques, such as utilizing aspects of the cameras and image processors described U.S. Pat. Nos. 5,550,677; 5,760,962; 6,690,268; 6,498,620; 6,396,397; 6,222,447; 6,201,642; 6,097,023; 5,796,094; 5,715,093; 6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,320,176; 6,559,435; 6,831,261; 6,806,452; 6,822,563; 6,946,978; 7,038,577; 7,004,606; 7,720,580; 8,446,470; 8,451,107 and/or 9,126,525, and/or U.S. Pat. Pub. Nos. US-2006-0171704; US-2009-0244361 and/or US-2010-0214791, which are all hereby incorporated herein by reference in their entireties. The imaging sensor or camera may be activated and the display screen may be activated in response to the vehicle shifting into reverse, such that the display screen is viewable by the driver and is displaying an image of the rearward scene while the driver is reversing the vehicle. It is envisioned that the image processor or controller may comprise the likes of an EYEQ™ image processing chip available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and processes image data captured by the forward viewing camera and the driver monitoring camera (and optionally surround view cameras and/or CMS cameras of the vehicle).
Changes and modifications in the specifically described embodiments may be carried out without departing from the principles of the present invention, which is intended to be limited only by the scope of the appended claims as interpreted according to the principles of patent law.
The present application is a continuation of U.S. patent application Ser. No. 17/905,119, filed Aug. 26, 2022, which is a 371 U.S. National Stage filing of PCT Application No. PCT/US2022/072238, filed May 11, 2022, which claims the filing benefits of U.S. provisional application Ser. No. 63/363,598, filed Apr. 26, 2022, U.S. provisional application Ser. No. 63/267,316, filed Jan. 31, 2022, U.S. provisional application Ser. No. 63/262,642, filed Oct. 18, 2021, U.S. provisional application Ser. No. 63/260,359, filed Aug. 18, 2021, and U.S. provisional application Ser. No. 63/201,757, filed May 12, 2021, which are hereby incorporated herein by reference in their entireties. U.S. patent application Ser. No. 17/905,119 also is a continuation-in-part of U.S. patent application Ser. No. 17/905,109, filed Aug. 26, 2022, now U.S. Pat. No. 11,639,134, which is a 371 U.S. National Stage filing of PCT Application No. PCT/US2022/070882, filed Mar. 1, 2022, which claims the filing benefits of U.S. provisional application Ser. No. 63/267,316, filed Jan. 31, 2022, U.S. provisional application Ser. No. 63/262,642, filed Oct. 18, 2021, U.S. provisional application Ser. No. 63/260,359, filed Aug. 18, 2021, U.S. provisional application Ser. No. 63/201,757, filed May 12, 2021, U.S. provisional application Ser. No. 63/201,371, filed Apr. 27, 2021, U.S. provisional application Ser. No. 63/200,451, filed Mar. 8, 2021, and U.S. provisional application Ser. No. 63/200,315, filed Mar. 1, 2021.
| Number | Date | Country | |
|---|---|---|---|
| 63363598 | Apr 2022 | US | |
| 63267316 | Jan 2022 | US | |
| 63262642 | Oct 2021 | US | |
| 63260359 | Aug 2021 | US | |
| 63201757 | May 2021 | US | |
| 63267316 | Jan 2022 | US | |
| 63262642 | Oct 2021 | US | |
| 63260359 | Aug 2021 | US | |
| 63201757 | May 2021 | US | |
| 63201371 | Apr 2021 | US | |
| 63200451 | Mar 2021 | US | |
| 63200315 | Mar 2021 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17905119 | Aug 2022 | US |
| Child | 18464477 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17905109 | Aug 2022 | US |
| Child | 17905119 | US |
