The present invention relates to imaging systems or vision systems for vehicles.
Use of imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporated herein by reference in their entireties.
The present invention provides a vision system or imaging system for a vehicle that utilizes one or more cameras to capture images exterior of the vehicle, and provides the communication/data signals, including camera data or image data, that may be processed by an image processor, such as for a headlamp control or other machine vision system, or that may be displayed at a display screen that is viewable by the driver of the vehicle.
According to an aspect of the present invention, a vision system for a vehicle includes a camera or image sensor disposed at a windshield of a vehicle and having a field of view forward of the vehicle and through the windshield of the vehicle, and a processor operable to process data transmitted by the camera. The vision system or camera assembly or system includes an angular filter disposed at or near the windshield forward of the camera. The angular filter comprises a substantially transparent film that limits reflection of light through an angular range that generally corresponds to the stray light that reflects off of the vehicle (such as off of the vehicle dashboard) and would otherwise impinge the camera lens aperture.
The camera is electrically connected to circuitry established at a circuit board that is mounted generally along the windshield behind the camera, and the camera preferably is electrically connected to the circuitry via a flexible electrical connector. The flexible electrical connector flexes to allow a viewing angle of the camera to be adjusted relative to a mounting angle of the circuit board.
Therefore, the present invention provides an angular light filter that rejects or substantially rejects or attenuates reflections from the vehicle dash board into the camera. The angular filter replaces the stray light cone or shroud of a typical module or housing, allowing greater flexibility and lower mounting of the camera at the windshield.
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
A vehicle vision system and/or driver assist system and/or object detection system and/or alert system operates to capture images exterior of the vehicle and may process the captured image data to display images and to detect objects at or near the vehicle and in the predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a forward (or rearward) direction.
Front facing vehicular cameras include optical elements that constitute the camera. These elements are typically mounted in a vehicular camera housing, such as a windshield electronics module housing or the like, such as shown in
As shown in
The angular filter 14 may comprise any suitable materials. For example, a suitable film material may be found on the likes of computer notebook screens and other types of display monitors and are commercially available from the 3M Company and other suppliers. In some embodiments, the filter may be placed directly on the windshield, and in other embodiments (and such as shown in
With the proposed structure, the designer of the camera system or vision system is afforded a great deal of design flexibility. In particular, and as can be seen with reference to
Optionally, and as shown in
The camera or sensor may comprise any suitable camera or sensor. Optionally, the camera may comprise a “smart camera” that includes the imaging sensor array and associated circuitry and image processing circuitry and electrical connectors and the like as part of a camera module, such as by utilizing aspects of the vision systems described in U.S. provisional applications Ser. No. 61/565,713, filed Dec. 1, 2011; and/or Ser. No. 61/563,965, filed Nov. 28, 2011, which are hereby incorporated herein by reference in their entireties.
As disclosed in U.S. provisional application Ser. No. 61/565,713, filed Dec. 1, 2011 (incorporated herein by reference in its entirety), the vehicle includes a display device operable to display images for viewing by a driver of the vehicle. The camera can provide almost raw image data to the display device and has a control channel for a data line (which might be any kind of data line or bus), and wherein a graphics engine runs as a routine at the display device (with, for example, the graphics engine running as a routine on a head unit of the vehicle). The camera may be part of an automotive vision system, which uses LVDS as a bidirectional control channel and an image data transfer channel and comprising an automotive vision multi camera architecture, where all cameras are controlled by one control / image data processing device, and where an image data processing device sends processed image data to the head unit or other display device and with the system processing image data captured by more than one camera and by other driver assistant system sources such as ultrasound sensors, radar sensors, infrared and visual cameras, lidar or laser sensors. The automotive vision system may use LVDS data decoders. A driver assist system and/or vision system and/or object detection system and/or alert system may operate to capture images exterior of the vehicle and process the captured image data to detect objects at or near the vehicle and in the predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle. The object detection may utilize detection and analysis of moving vectors representative of objects detected in the field of view of the vehicle camera, in order to determine which detected objects are objects of interest to the driver of the vehicle. An image data stream from the camera to the head unit (or other end device) is realized on a data encoder chip, preferably by a Low Voltage Differential Signal (LVDS) or Ethernet interface, preferably using a mono coaxial cable and LVDS/Ethernet encoder chips (in the camera and in the head unit). The data stream can be mono-directional. Optionally, a control line may be realized by a CAN / LIN / other car bus interface or just by a single signal line/wire. Optionally, the control signal may be transferred via the data encoder chip, preferably by LVDS, so the interfaces and data stream are bi-directional.
The vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ultrasonic sensors or the like. The imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, an array of a plurality of photosensor elements arranged in 640 columns and 480 rows (a 640 × 480 imaging array), with a respective lens focusing images onto respective portions of the array. The photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns. The logic and control circuit of the imaging sensor may function in any known manner, such as in the manner described in U.S. Pat. Nos. 5,550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094 and/or 6,396,397, and/or U.S. provisional applications, Ser. No. 61/615,410, filed Mar. 26, 2012; Ser. No. 61/613,651, filed 2012; Ser. No. 61/607,229, filed Mar. 6, 2012; Ser. No. 61/605,409, filed Mar. 1, 2012; Ser. No. 61/602,878, filed Feb. 24, 2012; Ser. No. 61/602,876, filed Feb. 24, 2012; Ser. No. 61/600,205, filed Feb. 17, 2012; Ser. No. 61/588,833, filed Jan. 20, 2012; Ser. No. 61/583,381, filed Jan. 5, 2012; Ser. No. 61/579,682, filed Dec. 23, 2011; Ser. No. 61/570,017, filed Dec. 13, 2011; Ser. No. 61/568,791, filed Dec. 9, 2011; Ser. No. 61/567,446, filed Dec. 6, 2011; Ser. No. 61/559,970, filed Nov. 15, 2011; Ser. No. 61/552,167, filed Oct. 27, 2011; Ser. No. 61/540,256, filed Sep. 28, 2011; Ser. No. 61/513,745, filed Aug. 1, 2011; Ser. No. 61/511,738, filed Jul. 26, 2011; and/or Ser. No. 61/503,098, filed Jun. 30, 2011, which are all hereby incorporated herein by reference in their entireties. The system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in PCT Application No. PCT/US10/038477, filed Jun. 14, 2010, and/or U.S. Pat. application Ser. No. 13/202,005, filed Aug. 17, 2011, now U.S. Pat. No. 9,126,525, and/or U.S. provisional applications, Ser. No. 61/567,150, filed Dec. 6, 2011; Ser. No. 61/565,713, filed Dec. 1, 2011; and/or Ser. No. 61/537,279, filed Sep. 21, 2011, which are hereby incorporated herein by reference in their entireties.
The imaging device and control and image processor and any associated illumination source, if applicable, may comprise any suitable components, and may utilize aspects of the cameras and vision systems described in U.S. Pat. Nos. 5,550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094; 6,396,397; 6,806,452; 6,690,268; 7,005,974; 7,937,667; 7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176; 6,313,454 and 6,824,281, and/or International Publication No. WO 2010/099416, published Sep. 2, 2010, and/or PCT Application No. PCT/US10/47256, filed Aug. 31, 2010, and/or U.S. Pat. application Ser. No. 12/508,840, filed Jul. 24, 2009, and published Jan. 28, 2010 as U.S. Pat. Publication No. US 2010-0020170; and/or U.S. provisional applications, Ser. No. 61/511,738, filed Jul. 26, 2011; and/or Ser. No. 61/503,098, filed Jun. 30, 2011, which are all hereby incorporated herein by reference in their entireties. The camera or cameras may comprise any suitable cameras or imaging sensors or camera modules, and may utilize aspects of the cameras or sensors described in U.S. Pat. applications, Ser. No. 12/091,359, filed Apr. 24, 2008; and/or Ser. No. 13/260,400, filed Sep. 26, 2011, and/or U.S. Pat. Nos. 7,965,336 and/or 7,480,149, which are hereby incorporated herein by reference in their entireties. The imaging array sensor may comprise any suitable sensor, and may utilize various imaging sensors or imaging array sensors or cameras or the like, such as a CMOS imaging array sensor, a CCD sensor or other sensors or the like, such as the types described in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,715,093; 5,877,897; 6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,201,642; 6,498,620; 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 6,806,452; 6,396,397; 6,822,563; 6,946,978; 7,339,149; 7,038,577; 7,004,606 and/or 7,720,580, and/or U.S. Pat. application Ser. No. 10/534,632, filed May 11, 2005, now U.S. Pat. No. 7,965,336; and/or PCT Application No. PCT/US2008/076022, filed Sep. 11, 2008 and published Mar. 19, 2009 as International Publication No. WO 2009/036176, and/or PCT Application No. PCT/US2008/078700, filed Oct. 3, 2008 and published Apr. 9, 2009 as International Publication No. WO 2009/046268, which are all hereby incorporated herein by reference in their entireties.
The camera module and circuit chip or board and imaging sensor may be implemented and operated in connection with various vehicular vision-based systems, and/or may be operable utilizing the principles of such other vehicular systems, such as a vehicle headlamp control system, such as the type disclosed in U.S. Pat. Nos. 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 7,004,606; 7,339,149 and/or 7,526,103, which are all hereby incorporated herein by reference in their entireties, a rain sensor, such as the types disclosed in commonly assigned U.S. Pat. Nos. 6,353,392; 6,313,454; 6,320,176 and/or 7,480,149, which are hereby incorporated herein by reference in their entireties, a vehicle vision system, such as a forwardly, sidewardly or rearwardly directed vehicle vision system utilizing principles disclosed in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,877,897; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978 and/or 7,859,565, which are all hereby incorporated herein by reference in their entireties, a trailer hitching aid or tow check system, such as the type disclosed in U.S. Pat. No. 7,005,974, which is hereby incorporated herein by reference in its entirety, a reverse or sideward imaging system, such as for a lane change assistance system or lane departure warning system or for a blind spot or object detection system, such as imaging or detection systems of the types disclosed in U.S. Pat. Nos. 7,720,580; 7,038,577; 5,929,786 and/or 5,786,772, and/or U.S. pat. applications, Ser. No. 11/239,980, filed Sep. 30, 2005, now U.S. Pat. No. 7,881,496, and/or U.S. provisional applications, Ser. No. 60/628,709, filed Nov. 17, 2004; Ser. No. 60/614,644, filed Sep. 30, 2004; Ser. No. 60/618,686, filed Oct. 14, 2004; Ser. No. 60/638,687, filed Dec. 23, 2004, which are hereby incorporated herein by reference in their entireties, a video device for internal cabin surveillance and/or video telephone function, such as disclosed in U.S. Pat. Nos. 5,760,962; 5,877,897; 6,690,268 and/or 7,370,983, and/or U.S. Pat. application Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018-A1, which are hereby incorporated herein by reference in their entireties, a traffic sign recognition system, a system for determining a distance to a leading or trailing vehicle or object, such as a system utilizing the principles disclosed in U.S. Pat. Nos. 6,396,397 and/or 7,123,168, which are hereby incorporated herein by reference in their entireties, and/or the like.
Optionally, the circuit board or chip may include circuitry for the imaging array sensor and or other electronic accessories or features, such as by utilizing compass-on-a-chip or EC driver-on-a-chip technology and aspects such as described in U.S. Pat. No. 7,255,451 and/or U.S. Pat. No. 7,480,149; and/or U.S. Pat. applications, Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008, and/or Ser. No. 12/578,732, filed Oct. 14, 2009 and published Apr. 22, 2010 as U.S. Publication No. US-2010-0097469, which are hereby incorporated herein by reference in their entireties.
Optionally, the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle. Optionally, for example, the vision system may include a video display device disposed at or in the interior rearview mirror assembly of the vehicle, such as by utilizing aspects of the video mirror display systems described in U.S. Pat. No. 6,690,268 and/or U.S. Pat. application Ser. No. 13/333,337, filed Dec. 21, 2011, now U.S. Pat. No. 9,264,672, which are hereby incorporated herein by reference in their entireties. The video mirror display may comprise any suitable devices and systems and optionally may utilize aspects of the compass display systems described in U.S. Pat. Nos. 7,370,983; 7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 4,546,551; 5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,677,851; 5,708,410; 5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,508; 6,222,460; 6,513,252 and/or 6,642,851, and/or European patent application, published Oct. 11, 2000 under Publication No. EP 0 1043566, and/or U.S. patent application Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008, which are all hereby incorporated herein by reference in their entireties. Optionally, the video mirror display screen or device may be operable to display images captured by a rearward viewing camera of the vehicle during a reversing maneuver of the vehicle (such as responsive to the vehicle gear actuator being placed in a reverse gear position or the like) to assist the driver in backing up the vehicle, and optionally may be operable to display the compass heading or directional heading character or icon when the vehicle is not undertaking a reversing maneuver, such as when the vehicle is being driven in a forward direction along a road (such as by utilizing aspects of the display system described in PCT Application No. PCT/US2011/056295, filed Oct. 14, 2011 and published Apr. 19, 2012 as International Publication No. WO 2012/051500, which is hereby incorporated herein by reference in its entirety). Optionally, the vision system (utilizing a forward and/or rearward facing camera and other cameras disposed at the vehicle with exterior fields of view) and/or the camera or cameras as part of a vehicle vision system comprising or utilizing a plurality of cameras (such as utilizing a rearward facing camera and sidewardly facing cameras and a forwardly facing camera disposed at the vehicle), may provide a display of a top-down view or birds-eye view of the vehicle or a surround view at the vehicle, such as by utilizing aspects of the vision systems described in PCT Application No. PCT/US10/25545, filed Feb. 26, 2010 and published on Sep. 2, 2010 as International Publication No. WO 2010/099416, and/or PCT Application No. PCT/US10/47256, filed Aug. 31, 2010 and published Mar. 10, 2011 as International Publication No. WO 2011/028686, and/or PCT Application No. PCT/US11/62834, filed Dec. 1, 2011 and published Jun. 7, 2012 as International Publication No. WO 2012-075250, and/or U.S. Pat. application Ser. No. 13/333,337, filed Dec. 21, 2011, now U.S. Pat. No. 9,264,672, and/or U.S. provisional applications, Ser. No. 61/615,410, filed Mar. 26, 2012; Ser. No. 61/588,833, filed Jan. 20, 2012; Ser. No. 61/570,017, filed Dec. 13, 2011; Ser. No. 61/568,791, filed Dec. 9, 2011; Ser. No. 61/559,970, filed Nov. 15, 2011; Ser. No. 61/540,256, filed Sep. 28, 2011, which are hereby incorporated herein by reference in their entireties.
Optionally, the video mirror display may be disposed rearward of and behind the reflective element assembly and may comprise a display such as the types disclosed in U.S. Pat. Nos. 5,530,240; 6,329,925; 7,855,755; 7,626,749; 7,581,859; 7,446,650; 7,370,983; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 5,668,663; 5,724,187 and/or 6,690,268, and/or in U.S. Pat. applications, Ser. No. 12/091,525, filed Apr. 25, 2008, now U.S. Pat. No. 7,855,755; Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008; and/or Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are all hereby incorporated herein by reference in their entireties. The display is viewable through the reflective element when the display is activated to display information. The display element may be any type of display element, such as a vacuum fluorescent (VF) display element, a light emitting diode (LED) display element, such as an organic light emitting diode (OLED) or an inorganic light emitting diode, an electroluminescent (EL) display element, a liquid crystal display (LCD) element, a video screen display element or backlit thin film transistor (TFT) display element or the like, and may be operable to display various information (as discrete characters, icons or the like, or in a multi-pixel manner) to the driver of the vehicle, such as passenger side inflatable restraint (PSIR) information, tire pressure status, and/or the like. The mirror assembly and/or display may utilize aspects described in U.S. Pat. Nos. 7,184,190; 7,255,451; 7,446,924 and/or 7,338,177, which are all hereby incorporated herein by reference in their entireties. The thicknesses and materials of the coatings on the substrates of the reflective element may be selected to provide a desired color or tint to the mirror reflective element, such as a blue colored reflector, such as is known in the art and such as described in U.S. Pat. Nos. 5,910,854; 6,420,036 and/or 7,274,501, which are hereby incorporated herein by reference in their entireties.
Optionally, the display or displays and any associated user inputs may be associated with various accessories or systems, such as, for example, a tire pressure monitoring system or a passenger air bag status or a garage door opening system or a telematics system or any other accessory or system of the mirror assembly or of the vehicle or of an accessory module or console of the vehicle, such as an accessory module or console of the types described in U.S. Pat. Nos. 7,289,037; 6,877,888; 6,824,281; 6,690,268; 6,672,744; 6,386,742 and 6,124,886, and/or U.S. Pat. application Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entireties.
Changes and modifications to the specifically described embodiments may be carried out without departing from the principles of the present invention, which is intended to be limited only by the scope of the appended claims as interpreted according to the principles of patent law.
The present application is a continuation of U.S. Pat. application Ser. No. 17/822,831, filed Aug. 29, 2022, now U.S. Pat. No. 11,667,252, which is a continuation of U.S. Pat. application Ser. No. 17/305,254, filed Jul. 2, 2021, now U.S. Pat. No. 11,427,136, which is a continuation of U.S. Pat. application Ser. No. 17/247,269, filed Dec. 7, 2020, now U.S. Pat. No. 11,052,834, which is a continuation of U.S. Pat. application Ser. No. 16/948,878, filed Oct. 5, 2020, now U.S. Pat. No. 10,857,953, which is a continuation of U.S. Pat. application Ser. No. 16/806,095, filed Mar. 2, 2020, now U.S. Pat. No. 10,793,086, which is a continuation of U.S. Pat. application Ser. No. 16/449,546, filed Jun. 24, 2019, now U.S. Pat. No. 10,576,909, which is a continuation of U.S. Pat. application Ser. No. 16/117,105, filed Aug. 30, 2018, now U.S. Pat. No. 10,328,868, which is a continuation of U.S. Pat. application Ser. No. 15/878,579, filed Jan. 24, 2018, now U.S. Pat. No. 10,065,575, which is a continuation of U.S. patent application Ser. No. 15/494,646, filed Apr. 24, 2017, now U.S. Pat. No. 9,878,679, which is a continuation of U.S. Pat. application Ser. No. 15/180,643, filed Jun. 13, 2016, now U.S. Pat. No. 9,630,570, which is a continuation of U.S. Pat. application Ser. No. 14/112,343, filed Oct. 17, 2013, now U.S. Pat. No. 9,380,219, which is a 371 national phase filing of PCT/US12/34236, filed Apr. 19, 2012, which claims the filing benefit of U.S. provisional application Ser. No. 61/477,315, filed Apr. 20, 2011, which is hereby incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
61477315 | Apr 2011 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17822831 | Aug 2022 | US |
Child | 18328823 | US | |
Parent | 17305254 | Jul 2021 | US |
Child | 17822831 | US | |
Parent | 17247269 | Dec 2020 | US |
Child | 17305254 | US | |
Parent | 16948878 | Oct 2020 | US |
Child | 17247269 | US | |
Parent | 16806095 | Mar 2020 | US |
Child | 16948878 | US | |
Parent | 16449546 | Jun 2019 | US |
Child | 16806095 | US | |
Parent | 16117105 | Aug 2018 | US |
Child | 16449546 | US | |
Parent | 15878579 | Jan 2018 | US |
Child | 16117105 | US | |
Parent | 15494646 | Apr 2017 | US |
Child | 15878579 | US | |
Parent | 15180643 | Jun 2016 | US |
Child | 15494646 | US | |
Parent | 14112343 | Oct 2013 | US |
Child | 15180643 | US |