Patent Application
20130002873
The present invention relates to imaging systems or vision systems for vehicles and, more particularly, to an imaging or vision system that includes at least one imaging device or camera for capturing images of a scene interior or exterior of the vehicle.
Use of imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935; and/or 5,550,677, which are hereby incorporated herein by reference in their entireties. When incorporating a camera into a vehicle, such as, for example, in an interior rearview mirror assembly for a forward viewing vision system, the space for any components or accessories is important and thus the packaging and package size are important features of the camera. In some vehicle applications, there may be two or more cameras for providing different fields of view (such as one camera facing generally forwardly in the forward direction of travel of the vehicle and one camera facing generally sidewardly towards a side region of the vehicle). Other sensing applications show combined projection areas of split optical systems having identical focal lenses, U.S. Pat. No. 6,617,564 suggests a vehicle moisture sensor, having a two lens system for projecting the same image (same focal lens) on two different areas of one image sensor.
The present invention provides a vision system or imaging system for a vehicle that utilizes a dual lens configuration to capture two separate and distinct images on different imaging array portions, preferably onto different imaging portions of a single or common imaging array of photosensors. For example, one lens may be disposed at one portion of the single imaging array and may provide a longer focal length and another lens may be disposed at another portion of the single imaging array and may provide a shorter focal length. Optionally, the different imaging array portions may comprise separate and distinct imaging arrays, each with a respective lens for focusing the respective image onto that imaging array.
According to an aspect of the present invention, an imaging or vision system for a vehicle includes an imaging device or sensor or camera with a pair of lenses or lens assemblies or optical elements disposed at the imaging sensor. The imaging sensor comprises an imaging array of photosensing pixels. A first lens or optical element is disposed at a first portion or array of the imaging array and provides a first focal length and a second lens or optical element is disposed at a second portion or array of the imaging array and provides a second focal length. The first focal length is longer than the second focal length so that the first portion of the imaging array captures focused images of a more remote or distant scene than that of the second portion of the imaging array.
Optionally, the imaging sensor may be disposed at or in the vehicle so as to have a generally forward field of view in the forward direction of travel of the vehicle. For example, the imaging sensor may be disposed at or in an interior rearview mirror assembly of a vehicle and may have a generally forward field of view through the windshield of the vehicle. Optionally, the first portion of the imaging array may have a forward field of view through the windshield of the vehicle and the first lens or optical element may focus an image at the first portion of the imaging array that is representative of a scene occurring forwardly of the vehicle, such as several yards or meters ahead of the vehicle at or on the road on which the vehicle is traveling, such as for a headlamp control system or lane departure warning system of the vehicle, while the second portion of the imaging array may have a field of view at the vehicle windshield and the second lens or optical element may focus an image at the second portion of the imaging array that is representative of the windshield itself, such as for a rain sensing function or accessory of the vehicle.
Therefore, the present invention provides a dual function imaging sensor or imaging system that, with a single imaging array and associated circuitry, can provide separate and distinct images or image data via a dual lens system or assembly disposed at the imaging array of the imaging sensor for focusing different images onto the respective portions of the imaging array of the imaging sensor. The present invention thus provides enhanced imaging while limiting or reducing or minimizing the space requirements for the imaging sensor or camera.
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
Referring now to the drawings and the illustrative embodiments depicted therein, a vehicle 10 includes an imaging system or vision system 12 that includes an imaging sensor or camera 14 which senses light from a scene forward of vehicle 10, with the imaging sensor 14 comprising an imaging array 16 of photosensing pixels 16a disposed on a common semiconductor substrate 16b and a pair of lenses or lens assemblies or optical elements 18, 20 disposed at respective portions 22, 24 of the imaging array 16 (
Because there are times or vehicle applications where there is a need to have a vehicle camera or imaging sensor detect or “see” a substantial or far distance in front of the vehicle as the vehicle is traveling along the road (such as for detection of headlamps of approaching vehicles or detection of taillights of leading vehicles or detection of other vehicles on the road such as for an adaptive cruise control system or collision avoidance system or the like, or such as lane marker detection or sign or object detection forward of the vehicle) and for other applications there is a need for near imaging, such as for rain sensing at the vehicle windshield or the like. far or near (e.g., see w/s for rain sensing, see far for headlamp detection), there is a need to provide multiple sensing means for the vehicle, without adversely affecting the packaging or size requirements for the imaging system. Likewise, for some applications, there is a need or desire for a clearer focus at objects or scenes exterior of the vehicle, while other applications do not require or need such clarity in the captured images. Also, for some applications, there is a need or desire for a generally straight forward field of view in front of the vehicle, while other applications, there is a need or desire for a generally sideward field of view towards a side region of the vehicle or the like. Typically, for such different applications or different imaging systems or functions, two separate imaging devices or cameras may be utilized.
The present invention provides a single camera or imaging sensor that utilizes a dual lens system or split lens system to focus or image different images (such as a near image and a far image or such as a forward image and a sideward image or the like) onto respective portions (such as two halves) of the single imaging sensor. Each of the portions of the imaging sensor may be fully capable of full color imaging (such as via color filters, such as red, green and blue filters or the like, disposed at the pixels of each of the imaging array portions) or may be capable of black and white imaging or may be capable of red-clear-clear imaging such as is known in the art. The imaging array thus may comprise a typical black and white imaging array or color imaging array, with both sides having similar or the same pixel filtering arrangement and the like.
The lenses 18, 20 are disposed at the respective portions or halves 22, 24 of the imaging array 16 and may have different characteristics, such as different focal lengths, to provide the desired focusing and imaging for the respective imaging array portion. For example, a first lens 18 may provide a telephoto or longer focal length to provide imaging at imaging array portion 22 of far or distant objects ahead (or sideward) of the vehicle, while the second lens 20 may comprises a wider angle lens or shorter focal length (or even a macro lens for close up imaging) to provide imaging at imaging array portion 24 of nearer objects or the like ahead or sideward of the vehicle or imaging sensor. For example, the first imaging array portion 22 may capture images or image data for processing for a headlamp control system or lane departure warning system or sign recognition system or object detection system or the like, while the second imaging array portion 24 may capture images or image data of close-up objects, such as the interior and/or exterior surface of the vehicle windshield for moisture detection (such as rain sensing or fog sensing or condensation sensing or the like). Optionally, one or both of the lenses may comprise enhanced optics to provide clearer focusing of images onto the respective portion or portions of the imaging array, depending on the particular application of the respective portion or portions of the imaging array. For example, a first optical element may be used for detection of objects very far away from the subject vehicle, such as far ahead of the subject vehicle on or at the road on which the vehicle is travelling (where a higher spatial resolution may be desired) and a second optical element may be used for detection of objects in the nearer field, such as close to the subject vehicle (where a lower resolution may be desired or acceptable). For example, the first optical element and associated portion of the imaging array may function to capture images or image data for vehicle detection in the far field, while the second optical element and associated portion of the imaging array may function to capture images or image data for vehicle and road sign detection in the near field.
Each of the lenses 18, 20 may comprise any suitable lens or lens assembly or optical element, such as a single molded plastic lens banded to or in close contact with the respective portion 22, 24 of the photosensor imaging array 16, or such as any appropriate or suitable image focusing means such as conventional single component optics, holographic lens type optics, binary optics or a microlens or an adjustable focus single-optic or multi-optic lens or the like. Although referred to as a lens, such a lens may comprise a multiple lens system consisting of many individual lens elements or optic elements, and such lens elements or optic elements may comprise or include defractive optics, holographic optics, plastic optics, glass optics, spherical optics, aspherical optics and/or the like. Each lens 18, 20 is designed to focus a respective image of the forward scene within a field of view onto the respective portion 22, 24 of the imaging array 16. Although shown and described as having generally forward fields of view, the imaging sensor 14 and lenses 18, 20 may be disposed elsewhere in the vehicle or otherwise positioned in other than a forwardly facing direction so long as appropriate lenses or other optics are used to direct the light or image information from the targeted area or areas onto the portions 22, 24 of the photosensitive surface of the photosensor array 16.
The imaging sensor 14 and its photosensor array 16 may comprise any suitable camera or sensing device, such as, for example, an array of a plurality of photosensor elements 16a arranged in 640 columns and 480 rows (a 640×480 Imaging array), with a respective lens focusing images onto respective portions of the array. In the embodiment illustrated in
As shown in
In the illustrated embodiment, the imaging sensor 14 is disposed at an interior rearview mirror assembly 26 of the vehicle 10, with the imaging array portions 22, 24 having forward fields of view towards and/or through the vehicle windshield 27. However, the imaging sensor of the vision system of the present invention may be disposed elsewhere in the vehicle and may have sideward and/or rearward fields of view, while remaining within the spirit and scope of the present invention. For example, the imaging sensor may be disposed at the rear of the vehicle, with one lens and imaging array portion functioning to capture images or image data of close-up objects, such as for a backup assist and/or trailer hookup assist system, while the other lens and imaging array portion function to capture images or image data of further away or more distant objects, such as for a parking assist system or object detection system or the like.
The imaging device and control and image processor and any associated illumination source, if applicable, may comprise any suitable components, and may utilize aspects of the cameras and vision systems described in U.S. Pat. Nos. 5,550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094; 6,396,397; 6,806,452; 6,690,268; 7,005,974; 7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176; 6,313,454; and 6,824,281, and/or International Publication No. WO 2010/099416, published Sep. 2, 2010, and/or PCT Application No. PCT/US10/47256, filed Aug. 31, 2010, and/or U.S. patent application Ser. No. 12/508,840, filed Jul. 24, 2009, and published Jan. 28, 2010 as U.S. Pat. Publication No. US 2010-0020170, which are all hereby incorporated herein by reference in their entireties. The camera or cameras may comprise any suitable cameras or imaging sensors or camera modules, and may utilize aspects of the cameras or sensors described in U.S. patent application Ser. No. 12/091,359, filed Apr. 24, 2008 and published Oct. 1, 2009 as U.S. Publication No. US-2009-0244361; and/or Ser. No. 13/260,400, filed Sep. 26, 2011 (Attorney Docket MAG04 P-1757), and/or U.S. Pat. Nos. 7,965,336 and/or 7,480,149, which are hereby incorporated herein by reference in their entireties. The imaging array sensor may comprise any suitable sensor, and may utilize various imaging sensors or imaging array sensors or cameras or the like, such as a CMOS imaging array sensor, a CCD sensor or other sensors or the like, such as the types described in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,715,093; 5,877,897; 6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,201,642; 6,498,620; 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 6,806,452; 6,396,397; 6,822,563; 6,946,978; 7,339,149; 7,038,577; 7,004,606; 7,965,336; and/or 7,720,580, and/or PCT Application No. PCT/US2008/076022, filed Sep. 11, 2008 and published Mar. 19, 2009 as International Publication No. WO/2009/036176, and/or PCT Application No. PCT/US2008/078700, filed Oct. 3, 2008 and published Apr. 9, 2009 as International Publication No. WO/2009/046268, which are all hereby incorporated herein by reference in their entireties.
The camera module and circuit chip or board and imaging sensor may be implemented and operated in connection with various vehicular vision-based systems, and/or may be operable utilizing the principles of such other vehicular systems, such as a vehicle headlamp control system, such as the type disclosed in U.S. Pat. Nos. 5,796,094; 6,097,023; 6,320,176; 6,550,435; 6,831,261; 7,004,606; 7,339,149; and/or 7,526,103, which are all hereby incorporated herein by reference in their entireties, a rain sensor, such as the types disclosed in commonly assigned U.S. Pat. Nos. 6,353,392; 6,313,454; 6,320,176; and/or 7,480,149, which are hereby incorporated herein by reference in their entireties, a vehicle vision system, such as a forwardly, sidewardly or rearwardly directed vehicle vision system utilizing principles disclosed in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,877,897; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; and/or 7,859,565, which are all hereby incorporated herein by reference in their entireties, a trailer hitching aid or tow check system, such as the type disclosed in U.S. Pat. No. 7,005,974, which is hereby incorporated herein by reference in its entirety, a reverse or sideward imaging system, such as for a lane change assistance system or lane departure warning system or for a blind spot or object detection system, such as imaging or detection systems of the types disclosed in U.S. Pat. Nos. 7,720,580; 7,038,577; 5,929,786 and/or 5,786,772, and/or U.S. patent application Ser. No. 11/230,980, filed Sep. 30, 2005, now U.S. Pat. No. 7,881,496, and/or U.S. provisional applications, Ser. No, 60/628,709, filed Nov. 17, 2004; Ser. No, 60/614,644, filed Sep. 30, 2004; Ser, No. 60/618,686, filed Oct. 14, 2004; Ser. No. 60/638,687, filed Dec. 23, 2004, which are hereby incorporated herein by reference in their entireties, a video device for internal cabin surveillance and/or video telephone function, such as disclosed in U.S. Pat. Nos. 5,760,962; 5,877,897; 6,690,268; and/or 7,370,983, and/or U.S. patent application Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entireties, a traffic sign recognition system, a system for determining a distance to a leading or trailing vehicle or object, such as a system utilizing the principles disclosed in U.S. Pat. Nos. 6,396,397 and/or 7,123,168, which are hereby incorporated herein by reference in their entireties, and/or the like.
Optionally, the circuit board or chip may include circuitry for the imaging array sensor and or other electronic accessories or features, such as by utilizing compass-on-a-chip or EC driver-on-a-chip technology and aspects such as described in U.S. Pat. No. 7,255,451 and/or U.S. Pat. No. 7,480,149; and/or U.S. patent application Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008, and/or Ser. No. 12/578,732, filed Oct., 14, 2009 (Attorney Docket DON01 P-1564), which are hereby incorporated herein by reference in their entireties.
Optionally, the vision system may include a display, such as a video display for displaying images captured by one or both of the portions of the imaging array of the imaging sensor for viewing by the driver of the vehicle while the driver is normally operating the vehicle. Optionally, for example, the vision system may include a video display device 28 disposed at or in the interior rearview mirror assembly 26 of the vehicle 10 (such as shown in
Optionally, the video mirror display may be disposed rearward of and behind the reflective element assembly and may comprise a display such as the types disclosed in U.S. Pat. Nos. 5,530,240; 6,329,925; 7,626,749; 7,581,859; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 5,668,663; 7,855,755; 5,724,187 and/or 6,690,268, and/or in U.S. patent application Ser. No. 11/226,628, filed Sep., 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008; and/or Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are all hereby incorporated herein by reference in their entireties. The display is viewable through the reflective element when the display is activated to display information. The display element may be any type of display element, such as a vacuum fluorescent (VF) display element, a light emitting diode (LED) display element, such as an organic light emitting diode (OLED) or an inorganic light emitting diode, an electroluminescent (EL) display element, a liquid crystal display (LCD) element, a video screen display element or backlit thin film transistor (TFT) display element or the like, and may be operable to display various information (as discrete characters, icons or the like, or in a multi-pixel manner) to the driver of the vehicle, such as passenger side inflatable restraint (PSIR) information, tire pressure status, and/or the like. The mirror assembly and/or display may utilize aspects described in U.S. Pat. Nos. 7,184,190; 7,255,451; 7,446,924 and/or 7,338,177, which are all hereby incorporated herein by reference in their entireties. The thicknesses and materials of the coatings on the substrates of the reflective element may be selected to provide a desired color or tint to the mirror reflective element, such as a blue colored reflector, such as is known in the art and such as described in U.S. Pat. Nos. 5,910,854; 6,420,036; and/or 7,274,501, which are hereby incorporated herein by reference in their entireties.
Optionally, the display or displays and any associated user inputs may be associated with various accessories or systems, such as, for example, a tire pressure monitoring system or a passenger air bag status or a garage door opening system or a telematics system or any other accessory or system of the mirror assembly or of the vehicle or of an accessory module or console of the vehicle, such as an accessory module or console of the types described in U.S. Pat. Nos. 7,289,037; 6,877,888; 6,824,281; 6,690,268; 6,672,744; 6,386,742; and 6,124,886, and/or U.S. patent application Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entireties.
The display or displays may comprise a video display and may utilize aspects of the video display devices or modules described in U.S. Pat. Nos. 6,690,268; 7,184,190; 7,274,501; 7,370,983; and/or 7,446,650, and/or U.S. patent application Ser. No. 12/091,525, filed Apr., 25, 2008, now U.S. Pat. No. 7,855,755; and/or Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are all hereby incorporated herein by reference in their entireties. The video display may be operable to display images captured by one or more imaging sensors or cameras at the vehicle.
Changes and modifications to the specifically described embodiments may be carried out without departing from the principles of the present invention, which is intended to be limited only by the scope of the appended claims as interpreted according to the principles of patent law.
The present application claims the filing benefit of U.S. provisional application Ser. No, 61/503,098, filed Jun. 30, 2011, which is hereby incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61503098 | Jun 2011 | US |
