Vehicular rear backup system

Information

  • Patent Grant
  • 11769335
  • Patent Number
    11,769,335
  • Date Filed
    Friday, November 18, 2022
    a year ago
  • Date Issued
    Tuesday, September 26, 2023
    8 months ago
  • CPC
    • G06V20/58
  • Field of Search
    • CPC
    • H04N23/90
    • H04N7/181
    • H04N23/698
  • International Classifications
    • G06V20/58
    • Disclaimer
      This patent is subject to a terminal disclaimer.
Abstract
A vehicular rear backup system includes a rear backup camera and an electronic control unit (ECU). The camera connects with the ECU via a cable. Image data captured by the camera is converted at a serializer of the camera to serialized image data. The serialized image data is carried to the ECU via the cable and is de-serialized at a de-serializer of the ECU to form de-serialized image data. Responsive at least in part to processing at the ECU of de-serialized image data, the vehicular rear backup system is operable to detect an object present rearward of the vehicle during a rear backup maneuver. Video images derived at least in part from an output generated at the ECU via processing at the ECU of de-serialized image data are displayed at a video display device of the vehicle during the rear backup maneuver of the equipped vehicle.
Description
FIELD OF THE INVENTION

The present invention relates to imaging systems or vision systems for vehicles.


BACKGROUND OF THE INVENTION

Use of imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporated herein by reference in their entireties.


SUMMARY OF THE INVENTION

The present invention provides a vision system or imaging system for a vehicle that utilizes two or more cameras to capture images exterior of the vehicle (such as forwardly and rearwardly of the vehicle), and provides the communication/data signals, including camera data or image data, that may be displayed at a display screen that is viewable by the driver of the vehicle, such as when the driver is backing up the vehicle, and that may be processed and, responsive to such image processing, the system may detect an object at or near the vehicle and in the path of travel of the vehicle, such as when the vehicle is backing up. The vision system may be operable to display a surround view or bird's eye view of the environment at or around or at least partially surrounding the subject or equipped vehicle.


According to an aspect of the present invention, a vision system for a vehicle includes multiple cameras or image sensors disposed at a vehicle and having respective fields of view exterior of the vehicle, and an image processor operable to process data transmitted by the cameras. The vision system includes a forward facing camera module (having image processing circuitry incorporated therein) and a rearward facing vision camera (for capturing video image data that is displayed on a display of the vehicle for viewing by the driver of the vehicle during a reversing maneuver). The video output of the rearward facing vision camera is fed to the forward facing camera module and to the display, so the video images can be viewed by the driver of the vehicle and can be processed by an image processor of the forward facing camera module. The video image data captured by the rearward facing camera may be fed to an amplifier of the forward facing camera module and an output of the amplifier is fed to a decoder of the forward facing camera module and an output of the decoder is fed to the image processor of the forward facing camera module. The vision system may provide a variety of functions by utilizing captured image data from one or more of the cameras at the vehicle, such as a forward facing camera, a rearward facing camera, side view cameras and/or a forward facing windshield mounted camera (having a field of view through the windshield of the vehicle).


These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a plan view of a vehicle with a vision system and imaging sensors or cameras that provide exterior fields of view in accordance with the present invention;



FIG. 2 is a schematic of a vision system of the present invention;



FIG. 3 is a schematic of another vision system of the present invention;



FIG. 4 is a schematic of another vision system of the present invention;



FIG. 5 is a plan view of a vehicle with a vision system and cameras of the present invention;



FIG. 6 is a schematic of a vehicle with a vision system and automatic braking control of the present invention;



FIG. 7 is a schematic of another vehicle vision system of the present invention;



FIG. 8 is a plan view and schematic of a vehicle with a vision system that provides various features in accordance with the present invention;



FIG. 9 is a perspective view of a bicyclist detected by the vision system of the present invention;



FIG. 10 is a plan view of a vehicle with a vision system that detects objects approaching from the rear to limit the vehicle occupant from opening the vehicle door into the path of the object;



FIG. 11 is an image showing a rear pedestrian detection function of the vision system of the present invention;



FIG. 12 is an image showing a rear object detection function of the vision system of the present invention;



FIG. 13 is an image showing a side cross traffic detection function of the vision system of the present invention;



FIGS. 14 and 15 show aspects of an adaptive emergency braking system of the vision system of the present invention;



FIG. 16 is an image showing a rear lane marker detection function of the vision system of the present invention;



FIGS. 17 and 18 are images showing different views based on images captured by a rear camera of the vision system of the present invention; and



FIG. 19 is a schematic of another vehicle vision system of the present invention.





DESCRIPTION OF THE PREFERRED EMBODIMENTS

A vehicle vision system and/or driver assist system and/or object detection system and/or alert system operates to capture images exterior of the vehicle and may process the captured image data to display images and to detect objects at or near the vehicle and in the predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a rearward direction. The vision system includes a processor that is operable to receive image data from the vehicle cameras and may provide a displayed image that is representative of the subject vehicle (such as for a top down or bird's eye or surround view, such as discussed below). The vision and display system may utilize aspects of the systems described in U.S. Pat. No. 7,855,755 and U.S. patent application Ser. No. 12/405,558, filed Mar. 17, 2009, now U.S. Pat. No. 9,019,090, which are hereby incorporated herein by reference in their entireties.


Referring now to the drawings and the illustrative embodiments depicted therein, a vehicle 10 includes an imaging system or vision system 12 that includes at least one exterior facing imaging sensor or camera, such as a rearward facing imaging sensor or camera 14a (and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forwardly facing camera 14b at the front (or at the windshield) of the vehicle, and a sidewardly/rearwardly facing camera 14c, 14b at respective sides of the vehicle), which captures images exterior of the vehicle, with the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera (FIG. 1). The vision system 12 includes a control or processor 18 that is operable to process image data captured by the cameras and may provide displayed images at a display device 16 for viewing by the driver of the vehicle (although shown in FIG. 1 as being part of or incorporated in or at an interior rearview mirror assembly 20 of the vehicle, the control and/or the display device may be disposed elsewhere at or in the vehicle).


The present invention provides a vehicle vision system that integrates the front and rear cameras. For example, a video line or feed from a rearward facing camera may be fed to a front camera module or FCM (that includes a forward facing imager and associated circuitry). Optionally, and as shown in FIG. 2, a rear camera may have a video and ground line connected to or in communication with a decoder (such as an NTSC decoder) of a front camera module. The front camera module includes the decoder and an encoder (such as an NTSC encoder) and an image processor. For example, the image processor may comprise an EYEQ2 image processing chip available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect objects. The power or Vcc line and the Ground line of the rear camera may connect to a display element or module of the vehicle, and the display is in communication with the encoder of the front camera module, as shown in FIG. 2. Thus, the rear camera video feeds into the front camera module decoder and the decoder feeds decoded video to the image processor or EYEQ2 processor, which may process the image data to detect objects or the like, and the decoder and/or processor may feed an output to the encoder, which feeds the encoded signal to the display for displaying video images derived from image data captured by at least the rearward facing camera (and optionally video images derived from image data captured by the forward facing camera and/or one or more sideward facing cameras of the vehicle, such as for a surround view vision system or the like).


Optionally, and as shown in FIG. 3, a rear camera may be in communication with an amplifier of a front camera module, which feeds video to the FCM decoder, which feeds the video to the image processor. The rear video thus feeds video to the FCM, and an internal splice in the FCM provides a video line to the display, while the amplifier isolates the video from the FCM and feeds video to the decoder, which feeds the video into the image processor. Such a configuration provides the camera integration without a change to the rear camera or to the display, and without need for an encoder (thus reducing the cost of the system).


Optionally, and with reference to FIG. 4, a rear camera video output may be fed to a video splitter, which feeds the video to both the forward camera module and the display. Such a configuration provides the camera integration with no change to the rear camera or to the display, and with fewer pins or terminals at the FCM and less or reduced space requirements in the FCM.


Optionally, a second video output may be added to the rear camera, which may provide a vision system with no change to the display, and with fewer pins or terminals at the FCM and less or reduced space requirements in the FCM. Optionally, a video splitter/pass-through may be added to the display, which may provide a vision system with no change to the rear camera, and with fewer pins or terminals at the FCM and less or reduced space requirements in the FCM.


Optionally, the vision system of the present invention may combine image and machine vision, such as when computing power is available for image processing of the captured images. The combination of image vision cameras (that capture images for displaying images to be viewed by the driver of the vehicle) and machine vision processing (that processes image data to provide various features) allows for additional features. Optionally, and with reference to FIGS. 5-8, the vision system may be associated with an emergency braking system of the vehicle and may provide different braking responses or functions depending on the environment in which the vehicle is driven. For example, different braking control may be provided between city speed driving, urban speed driving and when a pedestrian is detected. As shown in FIG. 8, the vision system may provide various features and different types of braking (responsive to different image processing) depending on the driving environment and whether a vehicle or pedestrian is detected by the vision system.


Optionally, and such as discussed above, the vision system of the present invention may have a rearward facing camera (such as an imaging camera for capturing video images for displaying at a display) video output fed as a video input to a machine vision forward camera (with image processing capabilities). Optionally, the machine vision processor may be part of the front camera or may be located at a central ECU of a surround view system (such as shown in FIG. 7). As shown in FIG. 7, the surround view system includes four cameras having forward, rearward and sideward fields of view, and one windshield mounted camera (having a forward field of view through the windshield of the vehicle), with a central ECU having five camera inputs and one display output.


Such a system may provide various features. For example, the system may be operable (utilizing image data captured by the windshield mounted camera and the exterior forward (such as grille mounted) camera) to detect bicyclists traveling along a side region of the road on which the subject vehicle is traveling (such as along a designated bike lane or the like along a side portion of the road surface). The forward camera provides a wider field of view (such as can be seen in FIG. 8) to detect crossing bicycles that are relevant for impact while the vehicle is driven at low speeds. For example, and with reference to FIG. 9, when the vehicle speed is around 10 m/s or thereabouts, the system may be operable to detect the bicycle traveling about 10 m/s at about a 45 degree angle forward and to the side of the vehicle.


Optionally, the vision system may provide a door opening protection feature or function, such as by detecting (via processing image data captured by the sideview camera at each side of the vehicle) an object or vehicle or bicycle approaching from the rear of the subject vehicle (and when the subject vehicle is parked or not moving), and generating an alert (or locking the vehicle door or precluding opening of the vehicle door) if the system determines that the approaching object may hit the vehicle door if the door were opened. For example, and with reference to FIG. 10, if the vision system detects the approaching bicyclist at and to the rear and side of the parked or non-moving subject vehicle, the system may alert the driver and/or passenger of the vehicle to not open the door at that side of the vehicle or may temporarily lock or limit opening of the vehicle door at that side of the vehicle until the detected object passes the door and is no longer a potential threat of impact.


Optionally, the vision system may provide a child presence detection feature or function. For example, the system may detect the presence of a child (such as via processing of image data captured by the front grille camera, the side view cameras and/or the rear camera) and may generate an alert or warning if a child is determined to be present in proximity of the vehicle, optionally even if the child is not in the path of travel of the vehicle and optionally even if the vehicle is not moving. Optionally, such a system may be specific to detection of children (such as by size of the detected person or the like), and not pedestrians in general.


Optionally, the vision system of the present invention may provide other features, such as, for example, blind spot detection function (to limit or prevent accidents during lane change maneuvers), an onramp assist function (to predict whether car can accelerate enough to merge with existing traffic before the end of the onramp), a low speed CMB/pedestrians function (with a wider field of view to detect pedestrians that are relevant for impact while driving at very low speeds (such as around 1-2 m/s or thereabouts or more or less), a prevent running red lights function (such as by generating an alert and/or optionally braking the vehicle), an alert to go when a traffic light changes to green, an automatic cruise control (ACC) automatic go in a stop and go ACC (such as for city driving conditions/environments), a traffic jam assist function (providing lateral and longitudinal control in traffic jam scenarios (low speed, controlled access road)), an enhanced automatic emergency braking (AEB) function based on rear traffic (optionally, for example, overriding or not braking or delaying braking if rear traffic is present), a better lane detection function in low sun or low lighting conditions (with improved availability of lane information such as, for example, for LKA, LDW and the like), a full autonomous driving function including autonomous lane change to overtake slower cars, construction area driving and lane merges, an autonomous pull-over maneuver function in case of an incapacitated and/or unresponsive driver, an automatic trailer hookup function (which is operable to guide the vehicle to a trailer), a trailer backup function (which is operable to automatically steer the vehicle based on a driver selected trajectory), an automatic parking (parallel, perpendicular) function with drive in control of longitudinal movement, an autonomous/remote controlled parking (parallel, perpendicular) function, a traffic sign recognition (TSR) extension to height limitation signs, a parking path height detection function, an AEB function during a reversing or backup maneuver, a traffic sign recognition (TSR) to set ACC speed (so as to provide a speed limiter function or the like), a ball detection function, a pedestrian impact detection function to activate active a pedpro system (such as to use a camera to replace an existing sensor or in addition to another impact sensor), a road friction estimation function (such as for determining if the vehicle is traveling on snow, gravel, ice or the like) to adjust the AEB thresholds and/or curve speed warning, a pothole depth and speed bump height estimation function for an active suspension control, a read license plate of preceding/following vehicle function (such as, for example, for Amber Alert notifications and the like), a curb detection/warning if a curb is too high to drive onto (such as if the vehicle is being driven towards a curb, so as to limit or prevent damage to the wheels or rims of the vehicle), an application of 3D information to parking situations function, a perspective correction function for a more accurate birds eye view (more realistic image), an ACC function that limits or precludes acceleration of the subject vehicle when the subject vehicle is being overtaken by another vehicle, and/or a lighting control function (such as providing an adjust lighting decision based on knowledge or other car overtaking of driving parallel to the subject vehicle, and/or the like.


Optionally, the vision system of the present invention may be operable to provide various functions. For example, the vision system may operate with or be associated with an adaptive automatic emergency braking (AEB) system of the vehicle, such that, when the subject vehicle determines that braking is desired or appropriate, the subject vehicle may, for example, brake earlier and/or harder, if no vehicle is following (as determined by image processing of the image data captured by the rearward facing camera), and risk of rear end collision is low, or may brake later, if the vision system determines that a vehicle is following, and the risk of rear end collision is higher. Optionally, the vision system may provide improved or enhanced lane detection at low sun/and increased availability of LDW based on detecting lanes in the rear camera images. Optionally, the vision system may provide rear pedestrian detection, and may provide a warning or may brake if a pedestrian is detected in the rear images, such as during a reversing maneuver of the vehicle. Optionally, the vision system may provide a rear object detection, and may provide a warning or the like if a general object is detected in the rear images. Optionally, the vision system may provide a rear cross traffic alert function, and may detect or determine crossing vehicles and may be operable to alert or warn the driver of the subject vehicle of crossing vehicles when the driver is reversing or backing up the subject vehicle.


For example, the vision system may provide pedestrian detection when backing up by determining when a pedestrian is present in the rearward field of view of the camera. The system may detect standing/walking adults and children at relevant ranges, with reasonable false alarm rate (such as, for example, 1 false detection per 50 or more backup maneuvers). The system may utilize pedestrian detection and classification aspects from a front object detection system applied to rear image processing (FIG. 11). The system may use additional crossing cues for moving pedestrians. The system may determine that a detected object is a pedestrian and generate an output based on various aspects of the object, such as a lateral distance to the object, a longitudinal distance to the object, the object height, the object width, an X-position in the captured image and/or a Y-position in the captured image and/or the like. The vision system thus may reduce the risk of back-over accidents, and, if driver is not looking at the rear camera display (such as indicated by the driver not braking the vehicle when the display shows an object or pedestrian rearward of the vehicle during a reversing maneuver), the system may generate an alert to warn the driver of a rear pedestrian detection and/or generate automatic braking to slow or stop the vehicle.


Similarly, the vision system may provide a rear object detection function to detect larger objects rearward of the vehicle (FIG. 12). The vision system may utilize SFM (structure from motion) and use image sequences to compute a dense three dimensional map of the road and stationary objects above the road, and the system may use lateral motion detection for general moving objects. The vision system thus may reduce the risk of back-over accidents, and, if driver is not looking at the rear camera display, the system may generate an alert to warn the driver of a rear pedestrian detection and/or generate automatic braking to slow or stop the vehicle.


Optionally, the vision system may provide a rear cross traffic alert function and may detect crossing vehicles in or approaching the rearward path of the subject vehicle during a reversing maneuver of the subject vehicle (FIG. 13). The system may utilize vehicle detection (pattern based) and lateral motion detection to identify cross traffic and warn the driver of the subject vehicle based on such detection and identification. The algorithm performance of the system may depend on the quality of the images and vehicles in image. For example, the system may detect sideward approaching vehicles from up to about 30 m to either side of the subject vehicle. Optionally, and desirably, the system may optimize rear camera distortion correction to work with the vehicle detection algorithm to enhance such detection and identification of approaching vehicles. The vision system thus limits or substantially reduces collisions with crossing traffic rearward of the subject vehicle during a reversing maneuver of the subject vehicle, and the system may generate an alert to warn the driver of the subject vehicle of an approaching vehicle (and may identify or inform the driver as to which side of the subject vehicle the detected vehicle is approaching from).


Optionally, the vision system may provide an adaptive automatic emergency braking (AEB) function (FIGS. 14 and 15). For example, the AEB may be based on the presence of a following vehicle (a vehicle following the subject vehicle) when the subject vehicle vision system has detected a vehicle or object ahead of the subject vehicle that presents a condition or situation that may require braking of the subject vehicle to avoid a collision with the detected object or vehicle. The AEB system is operable to brake earlier and/or harder if no vehicle is detected behind or following the subject vehicle, and the risk of a rear end collision is thus low, and/or the AEB system is operable to brake later if a vehicle is detected behind or following the subject vehicle, and risk of a rear end collision is thus higher. The system may utilize pattern based vehicle detection to detect vehicles (such as vehicles up to about 50 to 60 meters (or more) ahead and/or behind the subject vehicle) and may determine if a detected following vehicle object is in the same lane or adjacent lane as the subject vehicle and may determine the distance that the detected following vehicle is behind the subject vehicle, and may adapt the braking application accordingly. The vision system may provide an earlier warning to the driver of the subject vehicle and may provide a reduced risk of false brake activation.


Optionally, the vision system may utilize rear image processing for lane detection (FIG. 16). For example, the system may apply lane detection and tracking aspects from front image processing to rear images captured by one or more rearward facing cameras of the vehicle. The system may detect the lane markings and may determine the lateral distance to a left or right lane marking, and may control steering and/or provide an alert to the driver responsive to the detected distance to the lane markings. The system thus provides increased availability of lane information to the driver, and may warn the driver even where lane departure prevention (LDP) from the front camera may not be available, such as in low lighting conditions or situations, traffic jams (when preceding vehicles block lane markings), tunnel entry and/or the like. Optionally, it is envisioned that the rear lane detection of the present invention may be used for autonomous driving/lane keeping where high lane data availability is important.


The vision system of the present invention may capture rearward images and may display different aspects or portions of the captured images for different information display functions (such as during a reversing maneuver and the like, where a wide angle rearward image is desired). For example, and with reference to FIGS. 17 and 18, the system may provide an uncorrected raw view, a corrected wide view, a normal view and a top view for different functions or applications. Preferably, the vision system will apply the image processing (for object detection and the like) to one of the views, such as the corrected wide view, which is presentable to the driver at the display screen, and provides a wide angle field of view for rear cross traffic detection. While the normal view and the top view are also presentable to the driver, the normal view is not typically wide enough for rear cross traffic detection and the top view is a special view with limited range.


Optionally, and with reference to FIG. 19, the vision system may be operable to process image data captured from a front camera and image data captured from a rear camera using a common image processor (such as by utilizing aspects of the systems described in U.S. Pat. No. 7,855,755, which is hereby incorporated herein by reference in its entirety). The system may utilize NTSC rear video or may utilize a rear megapixel camera or the like. By relying on the rear camera to create three different view modes (wide, normal, top-view), the cross traffic alert will only work when the rear camera is in wide view mode. Because the view mode is typically selected by the driver using hardwired connections, the system does not control the view mode. The system relies on the display to create overlays, so the system preferably can manage latency problems between detection and overlay presentation. An advantage to this type of system is that it may provide the desired features at a relatively lower cost or reduced cost.


Optionally, and with reference to FIG. 19, the vision system may comprise a forward facing camera and a rearward facing camera and a separate common image processor. In the illustrated embodiment, the rear camera images are transmitted via LVDS (preferably over coaxial cables) to the image processor (such as an EYEQ2 or EYEQ3 image processor available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel), and the communication cables may utilize aspects of the systems described in International Publication No. WO 2013/043661, which is hereby incorporated by reference in its entirety. The image processor is operable to interpret the image, and also creates the different views desired by vehicle manufacturer, including cropping, distortion correction, and overlay generation. The visual image manipulation is implemented by algorithms or code running on the image processor, and the image is then sent to the display in a “ready to view” format.


Because the vision system of FIG. 19 adds two video connectors to the front camera, it may not be ideal for typical forward facing camera or imager package at the windshield. Instead, the vision system of FIG. 19 separates the front camera and the image processor and thus provides a two-box solution, with the image processing board being removed from the camera and disposed at or in a second box or module or unit that can be packaged anywhere in the vehicle. The vision system thus may meet the cross traffic requirements, including the hardwired interfaces for which there typically is not enough connector space at the windshield, and the system may achieve better overall system performance, since there is more information provided from the rear imager (both by virtue of being higher resolution and by providing pixel accurate data), and the system may be able to run cross traffic alerts with all of the desired views.


The vision system thus may feed video from a rear imager or rearward facing camera and may feed video from a front imager or forward facing camera into a separate and common image processing unit or module where there is separation between image manipulation software for processing images for display and image data processing for processing image data for object detection and/or the like. The image processor is thus decoupled from both imagers and could be disposed anywhere in the vehicle (and optionally could be disposed at or near or in the forward facing camera module). The image processor has both front and rear camera feeds and can process image data from both cameras simultaneously. The system thus utilizes software building blocks that can be applied to the front and rear images. The common image processor may be operable to utilize SFM on the front and rear images, and the image data or processed output may be passed to other algorithms for image manipulation for presenting the information for viewing by the driver at the display screen. The system may utilize coaxial cable that carries the camera or image signal and power bi-directionally. Such cables reduce the cost of the transmission/communication and makes the option of having a separate common image processor more attractive to the vehicle manufacturer (due to the lower cost cables and connectors such that the additional connectors and cables do not significantly add to the cost of the system).


In applications where the system operates as an automatic emergency braking system, it is important that a certain degree of safeness of absence of unjustified braking events is provided. Customers (driven by ISO26262) require certain theoretical analysis to guarantee a vehicle is “safe” (in the case of an emergency braking system, such safety is defined as “lack of unjustified brake events”). It is difficult to theoretically prove that the system (such as the image processor, such as a Mobileye EYEQ type image processor or the like) doesn't cause unjustified brake events. However, ISO26262 also accepts a “proven in use” argument that may be used for camera-based emergency braking. The method to develop an emergency braking system that utilizes such a “proven in use” feature comprises the following steps:


1. Develop a signal to initiate emergency braking. For example, this signal could be generated when the determined “time to contact” (TTC) is less than about 0.7 sec and the vehicle speed is less than 80 km/h.


2. During a first time period, the system may monitor all vehicles in which the signal occurs. This can be done using a Trip Statistics and Alert Data Download (TSADD) feature. As part of this feature, vehicle data (including, for example, vehicle speed, brake activation, and/or compressed camera images or the like) may be collected that allows an evaluation as to whether or not the signal was justified. The vehicle data may be collected via any suitable means, such as through a telematics system of the vehicle (such as, for example, ONSTAR®) or the like.


3. The system evaluates the signals that occurred in a large set of vehicles and over a prolonged period of time. In other words, the system uses more than just a handful of test vehicles, and instead may monitor, for example, about 100,000 (or more or less) customer vehicles over the course of several months to a year (or more or less) to collect a statistically significant set of signals.


4. If, in step 3, it can be concluded that the signal is clear of unjustified brake events, the system may use the signal which has now been proven in use to automatically activate brakes when the appropriate condition is detected.


Thus, the present invention is operable to provide an enhanced determination of the safeness of the AEB system by determining and using signals and parameters that have been tested in real life situations and determined to have resulted in few or no unjustified braking events. The present invention uses “proven in use” signals and parameters to derive an appropriate signal for that vehicle and/or vehicle type and/or driving conditions and/or the like.


The cameras or sensors may comprise any suitable cameras or sensors. Optionally, the camera may comprise a “smart camera” that includes the imaging sensor array and associated circuitry and image processing circuitry and electrical connectors and the like as part of a camera module, such as by utilizing aspects of the vision systems described in PCT Application No. PCT/US2012/066570, filed Nov. 27, 2012, and published on Jun. 6, 2013 as International Publication No. WO 2013/081984, and/or PCT Application No. PCT/US2012/066571, filed Nov. 27, 2012, and published Jun. 6, 2013 as International Publication No. WO 2013081985, which are hereby incorporated herein by reference in their entireties.


The system includes an image processor operable to process image data captured by the camera or cameras, such as for detecting objects or other vehicles or pedestrians or the like in the field of view of one or more of the cameras. For example, the image processor may comprise an EYEQ2 or EYEQ3 image processing chip available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect vehicles and/or other objects. Responsive to such image processing, and when an object or other vehicle is detected, the system may generate an alert to the driver of the vehicle and/or may generate an overlay at the displayed image to highlight or enhance display of the detected object or vehicle, in order to enhance the driver's awareness of the detected object or vehicle or hazardous condition during a driving maneuver of the equipped vehicle.


The vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ladar sensors or ultrasonic sensors or the like. The imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, an array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows (at least a 640×480 imaging array, such as a megapixel imaging array or the like), with a respective lens focusing images onto respective portions of the array. The photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns. The logic and control circuit of the imaging sensor may function in any known manner, and the image processing and algorithmic processing may comprise any suitable means for processing the images and/or image data.


For example, the vision system and/or processing and/or camera and/or circuitry may utilize aspects described in U.S. Pat. Nos. 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935; 6,636,258; 7,145,519; 7,161,616; 7,230,640; 7,248,283; 7,295,229; 7,301,466; 7,592,928; 7,881,496; 7,720,580; 7,038,577; 6,882,287; 5,929,786 and/or 5,786,772, and/or International Publication Nos. WO 2011/028686; WO 2010/099416; WO 2012/061567; WO 2012/068331; WO 2012/075250; WO 2012/103193; WO 2012/0116043; WO 2012/0145313; WO 2012/0145501; WO 2012/145818; WO 2012/145822; WO 2012/158167; WO 2012/075250; WO 2012/103193; WO 2012/0116043; WO 2012/0145501; WO 2012/0145343; WO 2012/154919; WO 2013/019707; WO 2013/016409; WO 20102/145822; WO 2013/043661; WO 2013/048994, and/or PCT Application No. PCT/US2012/061548, filed Oct. 24, 2012, and published on May 2, 2013 as International Publication No. WO 2013/063014, and/or PCT Application No. PCT/US2012/062906, filed Nov. 1, 2012, and published May 10, 2013 as International Publication No. WO 2013/067083, and/or PCT Application No. PCT/US2012/063520, filed Nov. 5, 2012, and published May 16, 2013 as International Publication No. WO 2013/070539, and/or PCT Application No. PCT/US2012/064980, filed Nov. 14, 2012, and published May 23, 2013 as International Publication No. WO 2013/074604, and/or PCT Application No. PCT/US2012/066570, filed Nov. 27, 2012, and published Jun. 6, 2013 as International Publication No. WO 2013/081984, and/or PCT Application No. PCT/US2012/066571, filed Nov. 27, 2012, and published Jun. 6, 2013 as International Publication No. WO 2013/081985, and/or PCT Application No. PCT/US2012/068331, filed Dec. 7, 2012, and published Jun. 13, 2013 as International Publication No. WO 2013/086249, and/or PCT Application No. PCT/US2012/071219, filed Dec. 21, 2012, and published Jul. 11, 2013 as International Publication No. WO 2013/103548, and/or PCT Application No. PCT/US2013/022119, filed Jan. 18, 2013, and published Jul. 25, 2013 as International Publication No. WO 2013/109869, and/or PCT Application No. PCT/US2013/026101, filed Feb. 14, 2013, and published Aug. 22, 2013 as International Publication No. WO 2013/123161, and/or PCT Application No. PCT/US2013/027342, filed Feb. 22, 2013, and published Aug. 9, 2013 as International Publication No. WO 2013/126715, and/or PCT Application No. PCT/US2013/036701, filed Apr. 16, 2013, and published Oct. 24, 2013 as International Publication No. WO 2013/158592 and/or U.S. patent application Ser. No. 13/851,378, filed Mar. 27, 2013, now U.S. Pat. No. 9,319,637; Ser. No. 13/848,796, filed Mar. 22, 2013, and published on Oct. 24, 2013 as U.S. Patent Publication No. US-2013-0278769; Ser. No. 13/847,815, filed Mar. 20, 2013, and published on Oct. 31, 2013 as U.S. Patent Publication No. US-2013-0286193; Ser. No. 13/800,697, filed Mar. 13, 2013, and published on Oct. 3, 2013 as U.S. Patent Publication No. US-2013-0258077; Ser. No. 13/785,099, filed Mar. 5, 2013, now U.S. Pat. No. 9,565,342; Ser. No. 13/779,881, filed Feb. 28, 2013, now U.S. Pat. No. 8,694,224; Ser. No. 13/774,317, filed Feb. 22, 2013, now U.S. Pat. No. 9,269,263; Ser. No. 13/774,315, filed Feb. 22, 2013, and published on Aug. 22, 2013 as U.S. Patent Publication No. US-2013-0215271; Ser. No. 13/681,963, filed Nov. 20, 2012, now U.S. Pat. No. 9,264,673; Ser. No. 13/660,306, filed Oct. 25, 2012, now U.S. Pat. No. 9,146,898; Ser. No. 13/653,577, filed Oct. 17, 2012, now U.S. Pat. No. 9,174,574; and/or Ser. No. 13/534,657, filed Jun. 27, 2012, and published on Jan. 3, 2013 as U.S. Patent Publication No. US-2013-0002873, and/or U.S. provisional applications, Ser. No. 61/813,361, filed Apr. 18, 2013; Ser. No. 61/840,407, filed Apr. 10, 2013; Ser. No. 61/808,930, filed Apr. 5, 2013; Ser. No. 61/807,050, filed Apr. 1, 2013; Ser. No. 61/806,674, filed Mar. 29, 2013; Ser. No. 61/806,673, filed Mar. 29, 2013; Ser. No. 61/804,786, filed Mar. 25, 2013; Ser. No. 61/793,592, filed Mar. 15, 2013; Ser. No. 61/793,614, filed Mar. 15, 2013; Ser. No. 61/793,558, filed Mar. 15, 2013; Ser. No. 61/772,015, filed Mar. 4, 2013; Ser. No. 61/772,014, filed Mar. 4, 2013; Ser. No. 61/770,051, filed Feb. 27, 2013; Ser. No. 61/770,048, filed Feb. 27, 2013; Ser. No. 61/766,883, filed Feb. 20, 2013; Ser. No. 61/760,366, filed Feb. 4, 2013; Ser. No. 61/760,364, filed Feb. 4, 2013; Ser. No. 61/758,537, filed Jan. 30, 2013; Ser. No. 61/756,832, filed Jan. 25, 2013; Ser. No. 61/754,804, filed Jan. 21, 2013; Ser. No. 61/745,925, filed Dec. 26, 2012; Ser. No. 61/745,864, filed Dec. 26, 2012; Ser. No. 61/736,104, filed Dec. 12, 2012; Ser. No. 61/736,103, filed Dec. 12, 2012; Ser. No. 61/735,314, filed Dec. 10, 2012; Ser. No. 61/734,457, filed Dec. 7, 2012; Ser. No. 61/733,598, filed Dec. 5, 2012; Ser. No. 61/733,093, filed Dec. 4, 2012; Ser. No. 61/727,912, filed Nov. 19, 2012; Ser. No. 61/727,911, filed Nov. 19, 2012; Ser. No. 61/727,910, filed Nov. 19, 2012; Ser. No. 61/718,382, filed Oct. 25, 2012; Ser. No. 61/713,772, filed Oct. 15, 2012; Ser. No. 61/710,924, filed Oct. 8, 2012; Ser. No. 61/710,247, filed Oct. 2, 2012; Ser. No. 61/696,416, filed Sep. 4, 2012; Ser. No. 61/682,995, filed Aug. 14, 2012; Ser. No. 61/682,486, filed Aug. 13, 2012; Ser. No. 61/680,883, filed Aug. 8, 2012; Ser. No. 61/678,375, filed Aug. 1, 2012; Ser. No. 61/676,405, filed Jul. 27, 2012; Ser. No. 61/666,146, filed Jun. 29, 2012; Ser. No. 61/653,665, filed May 31, 2012; Ser. No. 61/653,664, filed May 31, 2012; Ser. No. 61/648,744, filed May 18, 2012, which are all hereby incorporated herein by reference in their entireties. The system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in International Publication Nos. WO 2013/043661 and/or WO 2010/144900, and/or PCT Application No. PCT/US2012/066571, filed Nov. 27, 2012, and published Jun. 6, 2013 as International Publication No. WO 2013081985, and/or U.S. patent application Ser. No. 13/202,005, filed Aug. 17, 2011, now U.S. Pat. No. 9,126,525, which are hereby incorporated herein by reference in their entireties.


The imaging device and control and image processor and any associated illumination source, if applicable, may comprise any suitable components, and may utilize aspects of the cameras and vision systems described in U.S. Pat. Nos. 5,550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094; 6,396,397; 6,806,452; 6,690,268; 7,005,974; 7,937,667; 7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176; 6,313,454 and 6,824,281, and/or International Publication Nos. WO 2010/099416 and/or WO 2011/028686, and/or U.S. patent application Ser. No. 12/508,840, filed Jul. 24, 2009, and published Jan. 28, 2010 as U.S. Pat. Publication No. US 2010-0020170, and/or PCT Application No. PCT/US2012/048110, filed Jul. 25, 2012, and published on Jan. 31, 2013 as International Publication No. WO 2013/016409, and/or U.S. patent application Ser. No. 13/534,657, filed Jun. 27, 2012, and published on Jan. 3, 2013 as U.S. Patent Publication No. US-2013-0002873, which are all hereby incorporated herein by reference in their entireties. The camera or cameras may comprise any suitable cameras or imaging sensors or camera modules, and may utilize aspects of the cameras or sensors described in U.S. patent application Ser. No. 12/091,359, filed Apr. 24, 2008 and published Oct. 1, 2009 as U.S. Publication No. US-2009-0244361; and/or Ser. No. 13/260,400, filed Sep. 26, 2011, now U.S. Pat. Nos. 8,542,451, and/or 7,965,336 and/or 7,480,149, which are hereby incorporated herein by reference in their entireties. The imaging array sensor may comprise any suitable sensor, and may utilize various imaging sensors or imaging array sensors or cameras or the like, such as a CMOS imaging array sensor, a CCD sensor or other sensors or the like, such as the types described in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,715,093; 5,877,897; 6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,201,642; 6,498,620; 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 6,806,452; 6,396,397; 6,822,563; 6,946,978; 7,339,149; 7,038,577; 7,004,606; 7,720,580 and/or 7,965,336, and/or International Publication Nos. WO 2009/036176 and/or WO 2009/046268, which are all hereby incorporated herein by reference in their entireties.


The camera module and circuit chip or board and imaging sensor may be implemented and operated in connection with various vehicular vision-based systems, and/or may be operable utilizing the principles of such other vehicular systems, such as a vehicle headlamp control system, such as the type disclosed in U.S. Pat. Nos. 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 7,004,606; 7,339,149 and/or 7,526,103, which are all hereby incorporated herein by reference in their entireties, a rain sensor, such as the types disclosed in commonly assigned U.S. Pat. Nos. 6,353,392; 6,313,454; 6,320,176 and/or 7,480,149, which are hereby incorporated herein by reference in their entireties, a vehicle vision system, such as a forwardly, sidewardly or rearwardly directed vehicle vision system utilizing principles disclosed in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,877,897; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978 and/or 7,859,565, which are all hereby incorporated herein by reference in their entireties, a trailer hitching aid or tow check system, such as the type disclosed in U.S. Pat. No. 7,005,974, which is hereby incorporated herein by reference in its entirety, a reverse or sideward imaging system, such as for a lane change assistance system or lane departure warning system or for a blind spot or object detection system, such as imaging or detection systems of the types disclosed in U.S. Pat. Nos. 7,720,580; 7,038,577; 5,929,786 and/or 5,786,772, and/or U.S. patent application Ser. No. 11/239,980, filed Sep. 30, 2005, now U.S. Pat. No. 7,881,496, and/or U.S. provisional applications, Ser. No. 60/628,709, filed Nov. 17, 2004; Ser. No. 60/614,644, filed Sep. 30, 2004; Ser. No. 60/618,686, filed Oct. 14, 2004; Ser. No. 60/638,687, filed Dec. 23, 2004, which are hereby incorporated herein by reference in their entireties, a video device for internal cabin surveillance and/or video telephone function, such as disclosed in U.S. Pat. Nos. 5,760,962; 5,877,897; 6,690,268 and/or 7,370,983, and/or U.S. patent application Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entireties, a traffic sign recognition system, a system for determining a distance to a leading or trailing vehicle or object, such as a system utilizing the principles disclosed in U.S. Pat. Nos. 6,396,397 and/or 7,123,168, which are hereby incorporated herein by reference in their entireties, and/or the like.


Optionally, the circuit board or chip may include circuitry for the imaging array sensor and or other electronic accessories or features, such as by utilizing compass-on-a-chip or EC driver-on-a-chip technology and aspects such as described in U.S. Pat. Nos. 7,255,451 and/or 7,480,149; and/or U.S. patent application Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008, and/or Ser. No. 12/578,732, filed Oct. 14, 2009, now U.S. Pat. No. 9,487,144, which are hereby incorporated herein by reference in their entireties.


Optionally, the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle. Optionally, for example, the vision system may include a video display device disposed at or in the interior rearview mirror assembly of the vehicle, such as by utilizing aspects of the video mirror display systems described in U.S. Pat. No. 6,690,268 and/or U.S. patent application Ser. No. 13/333,337, filed Dec. 21, 2011, now U.S. Pat. No. 9,264,672, which are hereby incorporated herein by reference in their entireties. The video mirror display may comprise any suitable devices and systems and optionally may utilize aspects of the compass display systems described in U.S. Pat. Nos. 7,370,983; 7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 4,546,551; 5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,677,851; 5,708,410; 5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,508; 6,222,460; 6,513,252 and/or 6,642,851, and/or European patent application, published Oct. 11, 2000 under Publication No. EP 0 1043566, and/or U.S. patent application Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008, which are all hereby incorporated herein by reference in their entireties. Optionally, the video mirror display screen or device may be operable to display images captured by a rearward viewing camera of the vehicle during a reversing maneuver of the vehicle (such as responsive to the vehicle gear actuator being placed in a reverse gear position or the like) to assist the driver in backing up the vehicle, and optionally may be operable to display the compass heading or directional heading character or icon when the vehicle is not undertaking a reversing maneuver, such as when the vehicle is being driven in a forward direction along a road (such as by utilizing aspects of the display system described in International Publication No. WO 2012/051500, which is hereby incorporated herein by reference in its entirety).


Optionally, the vision system (utilizing the forward facing camera and a rearward facing camera and other cameras disposed at the vehicle with exterior fields of view) may be part of or may provide a display of a top-down view or birds-eye view system of the vehicle or a surround view at the vehicle, such as by utilizing aspects of the vision systems described International Publication Nos. WO 2010/099416; WO 2011/028686; WO 2012/075250; WO 2013/019795; WO 2012-075250; WO 2012/154919; WO 2012/0116043; WO 2012/0145501 and/or WO 2012/0145313, and/or PCT Application No. PCT/CA2012/000378, filed Apr. 25, 2012, and published Nov. 1, 2012 as International Publication No. WO 2012/145822, and/or PCT Application No. PCT/US2012/066571, filed Nov. 27, 2012, and published Jun. 6, 2013 as International Publication No. WO 2013081985, and/or PCT Application No. PCT/US2012/068331, filed Dec. 7, 2012, and published Jun. 13, 2013 as International Publication No. WO 2013/086249, and/or PCT Application No. PCT/US2013/022119, filed Jan. 18, 2013, and published Jul. 25, 2013 as International Publication No. WO 2013/109869, and/or U.S. patent application Ser. No. 13/333,337, filed Dec. 21, 2011, now U.S. Pat. No. 9,264,672, which are hereby incorporated herein by reference in their entireties.


Optionally, a video mirror display may be disposed rearward of and behind the reflective element assembly and may comprise a display such as the types disclosed in U.S. Pat. Nos. 5,530,240; 6,329,925; 7,855,755; 7,626,749; 7,581,859; 7,446,650; 7,370,983; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 5,668,663; 5,724,187 and/or 6,690,268, and/or in U.S. patent application Ser. No. 12/091,525, filed Apr. 25, 2008, now U.S. Pat. No. 7,855,755; Ser. No. 11/226,628, filed Sep. 14, 2005 and published Mar. 23, 2006 as U.S. Publication No. US-2006-0061008; and/or Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are all hereby incorporated herein by reference in their entireties. The display is viewable through the reflective element when the display is activated to display information. The display element may be any type of display element, such as a vacuum fluorescent (VF) display element, a light emitting diode (LED) display element, such as an organic light emitting diode (OLED) or an inorganic light emitting diode, an electroluminescent (EL) display element, a liquid crystal display (LCD) element, a video screen display element or backlit thin film transistor (TFT) display element or the like, and may be operable to display various information (as discrete characters, icons or the like, or in a multi-pixel manner) to the driver of the vehicle, such as passenger side inflatable restraint (PSIR) information, tire pressure status, and/or the like. The mirror assembly and/or display may utilize aspects described in U.S. Pat. Nos. 7,184,190; 7,255,451; 7,446,924 and/or 7,338,177, which are all hereby incorporated herein by reference in their entireties. The thicknesses and materials of the coatings on the substrates of the reflective element may be selected to provide a desired color or tint to the mirror reflective element, such as a blue colored reflector, such as is known in the art and such as described in U.S. Pat. Nos. 5,910,854; 6,420,036 and/or 7,274,501, which are hereby incorporated herein by reference in their entireties.


Optionally, the display or displays and any associated user inputs may be associated with various accessories or systems, such as, for example, a tire pressure monitoring system or a passenger air bag status or a garage door opening system or a telematics system or any other accessory or system of the mirror assembly or of the vehicle or of an accessory module or console of the vehicle, such as an accessory module or console of the types described in U.S. Pat. Nos. 7,289,037; 6,877,888; 6,824,281; 6,690,268; 6,672,744; 6,386,742 and 6,124,886, and/or U.S. patent application Ser. No. 10/538,724, filed Jun. 13, 2005 and published Mar. 9, 2006 as U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entireties.


Changes and modifications to the specifically described embodiments may be carried out without departing from the principles of the present invention, which is intended to be limited only by the scope of the appended claims as interpreted according to the principles of patent law.

Claims
  • 1. A vehicular rear backup system, the vehicular rear backup system comprising: a rear backup camera disposed at an exterior portion of a vehicle equipped with the vehicular rear backup system and viewing at least rearward of the equipped vehicle;the rear backup camera comprising an imaging sensor;wherein the imaging sensor of the rear backup camera comprises a megapixel array having at least one million photosensors arranged in multiple columns and multiple rows;wherein the rear backup camera is operable to capture image data;wherein the rear backup camera comprises a serializer operable to serialize image data captured by the rear backup camera;an electronic control unit (ECU);wherein the ECU comprises (i) a de-serializer, (ii) an electrical power source and (iii) an image processor;wherein the rear backup camera connects with the ECU via a first cable;wherein communication between the rear backup camera and the ECU via the first cable is bidirectional;wherein electrical power for the rear backup camera is carried from the ECU to the rear backup camera via the first cable;wherein image data captured by the imaging sensor of the rear backup camera is converted at the serializer to serialized image data that is carried to the ECU via the first cable;wherein serialized image data carried to the ECU via the first cable is de-serialized at the de-serializer of the ECU to form de-serialized image data;wherein, responsive at least in part to processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system is operable to detect an object present rearward of the equipped vehicle during a rear backup maneuver of the equipped vehicle; andwherein video images derived at least in part from an output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera are displayed at a video display device of the equipped vehicle during the rear backup maneuver of the equipped vehicle, the video display device comprising a video display screen viewable by a driver of the equipped vehicle.
  • 2. The vehicular rear backup system of claim 1, wherein, at least in part responsive to processing at the ECU of de-serialized image data, the vehicular rear backup system determines that the detected object comprises a pedestrian.
  • 3. The vehicular rear backup system of claim 2, wherein, at least in part responsive to processing at the ECU of de-serialized image data, the vehicular rear backup system distinguishes a pedestrian who is a child from a pedestrian who is an adult.
  • 4. The vehicular rear backup system of claim 2, wherein the ECU connects with a vehicle communication bus of the equipped vehicle.
  • 5. The vehicular rear backup system of claim 4, wherein the vehicle communication bus of the equipped vehicle comprises a CAN bus.
  • 6. The vehicular rear backup system of claim 2, wherein, responsive to the vehicular rear backup system determining that the detected object comprises a pedestrian, the vehicular rear backup system controls braking of the equipped vehicle.
  • 7. The vehicular rear backup system of claim 6, wherein the vehicular rear backup system controls braking of the equipped vehicle based at least in part on an environment in which the equipped vehicle is driven.
  • 8. The vehicular rear backup system of claim 7, wherein the environment comprises presence of pedestrian traffic rearward of the equipped vehicle.
  • 9. The vehicular rear backup system of claim 7, wherein the environment comprises presence of vehicles rearward of the equipped vehicle.
  • 10. The vehicular rear backup system of claim 1, wherein communication between the rear backup camera and the ECU utilizes Low-Voltage Differential Signaling (LVDS).
  • 11. The vehicular rear backup system of claim 1 wherein the output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera is provided to the video display device via a second cable.
  • 12. The vehicular rear backup system of claim 1, wherein the image processor comprises an image processing chip.
  • 13. The vehicular rear backup system of claim 1, wherein, responsive to processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera, and responsive at least in part to determination by the vehicular rear backup system that the equipped vehicle and the detected object may collide, the vehicular rear backup system at least in part controls a braking system of the equipped vehicle.
  • 14. The vehicular rear backup system of claim 1, wherein the output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera is at least in part generated via processing by the image processor at the ECU of de-serialized image data.
  • 15. The vehicular rear backup system of claim 14, wherein the image processor comprises an image processing chip.
  • 16. The vehicular rear backup system of claim 15, wherein, during the rear backup maneuver of the equipped vehicle and at least in part responsive to processing at the ECU of de-serialized image data, the driver of the equipped vehicle is alerted to presence of a pedestrian viewed by the rear backup camera via an overlay overlaying video images derived at least in part from the output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera and displayed at the video display device of the equipped vehicle during the rear backup maneuver of the equipped vehicle.
  • 17. The vehicular rear backup system of claim 1, further comprising a front camera disposed at an exterior portion of the equipped vehicle, and wherein, with the front camera disposed at the exterior portion of the equipped vehicle, the front camera at least views forward of the equipped vehicle, and wherein the front camera comprises an imaging sensor comprising an array of at least one million photosensor elements arranged in multiple columns and multiple rows, and wherein the front camera is operable to capture image data, and wherein the front camera comprises a second serializer operable to serialize image data captured by the front camera, and wherein the ECU comprises a second de-serializer, and wherein the front camera connects with the ECU via a second cable, and wherein image data captured by the imaging sensor of the front camera is converted at the second serializer to second serialized image data that is carried to the ECU via the second cable, and wherein second serialized image data carried to the ECU via the second cable is de-serialized at the second de-serializer of the ECU to form second de-serialized image data.
  • 18. The vehicular rear backup system of claim 17, wherein video images derived at least in part from an output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the front camera are displayed at the video display device of the equipped vehicle, and wherein the output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the front camera is at least in part generated via processing at the ECU of second de-serialized image data.
  • 19. The vehicular rear backup system of claim 18, wherein, at least in part responsive to processing at the ECU of second de-serialized image data, the vehicular rear backup system is operable to detect an object approaching the equipped vehicle from forward of the equipped vehicle.
  • 20. The vehicular rear backup system of claim 17, wherein the rear backup camera is part of a multi-camera surround view system of the equipped vehicle, and wherein the multi-camera surround view system of the equipped vehicle includes four cameras comprising (i) the front camera, (ii) the rear backup camera, (iii) a driver-side sideview camera and (iv) a passenger-side sideview camera.
  • 21. The vehicular rear backup system of claim 20, wherein image data captured by the four cameras of the multi-camera surround view system of the equipped vehicle is provided to, and is processed at, the ECU, and wherein, responsive to processing at the ECU of image data captured by the four cameras and provided to the ECU, surround view video images of an environment at least partially surrounding the equipped vehicle are displayed at the video display device.
  • 22. The vehicular rear backup system of claim 1, wherein the vehicular rear backup system detects a pedestrian standing rearward of the equipped vehicle.
  • 23. The vehicular rear backup system of claim 1, wherein the vehicular rear backup system detects a pedestrian walking rearward of the equipped vehicle.
  • 24. The vehicular rear backup system of claim 1, wherein the output generated at the ECU via processing at the ECU of de-serialized image data derived from image data captured by the imaging sensor of the rear backup camera is generated based on at least one selected from the group consisting of (i) lateral distance to the detected object, (ii) longitudinal distance to the detected object, (iii) height of the detected object, (iv) width of the detected object and (v) position of the detected object.
  • 25. A vehicular rear backup system, the vehicular rear backup system comprising: a rear backup camera disposed at an exterior portion of a vehicle equipped with the vehicular rear backup system and viewing at least rearward of the equipped vehicle;the rear backup camera comprising an imaging sensor;wherein the imaging sensor of the rear backup camera comprises a megapixel array having at least one million photosensors arranged in multiple columns and multiple rows;wherein the rear backup camera is operable to capture image data;wherein the rear backup camera comprises a first serializer operable to serialize image data captured by the rear backup camera;wherein the rear backup camera comprises an image processor;an electronic control unit (ECU);wherein the ECU comprises a first de-serializer;wherein the rear backup camera connects with the ECU via a first cable;wherein communication between the rear backup camera and the ECU utilizes Low-Voltage Differential Signaling (LVDS);wherein image data captured by the imaging sensor of the rear backup camera is converted at the first serializer to serialized image data that is carried to the ECU via the first cable;wherein serialized image data carried to the ECU via the first cable is de-serialized at the first de-serializer of the ECU to form first de-serialized image data;wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system is operable to detect a pedestrian present rearward of the equipped vehicle during a rear backup maneuver of the equipped vehicle;wherein video images derived at least in part from image data captured by the imaging sensor of the rear backup camera are displayed at a video display device of the equipped vehicle during the rear backup maneuver of the equipped vehicle, the video display device comprising a video display screen viewable by a driver of the equipped vehicle;a front camera disposed at an exterior portion of the equipped vehicle;wherein, with the front camera disposed at the exterior portion of the equipped vehicle, the front camera at least views forward of the equipped vehicle;wherein the front camera comprises an imaging sensor comprising an array of at least one million photosensor elements arranged in multiple columns and multiple rows, and wherein the front camera is operable to capture image data;wherein the front camera comprises a second serializer operable to serialize image data captured by the front camera;wherein the ECU comprises a second de-serializer, and wherein the front camera connects with the ECU via a second cable, and wherein image data captured by the imaging sensor of the front camera is converted at the second serializer to second serialized image data that is carried to the ECU via the second cable;wherein second serialized image data carried to the ECU via the second cable is de-serialized at the second de-serializer of the ECU to form second de-serialized image data;wherein the front camera and the rear backup camera are part of a multi-camera surround view system of the equipped vehicle, and wherein the multi-camera surround view system of the equipped vehicle includes four cameras comprising (i) the front camera, (ii) the rear backup camera, (iii) a driver-side sideview camera and (iv) a passenger-side sideview camera;wherein image data captured by the four cameras of the multi-camera surround view system of the equipped vehicle is provided to, and is processed at, the ECU; andwherein, responsive to processing at the ECU of image data captured by the four cameras and provided to the ECU, surround view video images of an environment at least partially surrounding the equipped vehicle are displayed at the video display device.
  • 26. The vehicular rear backup system of claim 25, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system alerts the driver of the equipped vehicle to presence of the detected pedestrian who is rearward of the equipped vehicle.
  • 27. The vehicular rear backup system of claim 25, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system distinguishes a pedestrian who is a child from a pedestrian who is an adult.
  • 28. The vehicular rear backup system of claim 25, wherein the ECU connects with a vehicle communication bus of the equipped vehicle.
  • 29. The vehicular rear backup system of claim 28, wherein the vehicle communication bus of the equipped vehicle comprises a CAN bus.
  • 30. The vehicular rear backup system of claim 25, wherein, responsive to the vehicular rear backup system detecting the pedestrian, the vehicular rear backup system controls braking of the equipped vehicle.
  • 31. The vehicular rear backup system of claim 30, wherein the vehicular rear backup system controls braking of the equipped vehicle based at least in part on an environment in which the equipped vehicle is driven.
  • 32. The vehicular rear backup system of claim 31, wherein the environment comprises presence of pedestrian traffic rearward of the equipped vehicle.
  • 33. The vehicular rear backup system of claim 31, wherein the environment comprises presence of vehicles rearward of the equipped vehicle.
  • 34. The vehicular rear backup system of claim 25, wherein communication between the rear backup camera and the ECU via the first cable is bidirectional.
  • 35. The vehicular rear backup system of claim 25, wherein the image processor comprises an image processing chip.
  • 36. The vehicular rear backup system of claim 25, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, and responsive at least in part to determination by the vehicular rear backup system that the equipped vehicle and the detected pedestrian may collide, the vehicular rear backup system at least in part controls a braking system of the equipped vehicle.
  • 37. The vehicular rear backup system of claim 25, wherein, during the rear backup maneuver of the equipped vehicle and responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the driver of the equipped vehicle is alerted to presence of the detected pedestrian viewed by the rear backup camera via an overlay overlaying video images derived at least in part from image data captured by the imaging sensor of the rear backup camera and displayed at the video display device of the equipped vehicle during the rear backup maneuver of the equipped vehicle.
  • 38. The vehicular rear backup system of claim 25, wherein electrical power for the rear backup camera is carried from the ECU to the rear backup camera via the first cable.
  • 39. The vehicular rear backup system of claim 25, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system is operable to detect an object approaching the equipped vehicle from rearward of the equipped vehicle.
  • 40. The vehicular rear backup system of claim 25, wherein the detected pedestrian is walking rearward of the equipped vehicle.
  • 41. The vehicular rear backup system of claim 25, wherein processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera determines at least one selected from the group consisting of (i) lateral distance to the detected pedestrian, (ii) longitudinal distance to the detected pedestrian, (iii) height of the detected pedestrian, (iv) width of the detected pedestrian and (v) position of the detected pedestrian.
  • 42. A vehicular rear backup system, the vehicular rear backup system comprising: a rear backup camera disposed at an exterior portion of a vehicle equipped with the vehicular rear backup system and viewing at least rearward of the equipped vehicle;the rear backup camera comprising an imaging sensor;wherein the imaging sensor of the rear backup camera comprises a megapixel array having at least one million photosensors arranged in multiple columns and multiple rows;wherein the rear backup camera is operable to capture image data;wherein the rear backup camera comprises a first serializer operable to serialize image data captured by the rear backup camera;wherein the rear backup camera comprises an image processor;an electronic control unit (ECU);wherein the ECU connects with a vehicle communication bus of the equipped vehicle;wherein the ECU comprises a first de-serializer;wherein the rear backup camera connects with the ECU via a first cable;wherein communication between the rear backup camera and the ECU utilizes Low-Voltage Differential Signaling (LVDS);wherein image data captured by the imaging sensor of the rear backup camera is converted at the first serializer to serialized image data that is carried to the ECU via the first cable;wherein serialized image data carried to the ECU via the first cable is de-serialized at the first de-serializer of the ECU to form first de-serialized image data;wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system is operable to detect a pedestrian present rearward of the equipped vehicle during a rear backup maneuver of the equipped vehicle;wherein video images derived at least in part from image data captured by the imaging sensor of the rear backup camera are displayed at a video display device of the equipped vehicle during the rear backup maneuver of the equipped vehicle, the video display device comprising a video display screen viewable by a driver of the equipped vehicle;wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system alerts the driver of the equipped vehicle to presence of the detected pedestrian who is rearward of the equipped vehicle;a front camera disposed at an exterior portion of the equipped vehicle;wherein, with the front camera disposed at the exterior portion of the equipped vehicle, the front camera at least views forward of the equipped vehicle;wherein the front camera comprises an imaging sensor comprising an array of at least one million photosensor elements arranged in multiple columns and multiple rows, and wherein the front camera is operable to capture image data;wherein the front camera comprises a second serializer operable to serialize image data captured by the front camera;wherein the ECU comprises a second de-serializer, and wherein the front camera connects with the ECU via a second cable, and wherein image data captured by the imaging sensor of the front camera is converted at the second serializer to second serialized image data that is carried to the ECU via the second cable;wherein second serialized image data carried to the ECU via the second cable is de-serialized at the second de-serializer of the ECU to form second de-serialized image data;wherein the front camera and the rear backup camera are part of a multi-camera surround view system of the equipped vehicle, and wherein the multi-camera surround view system of the equipped vehicle includes four cameras comprising (i) the front camera, (ii) the rear backup camera, (iii) a driver-side sideview camera and (iv) a passenger-side sideview camera;wherein image data captured by the four cameras of the multi-camera surround view system of the equipped vehicle is provided to, and is processed at, the ECU; andwherein, responsive to processing at the ECU of image data captured by the four cameras and provided to the ECU, surround view video images of an environment at least partially surrounding the equipped vehicle are displayed at the video display device.
  • 43. The vehicular rear backup system of claim 42, wherein processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera determines at least one selected from the group consisting of (i) lateral distance to the detected pedestrian, (ii) longitudinal distance to the detected pedestrian, (iii) height of the detected pedestrian, (iv) width of the detected pedestrian and (v) position of the detected pedestrian.
  • 44. The vehicular rear backup system of claim 42, wherein the vehicle communication bus of the equipped vehicle comprises a CAN bus.
  • 45. The vehicular rear backup system of claim 44, wherein, responsive to the vehicular rear backup system detecting the pedestrian, the vehicular rear backup system controls braking of the equipped vehicle.
  • 46. The vehicular rear backup system of claim 45, wherein the vehicular rear backup system controls braking of the equipped vehicle based at least in part on an environment in which the equipped vehicle is driven.
  • 47. The vehicular rear backup system of claim 46, wherein the environment comprises presence of pedestrian traffic rearward of the equipped vehicle.
  • 48. The vehicular rear backup system of claim 46, wherein the environment comprises presence of vehicles rearward of the equipped vehicle.
  • 49. The vehicular rear backup system of claim 42, wherein communication between the rear backup camera and the ECU via the first cable is bidirectional.
  • 50. The vehicular rear backup system of claim 42, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system distinguishes a pedestrian who is a child from a pedestrian who is an adult.
  • 51. The vehicular rear backup system of claim 42, wherein the image processor comprises an image processing chip.
  • 52. The vehicular rear backup system of claim 42, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, and responsive at least in part to determination by the vehicular rear backup system that the equipped vehicle and the detected pedestrian may collide, the vehicular rear backup system at least in part controls a braking system of the equipped vehicle.
  • 53. The vehicular rear backup system of claim 42, wherein, during the rear backup maneuver of the equipped vehicle and responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the driver of the equipped vehicle is alerted to the presence of the detected pedestrian viewed by the rear backup camera via an overlay overlaying video images derived at least in part from image data captured by the imaging sensor of the rear backup camera and displayed at the video display device of the equipped vehicle during the rear backup maneuver of the equipped vehicle.
  • 54. The vehicular rear backup system of claim 42, wherein electrical power for the rear backup camera is carried from the ECU to the rear backup camera via the first cable.
  • 55. The vehicular rear backup system of claim 42, wherein, responsive at least in part to processing by the image processor at the rear backup camera of image data captured by the imaging sensor of the rear backup camera, the vehicular rear backup system is operable to detect an object approaching the equipped vehicle from rearward of the equipped vehicle.
  • 56. The vehicular rear backup system of claim 42, wherein the detected pedestrian is walking rearward of the equipped vehicle.
CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent application Ser. No. 17/659,503, filed Apr. 18, 2022, now U.S. Pat. No. 11,508,160, which is a continuation of U.S. patent application Ser. No. 17/248,946, filed Feb. 15, 2021, now U.S. Pat. No. 11,308,718, which is a continuation of U.S. patent application Ser. No. 16/724,484, filed Dec. 23, 2019, now U.S. Pat. No. 10,922,563, which is a continuation of U.S. patent application Ser. No. 16/117,172, filed Aug. 30, 2018, now U.S. Pat. No. 10,515,279, which is a continuation of U.S. patent application Ser. No. 13/894,870, filed May 15, 2013, now U.S. Pat. No. 10,089,537, which claims the filing benefit of U.S. provisional applications, Ser. No. 61/699,498, filed Sep. 11, 2012, Ser. No. 61/682,486, filed Aug. 13, 2012, and Ser. No. 61/648,744, filed May 18, 2012, which are hereby incorporated herein by reference in their entireties.

US Referenced Citations (383)
Number Name Date Kind
4443769 Aschwanden et al. Apr 1984 A
4485398 Chapin, Jr. et al. Nov 1984 A
4720790 Miki et al. Jan 1988 A
4987357 Masaki Jan 1991 A
4991054 Walters Feb 1991 A
5001558 Burley et al. Mar 1991 A
5003288 Wilhelm Mar 1991 A
5012082 Watanabe Apr 1991 A
5016977 Baude et al. May 1991 A
5027001 Torbert Jun 1991 A
5027200 Petrossian et al. Jun 1991 A
5044706 Chen Sep 1991 A
5055668 French Oct 1991 A
5059877 Teder Oct 1991 A
5064274 Alten Nov 1991 A
5072154 Chen Dec 1991 A
5086253 Lawler Feb 1992 A
5096287 Kakinami et al. Mar 1992 A
5097362 Lynas Mar 1992 A
5121200 Choi Jun 1992 A
5124549 Michaels et al. Jun 1992 A
5130709 Toyama et al. Jul 1992 A
5168378 Black Dec 1992 A
5170374 Shimohigashi et al. Dec 1992 A
5172235 Wilm et al. Dec 1992 A
5177685 Davis et al. Jan 1993 A
5182502 Slotkowski et al. Jan 1993 A
5184956 Langlais et al. Feb 1993 A
5189561 Hong Feb 1993 A
5193000 Lipton et al. Mar 1993 A
5193029 Schofield et al. Mar 1993 A
5204778 Bechtel Apr 1993 A
5208701 Maeda May 1993 A
5245422 Borcherts et al. Sep 1993 A
5255442 Schierbeek et al. Oct 1993 A
5276389 Levers Jan 1994 A
5285060 Larson et al. Feb 1994 A
5289182 Brillard et al. Feb 1994 A
5289321 Secor Feb 1994 A
5305012 Faris Apr 1994 A
5307136 Saneyoshi Apr 1994 A
5309137 Kajiwara May 1994 A
5313072 Vachss May 1994 A
5325096 Pakett Jun 1994 A
5325386 Jewell et al. Jun 1994 A
5329206 Slotkowski et al. Jul 1994 A
5331312 Kudoh Jul 1994 A
5336980 Levers Aug 1994 A
5341437 Nakayama Aug 1994 A
5351044 Mathur et al. Sep 1994 A
5355118 Fukuhara Oct 1994 A
5374852 Parkes Dec 1994 A
5386285 Asayama Jan 1995 A
5394333 Kao Feb 1995 A
5406395 Wilson et al. Apr 1995 A
5410346 Saneyoshi et al. Apr 1995 A
5414257 Stanton May 1995 A
5414461 Kishi et al. May 1995 A
5416313 Larson et al. May 1995 A
5416318 Hegyi May 1995 A
5416478 Morinaga May 1995 A
5424952 Asayama Jun 1995 A
5426294 Kobayashi et al. Jun 1995 A
5430431 Nelson Jul 1995 A
5434407 Bauer et al. Jul 1995 A
5440428 Hegg et al. Aug 1995 A
5444478 Lelong et al. Aug 1995 A
5451822 Bechtel et al. Sep 1995 A
5457493 Leddy et al. Oct 1995 A
5461357 Yoshioka et al. Oct 1995 A
5461361 Moore Oct 1995 A
5469298 Suman et al. Nov 1995 A
5471515 Fossum et al. Nov 1995 A
5475494 Nishida et al. Dec 1995 A
5497306 Pastrick Mar 1996 A
5498866 Bendicks et al. Mar 1996 A
5500766 Stonecypher Mar 1996 A
5510983 Lino Apr 1996 A
5515448 Nishitani May 1996 A
5521633 Nakajima et al. May 1996 A
5528698 Kamei et al. Jun 1996 A
5529138 Shaw et al. Jun 1996 A
5530240 Larson et al. Jun 1996 A
5530420 Tsuchiya et al. Jun 1996 A
5535314 Alves et al. Jul 1996 A
5537003 Bechtel et al. Jul 1996 A
5539397 Asanuma et al. Jul 1996 A
5541590 Nishio Jul 1996 A
5550677 Schofield et al. Aug 1996 A
5555555 Sato et al. Sep 1996 A
5568027 Teder Oct 1996 A
5574443 Hsieh Nov 1996 A
5581464 Woll et al. Dec 1996 A
5594222 Caldwell Jan 1997 A
5610756 Lynam et al. Mar 1997 A
5614788 Mullins Mar 1997 A
5619370 Guinosso Apr 1997 A
5632092 Blank et al. May 1997 A
5634709 Iwama Jun 1997 A
5642299 Hardin et al. Jun 1997 A
5648835 Uzawa Jul 1997 A
5650944 Kise Jul 1997 A
5660454 Mori et al. Aug 1997 A
5661303 Teder Aug 1997 A
5666028 Bechtel et al. Sep 1997 A
5670935 Schofield et al. Sep 1997 A
5677851 Kingdon et al. Oct 1997 A
5699044 Van Lente et al. Dec 1997 A
5724316 Brunts Mar 1998 A
5732379 Eckert et al. Mar 1998 A
5737226 Olson et al. Apr 1998 A
5760828 Cortes Jun 1998 A
5760931 Saburi et al. Jun 1998 A
5761094 Olson et al. Jun 1998 A
5765116 Wilson-Jones et al. Jun 1998 A
5765118 Fukatani Jun 1998 A
5781437 Wiemer et al. Jul 1998 A
5786772 Schofield et al. Jul 1998 A
5790403 Nakayama Aug 1998 A
5790973 Blaker et al. Aug 1998 A
5793308 Rosinski et al. Aug 1998 A
5793420 Schmidt Aug 1998 A
5796094 Schofield et al. Aug 1998 A
5835255 Miles Nov 1998 A
5837994 Stam et al. Nov 1998 A
5844505 Van Ryzin Dec 1998 A
5844682 Kiyomoto et al. Dec 1998 A
5845000 Breed et al. Dec 1998 A
5848802 Breed et al. Dec 1998 A
5850176 Kinoshita et al. Dec 1998 A
5850254 Takano et al. Dec 1998 A
5867591 Onda Feb 1999 A
5877707 Kowalick Mar 1999 A
5877897 Schofield et al. Mar 1999 A
5878357 Sivashankar et al. Mar 1999 A
5878370 Olson Mar 1999 A
5883739 Ashihara et al. Mar 1999 A
5884212 Lion Mar 1999 A
5890021 Onoda Mar 1999 A
5896085 Mori et al. Apr 1999 A
5899956 Chan May 1999 A
5915800 Hiwatashi et al. Jun 1999 A
5923027 Stam et al. Jul 1999 A
5924212 Domanski Jul 1999 A
5959555 Furuta Sep 1999 A
5963247 Banitt Oct 1999 A
5986796 Miles Nov 1999 A
5990469 Bechtel et al. Nov 1999 A
5990649 Nagao et al. Nov 1999 A
6020704 Buschur Feb 2000 A
6049171 Stam et al. Apr 2000 A
6066933 Ponziana May 2000 A
6084519 Coulling et al. Jul 2000 A
6097024 Stam et al. Aug 2000 A
6100799 Fenk Aug 2000 A
6115159 Baker Sep 2000 A
6144022 Tenenbaum et al. Nov 2000 A
6175300 Kendrick Jan 2001 B1
6178034 Allemand et al. Jan 2001 B1
6201642 Bos Mar 2001 B1
6223114 Boros et al. Apr 2001 B1
6227689 Miller May 2001 B1
6250148 Lynam Jun 2001 B1
6266082 Yonezawa et al. Jul 2001 B1
6266442 Laumeyer et al. Jul 2001 B1
6285393 Shimoura et al. Sep 2001 B1
6294989 Schofield et al. Sep 2001 B1
6297781 Turnbull et al. Oct 2001 B1
6310611 Caldwell Oct 2001 B1
6313454 Bos et al. Nov 2001 B1
6317057 Lee Nov 2001 B1
6320282 Caldwell Nov 2001 B1
6333759 Mazzilli Dec 2001 B1
6341523 Lynam Jan 2002 B2
6353392 Schofield et al. Mar 2002 B1
6370329 Teuchert Apr 2002 B1
6392315 Jones et al. May 2002 B1
6396397 Bos et al. May 2002 B1
6411204 Bloomfield et al. Jun 2002 B1
6420975 DeLine et al. Jul 2002 B1
6424273 Gutta et al. Jul 2002 B1
6430303 Naoi et al. Aug 2002 B1
6442465 Breed et al. Aug 2002 B2
6477464 McCarthy et al. Nov 2002 B2
6497503 Dassanayake et al. Dec 2002 B1
6498620 Schofield et al. Dec 2002 B2
6516664 Lynam Feb 2003 B2
6534884 Marcus et al. Mar 2003 B2
6539306 Turnbull Mar 2003 B2
6547133 Devries, Jr. et al. Apr 2003 B1
6553130 Lemelson et al. Apr 2003 B1
6574033 Chui et al. Jun 2003 B1
6589625 Kothari et al. Jul 2003 B1
6594583 Ogura et al. Jul 2003 B2
6605775 Seeber et al. Aug 2003 B1
6611610 Stam et al. Aug 2003 B1
6636258 Strumolo Oct 2003 B2
6650455 Miles Nov 2003 B2
6672731 Schnell et al. Jan 2004 B2
6674562 Miles Jan 2004 B1
6678614 McCarthy et al. Jan 2004 B2
6680792 Miles Jan 2004 B2
6690268 Schofield et al. Feb 2004 B2
6700605 Toyoda et al. Mar 2004 B1
6704621 Stein et al. Mar 2004 B1
6710908 Miles et al. Mar 2004 B2
6711474 Treyz et al. Mar 2004 B1
6714331 Lewis et al. Mar 2004 B2
6717610 Bos et al. Apr 2004 B1
6735506 Breed et al. May 2004 B2
6741377 Miles May 2004 B2
6744353 Sjonell Jun 2004 B2
6757109 Bos Jun 2004 B2
6762867 Lippert et al. Jul 2004 B2
6794119 Miles Sep 2004 B2
6795221 Urey Sep 2004 B1
6806452 Bos et al. Oct 2004 B2
6819231 Berberich et al. Nov 2004 B2
6823241 Shirato et al. Nov 2004 B2
6824281 Schofield et al. Nov 2004 B2
6850156 Bloomfield et al. Feb 2005 B2
6882287 Schofield Apr 2005 B2
6889161 Winner et al. May 2005 B2
6909753 Meehan et al. Jun 2005 B2
6946978 Schofield Sep 2005 B2
6968736 Lynam Nov 2005 B2
6975775 Rykowski et al. Dec 2005 B2
6989736 Berberich et al. Jan 2006 B2
7004606 Schofield Feb 2006 B2
7005974 McMahon et al. Feb 2006 B2
7038577 Pawlicki et al. May 2006 B2
7062300 Kim Jun 2006 B1
7065432 Moisel et al. Jun 2006 B2
7079017 Lang et al. Jul 2006 B2
7085637 Breed et al. Aug 2006 B2
7092548 Laumeyer et al. Aug 2006 B2
7111968 Bauer et al. Sep 2006 B2
7116246 Winter et al. Oct 2006 B2
7123168 Schofield Oct 2006 B2
7136753 Samukawa et al. Nov 2006 B2
7145519 Takahashi et al. Dec 2006 B2
7149613 Stam et al. Dec 2006 B2
7161616 Okamoto et al. Jan 2007 B1
7195381 Lynam et al. Mar 2007 B2
7202776 Breed Apr 2007 B2
7227611 Hull et al. Jun 2007 B2
7230640 Regensburger et al. Jun 2007 B2
7248283 Takagi et al. Jul 2007 B2
7295229 Kumata et al. Nov 2007 B2
7338177 Lynam Mar 2008 B2
7365769 Mager Apr 2008 B1
7370983 DeWind et al. May 2008 B2
7381089 Hosler, Sr. Jun 2008 B2
7460951 Altan Dec 2008 B2
7480149 DeWard et al. Jan 2009 B2
7490007 Taylor et al. Feb 2009 B2
7492281 Lynam et al. Feb 2009 B2
7526103 Schofield et al. Apr 2009 B2
7581859 Lynam Sep 2009 B2
7592928 Chinomi et al. Sep 2009 B2
7639149 Katoh Dec 2009 B2
7681960 Wanke et al. Mar 2010 B2
7720580 Higgins-Luthman May 2010 B2
7724962 Zhu et al. May 2010 B2
7777611 Desai Aug 2010 B2
7855755 Weller et al. Dec 2010 B2
7881496 Camilleri et al. Feb 2011 B2
7914187 Higgins-Luthman et al. Mar 2011 B2
7952490 Fechner et al. May 2011 B2
7965336 Bingle et al. Jun 2011 B2
8013780 Lynam Sep 2011 B2
8027029 Lu et al. Sep 2011 B2
8058977 Lynam Nov 2011 B2
8090976 Maciver et al. Jan 2012 B2
8340866 Hanzawa et al. Dec 2012 B2
8849495 Chundrik, Jr. et al. Sep 2014 B2
8908039 De Wind et al. Dec 2014 B2
9019090 Weller et al. Apr 2015 B2
9041806 Baur et al. May 2015 B2
9090234 Johnson et al. Jul 2015 B2
9092986 Salomonsson et al. Jul 2015 B2
9146898 Ihlenburg et al. Sep 2015 B2
9210307 Gebauer et al. Dec 2015 B2
9900490 Ihlenburg et al. Feb 2018 B2
10515279 Nix et al. Dec 2019 B2
10922563 Nix et al. Feb 2021 B2
11308718 Nix et al. Apr 2022 B2
11508160 Nix et al. Nov 2022 B2
20020015153 Downs Feb 2002 A1
20020037054 Schurig Mar 2002 A1
20020044065 Quist et al. Apr 2002 A1
20020113873 Williams Aug 2002 A1
20020149679 Deangelis et al. Oct 2002 A1
20030137586 Lewellen Jul 2003 A1
20030222982 Hamdan et al. Dec 2003 A1
20040114381 Salmeen et al. Jun 2004 A1
20050078389 Kulas et al. Apr 2005 A1
20050134983 Lynam Jun 2005 A1
20050264891 Uken et al. Dec 2005 A1
20060018511 Stam et al. Jan 2006 A1
20060018512 Stam et al. Jan 2006 A1
20060061008 Karner et al. Mar 2006 A1
20060072011 Okada Apr 2006 A1
20060091813 Stam et al. May 2006 A1
20060103727 Tseng May 2006 A1
20060164221 Jensen Jul 2006 A1
20060212624 Kim Sep 2006 A1
20060250501 Wildmann et al. Nov 2006 A1
20060254805 Scherer et al. Nov 2006 A1
20060255920 Maeda et al. Nov 2006 A1
20060290479 Akatsuka et al. Dec 2006 A1
20070103313 Washington May 2007 A1
20070104476 Yasutomi et al. May 2007 A1
20070257923 Whitby-Strevens Nov 2007 A1
20080063129 Voutilainen Mar 2008 A1
20080150814 Hedou et al. Jun 2008 A1
20090024756 Spalla et al. Jan 2009 A1
20090093938 Isaji et al. Apr 2009 A1
20090113509 Tseng et al. Apr 2009 A1
20090171559 Lehtiniemi et al. Jul 2009 A1
20090177347 Breuer et al. Jul 2009 A1
20090243824 Peterson et al. Oct 2009 A1
20090244361 Gebauer et al. Oct 2009 A1
20090265069 Desbrunes Oct 2009 A1
20090295181 Lawlor et al. Dec 2009 A1
20100020170 Higgins-Luthman et al. Jan 2010 A1
20100097469 Blank et al. Apr 2010 A1
20100097519 Byrne et al. Apr 2010 A1
20100118145 Betham et al. May 2010 A1
20100228437 Hanzawa et al. Sep 2010 A1
20100296519 Jones Nov 2010 A1
20110115615 Luo et al. May 2011 A1
20110141381 Minikey, Jr. et al. Jun 2011 A1
20110157309 Bennett et al. Jun 2011 A1
20110193961 Peterson Aug 2011 A1
20110224978 Sawada Sep 2011 A1
20110257973 Chutorash et al. Oct 2011 A1
20110286544 Avudainayagam et al. Nov 2011 A1
20120044066 Mauderer et al. Feb 2012 A1
20120050550 Oba et al. Mar 2012 A1
20120062743 Lynam et al. Mar 2012 A1
20120069184 Hottmann Mar 2012 A1
20120140073 Ohta et al. Jun 2012 A1
20120154591 Baur et al. Jun 2012 A1
20120186447 Hodgson et al. Jul 2012 A1
20120218412 Dellantoni et al. Aug 2012 A1
20120245817 Cooprider et al. Sep 2012 A1
20120262340 Hassan et al. Oct 2012 A1
20120287140 Lin et al. Nov 2012 A1
20120303222 Cooprider et al. Nov 2012 A1
20130066542 Chung Mar 2013 A1
20130116859 Ihlenburg et al. May 2013 A1
20130124052 Hahne May 2013 A1
20130129150 Saito May 2013 A1
20130131918 Hahne May 2013 A1
20130134964 Ahrentorp et al. May 2013 A1
20130141578 Chundrlik, Jr. et al. Jun 2013 A1
20130187445 Mutzabaugh Jul 2013 A1
20130222593 Byrne et al. Aug 2013 A1
20130278769 Nix et al. Oct 2013 A1
20130314503 Nix et al. Nov 2013 A1
20130328672 Sesti et al. Dec 2013 A1
20140009633 Chopra et al. Jan 2014 A1
20140067206 Pflug Mar 2014 A1
20140152778 Ihlenburg et al. Jun 2014 A1
20140156157 Johnson et al. Jun 2014 A1
20140160291 Schaffner Jun 2014 A1
20140176711 Kirchner et al. Jun 2014 A1
20140218529 Mahmoud et al. Aug 2014 A1
20140218535 Ihlenburg et al. Aug 2014 A1
20140222280 Salomonsson et al. Aug 2014 A1
20140247355 Ihlenburg Sep 2014 A1
20140313339 Diessner Oct 2014 A1
20140340510 Ihlenburg et al. Nov 2014 A1
20140362209 Ziegenspeck et al. Dec 2014 A1
20140373345 Steigerwald Dec 2014 A1
20140379233 Chundrlik, Jr. et al. Dec 2014 A1
20150042807 Ihlenburg et al. Feb 2015 A1
20150156383 Biemer et al. Jun 2015 A1
20150222795 Sauer et al. Aug 2015 A1
20150232030 Bongwald Aug 2015 A1
20150294169 Zhou et al. Oct 2015 A1
20150296135 Wacquant et al. Oct 2015 A1
Foreign Referenced Citations (3)
Number Date Country
2247047 Nov 2010 EP
2921535 Mar 2009 FR
2010110957 Sep 2010 WO
Non-Patent Literature Citations (1)
Entry
Foresight CCTV, Inc., “Two Video with Alarm Signals Transmission Set”, 2003.
Related Publications (1)
Number Date Country
20230145036 A1 May 2023 US
Provisional Applications (3)
Number Date Country
61699498 Sep 2012 US
61682486 Aug 2012 US
61648744 May 2012 US
Continuations (5)
Number Date Country
Parent 17659503 Apr 2022 US
Child 18056874 US
Parent 17248946 Feb 2021 US
Child 17659503 US
Parent 16724484 Dec 2019 US
Child 17248946 US
Parent 16117172 Aug 2018 US
Child 16724484 US
Parent 13894870 May 2013 US
Child 16117172 US