Patent Grant
11007942
The present invention relates generally to vehicle-mounted systems for recording video and audio. More particularly, the present invention concerns such a system using distributed processing, including encoding the video and audio at their source(s), and a high-speed, e.g., Ethernet, bus connecting the various system components and external devices.
Many law enforcement vehicles include video systems for recording and displaying activity in and around the vehicle. Unfortunately, these systems typically consist of one or two cameras and an independent display monitor that is difficult to view while the vehicle is in operation. Moreover, the current systems are expensive, bulky, and difficult to operate and maintain. It is also difficult to find sufficient space for the camera, recording system, and monitor in the law enforcement vehicles, which are already heavily loaded with extra equipment. It is possible to locate certain components, such as the recording system, which do not need to be frequently accessed, in the trunk of the vehicle, but this then requires long cables extending through the vehicle to connect the recording system with the camera and monitor. Additionally, many current systems are limited to simply recording and displaying visual images of the activity, and do not provide any additional information associated with the activity.
Furthermore, current systems are designed with a single central processor unit (CPU) which controls most or all major functions, including encoding video received from a camera. Unfortunately, centralized processing creates bottlenecks for both speed and processing capabilities (depending on the CPU, encoding video signals may require 75% the CPU's processing capability), requires significant changes in order to add new hardware features, and, generally, results in an inability to make changes to the system without investing significant expense and time. Additionally, communicating unencoded analog signals within the vehicle to the single CPU can result in significant electrical interference and signal degradation.
The present invention overcomes the above-identified and other problems by providing a vehicle-mounted video and audio recording system using distributed processing, including encoding the video and audio at their source(s), and a high-speed, e.g., Ethernet, bus connecting the various system components and external devices.
In one embodiment, the video system for a vehicle broadly comprises a video camera mounted on the vehicle and operable to both capture and encode video, a central control unit mounted on the vehicle and operable to receive and decode the encoded video, and a display monitor mounted on the vehicle and operable to display the decoded video.
In various implementations, the video system may further include any one or more of the following features. The video camera may be synchronized with the central control unit so as to provide an accurate time stamp associated with the video. The video camera may be operable to implement a pre-event recording loop. The video camera and central control unit may be connected by a high speed bus. There may be two or more video cameras connected to a hub, wherein the hub is connected to the central control unit, and the central control unit is operable to receive the encoded video from each of the two or more video cameras substantially simultaneously. The system may include a microphone operable to capture and encode audio, wherein the central control unit is operable to receive and decode the encoded audio, a vehicle interface box mounted on the vehicle and operable to interface an external device to the central control unit, wherein the external device may be any one or more of a crash sensor, a radar gun, and a speedometer, and a co-processing module mounted on the vehicle and operable to provide processing for an additional feature of the system, wherein the additional feature may be any one or more of a face recognition feature, a license plate recognition feature, a streaming video feature, and a wireless Internet access feature.
The system may include a rear view mirror housing, a mirror mounted in the rear view mirror housing, and the display monitor mounted in the rear view mirror housing substantially behind the mirror, and the mirror and the display monitor being configured so that the displayed video is viewable through the mirror.
The system may include a location determining device operable to determine a location of the vehicle when the video is captured, and a recording medium operable to record at a least a portion of the captured video and the location of the vehicle when the video was captured.
These and other details of the present invention are described in greater below in the section below titled DETAILED DESCRIPTION.
Further features of the present invention will become apparent to those skilled in the art to which the present invention relates from reading the following description with reference to the accompanying drawings, in which:
With reference to the figures, a video system is herein described, shown, and otherwise disclosed in accordance with a preferred embodiment of the present invention. More specifically, the present invention provides a vehicle-mounted video system that is capable of recording, storing, and replaying video images, wherein the video system includes at least one internal camera and a display monitor, with both being integrated into the same housing as a rear view mirror of the vehicle, and with the monitor being located substantially behind the mirror such that video images displayed by the monitor are visible through the mirror. The video system may also allow for capturing audio signals and other desirable information, including, for example, location and speed information.
Referring to
The internal camera 30 is typically positioned on an upper and central portion of the mirror housing 20 so that it can capture video images of activity within the passenger compartment of the vehicle. Alternatively, the internal camera 30 may be hidden behind the mirror 170. The internal camera 30 may be mounted at an appropriate angle, such as approximately between 10 degrees and 20 degrees to the left, so that the camera 30 is able to properly view the passenger compartment even when the mirror 170 is angled towards the driver during normal use. Camera 30 may also be mounted at approximately 160 degrees or greater when camera 30 is a wide-angle camera. One appropriate camera for use as the internal camera 30 is a 510×492 black and white CMOS sensor with TV resolution, 0.01 Lux sensitivity, and a 140 degree 4-element coated glass lens.
The external camera 140 is mounted outside of the mirror housing 20 in a separate enclosure. The external camera 140 is useful, for example, to record video images when an officer leaves the vehicle, such as during a traffic stop. One appropriate camera for use as the external camera 140 is a color CCD sensor NTSC with 768×484 pixels and 470 lines of resolution, a 10× optical zoom and auto focus capabilities, a wide viewing angle that is from 50.7 to 5.4 degrees, and standard and low light modes.
The monitor 40 is mounted substantially behind the mirror 170 (see
The electronics module 50 includes a number of electronic components, including components for receiving video signals from the video cameras 30, 140 and for transmitting video signals to the monitor 40. The electronics module 50 also includes components operable to receive and execute instructions stored in internal memory. In one embodiment, for example, these instructions include menu instructions for setting operational modes and resolutions. These instructions may be updated by loading instructions into a memory card and then inserting that card into a port in the system 10.
The input and output connectors 110, 120 are connected to the module 50 for receiving electronic signals thereto and transmitting electronic signals therefrom. The input connectors 110 may include, for example, a connector for power, for the output from the speed detector 160, and for the output from the GPS antenna 150. The input connectors 110 may also include one or more connectors for receiving signals to trigger operation of the system. These triggers may include, for example, turning on the vehicle's siren and/or signal lights. The input connectors 110 may also include a connector for receiving the output of a second external camera, such as a rear-facing camera, and a connector for receiving the output of a second external microphone. The input connectors 110 may also include a port, such as a USB 2.0 port, to allow for directly accessing the memory 60 using a laptop or other computer. The output connectors 120 may include, for example, an audio/visual connector for transmitting audio/visual signals to an external monitor or recording device. Additionally or alternatively, any one or more of these physical connectors 110, 120, may be replaced with wireless communication technology allowing the system 10 to wirelessly receive or transmit any of the aforementioned input or outputs. In one embodiment, the input and output connectors 110, 120 are provided on an interface module or block which is not located on or integrated into the housing 20, but rather is located in a remote location, such as under the vehicle's dash, and operatively coupled with the module 50 by wire or wirelessly.
The module 50 may also include components for receiving audio signals from audio sources, such as the internal microphone 70, and for transmitting audio signals to the speaker 80. The module 50 may also include components for receiving wireless signals from one or more remote microphones, such as a wireless microphone worn by the officer. In this case, the module 50 may include an integrated 900 MHz (or another suitable frequency allowed by law), spread spectrum, dual receiver capable remote microphone system with a nominal range of up to approximately 1000 feet or greater (a range of several miles may be achieved under the proper conditions).
The module 50 may also include an integrated GPS receiver connected to the GPS antenna 150. Utilizing the information provided by these components, the module 50 may mark recorded video with real-time position data. The system may include a “dead reckoning” function which works with GPS to allow for operation in shielded locations, such as underground garages.
The module 50 may also be connected to the speed detector 140, which may be a radar gun or other conventional speed detecting device, and operable to record speed information provided by the speed detector 140 along with the video images.
The memory 60 is in communication with the module 50 for receiving and storing the video, audio, and other data. One appropriate form of electronic memory for use as the memory 60 is a CF card form factor removable memory module, and one appropriate format for storing the data is MPEG 4 format. Other appropriate forms of electronic memory for use as the memory 60 include micro hard drives, laptop-type hard drives, and flash memory cards. As will be understood by those in the field, the amount of data storable in the memory 60 is dependent, at least in part, on the resolution utilized by the electronics module 50. It is contemplated, however, that the memory 60 may store approximately one hour of data per gigabyte of memory per simultaneous camera for high resolution, approximately two hours of data per gigabyte of memory per simultaneous camera for medium resolution, and approximately four hours of data per gigabyte of memory per simultaneous camera for low resolution.
Referring also to
The at least one infrared LED 130 is disposed in the mirror housing 20 and operable to provide infrared illumination inside the vehicle's passenger compartment so that the internal camera 30 can capture video images even when there is little visible light.
Power is supplied to the components of the video system 10 from the vehicle. The power provided is heavily filtered and regulated to avoid interference. The video system 10, using the particular components described herein, may require 4 amps from a 10 V to 13.8 V DC power supply.
The rear view mirror includes the mirror 170 mounted within the housing 20. One appropriate mirror 170 is constructed of mirror glass. One appropriate housing for use as the housing 20 is constructed of a polycarbonate plastic that is resistant to high impacts and high temperatures and is approximately between 12 inches and 14 inches long, 3 inches and 4 inches high, and 0.5 inches and 1.5 inches deep. The vehicle's conventional rear view mirror mount may be replaced by a stronger mount better able to support the weight of the mirror 170 and housing 20 and other components of the system 10. The input buttons 90, discussed above, may be mounted on a front or side surface of the housing 20. The mirror housing 20, and the housings of other components of the system, may include materials operable to shield against electrical or radio interference.
Additionally, the system 10 may be provided with a “stealth” mode in which the cameras 30, 140 and the microphone 70 are active and recording, but the lights and indicators, such as the LED 100, are turned off, thereby making the system 10 appear to be dormant.
Additionally, the system 10 may provide “pre-event” recording in which the system 10 records constantly in a loop of a selected duration of time, such as thirty seconds or sixty seconds, so that when an event triggers recording, the events occurring shortly prior to the initiation of recording are also recorded and stored.
Additionally, various embodiments of the system 10 include any one or more of the following features. The system 10 requires entry of a password or code prior to accessing and changing operational settings. The system 10 requires use of a key to remove any removable memory components. The system 10 incorporates electronic watermarks into the recorded video images to prevent tampering or alteration. The system 10 allows for wirelessly downloading the contents of the memory 60 to a laptop or other computer. The system 10 allows for streaming the live video from the cameras 30, 140, and possibly other inputs and/or outputs, via a high-speed wireless data network. The system 10 is operable to encode multiple video streams from four or more cameras simultaneously. The system 10 includes a remote control device for allowing a user to remotely control the operation of the system 10. The system 10 includes a temperature sensor and temperature indicator operable to detect and warn the user if the system 10 is at risk of malfunction or damage due to an ambient temperature that is too high or too low for proper operation, such as may easily occur in a vehicle on a very hot or very cold day. The housing 20, and possibly the housings of other components of the system 10, is vented to dissipate heat, and may include other passive or active features to moderate temperature, especially in relatively extreme environments.
Referring also to
It will now be apparent that the present invention is both inexpensive to manufacture and easy to use, especially when compared to current vehicle video systems. The video system of the present invention is fully integrated into a small, easily installable and replaceable package that requires minimal space inside the vehicle. Thus, it replaces several single-purpose devices with a multifunction device that requires the same or less space in the vehicle. Moreover, the video system includes novel features and/or capabilities not present in currently available systems. Those skilled in the art will perceive additional significant improvements, changes, and modifications.
Referring also to
In one implementation, the system 1010 broadly comprises the rear view mirror housing 1020, a central control unit 1012, the internal camera 1030, the display monitor 1040, the input buttons 1090, one or more of the external cameras 1140, one or more external microphones 1142, a vehicle interface box 1144, one or more coprocessing modules 1146, and the high-speed bus 1148.
In this implementation, the central control unit 1012 does not itself encode the video and audio generated by the external camera 1140 and microphone 1142, but rather receives the signals already encoded. As such, the central control unit 1012 includes a decoder for decoding the encoded video and audio to allow for communication via the display monitor 1040 and an associated speaker.
The one or more external cameras 1140 are each operable to both capture video and encode the video before transmitting it to the central control unit 1012 for display and storage. Because encoding can account for 75% of the processing workload in prior art systems, encoding the video at the camera 1140 rather than at the CPU of the central control unit 1012 advantageously allows the central control unit 1012 to support multiple external cameras simultaneously.
Generally, existing IP (“Internet protocol”) cameras are unsuitable for use in the present system 1010 because they have a tendency to lose frames, which is not acceptable for law enforcement applications in which the video might be used as evidence, and because they have relatively narrow bandwidths, which is also problematic for law enforcement applications in which activity often takes place under extreme lighting conditions, e.g., bright streetlights and dark shadows. However, referring also to
In one implementation of the present system, a camera used in conjunction with the present system, such as the Nuvation Research Corporation IP Reference Camera described above, includes a storage component such that captured frames are stored in the camera in addition to being sent to central control unit 1012. These stored frames are also time-stamped during the normal course of operation of the present system. Thus, in the event any frames are lost during transmission from the camera to central control unit 1012, central control unit 1012 is able to request that the camera transmit the lost frames again. Once the lost frames are received, central control unit 1012 can integrate the lost frames into the data already received so that a complete record is formed. Time synchronization between the camera and central control unit 1012 ensures that central control unit 1012 is able to accurately identify missing frames, query the camera for those frames, and properly integrate the missing frames into the record once they are received.
The one or more external microphones 1142 are also each operable to both capture audio and encode the audio before transmitting it to the central control unit 1012 for play or storage, thereby advantageously allowing the central control unit 1012 to support multiple external microphones simultaneously.
The vehicle interface box 1144 is operable to interface various external devices to the system 1010. The external devices may include, for example, any one or more of a crash sensor, a radar gun, and a speedometer.
The one or more co-processing modules 1146 are each operable to provide processing for various additional features to the system 1010. The additional features may include, for example, any one or more of a face recognition feature, a streaming video feature, and a wireless Internet access feature. Further, wireless access may be provided for other networks, such as wireless mesh, that are not associated with the internet in any way.
The high-speed bus 1148 is operable to connect and allow for communication between the various other components of the system 1010. In one implementation, the bus is an Ethernet bus carrying power and data on the same cable. In one implementation, components, such as the cameras 1140 and microphones 1142 spaced apart from the central processing unit 1012, are connected to a hub 1064, and the hub 1064 is connected to the central processing unit 1012 by a single cable. In other implementations of the present system, other methods of communication between the various components of the present system may be used. Such other methods may include, for example, wireless communications, or combinations of wireless and wired communications. Further, although the implementation of the present system shown in the drawings utilize Power Over Ethernet (POE) in order to provide power to components of the present system, it is contemplated that any suitable method of providing such power may be utilized, and that numerous methods of providing power are known to those of skill in the art. It is further contemplated that a backup power source, such as a batter backup, may be used in conjunction with the present system.
It will now be apparent that, along with the earlier-discussed advantages of the first embodiment of the system, the second embodiment provides a number of additional advantages over prior art systems. For example, each external camera and microphone encodes its own video and audio, and therefore, the central control unit can support multiple cameras and microphones simultaneously, the cameras and microphones can be located much further away from the central control housing (which is important in larger vehicles) because encoded digital signals are less susceptible to the electrical interference and signal degradation experienced by unencoded analog signals, and the cameras and microphones can be easily added or replaced without requiring significant changes to the central control unit. Additionally, the high-speed bus carries both data and power to system and external components on the same cable, thereby eliminating the plurality of separate cables for power, video, audio, and communication required by prior art systems. Bus hubs allow for collecting and communicating data streams from multiple cameras, microphones, and other devices over a single cable, thereby eliminating the need to provide a long cable for each device. Bus connectivity and standard communication protocols allow for quickly adding features using plug-in modules. More generally, changes to the system can be accomplished with significantly less expense and time, allowing the system to adapt to user demands and extending the system's useful life.
Although various exemplary data formats and data transfer protocols are identified above, it is contemplated that any suitable format or protocol, whether now existing or hereafter developed, may be used in conjunction with the present invention. The discussion of specific formats or protocols herein is not intended to limit the scope of the present invention. For example, although the MPEG-4 format is mentioned above for encoding and storing audiovisual data obtained by the present system, it is contemplated that other formats such as, for example, H.263 and H.264, may also be used. Likewise, audiovisual data may be stored in high-definition (HD) format. Hardware or software changes or upgrades may be required in order to change formats, however the inventive functionality of the present system, as described herein, is preserved regardless of the specific format used. Because one goal of law enforcement implementations of the present system is to produce an evidentiary record, it is preferred that a lossless format be used in those implementations.
In addition to various suitable formats that may be used in conjunction with the present system, it is contemplated that any suitable data transfer protocol may be used. For example, real-time streaming protocol (RTSP) may be used to transfer data in the present system providing that the system is adapted to recover any lost frames from the camera. User datagram protocol (UDP) provides a better, lossless protocol for use with the present system. Any suitable existing protocol may be used, and new protocols may be developed for use with the present system. Because implementations of the present system include a data storage function in the camera, as described above, for retrieval of frames lost during data transfer, it is contemplated that typical IP cameras having such a storage feature may be used, with the system ensuring that lost frames are faithfully transmitted to central control unit 1012 when requested therefrom.
As noted above, the present system may be used with a variety of software, audiovisual formats, data transfer protocols, and the like. In some instances, changes to formats or protocols, or even making hardware changes such as upgrading the system to a HD-capable camera, may require that the software of the present system be updated. In some implementations of the present system, it is contemplated that the system software will be capable of being upgraded in the field. In such implementations, software upgrades may be provided via a memory card, portable flash memory device, a wireless data link to a portable devices, a wireless internet data link, or any other suitable device or method for upgrading the system software in the field. In some implementations wherein wireless communications are used for system upgrades, it is contemplated that the present system may optionally include a wireless communications component adapted to connect to a remote source for obtaining updates automatically. Such communications could, for example, be carried out over the internet via a cellular communications signal that allows the present system to access the internet.
In addition to what has been described above, various peripheral devices may be utilized in conjunction with the present invention. In law enforcement implementations of the present system, for example, or in other implementations where security is important, the present system may be provided with a biometric identification component or other secure identification component. In an implementation of the present system requiring biometric identification, for example, a fingerprint may be required before a user of the present system can log into the system and begin to use the system. Other security peripherals include, for example, a dongle carried by a user of the present system that can be presented to the system in order to verify the identity of a user. Any suitable security component or method may be included with the present invention.
In addition to maintaining or verifying user security, the present system may also include additional components to establish the security and evidentiary value of the audiovisual data recorded thereby. For example, it is contemplated that the cameras 1140 associated with the present system include a unique identifier, such as a serial number or other identifier that is unalterable, and that audiovisual signals obtained by any given camera are stamped with that camera's identifier. Thus, the identity of the camera that acquired any given data is verified and secured along with the actual data recorded by the system.
It is further contemplated that a CD or DVD burner may be provided as a component of the present system so that a user of the system can make a copy of captured audiovisual data while in the field. Any suitable recording device and medium known in the art may be used in association with the present invention.
Peripheral devices used for interfacing with the present system may also be provided. For example, a keyboard may be provided, the keyboard adapted to plug directly into the present system or to communicate wirelessly with the present system via Bluetooth, infrared, or other suitable method of wireless communication. Further, it is contemplated that a PDA, laptop, smartphone, or other mobile device may be adapted (for example by installing software thereon) for communication with and manipulation of the present system. Such devices may be used to manipulate a display associated with the present system, or to configure or control the present system.
With respect to any of the various peripherals that may be associated with the present system, whether described herein or not, it is contemplated that the peripherals may be plugged into or otherwise associated with electronics module 50 or central control unit 1012, or that any of cameras 1140 may be adapted to communicate with the peripherals, either through a hard-wired or wireless connection.
Although the invention has been disclosed with reference to various particular embodiments, it is understood that equivalents may be employed and substitutions made herein without departing from the contemplated scope of the invention. For example, specific suitable hardware, processors, software, and the like as described above is exemplary and not intended to limit the present invention. Any suitable hardware may be used to implement the inventive functionality of the present system.
The present application is a continuation, and claims priority benefit with regard to all common subject matter, of earlier-filed U.S. patent application Ser. No. 15/137,207, filed Apr. 25, 2016, now U.S. Pat. No. 10,730,439, issued Aug. 4, 2020, and entitled “Vehicle-Mounted Video System with Distributed Processing” (“the '439 patent”). The '439 patent is a continuation and claims priority benefit with regard to all common subject matter, of earlier-filed U.S. patent application Ser. No. 13/975,844, filed Aug. 26, 2013, now U.S. Pat. No. 9,325,950, issued Apr. 26, 2016, and entitled “Vehicle-Mounted Video System with Distributed Processing” (“the '950 patent”). The '950 patent is a continuation, and claims priority benefit with regard to all common subject matter, of earlier-filed U.S. patent application Ser. No. 12/189,192, filed Aug. 10, 2008, now U.S. Pat. No. 8,520,069, issued Aug. 27, 2013, and entitled “Vehicle-Mounted Video System with Distributed Processing” (“the '069 patent”). The '069 patent is a continuation-in-part, and claims priority benefit with regard to all common subject matter, of U.S. patent application Ser. No. 11/531,955, filed Sep. 14, 2006, now abandoned, and entitled “Vehicle-Mounted Video System with Distributed Processing” (“the '955 application”). The '955 application is a non-provisional, and claims priority benefit with regard to all common subject matter, of U.S. Provisional Application No. 60/717,602, filed Sep. 16, 2005, and entitled “Rear View Mirror with Integrated Video System.” The '069 patent is also a non-provisional, and claims priority benefit with regard to all common subject matter, of U.S. Provisional Application No. 60/955,129, filed Aug. 10, 2007, and entitled “Vehicle-Mounted Video System with Distributed Processing.” Each of the identified earlier-filed patent and patent applications are hereby incorporated by reference into the present patent application in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6690268 | Schofield | Feb 2004 | B2 |
| 10730439 | Haler | Aug 2020 | B2 |
| 20030081121 | Kirmuss | May 2003 | A1 |
| 20050100329 | Lao | May 2005 | A1 |
| 20060104600 | Abrams | May 2006 | A1 |
| 20070250194 | Rhoads | Oct 2007 | A1 |
| 20070300272 | Takanezawa | Dec 2007 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20200361385 A1 | Nov 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60955129 | Aug 2007 | US | |
| 60717602 | Sep 2005 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15137207 | Apr 2016 | US |
| Child | 16983220 | US | |
| Parent | 13975844 | Aug 2013 | US |
| Child | 15137207 | US | |
| Parent | 12189192 | Aug 2008 | US |
| Child | 13975844 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11531955 | Sep 2006 | US |
| Child | 12189192 | US |
