This application claims priority to EPO Application No. EP 13179109, filed Aug. 2, 2013, the contents of such application being incorporated by reference herein.
The invention relates to a video camera and a video receiver of a video monitoring system and in particular to a video watchdog concept for a video camera used in a video monitoring system which can be employed in an automotive surround view system.
In many applications, video cameras are used in a video monitoring system. Video cameras are for instance used in airport security or traffic monitoring. Video cameras can also be used in wrap-around top view systems within automotive applications. A vehicle such as a truck can be equipped with cameras mounted on the truck to report images from different directions. A conventional top view system can combine images of different cameras for helping a driver to improve his visibility. Wrap-around view systems allow users to observe a bird's eye view of his vehicle and can be controlled to display the vehicle at different angles.
Accordingly, an aspect of the present invention provides an apparatus and a method for increasing the security in a video monitoring system.
According to a first aspect of the present invention a video camera of a video monitoring system is provided comprising
an image generation unit which provides a sequence of digital images having watchdog information data to supervise said sequence of digital images,
an information data encoder adapted to encode the watchdog information data to generate information blocks,
a video compression unit adapted to compress the digital images received from the image generation unit to generate compressed digital images consisting of image blocks, and
a data transmission unit adapted to transmit the generated image blocks received from the video compression unit along with the information blocks generated by the information data encoder.
In a possible embodiment of the video camera according to the first aspect of the present invention, the video camera further comprises a separation unit adapted to separate watchdog information data embedded in the sequence of digital images received from said image generation unit and to store the separated watchdog information data in a memory connected to the information data encoder.
In this preferred embodiment, the watchdog information data is embedded in a sequence of digital images so that the complexity of additional circuitry provided for processing this embedded data is not too complex. Furthermore, the use of embedded data as watchdog information data makes the video monitoring system more resilient against dangers and/or manipulations.
In a further possible embodiment of the video camera according to the first aspect of the present invention, the data transmission unit of the video camera comprises encapsulation means adapted to encapsulate the image blocks and the information blocks as payload data in data packets transmitted by the data transmission unit via an interface of said video camera to a video receiver of the video monitoring system.
In this preferred embodiment, the image blocks and the information blocks forming encoded watchdog information data are transported in data packets so that available communication standards for packet transport can be used by the video camera. The transport of the information blocks as payload within the data packets has the additional advantage that the data transport becomes more resilient against communication impairments of the data communication channel.
In a further possible embodiment of the video camera according to the first aspect of the present invention, the image generation unit provides a sequence of digital images each being formed by a matrix of image pixels.
In a still further possible embodiment of the video camera according to the first aspect of the present invention, each digital image generated by the image generation unit does comprise pixel rows and pixel columns,
wherein the watchdog information data of the digital image generated by the image generation unit is embedded in a predetermined pixel row of said digital image.
In a further possible embodiment of the video camera according to the first aspect of the present invention, the watchdog information data is carried in a predetermined group of pixels within the predetermined row of said digital image and comprises image parameters of the digital image including an image counter or timestamp data provided by the image generation unit when generating the respective digital image.
In a still further possible embodiment of the video camera according to the first aspect of the present invention, the video compression unit generates an interrupt signal at the end of each received digital image compressed by the video compression unit, wherein the generated interrupt signal is applied to the information data encoder which encodes the watchdog information data of the respective digital image to generate information blocks which are added to the image blocks output by said video compression unit.
According to a further possible embodiment of the video camera according to the first aspect of the present invention, the encapsulation means of the data transmission unit is adapted to encapsulate the information blocks of a digital image generated by said information data encoder and the image blocks of the compressed digital image output by said video compression unit as payload data in at least one Ethernet package transmitted via the interface of said video camera to the video receiver of said video monitoring system.
The use of Ethernet packages or Ethernet frames has the advantage that this standard is widely spread so that the implementation of additional circuitry can be avoided.
According to a second aspect of the present invention, a video receiver of a video monitoring system is provided comprising a data reception unit adapted to receive image blocks and information blocks of digital images from at least one video camera of said video monitoring system, a video decoder adapted to decode the received image blocks and the received image information blocks of the digital images, an information data decoder adapted to decode the decoded information blocks received from said video decoder to provide watchdog information data of the digital images, and an evaluation unit adapted to evaluate the watchdog information data of the digital images to supervise a sequence of the digital images received from at least one video camera of said video monitoring system.
In a possible embodiment of the video receiver according to the second aspect of the present invention, the data reception unit of the video receiver comprises decapsulation means adapted to decapsulate image blocks and information blocks carried as payload data in data packets received from at least one video camera of said video monitoring system and to supply the decapsulated image blocks and information blocks to the video decoder of the video receiver.
In a still further possible embodiment of the video receiver according to the second aspect of the present invention, the evaluation unit of the video receiver evaluates the watchdog information data of the digital images to detect an inconsistency of image parameters of said digital images including image counters and/or timestamp data.
In a still further possible embodiment of the video receiver according to a second aspect of the present invention, the evaluation unit of the video receiver further checks header data of the received data packets, frame rates of the received data packets and an average bandwidth of a communication channel between the video camera and the video receiver to detect a communication failure or communication impairment of the communication channel.
This embodiment provides the advantage that the security against failures is further increased.
In a still further possible embodiment of the video receiver according to the second aspect of the present invention, the evaluation unit of the video receiver checks decoder error messages of the video decoder and/or of the information data decoder to detect a communication failure or communication impairment of a communication channel between a video camera of said video monitoring system and the video receiver.
In a still further possible embodiment of the video receiver according to the second aspect of the present invention, the evaluation unit of the video receiver deactivates a display connected to said video receiver provided for displaying the received images, if an inconsistency of image parameters of the digital images and/or a communication failure or a communication impairment of a communication channel between a video camera and the video receiver is detected by the evaluation unit.
According to a third aspect of the present invention, a video monitoring system is provided comprising at least one video camera according to the first aspect of the present invention and a video receiver according to the second aspect of the present invention.
The invention further provides according to a further aspect a method increasing the security in the video monitoring system comprising the steps of:
providing a sequence of digital images having watchdog information data to supervise said sequence of digital images, encoding the watchdog information data to generate information blocks,
compressing the digital images to generate compressed digital images consisting of image blocks, and
transmitting the generated image blocks along with the information blocks to a video receiver.
According to a further aspect of the present invention, the transmitted image blocks and information blocks are received, wherein the received image blocks and the received image information blocks of the digital images are decoded, wherein the decoded information blocks are further decoded to provide watchdog information data of the digital images, and wherein the watchdog information data of the digital images is evaluated to supervise a sequence of digital images received by the video receiver of said video monitoring system.
In the following, possible embodiments of the video monitoring system comprising a video camera and a video receiver according to the present invention are described in more detail.
As can be seen in
As can be seen in
The information data encoder 2D is adapted to encode the watchdog information data WID stored in the memory 2C to generate information blocks. The video compression unit 2E is adapted to compress the digital images DI received from the image generation unit 2A to generate compressed digital images consisting of image blocks. The video compression unit 2E can in a possible embodiment an MPEG video compression unit. In a further possible embodiment, the video compression unit 2E is an MJPEG (motion JPEG) video compression unit. In a still further possible embodiment, the video compression unit 2E can be an H.264 MPEG-4 video compression unit. H.264/MPEG-4 AVC (advanced video coding) is a block-oriented motion compensation-based codec standard. It can be used for streaming internet sources on a HDTV broadcast over terrestrial, cable or satellite. H.264/AVC provides high video quality at lower bit rates than other standards without increasing the complexity of design. The video compression unit 2E is adapted to compress the digital images DI received from the image generation unit 2A to reduce the necessary data transmission capacity. The video camera 2 further comprises a data transmission unit 2F adapted to transmit the generated image blocks received from the video compression unit 2E along with the information blocks generated by the information data encoder 2D.
In a possible embodiment, the video compression unit 2E generates an interrupt signal INT at the end of each received digital image DI compressed by said video compression unit 2E. The generated interrupt signal INT is applied to the information data encoder 2D which is adapted to encode the watchdog information data WID of the respective digital image DI to generate the information blocks which are added to the image blocks output by the video compression unit 2E. In a possible implementation, a software block can stop sending the video packets by looking in the last encoded image block for an end of image marker. In a possible embodiment, the software blocks can be software image blocks such as DCT or MJPEG blocks entered before the end of line marker and can be sent as combined data. In an embodiment, a line of colour or structured information blocks can be added at the end of image to be transmitted. Using these color information blocks, structured information data can be encoded rendering them highly immune against distortions. The encoded data can contain information data such as an image counter value ICV. The data from the embedded line row coming from the image generation unit 2A can be encoded in this line.
In a possible embodiment, the data transmission unit 2F of the video camera 2 can comprise an encapsulation means adapted to encapsulate the image blocks received from the video compression unit 2E and the information blocks received from the information data encoder 2D as payload data in data packets. These data packets can be transmitted by the data transmission unit 2F via an interface of the video camera 2 to a video receiver 4 of the video monitoring system 1. In a possible implementation, the encapsulation means of the data transmission unit 2F are adapted to encapsulate the information blocks of a digital image DI generated by the information data encoder 2D and the image blocks of the compressed digital image output by the video compression unit 2E as payload data in at least one Ethernet package transmitted via the interface of the video camera 2 to the video receiver 4. The data packets comprise payload data including the image blocks and information blocks as well as header data HD which can carry further information such as a packet counter.
As can be seen in
An evaluation unit 4F of the video receiver 4 is adapted to evaluate the watchdog information data WID of the digital images DI received from the information data decoder 4E to supervise a sequence of the digital images received from at least one video camera 2-i of the video monitoring system 1. In a possible embodiment, the evaluation unit 4F is adapted to evaluate the watchdog information data WID of the digital images DI to detect an inconsistency of image parameters of said digital images including for instance image counter values ICV and/or timestamp data TSD. In a specific embodiment, the evaluation unit 4F can monitor image counter values of data images DI received from a specific video camera 2-i within the video monitoring system 1 to detect whether there is an inconsistency, in particular whether the image counter value ICV is constant or the image counter value ICV jumps from one digital image DI to the next. If the image counter value ICV is constant, this can be an indication that the video sequence of the digital images provided by the respective video camera 2-i has been interrupted and the picture has freezed. Further, the timestamp data TSD and/or image counter value ICV can indicate a time delay. If, for instance, the video receiver 4 receives different digital images from four different cameras 2-i, as illustrated in the embodiment of
In a further possible embodiment of the video receiver 4 according to the present invention, the evaluation unit 4F can also be connected to the data reception unit 4A, the video decoder 4B and the image processing unit 4C. In this embodiment, the evaluation unit 4F can further check header data of the received data packets or frame rates of the received data packets and monitor an average bandwidth of a communication channel between the video camera 2 and the video receiver 4 to detect a communication failure or a communication impairment of the respective communication channel. The evaluation unit 4F can additionally check an Ethernet reception average frame rate, an average bandwidth and information carried in Ethernet packet headers such as Ethernet packet counters. When monitoring also the header data of the received data packets, the security of the video monitoring system 1 is further increased. In a further possible embodiment, the evaluation unit 4F can also check decoder error messages of the video decoder 4B and/or of the information data decoder 4E to detect a communication failure or communication impairment of the communication channel between the video camera 2 of the video monitoring system 1 and the video receiver 4. If the video receiver 4 does not directly drive a display 5, the encoded information blocks can be copied in a possible embodiment at known positions to the generated output image provided by the image processing unit 4C.
In a possible embodiment, the evaluation 4F can output a warning, if an inconsistency of image parameters of the digital images and/or a communication failure or a communication impairment has been detected by the evaluation unit 4F. In a possible embodiment, the evaluation unit 4F further deactivates the display 5 connected to the video receiver 4 or interrupts a data link to the display 5, if an inconsistency of image parameters of the digital images and/or a communication failure or communication impairment of a communication channel between a video camera 2 and the video receiver 4 is detected by the evaluation unit 4F. By deactivating the display 5, the driver of the vehicle will immediately become aware that the video monitoring system 1 does not operate properly and can use other technical means to supervise the environment of the vehicle such as conventional mirrors.
The video monitoring system 1 according to the present invention comprises several video cameras 2 and a video receiver 4 which can be used in different applications. In a possible embodiment, the video monitoring system 1 can be used in an airport or transport security system. Further, the video monitoring system 1 can be used for traffic monitoring. In a still further possible embodiment, the video monitoring system 1 can be used for crowd control in transport systems. The number of video cameras used in the monitoring system 1 can vary. In a possible implementation, the video monitoring system 1 can comprise a single camera which can for example be carried by a person. In another possible application, the video monitoring system 1 can comprise a plurality of video cameras 2 connected via a network 3 to the video receiver 4. In the embodiments shown in
In a possible embodiment of the video monitoring system 1 according to the present invention, the evaluation unit 4F can generate control data when detecting an inconsistency within the supervised sequence of digital images DI received from the video cameras 2 of the video monitoring system 1. In a possible embodiment, this control data can be transported from the video receiver 4 within a communication channel to the affected video cameras 2, for instance for performing a reset of the affected video camera 2-i. After restarting the affected video camera 2, the evaluation unit 4F can monitor again the information blocks of the digital images received from the affected video camera 2-1 to check whether the reset of the video camera now provides a consistent sequence of digital images. If the evaluation unit 4F detects that the consistency does no longer exist, it can in a possible embodiment restart the visualization of the digital images DI on the display 5 of the video monitoring system 1.
In a still further possible embodiment, the evaluation unit 4F may deactivate the communication channel of an affected video camera 2 and instruct the image processing unit 4C of the video receiver 4 to perform the image processing on the basis of the remaining still operating video cameras. In a possible embodiment, the information blocks transporting the watchdog information data WID have the same size as the image blocks provided by the video compression unit. The watchdog information data WID is encoded in a possible embodiment in colored information blocks which can carry a predetermined number of admissible color values. By using these color information blocks, the watchdog information data WID carried therein is highly immune against distortions, for instance caused by external influences on the communication channel.
Information can be carried in a possible embodiment by means of color regions or blocks with colored structure which can be generated by Software Video Encoding. These are robust against processing in the video chain. They can be placed at predetermined positions of the respective image.
Number | Date | Country | Kind |
---|---|---|---|
13179109 | Aug 2013 | EP | regional |