Patent Application
20080258914
1. Field of the Invention
The present invention relates to a monitoring apparatus of computing a new output from outputs of two sensors so as to, for example, detect a person who is staying in a monitored area.
2. Description of Related Art
Prior art monitoring apparatus use a plurality of different sensors for the main purpose of complementing monitor region, space, and target which cannot be covered by each of the plurality of different sensors (for example, refer to patent reference 1).
[Patent reference 1] JP,2000-69459,A
In a prior art monitoring apparatus using a combination of a plurality of types of sensors, the functions of one of them which cannot be covered through the use of only a single sensor of another type can be complemented by combining outputs of the plurality of types of sensors. For example, although the use of a single monitoring camera cannot implement a function of appropriately restricting the time zone during which the monitored image is to be recorded, this function can be complemented by using an infrared sensor and then starting recording of the image of the monitoring camera in response to an alarm from the infrared sensor. For this reason, the sensing functions of a prior art monitoring apparatus depend upon each of a plurality of sensors disposed therein, and the sensing functions do not have a total sensing capability which exceeds the capability of each of the plurality of sensors. Therefore, in order to improve the accuracy of monitoring of a prior art monitoring apparatus, the capability of each of a plurality of sensors included has to be improved.
The present invention is made in order to solve the above-mentioned problem, and it is therefore an object of the present invention to provide a monitoring apparatus which can improve the detection accuracy of the whole monitoring apparatus.
In accordance with the present invention, there is provided a monitoring apparatus including: a first sensor for outputting a first possibility distribution of occurrence of an event in a first monitor area; a second sensor for outputting a second possibility distribution of occurrence of the event in a second monitor area which overlaps the first monitor area; a distribution computing means for computing an integrated possibility distribution of occurrence of the event in a common portion where the first monitor area and the second monitor area overlap each other on the basis of the first possibility distribution and the second possibility distribution; and an information presenting means for outputting the integrated possibility distribution acquired by the distribution computing means.
The monitoring apparatus of the present invention thus computes the integrated possibility distribution of the occurrence of the event on the basis of the first possibility distribution obtained by the first sensor and the second possibility distribution obtained by the second sensor. Therefore, the present invention can improve the detection accuracy of the whole monitoring apparatus.
Further objects and advantages of the present invention will be apparent from the following description of the preferred embodiments of the invention as illustrated in the accompanying drawings.
a) to 6(c) are explanatory diagrams showing another example of display of information by the monitoring apparatus in accordance with embodiment 1 of the present invention;
The position detection sensor using electromagnetic wave 1 has two leaky coaxial cables (LCX) 1a and 1b so as to detect the position of a monitor object 100 which exists between the LCX 1a and 1b. This position detection sensor using electromagnetic wave 1 is, for example, a sensor disclosed by, for example, JP,2004-138402,A, and the detailed explanation of the position detection sensor will be omitted hereafter because the sensor is well known. The image pickup device 2 is a camera for acquiring an image of a specific area, and the image processing device 3 is a unit which detects the position of the monitor object 100 from the image acquired by the image pickup device 2 by performing image processing on the image. Because a process of detecting the monitor object 100 of the image processing device 3 is well known, the explanation of the detecting process will be omitted hereafter. The position detection sensor using electromagnetic wave 1 and the second sensor 4 are arranged so that a first detection region (i.e., a first monitor area) 101 which is monitored by the position detection sensor using electromagnetic wave 1 overlaps a second detection region (i.e., a second monitor area) 102 which is monitored by the second sensor 4. The distribution computing means 5 is a unit for computing a distribution of the detected position on the basis of both the output of the position detection sensor using electromagnetic wave 1, and the output of the image processing device 3. The information presenting means 6 is a unit for outputting information, for example, for displaying the distribution computed by the distribution computing means 5 on a display not shown in the figure.
Next, the operation of the monitoring apparatus according to embodiment 1 will be explained. In accordance with this embodiment, in order to detect and monitor the position of the monitor object 100, the two types of sensors, i.e., the position detection sensor using electromagnetic wave 1 and the second sensor 4 which consists of the image pickup device 2 and the image processing device 3 are provided, and the position of the monitor object 100 continues to be monitored. Conventionally, even though a prior art monitoring apparatus has such a structure, in most cases, detection of a region which cannot be monitored by either the position detection sensor using electromagnetic wave 1 or the second sensor 4 is complemented by detection of another region which can be monitored by the other sensor. For example, when the monitor region of the second sensor 4 is narrow, the prior art monitoring apparatus monitors a larger region by using the position detection sensor using electromagnetic wave 1 while it controls the second sensor 4 if needed so as to capture an image of a monitor object to be monitored and monitor the position of the monitor object using the second sensor 4. In most cases, because the prior art monitoring apparatus determines the position of the monitor object on the basis of sensing information about the sensing obtained by either the position detection sensor using electromagnetic wave 1 or the second sensor 4, the prior art monitoring apparatus cannot acquire information having a degree of accuracy exceeding the position detection accuracy of either the position detection sensor using electromagnetic wave 1 or the second sensor 4. Furthermore, because position detection signals outputted from these sensors are acquired by the sensors of different-types, there is no correlation between them and they are independent of each other. Generally, whether to select, as correct information, either of the position detection signals outputted from the position detection sensor using electromagnetic wave 1 and the second sensor 4 for a region in which the position of the monitor object can be detected by both the position detection sensor using electromagnetic wave 1 and the second sensor 4 is left to the discretion of how to use the monitoring apparatus. Therefore, even if the plurality of position detection signals can be acquired, the prior art monitoring apparatus simply selects either one of them, and therefore the accuracy of detecting the position of the monitor object depends on the detection accuracy of each of the sensors and therefore cannot exceed this accuracy. Furthermore, it is difficult to use the plurality of different sensor output signals by simply combining them because there is no correlation among them.
Therefore, the monitoring apparatus in accordance with this embodiment is so constructed as to operate more efficiently by integrating the outputs of the plurality of types of sensors for which such a correlation cannot be easily defined. Hereafter, the concrete operation of the monitoring apparatus of this embodiment will be explained.
First, when the monitor object 100 exists in only either one of the first detection region 101 which is monitored by the position detection sensor using electromagnetic wave 1 and the second detection region 102 which is monitored by the second sensor 4 (i.e., when the detection signal is acquired from only one of the sensors), the distribution computing means 5 and the information presenting means 6 operate on the basis of the output of the sensor from which the detection signal is acquired. In other words, in this case, the output of the sensor from which the detection signal is acquired becomes the output of the information presenting means 6, just as it is. In this embodiment, assume, as monitoring of occurrence of an event different from normal events, detection of an invader to a monitor area or detection of the position of a monitor object which exists in a monitor area.
Next, when the monitor object 100 exists in a region portion in which the first detection region 101 and the second detection region 102 overlap each other, the distribution computing means 5 computes a possibility distribution of the position of the monitor object 100 on the basis of the output of the position detection sensor using electromagnetic wave 1 and the output of the image processing device 3. Because the position detection sensor using electromagnetic wave 1 and the second sensor 4 are position detecting sensors, each of their position detection output signals is generally outputted as information about a point. In an internal process, information about a point with the highest degree of reliability or probability among a plurality of detected candidates for the position where the monitor object 100 can be assumed to exist is outputted as a detected result.
The second sensor 4 carries out an operation of detecting the position of the monitor object 100 as follows.
The distribution computing means 5 computes a position range of the monitor object 100 on the basis of such the outputs of the position detection sensor using electromagnetic wave 1 and the second sensor 4.
When performing the weighting, if judging that, for example, a failure, an abnormality, or a malfunction has occurred in one of the sensors, the distribution computing means 5 decreases the weight assigned to the sensor. Furthermore, according to the characteristics of each of the sensors, the distribution computing means can change the weight assigned to each sensor. For example, in consideration of the influence of increase in noises in the image from the image pickup device 2 due to shaking of the image pickup device 2 at a time when a strong wind is blowing, the distribution computing means can reduce the weight by which the second possibility distribution 120 of the second sensor 4 is multiplied. Furthermore, in consideration of the influence of reflection of electromagnetic waves by moisture at a time of rainy weather, the distribution computing means can reduce the weight by which the first possibility distribution 110 of the position detection sensor using electromagnetic wave 1 is multiplied. In addition, because the reliability of the second sensor 4 is improved when monitoring of a point in the vicinity of the image pickup device 2, the distribution computing means can increase the weight by which the second possibility distribution 120 is multiplied. When computing the integrated possibility distribution 130, the distribution computing means can further improve the reliability of the computation by, for example, adding the first possibility distribution 110 and the second possibility distribution 120 only at positions at each of which they have values other than zero (i.e., by performing an addition of the first possibility distribution 110 and the second possibility distribution 120 after implementing an AND logical operation on them). As shown in
Next, the information presenting means 6 displays the possibility distribution which is computed by the distribution computing means 5 on a display or the like which is not shown in
As an alternative, the possibility distributions 110, 120, and 130 can be displayed separately.
In addition, as the method of displaying such a possibility distribution, an information presenting method of not only displaying a possibility distribution in the form of a graph, but superimposing it on a map in three dimensions can be used.
By carrying out such a display, the information presenting means can make the display be further intuitive and can improve the visibility of the display for guards or watchmen.
In above-mentioned embodiment 1, an RFID (Radio Frequency Identification) can be used as the second sensor, instead of the combination of the image pickup device 2 and the image processing device 3.
Furthermore, because many ranges 140 can be acquired in a case in which may tag sensors 7 are arranged, a region where these ranges overlap can be detected as a region with the highest probability of the existence of the tag, and therefore the detection accuracy can be further improved.
As mentioned above, the monitoring apparatus according to embodiment 1 for monitoring occurrence of an event different from normal events includes: the first sensor for outputting a first possibility distribution of occurrence of the event in a first monitor area; a second sensor for outputting a second possibility distribution of occurrence of the event in a second monitor area which overlaps the first monitor area; the distribution computing means for computing an integrated possibility distribution of occurrence of the event in a common portion where the first monitor area and the second monitor area overlap each other on the basis of the first possibility distribution and the second possibility distribution; and the information presenting means for outputting the integrated possibility distribution acquired by the distribution computing means. Therefore, the detection accuracy of the whole monitoring apparatus can be further improved as compared with the case where a plurality of sensors are simply used.
Furthermore, in the monitoring apparatus according to embodiment 1, the first and second sensors are of different types. Therefore, the monitoring apparatus can correct errors which are difficult to correct by using only one kind of sensor by using the combination of the first and second sensors, and can carry out highly accurate detection of the position of the monitor object.
In addition, in the monitoring apparatus according to embodiment 1, the event different from normal events is a person's intrusion into a monitor area. Therefore, the monitoring apparatus can detect any invader into the monitored area with high accuracy.
Furthermore, in the monitoring apparatus according to embodiment 1, the monitoring of the occurrence of the event different from normal events is detection of a position of an object which exists in a monitor area. Therefore, the monitoring apparatus can carry out detection of the position of an object which exists in the monitored area with high accuracy.
In addition, in the monitoring apparatus according to embodiment 1, the first sensor is a position detection sensor using electromagnetic wave, and the second sensor includes an image pickup device for acquiring an image of the second monitor area and an image processing device for detecting occurrence of the event different from normal events from the image acquired by the image pickup device. Therefore, the monitoring apparatus can detect occurrence of an event different normal events with high accuracy.
Furthermore, in the monitoring apparatus according to embodiment 1, the first sensor is a position detection sensor using electromagnetic wave, and the second sensor is a tag sensor for detecting the position of an RFID tag. Therefore, the monitoring apparatus can detect occurrence of an event different normal events with high accuracy.
In addition, in the monitoring apparatus according to embodiment 1, the information presenting means outputs the first possibility distribution of the first sensor and the second possibility distribution of the second sensor separately. Therefore, the monitoring apparatus can improve the viewability of the display for guards or watchmen by displaying only needed information.
In above-mentioned embodiment 1, the combination of the image pickup device and the position detection sensor using electromagnetic wave is shown as an example. Instead of this combination, sensors each including a processing unit having a probability distribution of the existence of a monitor object can be used. More specifically, sensors each for detecting passage of a monitor object, such as an infrared sensor or a photoelectric sensor, except for sensors without any possibility distribution of the existence of a monitor object in performing internal processing in order to detect the position of the monitor object, but having characteristics close to digital outputs, can be similarly used. In this embodiment 2, such an example of use of sensors each for detecting passage of a monitor object, such as an infrared sensor or a photoelectric sensor, will be explained.
Because the structures and operations of the distribution computing means 5 and the information presenting means 6 in accordance with embodiment 2 are the same as those of embodiment 1, schematic representations and detailed explanations of them will be omitted hereafter. More specifically, the distribution computing means 5 computes an integrated possibility distribution on the basis of the possibility distributions which correspond to the region 107 in which the monitor object 100 can be assumed to exist on the basis of the detection results from the pressure-sensitive position detecting sensor 9, and the region 108 in which the monitor object 100 can be assumed to exist on the basis of the detection results from the laser radar 10, like that of embodiment 1, and the information presenting means 6 displays the integrated possibility distribution. The monitoring apparatus thus makes it possible to freely combine sensors each of which provides a possibility distribution in detection of a monitor object. In a case where a region which possibility distributions overlap exists, there is no restriction on the number of sensors combined.
As mentioned above, in the monitoring apparatus according to embodiment 2, the first sensor is a range sensor using laser scanner, and the second sensor is a pressure-sensitive position detecting sensor. Therefore, the monitoring apparatus can detect occurrence of an event different normal events with high accuracy.
In above-mentioned embodiments 1 and 2, an integrated possibility distribution is obtained on the basis of the outputs of the first and second sensors, as previously explained. In this embodiment 3, an example of performing a calibration on a sensor will be explained. More specifically, a sensor for detecting the position of a monitor object on the basis of a probability distribution, like the position detection sensor using electromagnetic wave 1 and the second sensor 4 which are explained in embodiment 1, needs an algorithm of determining the detected position of the monitor object from the probability distribution, a threshold process, adjustment of the sensitivity of the sensing function thereof, etc., and a balance among them determines most of the detection accuracy. Therefore, an operation of achieving a balance among them (a calibration operation) is generally needed. In performing a calibration operation, in order to improve the accuracy of a target sensor, another reference with high accuracy needs to be prepared and adjustment needs to be performed on the target sensor on the basis of this reference. Therefore, in a case in which a prior art calibration method is applied to the structure as shown in
For this reason, the calibration is generally carried out only at a time when the monitoring apparatus is installed. A problem is therefore that it is difficult to adjust each of the sensors after each of the sensors is installed, and hence a sensor with higher accuracy or an installation operation with higher accuracy are needed and this results in increase in the cost of the monitoring apparatus. In contrast with this, in accordance with this embodiment 3, a calibration operation is performed by adjusting the possibility distributions 110 and 120 again on the basis of the integrated possibility distribution 130 in order to solve the problem. Hereafter, the calibration operation will be explained concretely.
Next, the calibration operation in accordance with embodiment 3 will be explained. In the calibration operation, the parameters of a sensor are adjusted by using a correct value as a teacher signal. Hereafter, the calibration operation will be explained by taking, as an example, the case shown in
It should be noted that at the time of performing a calibration, in order to improve the accuracy of a certain sensor, any information about the same sensor cannot be used. In contrast, because the information about a different type of sensor is used in the monitoring apparatus of embodiment 3, the calibration method of this embodiment is suitable for automatic calibrations. A fundamental problem of whether or not the assumed positions 131 are correct (i.e., whether the monitor object 100 really exists there) can be solved by carrying out the calibration iteratedly because, from the viewpoint of characteristics of the calibration, if the acquired values are correct, they become stable and then converge to stable correct values, whereas unless the values are incorrect, the parameters become unstable while the values converge to stable correct values.
When the sensor output of either the position detection sensor using electromagnetic wave 1 or the second sensor 4 can be trusted absolutely, the calibration means can alternatively carry out the calibration by using, as the teacher signal, the output signal of either the sensor which can be trusted or the sensor used as reference. For example, when the output of the second sensor 4 is used as reference because the second sensor 4 has an adequate degree of accuracy, the calibration means 11 does not perform any calibration on the second sensor 4, but performs a calibration on the position detection sensor using electromagnetic wave 1 using the assumed positions 121 of the second sensor 4 as the teacher signal, instead of the assumed positions 131, so as to adjust the parameters of the position detection sensor using electromagnetic wave 1 so that the assumed positions 113 get closer to the assumed positions 121 as close as possible.
As previously mentioned, the monitoring apparatus according to embodiment 3 can carry out the calibration again not only at a time when the monitoring apparatus is installed but also at a time when the monitoring apparatus is operating under normal conditions, it can improve the accuracy of each of the position detection sensor using electromagnetic wave 1 and the second sensor 4 during normal operation. As a result, the accuracy can be maintained during normal operation while the calibration cost at the time when the monitoring apparatus is installed is reduced, and spending much time on the calibration can achieve a higher-accuracy calibration compared with the case where the calibration is carried out only at the time when the monitoring apparatus is installed. Generally, in many cases, the machine accuracy and installation accuracy of a sensor change and degrade with time. However, because the monitoring apparatus according to this embodiment can carry out the calibration successively, the present embodiment can also offer an advantage of reducing the change and degradation in the machine accuracy and installation accuracy of each of the sensors.
As mentioned above, the monitoring apparatus according to embodiment 3 includes the calibration means for calibrating the output of at least one of the first and second sensors on the basis of the output of the distribution computing means. Therefore, the monitoring apparatus can calibrate each of the sensors during its normal operation, and therefore can improve the detection accuracy during normal operation.
Many widely different embodiments of the present invention may be constructed without departing from the spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific embodiments described in the specification, except as defined in the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2007-109625 | Apr 2007 | JP | national |
