1. Field of the Invention
The present invention relates to a traffic monitoring apparatus for monitoring the number of objects such as people moving past an area under surveillance such as, for example, entrance and exit portals of a revolving door.
2. Description of the Prior Art
In recent years, as a security technology to curb the flow of information from corporations, the control system is known, in which a verifying device is installed in each of the important entrance and exit of a commercial building so that only when a person is attested as an authorized person through the ID card or the fingerprint, the door at the entrance or exit can be opened.
With the foregoing security technology, it is necessary to block passage of one or more persons trying to pass through the entrance or exit while tailgating, or following side by side with, the authorized person, who has been given a permission to pass through the entrance or exit after having inserted his or her regular ID card into an ID card verifying device. Accordingly, attempts have hitherto been made to lay a body weight sensitive floor mat on an area under surveillance in the vicinity of the door so that when the body weight detected by the body weight sensor built in the floor mat is greater than a threshold value, determination can be made that a plurality of persons exist and the opening of the door is hence inhibited and, alternatively, to use a monitoring system in which a plurality of ultrasonic sensors are secured to the ceiling above the door, with those ultrasonic sensors storing on a time-series basis information on the body height of an object measured thereby, so that when the average body height of a person appears continuously in the body height information, determination is made that there are two persons and the opening of the door is hence inhibited. See, for example, U.S. Pat. No. 5,201,906.
On the other hand, as another monitoring device, it is known to use a method in which a contour pattern in image data imaged with a tracking camera installed at the area under surveillance in the vicinity of the door is compared and collated with a reference pattern stored beforehand to determine the number of persons existing. See, for example, Published United States Patent Application No. 2004/0017929.
It has, however, been that with the monitoring device in which the body weight sensitive floor mat is laid, and considering that it may occur that the body weight of a single person of a big build would exceed the sum of respective body weights of two persons of a small build, setting of the threshold value to a low value will result in that an authorized person of a big build will not be allowed to pass, but setting of the threshold value to a high value will result in that two persons of a small build will be allowed to pass. Also, with the monitoring device in which the ultrasonic sensors are installed, when two persons in proximity to each other try to pass, information will become comparable to the body height information on a single person on a time-series basis, resulting in an erroneous determination that it is a single person. On the other hand, with the monitoring device based on the image data photo-taken by the tracking camera, the pattern matching cannot be taken, resulting in an erroneous determination in the event that a plurality of persons try to pass in a posture not found in the preset reference pattern, for example, in the event that one person in a standing posture and another person in a bowing posture try to pass.
The present invention has been devised in view of the foregoing problems and inconveniences inherent in the prior art and is intended to provide a traffic monitoring apparatus capable of accurately determining the number of objects such as, for example, persons present in an area under surveillance without being affected by the difference in arrangement of those objects.
In order to accomplish the foregoing object of the present invention, the traffic monitoring apparatus according to a first aspect of the present invention includes an object information acquiring device for acquiring three-dimensional object information related with an object present in an area under surveillance, and a determining device for determining the number of objects based on at least a volume, which is one of a volume and a body height of an object obtained from the object information.
According to this construction, since the number of the objects is determined based on at least the volume of the three-dimensional object information, and let it be assumed that an object stands for a person, the object information will be the one having a large volume corresponding to the sum of respective volumes of two persons in the case where there are two persons, and since the volume of the sum of those of the two persons will be larger than a preset threshold value, it is possible to assuredly determine that they are a plurality of persons, even when two persons of a small build try to pass in proximity to each other. On the other hand, where what exists is a single person, in most cases there is no possibility that an erroneous determination that they are a plurality of persons may occur, since there is little persons having a build enough to exceed the volume of the sum of the respective volumes of the two persons.
In the structure according to the first aspect of the present invention, the determining device may be the one capable of determining the number of the objects based on the threshold value of the volume. According to this construction, if the volume of the threshold value is set to a value greater than the average volume of, for example, a tall person and smaller than the sum of the respective average volumes of two persons of short stature, distinction between whether the number of persons is singular and whether the number of persons is plural can be substantially accurately accomplished based on the magnitude of the threshold value of the volume.
Also, in the structure according to the first aspect of the present invention, the determining device referred to above is preferably operable to determine the number of the objects based on the threshold value of the volume which varies depending on the body height. According to this feature, in the case where, for example, one or two persons are to be determined, if the volume of the threshold value is so chosen as to be a value that varies from the minimum value, which is larger than the maximum possible volume of one person of short stature and smaller than the sum of minimum possible volumes of two persons of short stature, and to the maximum value, which has successively increased to a higher value with increase of the body height and which is larger than the maximum possible volume of one person of tall stature and smaller than the sum of minimum possible volumes of two persons of tall stature, a possible erroneous determination that a single person of an extremely big build may be determined as a plurality of persons and a possible erroneous determination that two persons of an extremely small build trying to pass in proximity to each other may be determined as a single person can be eliminated, with the accuracy of determination of the number of the objects increased consequently. Determination of three or more persons can be accomplished by setting the threshold value for each of quantitative values.
Also, in the structure according to the first aspect of the present invention, the object information acquiring device may be of a structure including a corrected volume calculating unit for determining the volume of the object except for a portion having a body height exceeding a predetermined value. According to this feature, for example, by determining the volume of a person except for an upper portion exceeding a relatively low value of 160 cm, a distinction between the volume of a single person of a big build and the volume of two persons of short stature makes clearer as far as a person of a body height exceeding 160 cm is concerned and, therefore, even the use of a predetermined value regardless of the body height for the threshold value can bring about increase of the accuracy of determination of the number of the objects.
The traffic monitoring apparatus according to a second aspect of the present invention includes an object information acquiring device for acquiring three-dimensional object information related with an object present in an area under surveillance, and a determining device for determining the number of objects based on a distribution, in a two-dimensional plane, of volumes of objects from the object information. According to this construction, since the distribution of the volumes of the object information acquired shows up in an arrangement of a clot in the case where the number of the objects is singular or in an arrangement of separate clots in the case where the number of the objects is plural, the number of the objects can be determined almost without being affected by influences brought about by the difference in body height and volume of the individual objects and, in particular, even where two persons in close proximity to each other try to pass, it is possible to accurately determine that there are two persons.
The determining device in the construction according to the second aspect of the present invention may preferably include a moment calculating unit for determining the moment of the distribution based on the distance in the two-dimensional plane of the distribution from the reference point to the point of distribution and for calculating the value of the moment which is normalized by the volume of the object, and a determining device for determining the number of the objects based on the moment value. According to this feature, since the value of the moment varies depending on the number of the object, an intermediate value of the various moment values can be set as a threshold value, allowing the number of the objects to be accurately determined. Also, since the value of the moment is normalized by the volume, the value of the moment which is not affected by the difference in volume of the persons can be obtained.
The reference point referred to above in the construction according to the second aspect may be a position of the center of gravity of the distribution in the two-dimensional plane. According to this feature, where the number of the objects present is singular, the center of gravity of the distribution lies in the vicinity of the center of the object in the two-dimensional plane, but where the number of the objects present is plural, the center of gravity of the distribution lies at a position between the entire objects in the two-dimensional plane. Accordingly, using this position as the reference point, the difference in value of the moment resulting from the number of the objects can be increased and, therefore, the number of the objects can easily be determined.
The reference point in the construction according to the second aspect may be a vertex at which the body height attains a maximum value. According to this feature, the reference value can easily be determined from the object information. Also, if the object is a person, and where the number of persons present is singular, the top of the head will become the reference point, but where the number of persons is two, the top of the head of the taller person will become the reference point. Accordingly, the difference in value of the moment resulting from the number of the objects can be increased, thereby facilitating the determination of the number of the objects.
The traffic monitoring apparatus according to a third aspect of the present invention includes an object information acquiring device for acquiring three-dimensional object information related with an object present in an area under surveillance, a first information generating device for generating a first quantitative information related with the number of objects based on at least the volume, which is one of a volume and a body height of an object obtained from the object information, a second information generating device for generating a second quantitative information related with the number of objects based on a distribution of the volumes of objects in a two-dimensional plane from the object information referred to above, and a determining device for determining the number of the objects based on the first and/or second quantitative information.
According to this construction, the number of the objects can be determined with high precision from the object information if the first quantitative information based on at least the volume, which is one of the body height and the volume of the object, is combined with the second quantitative information based on the distribution of volumes of the objects.
In the construction according to the third aspect of the present invention, the use may further be made of a weighting unit for weighting at least one of the first and second quantitative information. According to this feature, by properly setting the magnitude of the weighting in dependence on the environment of the area under surveillance, the accuracy of quantitative determination can be increased.
In any event, the present invention will become more clearly understood from the following description of preferred embodiments thereof, when taken in conjunction with the accompanying drawings. However, the embodiments and the drawings are given only for the purpose of illustration and explanation, and are not to be taken as limiting the scope of the present invention in any way whatsoever, which scope is to be determined by the appended claims. In the accompanying drawings, like reference numerals are used to denote like parts throughout the several views, and:
FIGS. 10(a) to 10(c) are plan views of persons, showing the manner in which a reference point of the distribution of objects is set in the traffic monitoring apparatus shown in
FIGS. 12(a) to 12(c) are plan view of persons showing the different manner in which a reference point of the distribution of objects is set in the traffic monitoring apparatus shown in
The revolving door 4 is of a type including a plurality of wings 4b secured to a shaft 4a supported at its opposite ends by the floor and the ceiling of a building. In this revolving door 4, a left portion of the figure represents an entrance IN whereas a right portion of the same figure represents an exit EX. A known stereovision sensor 7 is mounted on the ceiling, forming an upper surface of the passageway through the revolving door 4, so as to be proximate to the entrance IN and the exit EX and an area 8 under surveillance shown by the broken line is defined by the stereovision sensor 7. In the description that follows, only the structure provided on a side of the entrance IN will be described for the sake of brevity.
The entrance of the revolving door 4 is provided with an ID card verifying device 9 shown in
The object information acquiring device 1A shown in
For the object information acquiring device 1A, in place of the stereovision sensor 7, devices for acquiring three-dimensional object information with a single photosensor can be employed (See U.S. Pat. Nos. 6,323,942 and No. 6,512,838). The area under surveillance appropriate to the angle of revolution of the wings 4b of the revolving door 4 is properly divided into a plurality of blocks on a two-dimensional plane (the floor surface in the illustrated instance), with the coordinate system of each of those blocks stored in an surveillance area setting memory 11. A reference plane distance setting memory 12 stores, as a reference distance, the distance from the stereovision sensor 7 to a reference plane (Since in this instance it means a floor surface, reference will hereinafter be made to the floor surface.).
A block volume calculating unit 10 of the object information acquiring device 1A is operable to extract only distance information, corresponding to the block stored in the surveillance area setting memory 11, from the stereovision sensor 7, to convert the extracted distance information for each of the blocks into the distance information from the reference distance, stored in the reference plane distance setting memory 12, to thereby determine the body height from the reference plane in each of those blocks, and to secure the three-dimensional object information which is the volume of the object for each of those blocks.
The three-dimensional object information D outputted from the object information acquiring device 1A shown in
A threshold value setting memory 18 of the determining device 2A stores therein a threshold value that is used to determine whether the number of persons present in the area under surveillance is one or two, and this threshold value is set in the following manner.
In
A determining unit 17 of the determining device 2A is operable to add together cumulative volumes of the frames F in the volume information inputted from the volume calculating unit 13, to calculate a numerical value proportional to the volume by dividing the added value by the number of the frames F, and finally to multiply the calculated numerical value by a predetermined coefficient to provide the volume, which is one of the object information. In this way, influence which may be brought about by noises contained in the object information can be suppressed.
The determining unit 17 referred to above determines the number of persons in the following manner, based on signals, fed respectively from the volume calculating unit 13 and the peak body height extracting unit 14, and the threshold value TL1 fed from the threshold value setting memory 18. That is to say, where the body height of a person inputted from the peak body height extracting unit 14 is within the range of 155 to 175 cm and the volume from the volume calculating unit 13 is smaller than the volume corresponding to the threshold value TL1 of the volume read out from the threshold value setting memory 18, it is determined that the number of persons is singular, but where the body height is within the range of 155 to 175 cm and the volume of the object information is greater than the volume corresponding to the threshold value TL1, it is determined that the number of persons is two. This result of determination is outputted to the control unit 3, which when the number of persons is determined two, activates the door locking unit 5 to thereby inhibit revolution of the revolving door 4.
As shown by mesh hatched areas in
With the traffic monitoring apparatus according to this embodiment, the number of persons is determined based on at least the volume, which is one of the body height and the body weight of a person contained in the three-dimensional object information and, therefore, since the total volume of two persons generally exceeds the threshold value TL1, it can be assuredly determined that the number of persons trying to pass is plural even in the case where two persons of a small build in close proximity to each other try to pass. On the other hand, in the case of a single person, the volume thereof is generally not greater than the threshold value TL1 and, therefore, there is little possibility of an erroneous determination that the number of persons may be plural.
Also, although in the foregoing embodiment, the constant volume regardless of the body height is set as the threshold value TL1, instead thereof, the threshold value TL2 based on the volume that varies depending on the body height can be used as shown in
Where this variable threshold value TL2 is used, a possible erroneous determination that a single person of an extremely big build may be determined as a plurality of persons and a possible erroneous determination that two persons of an extremely small build trying to pass in proximity to each other may be determined as a single person can be eliminated, with the accuracy of determination of the number of the objects increased consequently.
With respect to a portion of the area 8 under surveillance adjacent the exit EX shown in
As shown in
Accordingly, with respect to the person of a body height exceeding 160 cm, since the volume so determined becomes small, the difference in volume resulting from the difference in body height becomes small. In correspondence therewith, by setting a low volume for the constant threshold value TL3, as can readily be understood from comparison between
The detail of the calculating process performed by the moment calculating unit 21 will now be described. Assuming that the coordinates of the floor surface (reference plane) are expressed by x and y and the height z above the floor surface in the coordinates x and y is expressed by z=f(x, y), the product of the surface area s of the floor surface of the block B (
The two-dimensional coordinates (mx, my) on the floor surface having the center of gravity m that is to be determined will, as shown by (a) in
Then, the moment calculating unit 21 makes use of the coordinates (mx, my) on the floor surface having the center of gravity m so determined as discussed above to perform the calculating based on the following equation (3) to thereby calculate the n-th order moment value Mn. This moment value Mn is the moment of distribution of the volumes, which is determined by the distance (x−mx), (y−my) from the center of gravity m of the distribution to the point of distribution as shown by the formula (3) and is then normalized by the volume (the denominator of the formula (3)). By this normalization, influence which may be brought about by the difference in body height of the persons H can be excluded. In the case of the absence of any person, the denominator of the formula (3) will be zero and, therefore, no moment value is calculated with the numerator being zero.
With the traffic monitoring apparatus according to the third embodiment, since the number of persons is determined on the distribution of the volumes of the persons H on the two-dimensional plane (floor surface), the number of the persons H can be determined almost without being affected by the influence resulting from the difference in body height and body weight of the persons H. That is to say, since the distribution of the volumes contained in the acquired object information D shows up in an arrangement of a clot in the case where the number of the objects is singular or in an arrangement of separate clots in the case where the number of the objects is plural, even where two persons in side-by-side relation with each other try to pass, it is possible to accurately determine that there are two persons.
It is to be noted that although in the foregoing embodiment reference has been made to the case in which the center of gravity of the distribution is employed with reference to the reference point of the distribution of volumes of the objects, the vertex at which the height of an object is maximal can be used as a reference point as shown by (a) to (c) in
The first information generating device 24 includes a determining unit 17, which is, as explained in connection with the first embodiment shown in
By way of example, with the first information generating device 24, when the calculated volume is smaller than the threshold value used to determine whether the number of persons is one or two, the determining unit 17 outputs a determination value “1” indicative of the single person, but when the calculated volume exceeds the threshold value, the determining unit 17 outputs a determination value “2” indicative of the two persons. The weighting unit 27 weights the determination value “2” indicative of the two persons to generate the first quantitative information N1 of a value “2.8”. On the other hand, with the second information generating device 28, when the calculated moment value is lower than the threshold value used to determine whether the number of persons is one or two, the determining unit 23 outputs a determination value “1” indicative of the single person, but when the calculated moment value exceeds the threshold value, the determining unit 23 outputs a determination value “2” indicative of the two person. The weighting unit 29 weights the determination value “2” indicative of the two persons to generate the second quantitative information N2 of a value “3.5”.
The determining unit 30 adds the weighted first and second quantitative information N1 and N2 together and, when the calculated value attains a value in excess of “6.0”, it determines that the number of persons H is two. With this way of weighting, the second quantitative information N2 based on the moment value of a high reliability in quantitative determination is highly counted and, therefore, the determination of the number of the persons can be accomplished with further increased accuracy. Depending on the environment of the area 8 under surveillance, it may occur that the first quantitative information N1 based on the volume may have a higher reliability and, in such case, arrangement should be made so that in order for the first quantitative information N1, rather than the second quantitative information N2, to be highly counted, the weighting unit 27 can weight more value than the weighting unit 29.
With the traffic monitoring apparatus according to this embodiment, since the first quantitative information related with the objects, based on at least the volume, which is one of a volume and a body height of an object, and the second quantitative information related with the objects, based on the distribution of the volumes of those objects are determined from the object information D, the number of the objects are determined based on those two quantitative information. Therefore, demerits of those determining devices can be counterbalanced with each other and, even when the two objects try to pass in any of various postures and/or the object information D contains noises, the number of the objects can be determined with high accuracy.
In any one of the foregoing embodiments of the present invention, determination has been made as to whether the number of persons is one or two or more, it is possible to determine the number of persons exceeding three or more if a threshold value of a quantity (for example, the volume or the moment value) is set between two persons and three persons or between three persons and four persons. Also, the present invention is not always limited to the monitoring of the persons as objects, but can be equally applied to the determination of the number of goods, specifically goods moving past the area under surveillance by means of, for example, a belt conveyor.
The present invention having been fully described hereinbefore, it has now become clear that with the traffic monitoring apparatus of the present invention, the number of the objects are determined based from the three-dimensional object information related with the object present in the area under surveillance, based on at least the volume, which is one of the body height and the volume of the object, or the distribution of volumes of the objects, or the both, and, therefore, regardless of the difference in body height of the objects, the number of the objects can be determined with high precision.
Although the present invention has been fully described in connection with the preferred embodiments thereof with reference to the accompanying drawings which are used only for the purpose of illustration, those skilled in the art will readily conceive numerous changes and modifications within the framework of obviousness upon the reading of the specification herein presented of the present invention. Accordingly, such changes and modifications are, unless they depart from the scope of the present invention as delivered from the claims annexed hereto, to be construed as included therein.
Number | Date | Country | Kind |
---|---|---|---|
2005-022493 | Jan 2005 | JP | national |