Patent Application
20220390604
The present application claims priority from Japanese application JP2021-094208, filed on Jun. 4, 2021, the contents of which is hereby incorporated by reference into this application.
The present invention relates to a TOF apparatus, a TOF system, and an installation status notification method.
Conventionally, a TOF apparatus is known that measuring the distance to an object based on the TOF (Time Of Flight) method that measures the distance by the flight time until the irradiation light is reflected by the object and returns. JP-A-2020-56698 discloses this type of TOF apparatus.
That is, JP-A-2020-56698 discloses a distance measurement image pickup apparatus including a light emitting unit, a light receiving unit, and a distance computation unit. The light emitting unit emits pulsed irradiation light emitted by a light source such as a laser diode (LD) or a light emitting diode (LED). The light receiving unit exposes the pulsed reflected light that is irradiated and reflected by the object and returned by an image sensor such as a CCD or CMOS in which pixels are arranged two-dimensionally, and converts it into an electric signal. The distance computation unit calculates the distance to the object from the output signal of the light receiving unit.
The TOF apparatus is often used for counting the number of people and acquiring flow lines, and may be installed on the ceiling of a store such as an apparel shop, for example. However, since the installation environment of the TOF apparatus affects the performance, there are not a few cases where re-construction work is performed to shift the installation location after the start of operation.
To explain an example, normally, the TOF apparatus is installed by the construction work by the contractor after conducting a field survey (also called the site investigation) in advance to determine the installation location and then giving instructions to the contractor. However, there are cases where the installation location is instructed to the contractor by looking only at the drawings at the site without making the field survey, and the quality of the installation may depend on the experience of the contractor. In addition, the accuracy may not be obtained after the start of operation, and from the viewpoint of accuracy, the construction work may be performed again after the start of operation.
Therefore, the present invention purpose to provide a TOF apparatus, a TOF system, and an installation status notification method that can automatically determine the quality of installation and reduce the loss of performing re-construction work.
According to a first aspect of the invention, the following TOF apparatus is provided. TOF apparatus includes a processor. The processor executes an anomaly determination program to determine whether the installed state is normal or anomaly based on at least one of the viewpoints of the installation angle, the influence of interference, the field of view, and the measurement distance, and notifies the determination result.
According to a second aspect of the invention, the following TOF system is provided. TOF system includes a TOF apparatus, a display, and a processor. The processor executes an anomaly determination program to determine whether the TOF apparatus installed state is normal or anomaly based on at least one of the viewpoints of the installation angle, the influence of interference, the field of view, and the measurement distance, and display information of related to the determine on the display.
According to a third aspect of the invention, the following installation status notification method is provided. The installation status notification method is a method executed by the processor. The installation status notification method determines whether the TOF apparatus installed state is normal or anomaly based on at least one of the viewpoints of the installation angle, the influence of interference, the field of view, and the measurement distance, and the measurement distance, and notifies the determination result.
According to the invention, it is possible to provide a TOF apparatus, a TOF system, and an installation status notification method that can automatically determine the quality of installation and reduce the loss of performing re-construction work.
First, a configuration of a TOF sensor (TOF apparatus) of the first embodiment will be described with reference to
The mounting unit 14 is a unit for mounting the apparatus, and may have an appropriate configuration. The mounting portion 14 can have, for example, a configuration in which a plurality of screw holes are formed and construction using screws is possible. Further, the mounting portion 14 may have a configuration that enables construction using a member such as a fixer or a bracket separately.
Further, the TOF sensor 1 may be configured so that the installation angle can be changed by rotating the TOF sensor 1 with respect to the installation portion. Therefore, the mounting unit 14 may have an appropriate rotation mechanism for changing the installation angle. Further, the TOF sensor 1 may be installed by using separately a member having a rotation mechanism capable of changing the installation angle. The TOF sensor 1 is used by being installed to the upper surface side (for example, the ceiling) inside the structure. Then, the TOF sensor 1 can change the installation angle with respect to the installed portion (for example, the installation surface of the ceiling).
Next, the configuration of the TOF sensor will be described with reference to the hardware block diagram of
The TOF sensor 1 includes an acceleration sensor 23 (installation angle detection sensor), a power supply 24, and a LED 25 (lamp). The acceleration sensor 23 is appropriately provided so that the tilt angle of the apparatus with respect to the installation surface can be detected as angle information. In the present embodiment, when considering a three-axis rectangular coordinate system (when considering the direction horizontal to the installation surface and viewing the light emitting unit 12 and the light receiving unit 13 as the Z axis, the direction perpendicular to the installation surface as the Y axis, and the direction horizontal to the installation surface and perpendicular to the Z-axis and Y-axis as the X-axis), the acceleration sensor 23 detects the tilt angle with respect to an installation surface at least around the X-axis and around the Z-axis.
The power supply 24 is the configuration used for supplying electric power. In this embodiment, power is supplied by PoE (Power of Ethernet), and a LAN cable is connected. The LED 25 can be configured by an appropriate LED lamp. The LED 25 is appropriately provided so that the contractor or the like can visually recognize it, and is used to notify the determination result in the execution of the anomaly determination program 31.
In the present embodiment, when the TOF sensor 1 is installed, the anomaly determination program 31 is executed. Next, an example of the processing of the anomaly determination program 31 will be described with reference to
When the TOF sensor 1 is installed and power is supplied (step 101), the anomaly determination program 31 is executed, and first, a check is performed as to whether or not the completion flag 32 is on (step 102). Here, at the time of factory shipment, the completion flag 32 is set to off. Therefore, when the TOF sensor 1 is installed, the completion flag 32 is considered to be off. In the step 102, when the completion flag 32 is confirmed on, the process of step 110 described later is performed. On the other hand, when the completion flag 32 is confirmed off, using the angle information from the acceleration sensor 23, the determination as to whether or not the installation angle is normal is started (step 103).
As shown in
In the present embodiment, in the step 103, when the installation angle of the apparatus with respect to the installation surface is determined less than plus or minus 5 degrees, a light emitting instruction is output to the light emitting unit 12, a laser is emitted (that is, the light source emits light), and acquisition of an IR image based on distance data and luminance information is started (step 104).
On the other hand, when it is determined that the installation angle of the apparatus is plus or minus 5 degrees or more with respect to the installation surface, the number of blinks of the LED 25 per predetermined time is set to one (step 121), the laser is turned off (that is, the light source is turned off), and the acquisition of the distance data and the IR image is stopped (step 125). Then, the step 126 described below is performed.
In the step 105, on the premise of an environment in which there is no movement of a person or an object (that is, on the premise that the distance data from the moving object is not acquired), the variation in the distance data acquired in step 104 is measured, and the presence or absence of interference is determined. That is, it is considered that there is no variation in the distance data from a non-moving object. Therefore, the presence or absence of interference is determined based on whether or not have a variation of a predetermined or more (it can be set as appropriate, and in this embodiment, 10% or more) in the distance data for a predetermined time (it is able to set as appropriate, and in this embodiment, 10 seconds). Note that, as an example, it is considered that the interference is caused by the influence of another TOF sensor or LiDAR installed nearby.
In the step 105, when it is determined that there is no variation of 10% or more in the distance data, the luminance of the IR image acquired in the step 104 is measured, and the field of view of anomaly is determined (step 106).
On the other hand, when it is determined that there is variation of 10% or more in the distance data, the number of blinks of the LED 25 per predetermined time is set to two (step 122), the laser is turned off (that is, the light source is turned off), and the acquisition of the distance data and the IR image is stopped (step 125). Then, the step 126 described below is performed.
In the step 106, an anomaly of the field of view is determined from the viewpoint of luminance. For example, as shown in
In the step 106, when it is determined in the IR image that pixels having a predetermined brightness or more do not occupy 30% or more, a distance anomaly regarding whether or not the measurement distance is appropriate is determined based on the distance data acquired in the step 104 (step 107).
On the other hand, when it is determined that pixels having a predetermined brightness or more occupy 30% or more in the IR image, the number of blinks of the LED 25 per predetermined time is set to three (step 123), the laser is turned off (that is, the light source is turned off), and the acquisition of the distance data and the IR image is stopped (step 125). Then, the step 126 described below is performed.
In the step 107, an anomaly of the measurement distance is determined from the viewpoint of the distance to the object. For example, as shown in
In the step 107, when it is determined that the distance data of less than 1 meter does not occupy 30% in the image, the laser is turned off (that is, the light source is turned off), and the acquisition of the distance data and the IR image is stopped (step 108). Then, the completion flag 32 is set to on (step 109). In the step 110, the LED 25 is turned on (that is, the LED is left on), and the processing of the anomaly determination program 31 is completed. By the step 110, the TOF sensor 1 is in a state of being able to operate normally.
On the other hand, when it is determined that the distance data of less than 1 meter occupies 30% or more in the image, the number of blinks of the LED 25 per predetermined time is set to four (step 124), the laser is turned off (that is, the light source is turned off), and the acquisition of the distance data and the IR image is stopped (step 125). Then, the step 126 described below is performed.
In the step 126, the LED 25 is blinked under the conditions set in the step 121, the step 122, the step 123, or the step 124 described above. Then, the processing of the anomaly determination program 31 ends. In the step 126, the completion flag 32 is not turned on, which is different from the step 110, it does not become a state of being able to operate normally. Therefore, in order to use the TOF sensor 1 normally, it is necessary to change the installation environment, execute the anomaly determination program 31 again, and turn on the completion flag 32.
According to the present embodiment, when an anomaly in the installation angle is determined, when it is determined that there is interference, when an anomaly in the field of view is determined, and when an anomaly in the measurement distance is determined, the abnormality is determined, since the LED 25 is blinked in different modes, the contractor or the like can easily grasp which type of anomaly is determined by paying attention to the LED 25.
In the installation of the TOF sensor 1, for example, it is conceivable that a step portion is formed at the installation location or a blind spot is generated by an existing installation object. For example, when the TOF sensor 1 is installed on the ceiling, it is conceivable that a step portion is formed on the ceiling or a blind spot is generated by illumination, an air conditioner, or the like. Then, for example, it is conceivable that the occurrence of a blind spot limits the irradiation of the irradiation light and the acquisition of the image, and the measurement accuracy is lowered, and the accuracy of the counting the number of people and the acquiring flow lines is lowered accordingly. In this way, the TOF sensor 1 is affected by the installation environment, but according to the present embodiment, since it is possible to determine whether the installation environment is appropriate and notify it, the installation work can be performed appropriately. Therefore, after the start of operation, it is possible to reduce the loss of performing the installation work again from the viewpoint of accuracy.
Next, the second embodiment will be described. In the second embodiment, an example of a TOF system using a TOF sensor will be described.
As shown in
The PC 43 includes a storage 52, a processor 53, and a screen 54. The storage 52 is configured as an appropriate storage device for storing data, and may be, for example, an HDD (Hard disk drive) or a ROM. The storage 52 stores the anomaly determination program 61. The processor 53 has a calculation function, and can be a CPU as an example. The processor 53 can execute the anomaly determination program 61 stored in the storage 52. The screen 54 is composed of an appropriate display device such as a display. As will be described later, information is displayed on the screen 54 when the anomaly determination program 61 is executed.
Next, an example of the processing of the anomaly determination program 61 will be described with reference to
When the TOF sensor 42 is installed, the anomaly determination program 61 is activated (step 201). Then, a command is issued to start communication with the TOF sensor (step 202), and a command is issued to acquire angle information which is information on the installation angle of the TOF sensor 42 (step 203). Then, it is determined whether or not the installation angle of the TOF sensor 42 is appropriate. In this embodiment, it is determined whether or not the installation angle is plus or minus 5 degrees or more.
Here, if it is determined that the installation angle is appropriate, step 204 described later is executed. On the other hand, when it is determined that the installation angle is not appropriate (that is, if an anomaly in the installation angle is determined), information indicating an angle anomaly and an arrow indicating a direction for correcting the angle are displayed on the screen 54 (step 221). Note that, the display mode of the information indicating the angle anomaly is not particularly limited as long as it can be grasped that the angle anomaly is present. For example, the angle anomaly may be shown by displaying the character information. Further, for example, by displaying a specific symbol, an angular anomaly may be indicated.
The details of the processing when the anomaly of the installation angle is determined will be described with reference to
Next, an example of the display of the arrow displayed on the screen 54 will be described.
In this embodiment, an example in which a blue arrow is used for the angle around the X axis and a red arrow is used for the angle around the Z axis has been described. However, the display mode of the arrow is not particularly limited as long as the direction for improving the inclination can be appropriately displayed, and for example, different colors other than these may be used. Also, arrows of the same color may be displayed.
Then, the installation state can be changed with reference to the arrow displayed on the screen 54, and the angle anomaly can be resolved. Further, the screen 54 displays information for selecting whether to continue the measurement (step 225). Here, when the measurement is selected to be continued, the step 203 is executed again. On the other hand, when choosing not to continue the measurement, the step 208, described below, is performed. Note that, an appropriate configuration is used for selecting whether to continue the measurement (for example, a configuration for inputting with a keyboard or a touch panel is used).
In the step 204, a command is issued to cause the TOF sensor 42 to emit a laser. Then, the acquisition of the distance data and the IR image is started. After that, in the step 205, the presence or absence of interference is determined in the same manner as in the step 105 described above, and when it is determined that the variation in the distance data is not 10% or more, the step 206 is executed. On the other hand, when it is determined that the variation of the distance data is 10% or more, the step 222 is executed. In the step 222, information indicating the occurrence of interference is displayed on the screen 54. Note that, the display mode of the information indicating the occurrence of interference is not particularly limited as long as the occurrence of interference can be grasped. For example, display may be performed by character information, or display may be performed based on a specific symbol. Then, based on the information displayed on the screen 54, the interference can be resolved by changing the interference setting such as by changing the installation location. Further, similarly to the above, the screen 54 displays information for selecting whether to continue the measurement (step 225), when the measurement is selected to be continued, the step 203 is performed again. When choosing not to continue the measurement, the step 208 described below is performed.
In the step 206, an anomaly in the field of view is determined in the same manner as in the step 106 described above, and when it is determined that pixels having a predetermined brightness or higher do not occupy 30% or more in the IR image, the step 207 is executed. On the other hand, when it is determined that pixels having a predetermined brightness or more occupy 30% or more in the IR image, information indicating the field of view anomaly and an arrow indicating the direction for correcting the sensor (that is, the direction for correcting the field of view anomaly) are displayed on the screen 54 (step 223). Note that, the display mode of the information indicating the field of view anomaly is not particularly limited as long as the field of view anomaly can be grasped, as in the case described above.
The details of the processing when the field of view anomaly is determined will be described with reference to
The details of the display on the screen 54 will be described with reference to
Note that, the display mode of the mark indicating the position of the centroid of the IR image and the mark indicating the position of the centroid in the region where the brightness is high may be appropriately changed. Further, these marks may be omitted as appropriate. Further, the display mode of the arrow may be changed as appropriate as long as it can grasp the direction away from the region where the brightness is high.
Then, by changing the installation state based on the information displayed on the screen 54 (for example, by tilting in the direction of the arrow to change the installation angle), the field of view anomaly can be resolved. Note that, by changing the installation location (for example, by changing the installation location of the device in the direction of the arrow), the field of view anomaly may be resolved. Further, similarly to the above, the screen 54 displays information for selecting whether to continue the measurement (step 225), and when the measurement is selected to be continued, the step 203 is executed again. When choosing not to continue the measurement, the step 208 described below is performed.
In the step 207, an anomaly in the measured distance is determined in the same manner as in the step 107 described above, and when it is determined that the distance data of less than 1 m does not occupy 30% of the image, the step 208 is executed. On the other hand, when it is determined that the distance data of less than 1 m occupies 30% or more in the image, the information indicating the distance anomaly, and an arrow indicating the direction (that is, the direction to correct the anomaly distance) to correct the sensor are displayed on the screen 54 (step 224). Note that, the display mode of the information indicating the distance anomaly is not particularly limited as long as the distance anomaly can be grasped, as in the case described above.
The details of the processing when the distance anomaly is determined will be described with reference to
The details of the display on the screen 54 will be described with reference to
Note that, the display mode of the mark indicating the position of the centroid of the image of the distance data and the mark indicating the position of the centroid in the region where the distance is anomaly may be appropriately changed. Further, these marks may be omitted as appropriate. Further, the display mode of the arrow may be changed as appropriate as long as it can grasp the direction away from the region of the distance data less than the predetermined distance.
Then, by changing the installation state with reference to the arrow displayed on the screen 54 (for example, by tilting in the direction of the arrow to change the installation angle), the distance anomaly can be resolved. Note that, by changing the installation location (for example, by changing the installation location of the device in the direction of the arrow), the distance anomaly may be resolved. Further, the screen 54 displays information for selecting whether to continue the measurement (step 225), and when the measurement is selected to be continued, the step 203 is executed again. On the other hand, when choosing not to continue the measurement, the step 208 is performed.
In the step 208, a command is issued to turn off the laser (that is, turn off the light source) and stop the acquisition of distance data and IR images. Then, the anomaly determination program 61 ends (step 209). By executing this anomaly determination program 61, as shown in
According to this embodiment, from the viewpoint of the installation angle, the presence or absence of interference, the anomaly of the field of view, and the anomaly of the measurement distance, it is determined whether or not the installation state of the TOF sensor 42 is appropriate, when it is determined to be anomaly, the information is displayed on the screen 54 as the notification content. Then, appropriate Installation work can be performed by referring to the content of the notification. Therefore, it is possible to reduce the loss of performing the Installation work again from the viewpoint of accuracy after the operation is started.
According to the embodiments described above, an installation status notification method executed by a processor is provided. The installation status notification method determines whether the TOF apparatus installed state is normal or anomaly based on at least one of the viewpoints of the installation angle, the influence of interference, the field of view, and the measurement distance, and the measurement distance, and notify the determination result. Further, a program for causing the processor to execute the installation status notification method is provided.
Hereinbefore, the embodiment has been described, but the invention is not limited to the above-described embodiment, and includes various modifications. For example, addition, deletion, or substitution of another configuration can be made with respect to a part of the configuration of the embodiment.
As an example of the processor, the CPU is considered, but another semiconductor device (for example, GPU) may be employed as long as the other semiconductor device is a main body that executes predetermined processes.
The criteria for determining the installation angle, the presence or absence of interference, the anomaly of the field of view, and the anomaly of the distance can be changed as appropriate. For example, in the above explanation, the reference value of the installation angle is plus or minus 5 degrees, but if it can be appropriately determined whether or not it is within an appropriate range, the reference value of the installation angle may be appropriately changed. Regarding the presence or absence of interference, it suffices if an appropriate determination is made based on the variation in distance data, distance data with a time different from 10 seconds may be used, or the determination may be made based on variations other than 10%. Regarding the field of view anomaly, it suffices if an appropriate determination is made, and the reference value of the luminance used for the determination and the size of the region may be appropriately changed. Regarding the anomaly of the distance, it suffices if an appropriate determination is made, and the reference value of the distance and the size of the region used for the determination may be appropriately changed.
The acceleration sensor 23 may have a known configuration as long as it can appropriately detect the inclination angle with respect to the installation surface. Further, instead of the acceleration sensor 23, another known configuration such as a gyro sensor may be used as the installation angle detection sensor for detecting the installation angle. In the above description, the example in which the electric power is supplied by PoE has been described, but the electric power may be supplied by other appropriate means. Further, in the second embodiment, the communication by the ethernet 51 between the TOF sensor 42 and the PC 43 has been described, but the communication by another method may be performed.
An external display device may be used as the screen. In this case, the configuration related to the screen 54 in the PC 43 may be omitted.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2021-094208 | Jun 2021 | JP | national |
