The present disclosure relates to a laser beam irradiation detection device, a laser beam irradiation detection method, and a laser beam irradiation detection system capable of detecting that a predetermined target object is irradiated with a laser beam.
Cases have occurred in which a laser beam is irradiated to a target object such as a windshield of a cockpit of an airplane due to mischief or the like.
Heretofore, a detection device for detecting a laser beam irradiated to a target object due to mischief has not been put to practical use.
A first aspect of one or more embodiments provides a laser beam irradiation detection device including: a bandpass filter configured to allow a light ray of a predetermined band including a wavelength band of a color of a laser beam, which is a target of detection, among light rays from a subject to pass therethrough; an imaging unit configured to image the light ray passing through the bandpass filter; and a detector configured to analyze a frequency for each brightness level of a video signal generated based on an imaging signal output from the imaging unit to detect a peak at which the frequency protrudes at a specific brightness level, and to detect a trajectory of a straight light ray in a frame of the video signal to detect that the laser beam is irradiated, when it is detected that the peak exists at the specific brightness level and the trajectory of the light ray exists in the frame.
A second aspect of one or more embodiments provides a laser beam irradiation detection method including: allowing a light ray of a predetermined band including a wavelength band of a color of a laser beam, which is a target of detection, among light rays from a subject to pass and attenuating light rays in other bands with a bandpass filter; imaging the light ray of the predetermined band with an imaging unit; analyzing a frequency for each brightness level of a video signal generated based on an imaging signal output from the imaging unit and detecting a peak at which the frequency protrudes at a specific brightness level; detecting a trajectory of a straight light ray in a frame of the video signal; and detecting that the laser beam is irradiated when it is detected that the peak exists at the specific brightness level and the trajectory of the light ray exists in the frame.
A third aspect of one or more embodiments provides a laser beam irradiation detection system including: a plurality of laser beam irradiation detection devices with mutually offset ranges for imaging a subject; a system control device to which image data output from the plurality of laser beam irradiation detection devices are supplied; and a monitor which displays an image based on the image data which is output from the plurality of laser beam irradiation detection devices and supplied to the system control device.
Each of the plurality of the laser beam irradiation detection device includes: an image synthesizing unit configured to synthesize a first video signal generated based on a first imaging signal that captures a light ray from a subject and a second video signal generated based on a second imaging signal that captures a light ray obtained by causing a light ray of a predetermined band including a wavelength band of a color of the laser beam, which is a target of detection, among light rays from the subject to pass through a bandpass filter, and to generate a synthesized video signal; a detector configured to analyze a frequency for each brightness level of the second video signal, to detect a peak at which a frequency protrudes at a specific brightness level, to detect a trajectory of a straight light ray in a frame of the second video signal, and to detect that the laser beam is irradiated when it is detected that the peak exists at the specific brightness level and the trajectory of the light ray exists in the frame; and a position and direction information generator configured to generate emission position information indicating a laser beam emission position or emission position direction information indicating an emission position direction, and to supply the information to the system control device, when the detector detects that the laser beam is irradiated.
The system control device is configured to display on the monitor a synthesized image based on the synthesized video signal generated by the image synthesizing unit, and to superimpose and display an identification image indicating the laser beam emission position or the emission position direction on the synthesized image based on the emission position information or the emission position direction information.
Hereinafter, a laser beam irradiation detection device, a laser beam irradiation detection method, and a laser beam irradiation detection system according to one or more embodiments will be described with reference to the accompanying drawings. In one or more embodiments, a case where a target object irradiated with a laser beam is a windshield or a cockpit window in front of a cockpit of an airplane is taken as an example. Hereinafter, a windshield or the like includes at least one of the windshield and the cockpit window.
In
The laser beam irradiation detection device 10A includes a video camera 1a, a video camera 2a with a bandpass filter 3a mounted on the front, a controller 4a, a monitor 5a, and a memory 6a. A laser beam irradiation detection device 10B includes a video camera 1b, a video camera 2b with a bandpass filter 3b mounted on the front, a controller 4b, a monitor 5b, and a memory 6b.
A laser beam irradiation detection device 10C includes a video camera 1c, a video camera 2c with a bandpass filter 3c mounted on the front, a controller 4c, a monitor 5c, and a memory 6c.
The video cameras 1a, 1b, and 1c are collectively referred to as a video camera 1. The video cameras 2a, 2b, and 2c are collectively referred to as a video camera 2. The bandpass filters 3a, 3b, and 3c are collectively referred to as a bandpass filter 3. The controllers 4a, 4b, and 4c are collectively referred to as a controller 4. The monitors 5a, 5b, and 5c are collectively referred to as a monitor 5. The memories 6a, 6b, and 6c are collectively referred to as a memory 6.
The video cameras 1 and 2 are normal video cameras capable of capturing an image of a visible light region, and may be commercially available consumer video cameras or business video cameras. The video camera 1 and the video camera 2 operate in synchronization and capture images of the same subject at the same angle of view.
As illustrated in
The video camera 1 and the video camera 2 have the same configuration, and the bandpass filter 3 is attached to the front of the lens of the video camera 2. The imaging unit 111 captures a light ray from a subject which does not pass through the bandpass filter 3, and the imaging unit 211 captures a light ray which passes through the bandpass filter 3. The light ray from the subject is a light ray reflected from the subject and may include a laser beam emitted from a laser beam source. The controller 4 is supplied with the video signals V1 and V2 output from the video output terminals 113 and 213.
The bandpass filter 3 allows a light ray of a predetermined band including the wavelength band of the color of the laser beam, which is the target of the detection, among the light rays from the subject to pass therethrough and attenuates a light ray of other bands. In many cases, laser beams to be irradiated due to mischief to a windshield or the like of a cockpit of an airplane are green laser beams. Therefore, it is preferable that a filter which allows a light ray in a band including the wavelength band of green color to pass therethrough be used as the bandpass filter 3.
When a red laser beam is to be detected, it is preferable that a filter which allows a light ray in a band including the wavelength band of red color be used as the bandpass filter 3. The bandpass filter 3 may be a filter which allows light ray in a band including the wavelength bands of green and red to pass therethrough.
The controller 4 can be configured by a microprocessor. The controller 4 and the memory 6 may be microcomputers and the controller 4 may be a central processing unit (CPU). The monitor 5 is a liquid crystal panel which displays an image based on the video signal V1 or a synthesized video signal V12 described below, for example. The laser beam irradiation detection device 10 may not include the monitor 5.
The memory 6 stores an image processing program and the controller 4 executes the image processing program. The memory 6 stores image data, which will be described below, generated by the controller 4 executing the image processing program.
The system control device 20 can be configured by a personal computer. The system control device 20 controls the laser beam irradiation detection devices 10A to 10C. Various types of information to be described below are input from the controller 4 to the system control device 20 and image data (synthesized video signal V12) is input from the memory 6.
The monitor 21 displays an image based on the image data input to the system control device 20. As illustrated in
In this case, the monitor 21a displays an image ImA based on the image data output from the laser beam irradiation detection device 10A. The monitor 21b displays an image ImB based on the image data output from the laser beam irradiation detection device 10B. The monitor 21c displays an image ImC based on the image data output from the laser beam irradiation detection device 10C.
As illustrated in
As illustrated in
The system control device 20 and the monitor 21 may be arranged at any position in the cockpit 501 or may be arranged outside of the cockpit 501. The laser beam irradiation detection device 10 and the system control device 20 may be connected by wire or may be connected wirelessly.
An example of a functional internal configuration of the controller 4 when the controller 4 executes the image processing program will be described using
The data writing and reading controller 41 supplies the memory 6 with the write or read control signal SCTL, writes the video signals V1 and V2 into the memory 6, and reads the video signals V1 and V2 from the memory 6. The image synthesizing unit 42 synthesizes the video signals V1 and V2 read from the memory 6 to generate a synthesized video signal V12.
The synthesized video signal V12 is written to the memory 6 as image data. The synthesized video signal V12 read from the memory 6 is supplied to the system control device 20.
As illustrated in
The light ray trajectory detector 45 detects whether a straight light ray trajectory exists in a frame of the video signal V2. In
When any three bright spots Pa, Pb, and Pc on the trajectory 450 satisfy ax+by+c=0 with a, b, and c as constants and x and y as variables, the light ray trajectory detector 45 determines that the trajectory 450 is a straight line. The light ray trajectory detector 45 can detect, based on the determination result, whether a straight light ray trajectory exists in the frame F2.
When it is determined that the peak exists at a specific brightness level of the histogram and a straight light ray trajectory exists in the frame F2, the determiner 46 determines that the trajectory is the trajectory of the light ray formed by the irradiation of the laser beam, and the windshield 502 is irradiated with the laser beam.
When it is determined by the determiner 46 that the windshield 502 is irradiated with the laser beam, the position and direction information generator 47 generates emission position information indicating the emission position of the laser beam or emission position direction information indicating the direction of the emission position as follows. The position and direction information generator 47 operates as an emission position detector and an emission position direction estimating unit.
When the condition that, in the trajectory 450, the brightness level decreases from the first end portion 451 side to the second end portion 452 side, and the first end portion 451 exists inside the frame F2 is satisfied, the position and direction information generator 47 detects the first end portion 451 as the laser beam emission position. The position and direction information generator 47 generates and outputs laser beam emission position information.
A person carrying a laser beam source may shake the laser beam source. Therefore, while the bright spot on the first end portion 451 side is unlikely to move, the bright spot on the second end portion 452 side may move in an arc shape. When the condition that the bright spot on the second end portion 452 side moves in an arc shape as satisfied in addition to the above conditions, the position and direction information generator 47 may detect the first end portion 451 as the laser beam emission position. In this way, it is possible to improve the detection accuracy of the laser beam emission position.
When satisfying the condition that, in the trajectory 450, the brightness level decreases from the first end portion 451 side to the second end portion 452 side and the first end portion 451 is located at the end portion of the frame F2, the position and direction information generator 47 estimates that the laser beam emission position exists in a direction in which the trajectory 450 extends outward beyond the first end portion 451. The position and direction information generator 47 generates and outputs laser beam emission position direction information.
As similar to
When, in addition to the above condition, satisfying the condition that the bright spot on the second end portion 452 side moves more largely in an arc shape than the bright spot on the first end portion 451 side, the position and direction information generator 47 may estimate that the laser beam emission position exists in a direction in which the trajectory 450 extends outward beyond the first end portion 451. In this way, it is possible to improve the estimation accuracy of the laser beam emission position direction.
The frame F2 shows a view in a state in which the trajectory 450 by the laser beam is clearly captured by the video camera 2 imaging the light ray which passes through the bandpass filter 3. In the frame F2, the light ray in a band other than the pass band of the bandpass filter 3 is attenuated, so it is difficult to determine where in the view the emission position (first end portion 451) of the laser beam or the emission position direction is located.
By the image synthesizing unit 42 generating the synthesized frame F12, which is a synthesized image, it is possible to superimpose the trajectory 450 by the laser beam on the normal view captured by the video camera 1. By watching the synthesized frame F12 displayed on the monitor 21, a monitoring person can easily determine where the laser beam emission position or the emission position direction is located in the view.
The operation of the laser beam irradiation detection device 10 and the process performed by the laser beam irradiation detection method will be described using a flowchart illustrated in
When the trajectory 450 of the laser beam is detected (YES), the laser beam irradiation detection device 10 determines in step S2 whether the laser beam emission position exists within the angle of view. When the laser beam emission position exists within the angle of view (YES), the laser beam irradiation detection device 10 transmits the emission position information to the system control device 20 in step S3 and shifts the process to step S6.
When the laser beam emission position does not exist within the angle of view in step S2 (NO), the laser beam irradiation detection device 10 determines in step S4 whether the direction of the laser beam emission position can be estimated. When the direction of the laser beam emission position can be estimated (YES), the laser beam irradiation detection device 10 transmits the emission position direction information to the system control device 20 in step S5 and shifts the process to step S6. When the direction of the laser beam emission position cannot be estimated (NO), the laser beam irradiation detection device 10 shifts the process to step S6.
In step S6, the laser beam irradiation detection device 10 determines whether the end of the laser beam irradiation detection process is instructed. When the end of the laser beam irradiation detection process is not instructed (NO), the laser beam irradiation detection device 10 returns the process to step S1 and repeats the processes of steps S1 to S6. When the end of the laser beam irradiation detection process is instructed (YES), the laser beam irradiation detection device 10 ends the process.
The operation of the system control device 20 will be described using the flowchart illustrated in
When the emission position information is not received from the laser beam irradiation detection device 10A in step S11 (NO), the system control device 20 determines in step S13 whether the emission position direction information is received from the laser beam irradiation detection device 10A. When the emission position direction information is received from the laser beam irradiation detection device 10A (YES), the system control device 20 causes the monitor 21a to display an icon indicating the emission position direction step S14 and shifts the process to step S15.
When the emission position direction information is not received from the laser beam irradiation detection device 10A in step S13 (NO), the system control device 20 shifts the process to step S15.
The system control device 20 determines in step S15 whether the emission position information is received from the laser beam irradiation detection device 10B. When the emission position information is received from the laser beam irradiation detection device 10B (YES), the system control device 20 causes the monitor 21b to display an icon indicating the emission position in step 16 and shifts the process to step S19.
When the emission position information is not received from the laser beam irradiation detection device 10B in step S15 (NO), the system control device 20 determines in step S17 whether the emission position direction information is received from the laser beam irradiation detection device 10B. When the emission position direction information is received from the laser beam irradiation detection device 10B (YES), the system control device 20 causes the monitor 21b to display an icon indicating the emission position direction in step S18 and shifts the process to step S19.
When the emission position direction information is not received from the laser beam irradiation detection device 10B in step S17 (NO), the system control device 20 shifts the process to step S19.
The system control device 20 determines in step S19 whether the emission position information is received from the laser beam irradiation detection device 10C. When the emission position information is received from the laser beam irradiation detection device 10C (YES), the system control device 20 causes the monitor 21c to display an icon indicating the emission position in step 20 and shifts the process to step S23.
When the emission position information is not received from the laser beam irradiation detection device 10C in step S19 (NO), the system control device 20 determines in step S21 whether the emission position direction information is received from the laser beam irradiation detection device 10C. When the emission position direction information is received from the laser beam irradiation detection device 10C (YES), the system control device 20 causes the monitor 21c to display an icon indicating the emission position direction in step S22 and shifts the process to step S23.
When the emission position direction information is not received from the laser beam irradiation detection device 10C in step S21 (NO), the system control device 20 shifts the process to step S23.
In step S23, the system control device 20 determines whether the end of the display process of the laser beam irradiation detection result is instructed. When the end of the display process is not instructed (NO), the system control device 20 returns the process to step S11 and repeats the processes of steps S11 to S23. When the end of the display process is instructed (YES), the system control device 20 ends the process.
As an example,
As an example,
In
Since the system control device 20 can detect the inclination of the trajectory 450, the inclination of the icon 472 can be displayed according to the inclination of the trajectory 450.
As described above, in accordance with the laser beam irradiation detection device, the laser beam irradiation detection method, and the laser beam irradiation detection system according to one or more embodiments, it can be detected that the laser beam is irradiated to a predetermined target object such as the windshield of the cockpit of an airplane. In accordance with the laser beam irradiation detection device, the laser beam irradiation detection method, and the laser beam irradiation detection system according to one or more embodiments, the emission position or the emission position direction of the laser beam can be detected.
In accordance with the laser beam irradiation detection system according to one or more embodiments, a monitoring person can easily recognize the emission position or the emission position direction of the laser beam by the image displayed on the monitor 21.
In the configuration example illustrated in
A video camera 100 illustrated in
Moreover, a light ray from a subject is incident on an imaging element 106 through a bandpass filter 104 and one or a plurality of lenses 105 and is imaged. Similar to the bandpass filter 3, the bandpass filter 104 allows a light ray of a predetermined band including the wavelength band of the color of the laser beam, which is the target of the detection, among the light rays from the subject to pass therethrough, and attenuates the light ray of the other band. The video signal processing circuit 107 generates a video signal V2 based on the imaging signal from the imaging element 106.
The operation of the controller 108, the monitor 109, and the memory 110 is similar to that of the controller 4, the monitor 5, and the memory 6. The monitor 109 can be omitted.
The invention is not limited to one or more embodiments described above, and various modifications can be made without departing from the scope of the invention. In one or more embodiments, by executing an image processing program, the controller 4 generates the histogram of the video signal V2, detects the existence of the trajectory of the straight light ray, and determines whether the target object is irradiated with a laser beam. The configuration for executing those operations may be realized by hardware.
The use of hardware and software in the configuration of the laser beam irradiation detection device 10 or the laser beam irradiation detection system is optional.
A target object for detecting the irradiation of the laser beam is not limited to the windshield of the cockpit of the airplane or the like. The target object may be an automobile, a player playing sports, or the like. In one or more embodiments, three laser beam irradiation detection devices 10 are used, but an appropriate number of laser beam irradiation detection devices 10 may be used according to the range of the target object for detecting the irradiation of the laser beam. The laser beam irradiation detection devices 10 may be arranged so as to monitor a 360-degree range around a predetermined point.
The disclosure of the present application is related to the subject matter described in Japanese Patent Application No. 2017-041441 filed on Mar. 6, 2017, the entire disclosure content of which is incorporated herein by reference.
It should be noted that various modifications and variations may be made to one or more embodiments without departing from the novel and advantageous features of the invention other than those already described. Accordingly, all such modifications and variations are intended to be included within the scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2017-041441 | Mar 2017 | JP | national |
This application is a Continuation of PCT Application No. PCT/JP2017/036300, filed on Oct. 5, 2017, and claims the priority of Japanese Patent Application No. 2017-041441, filed on Mar. 6, 2017, the entire contents of both of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2017/036300 | Oct 2017 | US |
Child | 16560369 | US |