Patent Application
20210125340
The present invention relates to a vibration analysis device, a control method for a vibration analysis device, a vibration analysis program, and a recording medium.
The present application claims priority to Japanese Patent Application 2018-075567 filed in Japan on Apr. 10, 2018, of which contents are incorporated herein by reference.
Techniques for analyzing vibration of an object include a technique of placing a sensor, such as an acceleration sensor, on the object and analyzing the vibration of the object based on vibration information output by the sensor, a technique of irradiating the object with a laser beam and analyzing the object based on information of reflected light reflected by the object, and a technique of analyzing a moving image (video) of the object imaged by an imaging device. The technique of analyzing a video is useful in that measurement can be made remotely and a plurality of locations within the object can be analyzed.
As a technique for analyzing vibration of an object such as that described above, for example, PTL 1 discloses a technique of performing vibration analysis of a measurement object portion of a vibration measuring object based on images of the measurement object portion imaged in time series.
PTL 1: JP 2003-156389 A (published May 30, 2003)
Nevertheless, the technique described in PTL 1 cannot always suitably analyze the vibration of an object.
The present invention has been made in view of the problems described above, and an object of the present invention is to provide a vibration analysis device capable of suitably analyzing vibration of an object, and techniques related thereto.
In order to solve the problems described above, a vibration analysis device according to an aspect of the present invention includes an analysis axis configuration unit configured to configure analysis axes in accordance with an operation of a user, a vibration analyzing unit configured to analyze, based on a video of an object, vibration along each of the analysis axes of the object, and an output unit configured to output an analysis result obtained by the vibration analyzing unit.
A vibration analysis device according to an aspect of the present invention includes an analysis axis configuration unit configured to configure analysis axes, a vibration analyzing unit configured to analyze, based on a video of an object, vibration along each of the analysis axes of the object, and a display unit configured to display the analysis axes superimposed onto an image of the object and display an analysis result by the vibration analyzing unit.
A control method for a vibration analysis device according to an aspect of the present invention is a control method for a vibration analysis device configured to analyze vibration of an object, the control method including an analysis axis configuration step of configuring analysis axes in accordance with an operation of a user, a vibration analyzing step of analyzing, based on a video of the object, the vibration along each of the analysis axes of the object, and an output step of outputting an analysis result of the vibration analyzing step.
According to an aspect of the present invention, it is possible to provide a vibration analysis device capable of suitably analyzing vibration of an object, and techniques related thereto.
Below, a vibration analysis system 1, a vibration analysis device 60, and a control method for the vibration analysis device 60 according to an embodiment (first embodiment) of the present invention will be described in detail with reference to
First, an example of a configuration of the vibration analysis system 1 according to an embodiment of the present invention will be described with reference to
The imaging unit 10 captures a video of an object, and transmits the video of the object thus captured (video including the vibrating object, which is the object to be analyzed) as an input video to the vibration analysis device 60.
Here, in order to suitably capture the video of the object, the imaging unit 10 is preferably fixed. However, in a case where the object is a bridge or the like and is at a blind spot from the imaging unit 10 fixed to the ground during imaging, and in a case where imaging is difficult with the imaging unit 10 in a fixed state, the imaging unit 10 may be provided on a flying device (driving device) such as a drone, and moved together with the flying device. Even in a case where a video of the object is imaged while the imaging unit 10 is thus moved, the object is analyzed based on a displacement amount of an analysis region of the object relative to a non-moving point in the background on the input video, making it possible to suitably analyze vibration of the object.
The operation unit 20 receives input of an operation by a user, and is realized by, for example, a touch panel or a mouse. In a case where the operation unit 20 is a touch panel and the user inputs an input video via the touch panel, the input video is displayed on the display unit 30 provided with the touch panel.
The display unit 30 displays various images. The display unit 30 displays, for example, a video of the object imaged by the imaging unit 10 and an analysis result by a vibration analyzing unit 63 output by an output unit 64. Note that, in the example described above, the display unit 30 is provided in the vibration analysis system 1 external to the vibration analysis device 60, but the vibration analysis device 60 may include the display unit 30. In this case as well, similar to the example described above, the analysis result obtained by the vibration analyzing unit 63 can be displayed.
The storage memory 40 stores, for example, various control programs and the like to be executed by the control unit 50. Examples of the storage memory 40 include a hard disk drive and nonvolatile storage devices such as a flash memory. The storage memory 40 stores, for example, an input video, an output video, an analysis region of the object, analysis axes, and an analysis result.
The control unit 50 is configured to comprehensively control each functional block such as the imaging unit 10, the operation unit 20, the display unit 30, the storage memory 40, and the vibration analysis device 60.
The vibration analysis device 60 analyzes the vibration of the object in the input video, and outputs an analysis result. Here, a case where the input video is a video captured by the imaging unit 10 is described, but the video may be a video stored in the storage memory 40, a video obtained via a network, or a video stored in a removable storage device. Further, the vibration analysis device 60 is constituted by software or hardware such as a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), and an application-specific integrated circuit (ASIC), and may be operated by the same device as the control unit 50 or the like. As illustrated in
The analysis region configuration unit 61 configures an analysis region to be analyzed for vibration, which is, of the input video input to the vibration analysis device 60, a region of at least a portion of the vibrating object. The analysis region configuration unit 61 can configure, as the analysis region, one or a plurality of points (pixels) on the object, a line such as an edge of the vibrating object, a region of a portion of the object, or a region of the entire object (all pixels), for example.
In one aspect, the analysis region configuration unit 61 configures the analysis region in accordance with a video of the object. In this case, the analysis region configuration unit 61 may detect a vibrating area from within the input video, and configure a point, a line, and a region on the detected object as the analysis region.
Further, in another aspect, the analysis region configuration unit 61 configures the analysis region in accordance with an operation of the user. In this case, the analysis region configuration unit 61 may configure the analysis region in accordance with input information of the user input via the operation unit 20. For example, an input video is displayed on the display unit 30 by the control unit 50, and the user specifies, via the operation unit 20, a region of a portion of the object in the input video displayed on the display unit 30. Then, the analysis region configuration unit 61 configures the region of the portion of the object thus input as the analysis region.
The analysis axis configuration unit 62 configures analysis axes for the vibration analyzing unit 63 to analyze the vibration of the object. In one aspect, the analysis axis configuration unit 62 configures the analysis axes in accordance with a video of the object. In this case, the analysis axis configuration unit 62 may analyze a direction of vibration of the analysis region configured by the analysis region configuration unit 61, and configure the analysis axes based on the analysis result.
Further, in another aspect, the analysis axis configuration unit 62 configures the analysis axes in accordance with an operation of the user. In this case, the analysis axis configuration unit 62 may configure the analysis axes in accordance with the input information of the user input via the operation unit 20. For example, possible directions of an analysis axis are displayed on the display unit 30 as a plurality of arrows rotatably extending from a black dot, and the user specifies the direction of the analysis axis via the operation unit 20 or the display unit 30 that includes the operation unit 20 such as a touch panel. Then, the analysis axis configuration unit 62 configures the analysis axis in the specified direction.
Here, in a case where an analysis axis is configured in a fixed direction such as a longitudinal direction or a lateral direction of the video, it may be difficult to suitably estimate the vibration of the object. In response, as described above, the analysis axis configuration unit 62 configures the analysis axes in a state in which the directions of the analysis axes can be changed in accordance with the video of the object or the operation of the user, making it possible to configure the analysis axes in suitable directions. As a result, the vibration of the object can be suitably analyzed.
The vibration analyzing unit 63 analyzes the vibration along each of the analysis axes of the object based on the input video. For example, the vibration analyzing unit 63 may analyze the vibration along each of the analysis axes configured on the analysis region configured by the analysis region configuration unit 61. More specifically, the vibration analyzing unit 63 calculates a displacement amount of the analysis region in each frame image of the object imaged in time series by the imaging unit 10. Thus, in addition to the displacement amount, the vibration analyzing unit 63 calculates vibration information such as a displacement direction, a displacement velocity, and a damping amount of the analysis region to analyze the vibration information.
The vibration analyzing unit 63 can calculate the displacement amount of the analysis region in each frame image by using a known method such as block matching. Further, the vibration analyzing unit 63 can calculate a position of a point on another frame image corresponding to the analysis region, such as a point configured on a reference image, using a predetermined frame image as the reference image. Thus, the displacement amount of the analysis region of the other frame image relative to the analysis region in the reference image can be calculated, and the displacement amount of the analysis region in time series can be calculated. Further, the vibration analyzing unit 63 can calculate the displacement direction, the displacement velocity, the damping amount, and other factors of the analysis region by analyzing the displacement amount of the analysis region in time series.
Note that, in the example described above, the vibration analyzing unit 63 analyzes vibration based on a video of the vibrating object imaged by the imaging unit 10, but the present embodiment is not limited thereto. In the present embodiment, the vibration analyzing unit 63 need not analyze vibration based on a video of the object imaged by the imaging unit 10, and may analyze vibration based on a video of the object imaged in advance.
The output unit 64 outputs the analysis result obtained by the vibration analyzing unit 63 to an external source outside the vibration analysis device 60, such as the display unit 30. For example, the output unit 64 generates an image used for displaying the analysis result of the vibration, such as a displacement amount of the vibration analyzed by the vibration analyzing unit 63, on the display unit 30 and outputs the image data to the display unit 30. The output unit 64 may output an image in which the analysis result analyzed by the vibration analyzing unit 63 is superimposed onto the input video, or may output an image indicating the analysis result only. With this configuration, the analysis result of the vibration can be suitably displayed. Details of the image generated by the output unit 64 will be described later.
Next, a flow of a control process of the vibration analysis device 60 (control method for the vibration analysis device) according to the present embodiment will be described with reference to
In step S201, the analysis region configuration unit 61 of the vibration analysis device 60 acquires the video of the object as an input video and configures an analysis region of the object in the input video.
In step S202, the analysis axis configuration unit 62 configures the analysis axes in accordance with the video of the object or an operation of the user relative to the analysis region configured by the analysis region configuration unit 61 (analysis axis configuration step).
In step S203, the vibration analyzing unit 63 analyzes the vibration along each of the analysis axes in the analysis region of the object based on the video of the object (vibration analyzing step).
In step S204, the output unit 64 outputs an analysis result, such as the displacement amount and the displacement direction of the analysis region of the object analyzed in step S203 (output step).
Next, details of the analysis of vibration by the vibration analysis device 60 will be described using Processing Example 1 below.
Configuration of Analysis Axes and Analysis of Vibration by Vibration Analysis Device 60
An example of the configuration of the analysis axes and the analysis of the vibration by the vibration analysis device 60 will be described with reference to
Note that, in the example described above, the vibration analyzing unit 63 analyzes the displacement amount of the analysis region 305 based on the analysis regions 305, 306, 307, but the present embodiment is not limited thereto. In the present embodiment, the vibration analyzing unit 63 may calculate the displacement amount of the analysis region 305 relative to a non-moving point in the background in the input video. In this way as well, the vibration analyzing unit 63 can calculate the displacement amount of the analysis region 305, and suitably calculate the vibration of the analysis region 305.
Thus, the vibration analyzing unit 63 analyzes the vibration based on the displacement amount of the analysis region of the object (displacement amount of the object), making it possible to obtain the amplitude of the vibration and the like in the analysis region as an analysis result. This makes it possible to more suitably analyze the vibration of the object.
Below, a calculation method for the displacement amount of the analysis region corresponding to a predetermined analysis region will be described in detail. In a case where the vibration analyzing unit 63 calculates the displacement amount of the analysis region based on a video, the vibration analyzing unit 63 first establishes a predetermined frame image of the video of the object including the analysis region as a reference image. Next, the vibration analyzing unit 63 searches for a region corresponding to the analysis region of the reference image in another frame image (corresponding region), and calculates the displacement amount of the corresponding region in the other frame image relative to the analysis region of the reference image.
Examples of the method for searching for the corresponding region include a block matching method. A block matching method is a method of evaluating a degree of similarity between images, and is a method of searching other frame images for a region having the highest degree of similarity with the predetermined region in the reference image. Methods of searching for a region having a high degree of similarity include, for example, a method that uses an evaluation function, such as sum of absolute differences (SAD) and sum of squared differences (SSD). SAD is a function used to select, as the region with the highest degree of similarity, a region where the sum of the absolute values of the differences in pixel values or luminance values between the reference image and the other frame image is the smallest. SSD is a function used to select, as the region with the highest degree of similarity, a region where the sum of the squares of the differences in pixel values or luminance values between the reference image and the other frame image is the smallest. In the block matching method, the direction in which the search for the region having a high degree of similarity is conducted is preferably an array direction of the pixels of the frame image (for example, at least one of the horizontal axis (X-axis) direction and the vertical axis (Y-axis) direction). Thus, the displacement amount of the other frame image relative to the predetermined region of the reference image in the configured search direction can be calculated. Further, when, as a method for searching for a region having a high degree of similarity, two directions (for example, the X-axis direction and the Y-axis direction), which are the array directions of the frame image, are configured and a search is conducted for a region having a high degree of similarity, a two-dimensional displacement amount within the frame image plane can be calculated.
Examples of the method for searching for another corresponding region include a phase only correlation. With use of the phase only correlation, the product of phase components calculated by Fourier-transforming two images can be inverse Fourier-transformed to calculate a phase only correlation function. This makes it possible to calculate a relative shift in position of the two images from peak coordinates of a phase only correlation function. The phase only correlation has the advantage that a change in brightness between the images of the reference image and another frame image is intense. On the other hand, because the block matching method described above refers to the difference in pixel values or luminance values between the reference image and another frame image, the method is affected by changes in brightness between images. For example, in a case where videos of the object are captured outdoors, even when the videos of the object are captured from the same position, the brightness of the videos of the object may differ. Therefore, in a case where the block matching method is used, the search for a corresponding region is preferably conducted after, for example, averaging the overall brightness of the two images being compared and adjusting the pixel values so that the difference in brightness between the two images is small. Further, preferably, the reference image is not fixed to a predetermined frame image and, for example, two images arranged chronologically in time series are compared to calculate the difference in brightness, and finally the difference in brightness from the initial frame image in time series is calculated. Thus, the effect of a difference in brightness between images can be reduced and, as a result, the displacement amount of the analysis region can be suitably calculated. Note that, in a case where two images arranged chronologically in time series are successively compared, the displacement amount of the analysis region in the image of the initial frame, which is the reference image, can be calculated by adding the calculated displacement amount of the analysis region of the two images.
Next, the analysis of vibration by the vibration analysis device 60 in Processing Example 1 will be described in detail with reference to
While, in the example described above, the analysis axes are configured in the two directions of the Y-axis and the X-axis in
While Processing Example 1 describes a case where an analysis result in which the amplitude, the period (frequency), and the like of the vibration are understood from the displacement amount of the analysis region of the object is obtained, there are also cases in which an analysis result in which the amplitude, the period (frequency), and the like of the vibration are understood from the displacement amount of the analysis region cannot be obtained. Below, a case where it is difficult to obtain an analysis result in which the amplitude, the period (frequency), and the like of the vibration are understood from the displacement amount of the analysis region will be specifically described with reference to
Thus, in a case where it is difficult to estimate vibration information such as amplitude and vibration frequency from the result of analyzing the displacement amount of the vibration using the analysis axes configured in certain directions, preferably the analysis axis configuration unit 62 changes the direction of at least one of the analysis axes to another direction in accordance with a video of the object or an operation of the user. Below, a case where the analysis axis configuration unit 62 changes the directions of the analysis axes to other directions, and the vibration analyzing unit 63 calculates the displacement amounts of the analysis region along the analysis axes after the change will be described with reference to
Processing Example 2 describes a case where it is difficult to estimate the amplitude and the frequency at which the vibration vibrates in a video from the displacement amounts of a certain analysis region in both the Y-axis direction and the X-axis direction. In contrast, there are cases where vibration information such as amplitude and frequency can be estimated from the displacement amount of the analysis region in the direction of one analysis axis, but estimating vibration information such as amplitude and frequency from the displacement amount of the analysis region in the direction of another analysis axis is difficult. In this case, the amplitude and the frequency of the vibration can be analyzed from the displacement amounts of the analysis region in the directions of both of the analysis axes by a method different from that in Processing Example 2. Below, a method for obtaining an analysis result such as an amplitude and a frequency of vibration by a method different from that in Processing Example 2 in a case where it is difficult to estimate vibration information such as amplitude and frequency from the displacement amount of the analysis region in the direction of one analysis axis will be specifically described with reference to
Thus, in a case where it is difficult to estimate the vibration information in the direction along one of the analysis axes, the vibration analyzing unit 63 preferably analyzes the vibration on a per frequency basis. Further, the analysis axis configuration unit 62 preferably changes the direction of at least one of the analysis axes to another direction based on the analysis result of the vibration at each frequency. In this way, the analysis axis is changed to a more suitable direction, and thus the vibration analyzing unit 63 can more suitably analyze the vibration of the object. Below, an example in which the vibration analyzing unit 63 analyzes the vibration on a per frequency basis and the analysis axis configuration unit 62 changes the direction of an analysis axis to another direction based on the analysis result of the vibration at each frequency will be described with reference to
Next, a case where the vibration analyzing unit 63 separates the vibration into two vibrations of the vibration of a low frequency and the vibration of a high frequency in the Y-axis direction shown in (a) of
Note that while, in the example described above, a case where it is difficult to estimate the amplitude and the frequency of the vibration from the analysis region in the direction of one analysis axis is described, the present embodiment is not limited thereto. In the present embodiment, in a case where it is difficult to estimate the amplitude, the frequency, and the like of the vibration from the analysis region in both the vertical direction (Y-axis direction) and the horizontal direction (X-axis direction) of the input video as in Processing Example 2, the vibration analyzing unit 63 may analyze the vibration of the analysis region on a per frequency basis. Then, the analysis axis configuration unit 62 may change the direction of at least one analysis axis to another direction based on the analysis result of the vibration at each frequency. According to this as well, similar to the examples described above, the vibration of the object can be suitably analyzed.
As described above, the vibration analysis system 1 according to the first embodiment changeably configures the analysis axes, making it possible to separate and observe a plurality of vibrations and make observations in directions having large amplitudes. This makes it possible to suitably analyze the vibration of the object.
In the vibration analysis system 1 according to the first embodiment described above, the analysis axis configuration unit 62 configures the analysis axes in a one-dimensional direction or in two-dimensional directions. However, as in a vibration analysis system 2 (not illustrated) according to a second embodiment, an analysis axis configuration unit 72 (not illustrated) in a vibration analysis device 70 (not illustrated) may configure the analysis axes in three-dimensional directions.
Below, the vibration analysis system 2 according to the second embodiment will be described with reference to
The vibration analysis system 2 includes the vibration analysis device 70 in place of the vibration analysis device 60 according to the first embodiment. Other than this, the vibration analysis system 2 has the same configuration as the vibration analysis system 1 according to the first embodiment.
The vibration analysis device 70 includes the analysis axis configuration unit 72 and a vibration analyzing unit 73 (not illustrated) in place of the analysis axis configuration unit 62 and the vibration analyzing unit 63 in the first embodiment, respectively. Other than this, the vibration analysis device 70 has the same configuration as the vibration analysis device 60 according to the first embodiment.
The analysis axis configuration unit 72 includes a distance information acquisition unit 720 (not illustrated) configured to acquire distance information regarding a distance between the imaging unit 10 and the object. The analysis axis configuration unit 72 configures the analysis axes in accordance with the distance information.
Note that the distance information acquisition unit 720 can acquire distance information, such as the distance between the imaging unit 10 and the object and three-dimensional positional information of the object relative to the imaging unit 10, by a known method. For example, the imaging unit 10 includes two cameras having different viewpoints, such as a stereo camera. In this case, the distance information acquisition unit 720 can calculate the distance from the camera to the object from a parallax of the video (image) captured by the two cameras, with reference to a focal length and the like of each camera. Thus, the distance information acquisition unit 720 can acquire three-dimensional positional information of the object based on the distance from each camera to the object and the position of the object on the image. Further, the object can be irradiated with a laser beam, the distance from the imaging unit 10 to the object can be calculated based on an arrival time of reflected light of the laser beam, and the three-dimensional positional information of the object can be acquired based on the distance.
The vibration analyzing unit 73 analyzes the vibration of the object based on a three-dimensional displacement amount of the object. Thus, even in a case where it is difficult to estimate vibration information when analyzing the vibration of an object in a two-dimensional video, the vibration analyzing unit 73 can analyze the vibration of the object based on three-dimensional positional information or the like of the object. For example, the vibration analyzing unit 73 can, by referring to the three-dimensional positional information of the object, convert a displacement amount of the analysis region on the input video into an amplitude of the vibration on a three-dimensional space. As a result, the vibration analyzing unit 73 can analyze the vibration direction, the amplitude, and the like on the three-dimensional space of the object, making it possible to more suitably analyze the vibration of the object.
Below, details of the analysis of vibration by the vibration analysis device 70 according to the second embodiment will be described below using the following Processing Example 4.
An example of an object subject to configuration of analysis axes by the analysis axis configuration unit 72 will be described with reference to
Next, an example of the positional relationship between the imaging unit 10 and the bridge 1301 will be described with reference to
Next, the configuration of analysis axes and the analysis of vibration by the vibration analysis device 70 will be described. The bridge 1301 vibrates in the y-axis direction, which is the vertical direction and a direction perpendicular to the x-axis, which is the longitudinal direction of the bridge 1301, and in the z-axis direction, which is the lateral direction of the bridge 1301 and a direction level with the surface of the bridge 1301. As is clear from
A Specific Example 1 of the configuration of the analysis axes and the analysis of the vibration by the vibration analysis device 70 will be described with reference to
Below, a case where the vibration along the analysis axis in the y-axis direction of the bridge 1301 is analyzed will be described. As described with reference to
Here, the distance information acquisition unit 720 in the analysis axis configuration unit 72 acquires each of the distances from the imaging unit 10 to the analysis regions 1302, 1303, 1304 of the bridge 1301, and acquires the three-dimensional positional information of the analysis regions 1302, 1303, 1304. Thus, the analysis axis configuration unit 72 can configure analysis axes in the y-axis direction, which is the vertical direction in the three-dimensional space. Furthermore, the vibration analyzing unit 73 can analyze the vibrations in these analysis regions in the y-axis direction, which is the direction of the analysis axes.
Thus, even in a case where the imaging unit 10 is substantially not directly facing the object (in a case where none of the analysis axes are configured in a direction connecting the imaging unit 10 and the object), the amplitudes on three-dimensional spaces in a plurality of different analysis regions of the object can be compared, and the amplitude of the vibration in each of the analysis regions can be analyzed.
In Specific Example 1 described above, the configuration of the analysis axes and the analysis of the vibration by the vibration analysis device 70 in a case where the imaging unit 10 is not directly facing the object is described. However, the imaging unit 10 and the object may be substantially directly facing each other. Below, a Specific Example 2 of the configuration of the analysis axes and the analysis of the vibration by the vibration analysis device 70 in a case where the imaging unit 10 and the object substantially directly face each other (a case where one of the analysis axes is configured in a direction connecting the imaging unit 10 and the object) will be described with reference to
Here, the distance information acquisition unit 720 in the analysis axis configuration unit 72 acquires the distance from the imaging unit 10 to the bridge 1301 to acquire the three-dimensional positional information of the bridge 1301. As a result, even when the analysis axis configuration unit 72 configures an analysis axis in the z-axis direction, the vibration analyzing unit 73 can analyze the vibration of the bridge 1301 vibrating in the same direction as the optical axis of the imaging unit 10 based on the three-dimensional positional information of the bridge 1301.
Thus, even in a case where the analysis axis configuration unit 72 has configured one of the analysis axes in a direction connecting the imaging unit 10 and the object, the vibration analyzing unit 73 can suitably analyze the vibration of the object based on the three-dimensional displacement amount of the object from the three-dimensional positional information or the like of the object.
In the vibration analysis systems 1, 2 according to the first and second embodiments described above, the analysis axis configuration units 62, 72 configure analysis axes in the same directions for all analysis regions. However, as in a vibration analysis system 3 (not illustrated) according to a third embodiment, an analysis axis configuration unit 82 (not illustrated) in a vibration analysis device 80 (not illustrated) may configure different analysis axes for each of the plurality of analysis regions.
Below, the vibration analysis system 3 according to the third embodiment will be described based on
The vibration analysis system 3 includes the vibration analysis device 80 in place of the vibration analysis device 60 according to the first embodiment. Other than this, the vibration analysis system 3 has the same configuration as the vibration analysis system 1 according to the first embodiment.
The vibration analysis device 80 includes the analysis axis configuration unit 82 and a vibration analyzing unit 83 (not illustrated) in place of the analysis axis configuration unit 62 and the vibration analyzing unit 63 in the first embodiment, respectively. Other than this, the vibration analysis device 80 has the same configuration as the vibration analysis device 60 according to the first embodiment.
The analysis axis configuration unit 82 configures the analyses axes in accordance with an input video for each of the plurality of analysis regions of the object. For example, the analysis axis configuration unit 82 may configure analysis axes in different directions for each analysis region of the object in the input video, or may configure analysis axes in the same directions for all analysis regions. Further, the analysis axis configuration unit 82 may configure analysis axes in the same directions for some of the analysis regions, and configure analysis axes in different directions for some of the analysis regions. Thus, the analysis axis configuration unit 82 can more suitably configure the analysis axes.
The vibration analyzing unit 83 analyzes vibration along the analysis axes of the object based on the input video on a per analysis region basis. Thus, the vibration analyzing unit 83 can more suitably analyze the vibrations in the analysis regions of the object.
Below, details of the analysis of vibration by the vibration analysis device 80 according to the third embodiment will be described using the following Processing Examples 5 and 6.
An example of the configuration of the analysis axes and the analysis of the vibration by the vibration analysis device 80 will be described using
Here, in accordance with the input video 1600, the analysis axis configuration unit 82 configures an analysis axis in the direction from the upper left to the lower right for the analysis region 1602, and configures an analysis axis in the Y-axis direction of the input video 1600 for the analysis region 1603. Further, the vibration analyzing unit 83 analyzes the vibrations in these analysis regions along the analysis axes respectively configured for the analysis region 1602 and the analysis region 1603. Thus, with the analysis axes configured in the same directions as the respective directions in which the analysis regions 1602, 1603 vibrate, the vibration analyzing unit 83 can analyze the vibration having the largest amplitude in each analysis region. This makes it possible to more suitably analyze the vibrations of the analysis regions.
Note that while, in the example described above, the analysis axis configuration unit 82 configures the analysis axes in accordance with the two-dimensional input video 1600 for each of the plurality of analysis regions, the present embodiment is not limited thereto. In the present embodiment, the analysis axes may be configured in three-dimensional directions, as in the analysis axis configuration unit 72 according to the second embodiment. For example, in a case where the analysis region 1604 in
The analysis axis configuration unit 82 may configure the analysis axes in accordance with video information on a per analysis region basis. Below, an example of the configuration of the analysis axes and the analysis of the vibration by the vibration analysis device 80 will be described with reference to
For example, the analysis region 1701 is a region having an edge in the vertical direction (Y-axis direction) of the input video 300, and thus the analysis axis configuration unit 82 configures an analysis axis in the horizontal direction (X-axis direction). The vibration analyzing unit 83 analyzes the vibration by calculating the displacement amount of the analysis region 1701 along the analysis axis in the X-axis direction. In general, a region having an edge in the vertical direction of the video is likely to have a similar pattern continuous in the vertical direction, and thus it is difficult to accurately calculate the displacement amount in the vertical direction in the region by the block matching method. Therefore, a calculation error in the displacement amount of the region may increase, and an error in the analysis result of depth may also increase. On the other hand, a region having an edge in the vertical direction does not have a similar pattern continuous in the horizontal direction orthogonal to the direction of the edge, making it likely that the displacement amount in the horizontal direction can be accurately calculated. Therefore, as described above, the analysis axis configuration unit 82 calculates the displacement amount of the analysis region 1701 in the horizontal direction orthogonal to the direction of the edge, thereby making it possible for the vibration analyzing unit 83 to obtain the vibration in the horizontal direction of the analysis region 1701 as an analysis result. This makes it possible to more suitably analyze the vibration.
Similarly, the analysis region 1702 is a region having an edge in the horizontal direction (X-axis direction) of the video, and thus the analysis axis configuration unit 82 configures an analysis axis in the Y-axis direction. The vibration analyzing unit 83 analyzes the vibration by calculating the displacement amount of the analysis region 1703 along the analysis axis in the Y-axis direction. Further, the analysis region 1703 is a region having edges in the X-axis direction and the Y-axis direction, and thus the analysis axis configuration unit 82 may configure analysis axes in the two directions of the X-axis direction and the Y-axis direction, or may configure an analysis axis in either one of the directions. In these cases as well, the vibration can be suitably analyzed in the same manner as in the examples described above.
Further, while, in the example described above, the analysis axis configuration unit 82 configures the analysis axes in accordance with the video information, the video information being the direction of an edge, on a per analysis region basis, the present embodiment is not limited thereto. In the present embodiment, the analysis axis configuration unit 82 may configure the analysis axes in accordance with features of the input video overall. In general, the object readily vibrates in a direction orthogonal to the longitudinal direction, and thus the analysis axis configuration unit 82 may configure an analysis axis in a direction orthogonal to the longitudinal direction of the object. For example, the bridge 303 in the input video 300 in
As in a vibration analysis system 4 (not illustrated) according to a fourth embodiment, a display unit 130 (not illustrated) may display the analysis axes superimposed onto the video of the object.
Below, the vibration analysis system 4 according to the fourth embodiment will be described based on
The vibration analysis system 4 includes the display unit 130 instead of the display unit 30 in the first embodiment. Other than this, the vibration analysis system 4 has the same configuration as the vibration analysis system 1 according to the first embodiment.
The display unit 130 displays the analysis axes superimposed onto the video of the object.
Below, the details of the display of an image by the display unit 130 will be described using the following Processing Example 7.
A specific example 1 of the display of an image by the display unit 130 will be described with reference to
Further, in the image 1800 there are also displayed a graph (analysis region) 1903 of the analysis result of the vibration of the analysis region 1901, and a graph (analysis result) 1904 of the analysis result of the vibration of the analysis region 1902, each analysis result of the vibration being a displacement amount. Therefore, in a case where, for example, the user changes the direction of an analysis axis of at least one of the analysis region 1901 and the analysis region 1902, the changed analysis axis and the graph of the changed analysis result are displayed in conjunction in the image 1800 of the display unit 130. Therefore, the user can easily recognize the analysis result in a case where the analysis axes are configured on a per analysis axis basis.
In specific example 1 described above, the display unit 130 displays one analysis axis per analysis region. However, a plurality of analysis axes may be displayed on the display unit 130, such as a plurality of analysis axes being displayed superimposed onto one analysis region, and the analysis result of the vibration along each of the plurality of analysis axes may be separately displayed on the display unit 130. Below, a specific example 2 of the display of an image by the display unit 130 will be described with reference to
As illustrated in (a) of
Further, the display unit 130 may display a plurality of analysis axes superimposed onto the analysis region 2101 in different colors for each analysis axis. In a case where a plurality of analysis axes are superimposed onto one analysis region, the plurality of analysis axes are displayed in different colors for each analysis axis, making it easy for the user to differentiate the plurality of analysis axes. Further, the display unit 130 may display each graph of an analysis result corresponding to an analysis axis using the color corresponding to the color of the analysis axis. For example, the display unit 130 may display the analysis axis 2101a and the graph 1903 of the analysis result of the vibration along the analysis axis 2101a in a warm color, and the analysis axis 2101b and the graph 2102 of the analysis result of the vibration along the analysis axis 2101b in a cool color. Further, the display unit 130 may display the analysis axis 2101a and the graph 1903 of the analysis result of the vibration along the analysis axis 2101a in monochrome, and the analysis axis 2101b and the graph 2102 of the analysis result of the vibration along the analysis axis 2101b in color. Thus, with each graph of an analysis result corresponding to an analysis axis being displayed in the color corresponding to the color of the analysis axis, the analysis result corresponding to a certain analysis axis can be easily recognized by the user.
Note that while, in the example described above, the display unit 130 displays the analysis axes in two-dimensional directions relative to the analysis region, the present embodiment is not limited thereto. In the present embodiment, the display unit 130 may display analysis axes in a three-dimensional space, such as the x-axis, the y-axis, and the z-axis in
As described above, in the vibration analysis system 4 according to the fourth embodiment, the display unit 130 displays the analysis axes superimposed onto a video of an object. This allows the user to easily recognize the direction in which the analysis axis of a certain analysis region is configured. Further, the display unit 130 displays the input video on which the analysis axes are superimposed and the analysis result along the analysis axis simultaneously as an image, making it possible for the user to easily recognize the direction to which a certain analysis result of vibration corresponds.
A control block (in particular, the analysis region configuration unit 61, the analysis axis configuration units 62, 72, 82, the vibration analyzing units 63, 73, 83, and the output unit 64) of the vibration analysis devices 60, 7080 may be realized by a logic circuit (hardware) formed by an integrated circuit (IC chip) or the like, such as an application specific integrated circuit (ASIC) and a field programmable gate array (FPGA), or may be realized by software using a central processing unit (CPU) and a graphics processing unit (GPU).
In the latter configuration, the vibration analysis devices 60, 70, 80 each include a CPU for executing instructions of a vibration analysis program, which is software for realizing each function, a read-only memory (ROM) or a storage device (each of these is referred to as a “recording medium”) in which the vibration analysis program and various types of data are recorded in a computer-readable (or CPU-readable) manner, a random access memory (RAM) in which the vibration analysis program is loaded, and the like. Then, the computer (or CPU) reads the vibration analysis program from the recording medium and executes the vibration analysis program to achieve the object of the present invention. As the recording medium, a “non-transitory tangible medium”, such as a tape, a disk, a card, a semiconductor memory, and a programmable logic circuit, for example, may be used. Further, the vibration analysis program may be supplied to the computer via any transmission medium (communication network, broadcast wave, or the like) capable of transmitting the vibration analysis program. Note that an aspect of the present invention may be realized in a form of a data signal embedded in a carrier wave, which is embodied by electronic transmission of the vibration analysis program.
A vibration analysis device (60, 70, 80) according to a first aspect of the present invention includes an analysis axis configuration unit (62, 72, 82) configured to configure analysis axes (1901, 1902, 2101, 2101a, 2101b) in accordance with an operation of a user, a vibration analyzing unit (63, 73, 83) configured to analyze, based on a video (input videos 300, 301, 302, 1300, 1500, 1600, 1900, 2100) of an object (bridges 303, 1301, automobile 1601), vibration along each of the analysis axes of the object, and an output unit (64) configured to output an analysis result (graphs 1903, 1904, 2102 of the analysis result) obtained by the vibration analyzing unit.
According to the configuration described above, vibration of the object can be suitably analyzed.
In the vibration analysis device according to a second aspect of the present invention, in the above-described first aspect, the vibration analyzing unit may analyze the vibration based on a displacement amount of the object caused by the vibration.
According to the configuration described above, the vibration analyzing unit analyzes the vibration based on the displacement amount of the object, making it possible to obtain an amplitude of the vibration of the object and the like as the analysis result. This makes it possible to more suitably analyze the vibration of the object.
In the vibration analysis device according to a third aspect of the present invention, in the above-described first or second aspect, the vibration analyzing unit may analyze the vibration based on a three-dimensional displacement amount of the object.
According to the configuration described above, a vibration direction, an amplitude, and the like on a three-dimensional space of the object can be analyzed, making it possible to more suitably analyze the vibration of the object.
In the vibration analysis device according to a fourth aspect of the present invention, in the above-described third aspect, the analysis axis configuration unit may configure one of the analysis axes in a direction connecting an imaging unit, configured to capture a video of the object, and the object.
According to the configuration described above, even in a case where one of the analysis axes is configured in a direction connecting the imaging unit and the object, the vibration analyzing unit can suitably analyze the vibration of the object in accordance with distance information, such as three-dimensional positional information, of the object.
In the vibration analysis device according to a fifth aspect of the present invention, in any one of the above-described first to fourth aspects, the analysis axis configuration unit may configure the analysis axes for each of a plurality of areas of the object.
According to the configuration described above, the analysis configuration unit configures the analysis axes for each of a plurality of areas of the object, making it possible to more suitably configure the analysis axes. Therefore, the vibration analyzing unit can more suitably analyze the vibration of the object.
In the vibration analysis device according to a sixth aspect of the present invention, in any one of the above-described first to fifth aspects, the analysis axis configuration unit may configure, among the analysis axes, two analysis axes not orthogonal to each other.
According to the configuration described above, in a case where analysis axes orthogonal to each other are configured and it is difficult to estimate the vibration information of the vibration in a direction along at least one of the analysis axes, the analysis axes can be changed to more suitable directions. With the analysis axes thus changed to suitable directions, the vibration analyzing unit can more suitably analyze the vibration of the object.
In a vibration analysis device according to a seventh aspect of the present invention, in any one of the above-described first to sixth aspects, the vibration analyzing unit may analyze the vibration on a per frequency basis.
According to the configuration described above, even in a case where it is difficult to estimate the vibration information of the vibration in a direction along at least one analysis axis, the analysis axis configuration unit can change the direction of the analysis axis to a suitable direction based on the analysis result obtained by analyzing the vibration on a per frequency basis, and thus the vibration of the object can be more suitably analyzed.
A vibration analysis device according to an eighth aspect of the present invention includes an analysis axis configuration unit configured to configured analysis axes, a vibration analyzing unit configured to analyze, based on a video of an object, vibration along each of the analysis axes of the object, and a display unit (30, 130) configured to display the analysis axes superimposed onto an image of the object and display an analysis result obtained by the vibration analyzing unit.
According to the configuration described above, the vibration of the object can be suitably analyzed. Further, the user can easily recognize the configured direction corresponding to the direction of the vibration of the object.
In the vibration analysis device according to a ninth aspect of the present invention, in the above-described eighth aspect, the analysis axis configuration unit may configure the analysis axes in accordance with a video of the object.
Even in a case where the analysis axes are configured in accordance with a video of the object, the vibration of the object can be suitably analyzed.
In the vibration analysis device according to a tenth aspect of the present invention, in the above-described ninth aspect, the analysis axis configuration unit may configure one of the analysis axes in a direction where an amplitude of the vibration is greater than an amplitude in an array direction of pixels of the video.
According to the configuration described above, the analysis axis is configured in a more suitable direction, making it possible to more suitably analyze the vibration of the object.
In a vibration analysis device according to an eleventh aspect of the present invention, in the above-described ninth or tenth aspect, the analysis axis configuration unit may configure one of the analysis axes in a direction where the amplitude of the vibration is greatest.
According to the configuration described above, the analysis axis is configured in a more suitable direction, making it possible to more suitably analyze the vibration of the object.
In the vibration analysis device according to a twelfth aspect of the present invention, in any one of the above-described eighth to eleventh aspect, the display unit may display a plurality of analysis axes and separately display an analysis result of the vibration along each of the plurality of analysis axes.
According to the configuration described above, even in a case where a plurality of analysis axes are displayed on the display unit, the user can easily recognize the respective analysis results of the vibrations.
A control method for a vibration analysis device according to a thirteenth aspect of the present invention is a control method for a vibration analysis device configured to analyze vibration of an object, the control method including an analysis axis configuration step of configuring analysis axes in accordance with an operation of a user, a vibration analyzing step of analyzing, based on a video of the object, the vibration along each of the analysis axes of the object, and an output step of outputting an analysis result of the vibration analyzing step.
According to the configuration described above, effects similar to those of the vibration analysis device according to an aspect of the present invention are produced.
According to the configuration described above, effects similar to those of the vibration analysis device according to an aspect of the present invention are produced.
Furthermore, the vibration analysis device according to each of the aspects of the present invention may be implemented by a computer. In this case, a vibration analysis program of the vibration analysis device that causes the computer to function as each unit (software element) included in the vibration analysis device to implement the vibration analysis device by the computer, and a computer-readable recording medium having recorded therein the vibration analysis program fall within the scope of the present invention.
The present invention is not limited to each of the above-described embodiments. It is possible to make various modifications within the scope of the claims. An embodiment obtained by appropriately combining technical elements each disclosed in different embodiments falls also within the technical scope of the present invention. Furthermore, technical elements disclosed in the respective embodiments may be combined to provide a new technical feature.
For example, the technical means disclosed in the third embodiment is implemented in accordance with an input image, and the technical means disclosed in the fourth embodiment is implemented in accordance with an operation of the user, and thus these technical means cannot be combined as is. However, using known technical means such as a switch button (not illustrated), it is possible to switch between the technical means disclosed in the third embodiment and the technical means disclosed in the fourth embodiment. Accordingly, each of the technical means disclosed in the first to fourth embodiments can be optionally combined by using known technical means, such as a switch button, and such technical means also fall within the technical scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2018-075567 | Apr 2018 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2019/013665 | 3/28/2019 | WO | 00 |
