Patent Grant
11105675
This U.S. patent application claims priority under 35 U.S.C. § 119 to: Indian Patent Application No. 201921001769, filed on 27 Jan. 2019. The entire contents of the aforementioned application are incorporated herein by reference.
The disclosure herein generally relates to vibration detection, and more particularly, to systems and computer implemented methods for unobtrusive and automated detection of frequency of vibrating objects using multiple strobe sources.
A typical workstation has a collection of different vibrating or moving parts. Likewise, a large machine body may have spatially distributed vibrating zones or parts. To detect the exact location and frequency of vibration of each vibrating part is crucial either for routine monitoring or fault detection.
Current solutions use either high frames per second (FPS) industrial grade camera or stroboscopes tuned at one particular frequency. Manual stroboscopes are also in use, which require manual intervention for objects moving at different speeds with high convergence time. Point-lasers have been used in some conventional systems for which prior knowledge of exact location of faults are to be known. Again, some state of the art employ point-by-point scanning of a large machine body which takes up a lot of time.
Embodiments of the present disclosure present technological improvements as solutions to one or more of the above-mentioned technical problems recognized by the inventors in conventional systems.
In an aspect, there is provided a processor implemented method for detecting frequency of one or more vibrating objects using multiple strobe sources, the method comprising the steps of: illuminating one or more vibrating objects, concurrently by a predefined number of strobe sources having a corresponding operating frequency forming a set of strobing frequencies [ωsi], wherein the operating frequency of each of the strobe sources is a unique multiple of a base frequency being a camera frame rate selected from a set of camera frame rates [ωcamj] associated with a camera, wherein elements of the set of camera frame rates [ωcamj] are mutually prime; iteratively performing for each camera frame rate serving as the base frequency from the set of camera frame rates [ωcamj]: capturing by the camera, a video having a predetermined length, of the one or more vibrating objects, when illuminated concurrently by the multiple strobe sources; processing, by one or more hardware processors, the captured video to obtain a set of observed frequencies of vibration [mk], wherein each element thereof corresponds to one of the one or more vibrating objects; and obtaining, by the one or more hardware processors, a set of potential frequencies [wk] of the one or more vibrating objects using the set of camera frame rates [ωcamj] and the set of observed frequencies of vibration [mk]; obtaining, by the one or more hardware processors, a set [C11] of common potential frequencies between the set of potential frequencies [wk] obtained for each camera frame rate from the set of camera frame rates [ωcamj]; and detecting, by the one or more hardware processors, frequency of the one or more vibrating objects by: associating elements of the set [C11] of common potential frequencies as a vibration frequency corresponding to the one or more vibrating objects if the cardinality of the set [C11] is equal to the number of the one or more vibrating objects; or iteratively performing: identifying a camera frame rate from the set of camera frame rates [ωcamj] having a maximum variation between the cardinality of the set [C11] and the number of the one or more vibrating objects by analyzing kurtosis of the set [C11]; and obtaining the set [C11] of common potential frequencies between the set of potential frequencies [wk] obtained for each camera frame rate from the set of camera frame rates [ωcamj]; until the cardinality of the set [C11] is equal to the number of the one or more vibrating objects.
In another aspect, there is provided a system for detecting frequency of one or more vibrating objects using multiple strobe sources, the system comprising: a predefined number of strobe sources configured to illuminate one or more vibrating objects currently, the strobe sources having a corresponding operating frequency forming a set of strobing frequencies [ωsi], wherein the operating frequency of each of the strobe sources is a unique multiple of a base frequency being a camera frame rate selected from a set of camera frame rates [ωcamj] associated with a camera, wherein elements of the set of camera frame rates [ωcamj] are mutually prime; the camera configured to capture a video having a predetermined length, of the one or more vibrating objects, when illuminated concurrently by the multiple strobe sources; a controller in communication with each of the multiple strobe sources and the camera, wherein the controller comprises: one or more data storage devices operatively coupled to one or more hardware processors and configured to store instructions configured for execution by the one or more hardware processors to: iteratively perform for each camera frame rate serving as the base frequency from the set of camera frame rates [ωcamj]: processing the captured video to obtain a set of observed frequencies of vibration [mk], wherein each element thereof corresponds to one of the one or more vibrating objects; and obtaining a set of potential frequencies [wk] of the one or more vibrating objects using the set of camera frame rates [ωcamj] and the set of observed frequencies [mk]; obtain, a set [C11] of common potential frequencies between the set of potential frequencies [wk] obtained for each camera frame rate from the set of camera frame rates [ωcamj]; detect frequency of the one or more vibrating objects by: associating elements of the set [C11] of common potential frequencies as a vibration frequency corresponding to the one or more vibrating objects if the cardinality of the set [C11] is equal to the number of the one or more vibrating objects; or iteratively perform: identifying a camera frame rate from the set of camera frame rates [ωcamj] having a maximum variation between the cardinality of the set [C11] and the number of the one or more vibrating objects by analyzing kurtosis of the set [C11]; and obtaining the set [C11] of common potential frequencies between the set of potential frequencies [wk] obtained for each camera frame rate from the set of camera frame rates [ωcamj]; until the cardinality of the set [C11] is equal to the number of the one or more vibrating objects.
In accordance with an embodiment of the present disclosure, the number of strobe sources is predefined such that the one or more vibrating objects are under coverage of the multiple strobe sources.
In accordance with an embodiment of the present disclosure, the predetermined length of the video is 1 second.
In accordance with an embodiment of the present disclosure, the one or more processors are further configured to obtain the set of potential frequencies [wk] of the one or more vibrating objects by: generating a first matrix west1(i,j) of evaluated frequencies of the one or more vibrating objects based on each camera frame rate selected from the set of camera frame rates [ωcamj] and each observed frequency from the set of observed frequencies of vibration [mk]; generating a second matrix west2 (i,j), of evaluated frequencies of the one or more vibrating objects based on each camera frame rate selected from the set of camera frame rates [ωcamj] and each observed frequency from the set of observed frequencies of vibration [mk]; and concatenating the first matrix west1(i,j) and the second matrix west2(i,j) to obtain the set of potential frequencies [wk].
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and, together with the description, serve to explain the disclosed principles.
Exemplary embodiments are described with reference to the accompanying drawings. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. Wherever convenient, the same reference numbers are used throughout the drawings to refer to the same or like parts. While examples and features of disclosed principles are described herein, modifications, adaptations, and other implementations are possible without departing from the spirit and scope of the disclosed embodiments. It is intended that the following detailed description be considered as exemplary only, with the true scope and spirit being indicated by the following claims.
Conventional systems that address the technical problem of detecting frequency of vibrating objects are expensive, require manual intervention, sometimes depend on prior knowledge of location of faults or involve high convergence time. Systems and methods of the present disclosure provide a cost-effective and fully automated solution that employs multiple strobe sources along with a low cost camera. In an embodiment, the camera employed is a 30 frames per second ordinary optical camera. Besides being cost-effective and automated, the solution also reduces convergence time significantly as explained later in the description.
Referring now to the drawings, and more particularly to
The I/O interface(s) may include a variety of software and hardware interfaces, for example, a web interface, a graphical user interface, and the like and can facilitate multiple communications within a wide variety of networks N/W and protocol types, including wired networks, for example, LAN, cable, etc., and wireless networks, such as WLAN, cellular, or satellite. In an embodiment, the I/O interface(s) can include one or more ports for connecting a number of devices to one another or to another server.
The memory may include any computer-readable medium known in the art including, for example, volatile memory, such as static random access memory (SRAM) and dynamic random access memory (DRAM), and/or nonvolatile memory, such as read only memory (ROM), erasable programmable ROM, flash memories, hard disks, optical disks, and magnetic tapes.
In accordance with an embodiment of the present disclosure, at step 202, the one or more vibrating objects are illuminated concurrently by a predefined number of strobe sources 104a-104f having a corresponding operating frequency forming a set of strobing frequencies [ωsi], wherein i represents the number of the one or more vibrating objects. In the illustrated embodiment, 6 strobe sources are provided. The number of strobe sources is predefined such that the one or more vibrating objects are under coverage of the multiple strobe sources. Accordingly, the more spatially distributed the vibrating objects are or larger the machine or more the number of vibrating objects result in more number of strobe sources. The one or more vibrating objects may be parts of a single machine 102 being monitored such as in the illustrated example. In an embodiment, the operating frequency of each of the strobe sources 104a-104f is a unique multiple of a base frequency, wherein the base frequency is a camera frame rate selected from a set of camera frame rates [ωcamj] associated with the camera 106, wherein elements of the set of camera frame rates [ωcamj] are mutually prime. Configuring the camera frame rates to be mutually prime or co-prime numbers enables the method of the present disclosure to converge.
In accordance with the present disclosure, the strobing frequency (ωsi) is a multiple of a camera frame rate [ωcamj]. Alternately, the strobing frequency (ωsi) may be represented as: ωsi=(i+1)×ωcamj; wherein i is a positive integer. Configuring the strobing frequency as a multiple of the camera frame rate, in accordance with the present disclosure, nullifies an aliasing component, that may otherwise have existed.
In an embodiment, for each camera frame rate serving as the base frequency, steps 204 through 208 are performed iteratively. At step 204, a video of the one or more vibrating objects is captured when illuminated concurrently by the multiple strobe sources. In accordance with the present disclosure, the video has a predetermined length, for instance 1 second.
In an embodiment, the one or more hardware processors of the controller 108 are configured to process, at step 206, the captured video to obtain a set of observed frequencies of vibration [mk], wherein each element thereof corresponds to one of the one or more vibrating objects. The processing of the captured video may be performed by any image processing method known in the art such as disclosed in Indian Patent Application 201721027017 titled ‘Autonomous Stroboscopic Machine Inspection for Multi-point and Multi-Frequency Vibration Measurement’ or European patent EP2384423B1 titled ‘Measurement of vibration characteristics of an object’. An exemplary image processing method disclosed in EP2384423B1 involves determining positions of feature points on the vibrating object in different color channels of the image to calculate frequency of each point in a point set of the vibrating object.
In an embodiment, the one or more hardware processors of the controller 108 are configured to obtain, at step 208, a set of potential frequencies [wk] of the one or more vibrating objects using the set of camera frame rates [ωcamj] and the set of observed frequencies [mk]. In an embodiment, the step of obtaining a set of potential frequencies [wk] of the one or more vibrating objects comprises firstly generating a first matrix w and a second matrix west2(i,j) of evaluated frequencies of the one or more vibrating objects based on each camera frame rate selected from the set of camera frame rates [ωcamj] and each observed frequency from the set of observed frequencies of vibration [mk]. The first matrix and the second matrix of the present disclosure may be represented as:
west1(i,j)=ωcam×i+m(:,j); and
west2(i,j)=ωcam×i−m(:,j) respectively.
In an embodiment, the one or more hardware processors of the controller 108 are configured to concatenate the first matrix west1(i,j) and the second matrix west2(i,j) to obtain the set of potential frequencies [wk].
In an embodiment, the one or more hardware processors of the controller 108 are configured to obtain, at step 210, a set [C11] of common potential frequencies between the set of potential frequencies [wk] obtained for each camera frame rate from the set of camera frame rates [ωcamj].
In an embodiment, the one or more hardware processors of the controller 108 are configured to detect frequency of the one or more vibrating objects, at step 212. There may be two scenarios after the set [C11] of common potential frequencies is obtained. A first scenario involves the cardinality of the set [C11] being equal to the number of the one or more vibrating objects. In case of the first scenario, the elements of the set [C11] of common potential frequencies are identified as the vibration frequency of the one or more vibrating objects at step 212a. To further detect the actual one-to-one mapping of each element of the set [C11] to the one or more vibrating objects, a marker based image processing may be performed as disclosed in the Applicant's earlier patent application no. 201821015512 titled ‘Unobtrusive And Automated Detection Of Frequencies Of Spatially Located Distinct Parts Of A Machine’.
A second scenario involves the cardinality of the set [C11] being greater than the number of the one or more vibrating objects. In case of the second scenario, the steps 212b-1 and 212b-2 described below are iteratively performed until the cardinality of the set [C11] is equal to the number of the one or more vibrating objects. In an embodiment, at step 212b-1, a camera frame from the set of camera frame rates [ωcamj] having a maximum variation between the cardinality of the set [C11] and the number of the one or more vibrating objects by analyzing kurtosis of the set [C11] is identified. Then at step 212b-2, the set [C11] of common potential frequencies between the set of potential frequencies [wk] obtained for each camera frame rate from the set of camera frame rates [ωcamj] is obtained. If the cardinality of the set [C11] is equal to the number of the one or more vibrating objects, then the elements of the set [C11] of common potential frequencies are identified as the vibration frequency of the one or more vibrating objects as indicated in step 212a.
Experimental Data and Validation
In accordance with the Applicant's previous Indian patent application 201721027017 titled ‘Autonomous Stroboscopic Machine Inspection for Multi-point and Multi-Frequency Vibration Measurement’, strobe frequencies are prime or (ωsi)∈Prime, Then using Chinese Remainder Theorem (CRT), the vibrating frequencies were detected. Since this was a sequential approach, the prime frequency was required to be set in each iteration until the frequencies of all the vibrating objects were detected. Moreover, since the vibration information is unknown, the strobing had to begin from a very low prime value. Also, the observed frequency mk for a typical strobe frequency ωsi can have two possible combinations:
This resulted in a large convergence time when determining frequencies using CRT. To overcome the challenges mentioned above, multiple strobe sources are used in the present disclosure and ωsi is computed from ωcam. Reduced number of iterations and observed frequencies being same for any value of strobe frequency, result in a significantly reduced convergence time.
Experiment 1: Detecting Frequency of a Single Vibrating Object.
Say the unknown vibration frequency is ω=100 Hz and the vibrating object is illuminated by a set of strobe strobing frequencies [ωsi] which are multiples of camera frame rate ωcam=30 fps; hence ωsi=[60, 90, 120, 150, 180, 210].
Step 1:
ωcam=30 fps and strobing frequencies are ωsi=[60, 90, 120, 150, 180, 210], the observed frequency m1=10 Hz.
It may be observed that for any observed frequency m1, there are six possibilities:
1. Positive shift; ω=(i×ωs+m1);
2. Negative shift; ω=(i×ωs−m1);
3. Next positive frequency folding; ω=(i×ωs+m1)+ωcam
4. Next negative frequency folding; w=(i×ωs−m1)−ωcam
5. Previous positive frequency folding; w=(i×ωs+m1)−ωcam
6. Previous negative frequency folding; w=(i×ωs−m1)−ωcam
It may be observed from
Step 2:
In order to approximate the unknown vibration frequency, the camera fps is changed. ωcam=29 fps and strobing frequencies are ωsi=[29, 58, 87, 116, 145, 174, 203], the observed frequency m1=13 Hz.
From Step 1 and Step 2, it may be observed that there is single unique repetition of the unknown frequency. It may be also be noted that the ωcam=30 fps of Step 1 and ωcam=29 fps of Step 2 are mutually prime or co-prime numbers.
Results and Observations:
It may be noted from the below results and observations that for single frequency detection, time taken by the method of the present disclosure and the conventional CRT based method when the frequency is 61 Hz is same. However as frequency of vibration increases and as the number of frequencies to be detected increases, the method of present disclosure takes significantly lower time to converge.
Experiment 2: Detecting Frequency of Two Vibrating Objects
Say the unknown vibration frequencies of the two vibrating objects are ω=61, 515 Hz and the vibrating objects are illuminated by a set of strobe strobing frequencies [ωsi] which are multiples of camera frame rate ωcam=29 fps; Hence ωsi=[2*29, 3*29, 4*29, 5*29, 6*29, 7*29]=[58, 87, 116, 145, 174, 203].
Iteration 1: ωcam=29 fps and strobing frequencies are ωsi=[58, 87, 116, 145, 174, 203], the observed frequencies mk=[3, 7] Hz. The first matrix west1 and the second matrix west2 of evaluated frequencies of the two vibrating objects may be represented as:
Concatenate west1 and west2 in a new variable w1 (potential frequencies)
Iteration 2: ωcam=27 fps and strobing frequencies are ωsi=[54, 81, 108, 135, 162, 189], the observed frequencies mk=[2, 7] Hz. The first matrix west1 and the second matrix west2 of evaluated frequencies of the two vibrating objects may be represented as:
Concatenate west1 and west2 in a new variable w2 (potential frequencies)
Common potential frequencies between w1 and w2 are
Cardinality of the set [C11]=15 which is greater than the number of vibrating objects in this case being 2 (ω=61, 515 Hz).
Hence it is required to identify a camera frame rate ωcam having a maximum variation.
After analyzing the kurtosis of C11 for each ωcam=[30, 25, 23, 21, 19], the variation results are:
19.1238095238095 14.0952380952381 14.8285714285714 11.3142857142857 5.98095238095238
Hence, maximum variation occurs for ωcam=30 fps.
Iteration 3: ωcam=30 fps and strobing frequencies are ωsi=[60, 90, 120, 150, 180, 210], the observed frequencies mk=[1, 5] Hz. The first matrix west1 and the second matrix west2 of evaluated frequencies of the two vibrating objects may be represented as:
Concatenate west1 and west2 in a new variable w3 (potential frequencies)
Common potential frequencies between w3 and C11 are
Cardinality of the set [C21]=2 which is equal to the number of vibrating objects in this case being 2 (ω=61, 515 Hz). Hence elements of C21 are the vibration frequencies associated with the two vibrating objects under consideration.
Thus systems and methods of the present disclosure provide an automated solution to industrial problems like monitoring of heavy machinery wherein traditionally contact based accelerometer was used. For instance, in a drill bit, thickness of drill bit is critical for cutting precision. To find frequency of vibration of the drill bit, an accelerometer is needed, but that cannot be done. Rotational motion of drill bit will change, so unobtrusive monitoring is needed. The systems of the present disclosure may also be employed for machine fault detection and for monitoring vibrating objects in hazardous environment where it may not be humanly possible to monitor machines physically.
The written description describes the subject matter herein to enable any person skilled in the art to make and use the embodiments. The scope of the subject matter embodiments is defined by the claims and may include other modifications that occur to those skilled in the art. Such other modifications are intended to be within the scope of the claims if they have similar elements that do not differ from the literal language of the claims or if they include equivalent elements with insubstantial differences from the literal language of the claims.
It is to be understood that the scope of the protection is extended to such a program and in addition to a computer-readable means having a message therein; such computer-readable storage means contain program-code means for implementation of one or more steps of the method, when the program runs on a server or mobile device or any suitable programmable device. The hardware device can be any kind of device which can be programmed including e.g. any kind of computer like a server or a personal computer, or the like, or any combination thereof. The device may also include means which could be e.g. hardware means like e.g. an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination of hardware and software means, e.g. an ASIC and an FPGA, or at least one microprocessor and at least one memory with software modules located therein. Thus, the means can include both hardware means and software means. The method embodiments described herein could be implemented in hardware and software. The device may also include software means. Alternatively, the embodiments may be implemented on different hardware devices, e.g. using a plurality of CPUs.
The embodiments herein can comprise hardware and software elements. The embodiments that are implemented in software include but are not limited to, firmware, resident software, microcode, etc. The functions performed by various modules described herein may be implemented in other modules or combinations of other modules. For the purposes of this description, a computer-usable or computer readable medium can be any apparatus that can comprise, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The illustrated steps are ωcam out to explain the exemplary embodiments shown, and it should be anticipated that ongoing technological development will change the manner in which particular functions are performed. These examples are presented herein for purposes of illustration, and not limitation. Further, the boundaries of the functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternative boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed. Alternatives (including equivalents, extensions, variations, deviations, etc., of those described herein) will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. Such alternatives fall within the scope and spirit of the disclosed embodiments. Also, the words “comprising,” “having,” “containing,” and “including,” and other similar forms are intended to be equivalent in meaning and be open ended in that an item or items following any one of these words is not meant to be an exhaustive listing of such item or items, or meant to be limited to only the listed item or items. It must also be noted that as used herein and in the appended claims, the singular forms “a,” “an,” and “the” include plural references unless the context clearly dictates otherwise.
Furthermore, one or more computer-readable storage media may be utilized in implementing embodiments consistent with the present disclosure. A computer-readable storage medium refers to any type of physical memory on which information or data readable by a processor may be stored. Thus, a computer-readable storage medium may store instructions for execution by one or more processors, including instructions for causing the processor(s) to perform steps or stages consistent with the embodiments described herein. The term “computer-readable medium” should be understood to include tangible items and exclude carrier waves and transient signals, i.e., be non-transitory. Examples include random access memory (RAM), read-only memory (ROM), volatile memory, nonvolatile memory, hard drives, CD ROMs, DVDs, flash drives, disks, and any other known physical storage media.
It is intended that the disclosure and examples be considered as exemplary only, with a true scope and spirit of disclosed embodiments being indicated by the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201921001769 | Jan 2019 | IN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20050030756 | Thomas | Feb 2005 | A1 |
| 20080243441 | Chen | Oct 2008 | A1 |
| 20120019654 | Venkatesan | Jan 2012 | A1 |
| 20130329953 | Schreier | Dec 2013 | A1 |
| 20180283847 | Hatahori | Oct 2018 | A1 |
| 20190033124 | Mukherjee et al. | Jan 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 3 561 464 | Oct 2019 | EP |
| 201721027017 | Feb 2019 | IN |
| 201821015512 | Oct 2019 | IN |
| Entry |
|---|
| Roy et al., Demo Abstract: Shake meter—An Autonomous Vibration Measurement System using Optical Strobing, Nov. 14-16, 2016, pp. 1-2. (Year: 2016). |
| Misra et al., Unobtrusive Vibration Sensing using Optical Strobing: Performance Analysis, 2017, Eleventh International Conference on Sensing Technology (ICST), pp. 1-4. (Year: 2017). |
| Number | Date | Country | |
|---|---|---|---|
| 20200240833 A1 | Jul 2020 | US |
