The present disclosure relates to an operation situation detection device that detects a progress state of a cleaning operation or other operation in a chamber including a plurality of seats in a train, an aircraft, a vessel, a theater, or a movie theater or cinema, or other vehicle or facility, and relates to a computer-readable recording medium that records program and an operation situation detection method therefor.
Patent Literature 1 discloses a technology for grasping, in an information management center, current positions of cleaning operators by causing each cleaning operator to carry an IC card having a wireless function.
The technology disclosed in Patent Literature 1 enables grasping of the current positions of the cleaning operators, but fails to check whether the cleaning operation has been actually performed.
The present disclosure has an object of providing an operation situation detection device, a computer-readable recording medium that records a program, and an operation situation detection method for grasping actual performance of an operation with a high accuracy.
An operation situation detection device according to one aspect of this disclosure includes: at least one microphone that is provided in a chamber to detect a first operation sound which is an operation sound occurring when a predetermined operation is performed in the chamber; a memory that stores in advance a second operation sound which is a typical sound likely to occur when the operation is performed; a calculator that calculates a similarity between the first operation sound and the second operation sound; and a determinator that determines that the operation has been performed, when the similarity is a predetermined value or higher.
Knowledge Forming the Basis of the Present Disclosure
A train normally runs between a starting station and a terminal station, passengers get on and off the train at stations located therebetween, and finally no passenger remains in the train at the terminal station. The terminal station then serves as a starting station for return running. In a limited-express or other specific train, a time period before the return running is utilized for a cleaning operation including: mainly cleaning around seats; returning a reclined seat in a lying posture to its original position; changing a seat in a specific direction by rotating the seat; and replacing rest covers.
Similarly, in an aircraft, after all the passengers having boarded at a departure place get off the aircraft at a destination, a time period until next boarding to the aircraft is utilized for a cleaning operation including: mainly tidying-up around seats; and replacing pillow or rest covers.
In a theater or movie theater, after finish of an ongoing play or movie and leaving of spectators, a time period until entering of subsequent spectators is utilized for a cleaning operation including: mainly tidying-up around seats; and returning a reclined seat to its original position.
In this respect, a large number of cleaning operators are required to perform such a cleaning operation all at once to complete the cleaning operation at many locations in the limited time. Thus, improvement in the efficiency of the operation and management or checking of a progress state thereof have been demanded.
Although it is unclear whether a train, an aircraft, or a movie theater as described above is targeted, the technology disclosed in Patent Literature 1 enables an information management center to grasp a current position of each cleaning operator by causing the cleaning operator to carry an IC card or transponder card having a wireless function, and aims at entirely improved work efficiency by giving an instruction to the cleaning operator on the basis of a progress state of the cleaning.
However, the technology disclosed in Patent Literature 1 merely shows which chamber has been cleaned by managing the current position of the cleaning operator carrying the transponder card, but fails to clarify details of contents as to what item among many cleaning items is now being executed in each chamber. If details of contents about the current operation were graspable, appropriately prepared assistance would be available. Otherwise, such preparation is unexpected without the grasping of the details of contents. In other words, further entirely improved efficiency of cleaning operation is unattainable. Besides, it is necessary to arrange fixed stations in respective chambers to receive radio information from each transponder card. This is less applicable to a train, an aircraft, a movie theater, and other facility which is not partitioned into individual divisions and thus has difficulty in appropriate acquisition of positional information about each cleaning operator. The required additional arrangement of the fixed stations further causes problems of a weight increase and a cost increase.
To solve the problems, the present inventor has obtained the knowledge that it is detectable whether a specific operation has been actually performed with a high accuracy by detecting an operation sound occurring when the operation is performed in a chamber, and comparing the detected operation sound with a typical operation sound stored in advance, and the inventor has conceived of the present disclosure on the basis of this knowledge.
Hereinafter, aspects of this disclosure will be described.
An operation situation detection device according to one aspect of this disclosure includes: at least one microphone that is provided in a chamber to detect a first operation sound which is an operation sound occurring when a predetermined operation is performed in the chamber; a memory that stores in advance a second operation sound which is a typical sound likely to occur when the operation is performed; a calculator that calculates a similarity between the first operation sound and the second operation sound; and a determinator that determines that the operation has been performed, when the similarity is a predetermined value or higher.
According to this configuration, the determinator determines that the operation has been performed, when the similarity between the first operation sound detected by the microphone and the second operation sound stored in the memory in advance is the predetermined value or higher. The comparison between the operation sounds results in achieving detection concerning actual performance of the operation with a high accuracy.
This configuration may further include a sound detector that receives a signal concerning the first operation sound from the microphone and extracts, from the received first operation sound signal, a signal component which is in a frequency band defined by a first threshold and has a signal level on a second threshold or higher, and sends the signal component to the calculator.
This configuration enables the sound detector to appropriately detect a time at which a predetermined operation sound occurs, resulting in improving an accuracy of calculating the similarity and thus improving an accuracy of detecting the predetermined operation.
In the configuration, the sound detector may extract a signal component which is in the frequency band and has frequency samples whose signal level is on the second threshold or higher and the number of which is at a ratio on a third threshold or higher with respect to a total number of frequency samples falling within the frequency band.
This configuration further improves the accuracy of calculating the similarity, and thus achieves further improvement in the accuracy of detecting the predetermined operation.
In the configuration, the operation may be performed at a plurality of locations in the chamber, the at least one microphone may include a plurality of microphones respectively arranged at the locations, and the determinator may determine whether the operation has been performed at each of the locations. This configuration may further include: a progress checker that checks, on the basis of a result of the determination by the determinator, a progress state of the operation at each of the locations; and an output part that outputs a result of the checking by the progress checker to present information to the manager.
This configuration permits a manager to grasp a progress state of the operation at each of the locations in the chamber, and accordingly, attains entirely improved efficiency of the operation.
In the configuration, the chamber may include a plurality of seats, the at least one microphones may include a plurality of microphones respectively arranged for the seats, the calculator may calculate a similarity between the first operation sound and the second operation sound from each of the respective microphones for the seats, and the determinator may determine that the operation has been performed to the scats, when the similarity for each of the respective microphones for the seats is the predetermined value or higher.
This configuration achieves further improvement in the accuracy of detecting the predetermined operation by using the microphones respectively arranged for the seats.
In the configuration, the chamber may include a plurality of seats, the at least one microphone may include a noise microphone and an error microphone arranged for each of the seats. This configuration may further include: a signal processor that generates a control signal by performing predetermined signal processing to a noise signal from the noise microphone by using a control coefficient updated on the basis an error signal from the error microphone; and a speaker that is arranged for each seat to output the control signal from the signal processor.
According to this configuration, each of the noise microphone and the error microphone applicable to an active noise control serves as a microphone for detecting an operation sound, and thus contributes to realization of a size reduction and cost saving.
A computer-readable recording medium that records a program according to another aspect of the present disclosure includes: causing a computer provided in an operation situation detection device that includes: at least one microphone that is provided in a chamber to detect a first operation sound which is an operation sound occurring when a predetermined operation is performed in the chamber; a memory that stores in advance a second operation sound which is a typical sound likely to occur when the operation is performed, to serve as: a calculator that calculates a similarity between the first operation sound and the second operation sound; and a determinator that determines that the operation has been performed, when the similarity is a predetermined value or higher.
According to this configuration, the determinator determines that the operation has been performed, when the similarity between the first operation sound detected by the microphone and the second operation sound stored in the memory in advance is the predetermined value or higher. The comparison between the operation sounds results in achieving detection concerning actual performance of the operation with a high accuracy.
An operation situation detection method according to another aspect of the disclosure includes: by an operation situation detection device that includes: at least one microphone that is provided in a chamber to detect a first operation sound which is an operation sound occurring when a predetermined operation is performed in the chamber; and a memory that stores in advance a second operation sound which is a typical sound likely to occur when the operation is performed, calculating a similarity between the first operation sound and the second operation sound; and determining that the operation has been performed, when the similarity is a predetermined value or higher.
According to this configuration, the operation situation detection device determines that the operation has been performed, when the similarity between the first operation sound detected by the microphone and the second operation sound stored in the memory in advance is the predetermined value or higher. The comparison between the operation sounds results in achieving detection concerning actual performance of the operation with a high accuracy.
This disclosure can be realized as a program for causing a computer to execute each distinctive feature included in such a device described above, or realized as a system caused to operate by the program. Additionally, it goes without saying that the computer program is distributable as a non-transitory computer readable storage medium like a CD-ROM, or distributable via a communication network like the Internet.
Hereinafter, an embodiment of the disclosure will be described with reference to the accompanying drawings. The elements given the same reference numerals in different drawings are defined to be the same or corresponding elements.
The embodiment which will be described below represents a specific preferable example of the disclosure.
In the embodiment described below, an active noise control (hereinafter, abbreviated as “ANC”) to reduce a noise around a passenger sitting on a seat is exemplified for arrangement of a microphone to detect an operation sound, but the disclosure is not limited thereto.
Further, constituent elements, arrangement and connection of the constituent elements, an operation order, and the like shown in the embodiment described below are mere examples, and do not intend to limit the present disclosure. The present disclosure is defined by the scope of claims.
Moreover, constituent elements which are not recited in the independent claims each showing the broadest concept among the constituent elements in the embodiment are not indispensable to achieve the object of the present disclosure but are described as selectable constituent elements.
A configuration of an operation situation detection device according to the embodiment of the disclosure will be described.
Referring to
Detection of an operation of replacing rest covers 101 (101a, 101b) respectively put on headrests of the seats 100a, 100b will be explained with reference to
Referring to
A sound data memory 40 stores in advance sound data related to a typical operation sound likely to occur in the replacement operation of the rest cover 101. The similarity calculator 22d calculates a similarity between the signal concerning the operation sound received from the microphone 2d via the sound detector 21d and the sound data from the sound data memory 40. An operation determinator 30b receives a signal indicating a result of the calculation by the similarity calculator 22d. The operation determinator 30b determines that “the replacement operation of the rest cover 101b of the seat 100b has been performed” when the similarity received from the similarity calculator 22d is a predetermined value or higher. An operation progress checker 50 receives a signal indicating a result of the determination by the operation determinator
Here, the seat 100b is provided with a pair of microphones 2c, 2d across the rest cover 101b from which the operation sound occurs. The microphone 2c also detects an operation sound in the replacement operation of the rest cover 101b in the same manner as the microphone 2d. A similarity calculator 22c calculates, in the same manner as the similarity calculator 22d, a similarity between a signal concerning the operation sound received from the microphone 2c via a sound detector 21c and the sound data from the sound data memory 40. The operation determinator 30h receives a signal indicating a result of the calculation by the similarity calculator 22c. The operation determinator 30b determines that “the replacement operation of the rest cover 101b of the seat 100b has been performed” when each of the similarities received from the similarity calculators 22c, 22d is a predetermined value or higher. By contrast, when at least one of the similarities received from the similarity calculators 22c, 22d falls below the predetermined value, the operation determinator 30b determines that “the replacement operation of the rest cover 101b of the seat 100b has not been performed.” Use of both the signals concerning the sounds from the microphones 2c, 2d in this manner leads to improvement in an accuracy of determination by the operation determinator 30b as to whether the operation has been performed.
Here, a way of calculating a similarity by a similarity calculator 22 will be described.
For more mathematical calculation of the similarity, a way of calculating a vector distance between the signal concerning the operation sound and typical sound data may be adopted. The similarity is higher as the vector distance is shorter. For instance, a cepstrum distance may be used for the obtained frequency characteristics as shown in
As described above, each of the similarity calculators 22c, 22d calculates the similarity between the signal concerning the operation sound in the replacement operation of the rest cover 101b and the typical sound data from the sound data memory 40, and the operation determinator determines that the replacement operation of the rest cover 101b has been performed, when the similarity is the predetermined value or higher.
Here, external noises, air conditioning sounds or noises, and other noises and sounds cooccur as background noises (background noise characteristics K3A) shown in
To avoid the failure, a frequency band ΛR1 in which a difference between a signal level about the typical sound data and the signal level of the signal concerning the background noise is sufficiently ensured is defined by thresholds Th1L, Th1H as shown in
Consequently, the time of the occurrence of the operation sound in the replacement operation of the rest cover 101 is detectable with a high probability, and an appropriate result of the calculation of the similarity by the similarity calculator 22 is also obtainable.
The sound detector 21 may determine the occurrence of the operation sound in the replacement operation of the rest cover 101 when the frequency samples whose signal level is on the second threshold Th2 or higher and the number of which is at a ratio on a third threshold Th3 or higher with respect to a total number of frequency samples falling within the frequency band AR1 from the thresholds Th1L to Th1H of the signal concerning the detected sound. This achieves improvement in the accuracy of detecting the targeted operation sound. The threshold Th3 may be set to, for example, 80%.
The thresholds Th1L, Th1H, and the threshold Th2 shown in
Referring to
Furthermore, the operation progress checker 50 checks or manages operation situations of various kinds of operations including: a cleaning operation of a table 112a allotted to each seat; a cleaning operation of the luggage rack 1400; a cleaning operation of a base of each seat with a table broom; a cleaning operation of a floor like an isle with a vacuum cleaner or a buffing machine; and an operation of rotating one or more seats to align in the same direction; and an operation of returning a seat reclined at a specific angle to its original position, in addition to the replacement operation of each rest cover 101.
For instance, in the cleaning operation of the table 112a shown in
For instance, in the cleaning operation of the luggage rack 1400 located above the seat 100a as shown in
A similarity between an operation sound detected by a microphone located near a place from which a target operation sound is likely to occur and typical sound data related to the operation and stored in the sound data memory 40 is calculated in the same manner for another operation, such as the cleaning operation of each seat base, the cleaning operation of the floor, the operation of rotating a seat, or the operation of returning a seat reclined at a specific angle to its original position. Here, a process described below is applied to such an operation which is not necessarily required for all the seats in the vehicle as the operation of rotating a seat or the operation of returning a seat reclined at a specific angle to is original position. For instance, the operation determinator 30 determines no performance of each of the operations in the vehicle when no operation sound concerning each of the operations is detected in the vehicle, and determines performance of each of the operations in the vehicle when an operation sound in each of the operations is detected even at only one location in the vehicle.
The operation progress checker 50 determines a performance situation of each of the operations on the basis of the calculated similarity concerning each operation, and checks a progress state of each of all the operations in the train 1000. The operation progress checker 50 sends a signal indicating the progress state of each of all the operations to the progress display device 60 to cause the progress display device 60 to display the progress state on a screen thereof. In this manner, an operation manager who manages the entire cleaning of each chamber in the train 1000 can grasp the progress state of each operation in each vehicle at a glance. Therefore, in a case where a delay occurs in a certain operation in a certain vehicle, an instruction of requesting an operator who smoothly proceeds with the operation to give assistance at a location where the delay occurs to complete the operation within a limited time. This results in attainment of entirely improved work efficiency in the train 1000. A way of presenting information indicating a progress state of each of all the operations is not limited to the displaying on the screen of the progress display device 60, and the information may be displayed with a voice output.
A signal may be transmitted from the operation progress checker 50 to the progress display device 60 wirelessly or by using a fixed network system which is established in the train 1000. In the wireless transmission, the progress display device 60 may be a portable device carriable by the operation manager. In the transmission using the fixed network system, the progress display device 60 may be a display device provided in a place where the operation manager is located, or a way of connecting the portable device carried by the operation manager to the fixed network system via a hub may be adopted.
Here, the operation situation detection device shown in
In the ANC system, each microphone 1 (1a to 1l) includes a noise microphone to detect a noise signal, and each microphone 2 (2a to 2d) includes an error microphone to detect an error signal. The noise control filter 500 causes a signal processor 501 to perform signal processing to the noise signal detected by the noise microphone 1 to reduce a noise at an arrangement position of the error microphone 2, and regenerates the signal as a control sound (control signal) from each speaker 3 (3a to 3d). The running noise and the control sound interfere with each other at the arrangement position of the error microphone 2, and the error microphone 2 detects a resultant residual signal (error signal). Normally, the noise control filter 500 updates its control coefficient by performing adaptive signal processing to minimize the error signal. Repetitive execution of the processing leads to minimization of the error signal and obtaining of a control coefficient to reduce the running noise.
The ANC will be described in more detail.
In
Here, the transmission characteristics modifier 502 presets, as the coefficient, the transmission characteristics from the speaker 3 to the error microphone 2.
The transmission characteristics modifier 502 performs the signal processing to the noise signal detected by the noise microphone 1 with the coefficient set in this manner, and a coefficient updater 503 receives a signal output from the modifier.
The coefficient updater 503 updates the coefficient of the signal processor 501 to minimize the error signal by performing adaptive signal processing, such as least squares or learning identification, using the signal from the transmission characteristics modifier 502 and the error signal from the error microphone 2. Sequential repetition of the adaptive signal processing leads to minimization of the error signal and obtaining of an optimal control coefficient to reduce the running noise. As a result of the obtaining of the control coefficient of the signal processor 501, the running noise at the arrangement position of the error microphone 2 is minimized.
As described heretofore, in a case where an ANC system already includes the noise microphone 1, the error microphone 2, the speaker 3, and the noise control filter 500, each of the already included noise microphone 1 and error microphone 2 is adoptable as a microphone for an operation situation detection device to achieve a size reduction and cost saving of the system. The ANC system utilizes many microphones, and accordingly realizes checking of a progress state of various kinds of cleaning operations at respective locations in a chamber.
When audio services are focused without limitation to the ANC system, for example, such a system utilizing many microphones as a sound field control system to control a wide area, a directional control system, or a wavefront control system is available in combination with an operation situation detection device.
Although the embodiment exemplifies an application of the device in a train, the application is not limited thereto, and the device may be applied in an aircraft, a vessel, a theater, a movie theater, or other vehicle or facility. In a case of transportation means for many passengers, like a train, an aircraft, or a vessel, it is necessary to complete a cleaning operation in a chamber within a limited time from leaving of current passengers to next boarding or getting-on of subsequent passengers. The operation situation detection device according to the embodiment enables reliable grasping of a progress state of the cleaning operation, and thus, attains entirely improved work efficiency by giving assistance at a location where a delay occurs in the operation. Similarly, in a chamber for providing many people with simultaneous viewing services, e.g., in a theater or a movie theater, it is necessary to complete a cleaning operation in the chamber within a limited time from a finish of an ongoing play or movie and leaving of current spectators to a start of the next play or movie and entering of the next spectators. The operation situation detection device according to the embodiment enables reliable grasping of a progress state of the cleaning operation, and thus, attains entirely improved work efficiency by giving assistance at a location where a delay occurs in the operation.
The present disclosure is particularly applicable to an operation situation detection device that detects a progress state of a cleaning operation or other operation in a chamber including a plurality of seats in a train, an aircraft, a vessel, a theater, a movie theater, or other vehicle or facility.
Number | Date | Country | Kind |
---|---|---|---|
2021-037214 | Mar 2021 | JP | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2021/046714 | Dec 2021 | US |
Child | 18242856 | US |