Patent Application
20200145748
The present invention relates to a method of decreasing the effect of an interference sound; more particularly, the present invention relates to a method of decreasing the effect of an interference sound by means of eliminating the interference sound.
Early types of hearing aids were equipped with only a single microphone for picking up sounds. As a result, a hearing impaired person would always hear the same sound whether the sound was outputted from a first speaker or a second speaker. To help the hearing impaired person to experience more true-to-life sounds, current hearing aids are commonly equipped with two microphones, and the microphones are respectively located next to the left ear and the right ear of the hearing impaired person while in use.
Furthermore, some existing portable devices such as smart phones or tablet computers are equipped with two microphones, which are usually disposed respectively at the top end and the bottom end of the device and spaced a certain distance apart.
Moreover, although the arrangement of two microphones can significantly enhance the range and effect of picking up sounds, it often comes with a side effect of collecting interference sounds from the surrounding environment, which can result in unclear speech content. Therefore, an important focus of research and development of hearing aids is to eliminate or lower the volume of the interference sounds.
Therefore, there is a need to provide a method of decreasing the effect of an interference sound and a sound playback device to mitigate and/or obviate the aforementioned problems.
It is an object of the present invention to provide a method of decreasing the effect of interference sounds, and a sound playback device for executing the same.
To achieve the abovementioned objects, the method of decreasing the effect of an interference sound of the present invention is applied to a sound playback device. The sound playback device includes a first microphone and a second microphone. The method of decreasing the effect of an interference sound of the present invention comprises the following steps: receiving an input sound by the first microphone and the second microphone to respectively acquire a first sound signal and a second sound signal; determining and acquiring a plurality of sound source position data according to a phase difference between a plurality of sound frames of at least one position low-frequency sound signal of the first sound signal and a plurality of sound frames of at least one position low-frequency sound signal of the second sound signal; determining a probability that a main direction of the input sound is in accordance with a target orientation according to each of the sound source position data; and adjusting, according to the probability that the main direction of the input sound is in accordance with the target orientation, the sound volume of low-frequency sound signals of the first sound signal and the second sound signal being outputted.
The sound playback device of the present invention comprises a first microphone, a second microphone and a microcontroller. The first microphone is used for receiving an input sound to acquire a first sound signal. The second microphone is used for receiving the same input sound to acquire a second sound signal. The microcontroller is electrically connected to the first microphone and the second microphone. The microcontroller comprises a low-frequency sound signal analysis module, a computing module and a low-frequency sound signal processing module. The low-frequency sound signal analysis module is used for determining and acquiring a plurality of sound source position data according to a phase difference between a plurality of sound frames of at least one position low-frequency sound signal of the first sound signal and a plurality of sound frames of at least one position low-frequency sound signal of the second sound signal. The computing module is used for determining a probability that a main direction of the input sound is in accordance with a target orientation according to each of the sound source position data. The low-frequency sound signal processing module is used for adjusting, according to the probability that the main direction of the input sound is in accordance with the target orientation, the sound volume of low-frequency sound signals of the first sound signal and the second sound signal being outputted.
Other objects, advantages, and novel features of the invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
These and other objects and advantages of the present invention will become apparent from the following description of the accompanying drawings, which disclose several embodiments of the present invention. It is to be understood that the drawings are to be used for purposes of illustration only, and not as a definition of the invention.
In the drawings, wherein similar reference numerals denote similar elements throughout the several views:
Please refer to
As shown in
In one embodiment of the present invention, the first microphone 10 and the second microphone 20 can receive an input sound 90A or 90B from an external environment. After the first microphone 10 receives the input sound 90A or 90B, it will generate and acquire a first sound signal 91. After the second microphone 20 receives the input sound 90A or 90B, it will generate and acquire a second sound signal 92.
In one embodiment of the present invention, the microcontroller 30 is electrically connected to the first microphone 10 and the second microphone 20. The microcontroller 30 comprises a low-frequency sound signal analysis module 31, a computing module 33, a low-frequency sound signal processing module 35 and a filtering module 37. Please note that each of the abovementioned modules can be accomplished by a hardware device, a software program, a firmware or a combination thereof, and that it can also be configured in the form of a circuit loop or other suitable format. Furthermore, each of the modules can be configured either in an independent form or in a combined form. In one preferred embodiment, each module is a software program which can be stored in a memory (not shown in the figures) of the microcontroller 30 such that a processor (not shown in the figures) of the microcontroller 30 can execute each module to achieve the object of the present invention. Moreover, the embodiment disclosed herein only describes a preferred embodiment of the present invention. To avoid redundant description, not all possible variations and combinations are described in detail in this specification. However, those skilled in the art will understand that the above modules or components are not all necessary parts. Also, to implement the present invention, other more detailed known modules or components might also be included. It is possible that each module or component can be omitted or modified depending on different requirements, and it is also possible that other modules or components might be disposed between any two modules.
In one embodiment of the present invention, the low-frequency sound signal analysis module 31 is used for determining and acquiring a plurality of sound source position data according to a phase difference between a plurality of sound frames of a plurality of position low-frequency sound signals of the first sound signal 91 and a plurality of sound frames of a plurality of position low-frequency sound signals of the second sound signal 92. In a specific embodiment of the present invention, the frequency of the position low-frequency sound signal is, but not limited to, between 500 Hz and 1500 Hz. The process of the low-frequency sound signal analysis module 51 determining and acquiring the sound source position data will be described in more detail below; therefore, there is no need for further description in this paragraph.
In one embodiment of the present invention, the computing module 33 is used for determining a probability that a main direction of the input sound 90A or 90B is in accordance with a target orientation according to each of the sound source position data. The process of the computing module 33 determining the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation will be described in more detail below; therefore, there is no need for further description in this paragraph.
In one embodiment of the present invention, the low-frequency sound signal processing module 35 is used for adjusting, according to the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation, the sound volume of low-frequency sound signals of the first sound signal 91 and the second sound signal 92 being outputted. The higher the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation is, the lesser the sound volume of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92 being outputted is adjusted and lowered. In a specific embodiment of the present invention, the low-frequency sound signals refers to, without limiting the scope of the present invention, a sound signal with a frequency below 4000 Hz. The process of adjusting the sound volume of the sound signal according to the probability will be described in more detail below; therefore, there is no need for further description in this paragraph.
In one embodiment of the present invention, the filtering module 37 is used for recording a sound volume change of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92 and performing a smoothing process. The process of performing the smoothing process on the low-frequency sound signals will be described in more detail below; therefore, there is no need for further description in this paragraph.
In one embodiment of the present invention, the first speaker 40 is used for playing back sound according to a received left output sound signal 81, wherein the first output sound signal 81 is generated by the microcontroller 30 by means of processing the first sound signal 91 and the second speaker 50 is used for playing back sound according to a received second output sound signal 82, wherein the right output sound signal 82 is generated by the microcontroller 30 by means of processing the second sound signal 92.
Next, please refer to
First, performing step S1: receiving an input sound 90A or 90B by a first microphone 10 and a second microphone 20 to respectively acquire a first sound signal 91 and a second sound signal 92.
When the user uses the sound playback device 1 of the present invention, the first microphone 10 and the second microphone 20 can be used to receive the input sound 90A or 90B from an external environment. After the first microphone 10 receives the input sound 90A or 90B, it will generate and acquire the first sound signal 91. After the second microphone 20 receives the input sound 90A or 90B, it will generate and acquire the second sound signal 92. The first sound signal 91 and the second sound signal 92 will both be transmitted to the microcontroller 30.
Performing step S2: determining and acquiring a plurality of sound source position data according to a phase difference between a plurality of sound frames of a plurality of position low-frequency sound signals of the first sound signal 91 and a plurality of sound frames of a plurality of position low-frequency sound signals of the second sound signal 92.
When the user uses the sound playback device 1 of the present invention, the first microphone 10 and the second microphone 20 will be respectively disposed at two relative ends at a distance of L centimeters, where 7≤L≤40. Because the time of transmitting a sound wave to the first microphone 10 and to the second microphone 20 might be different, the main direction of the input sound 90A and 90B can be determined by means of comparing the phase difference between the first sound signal 91 and the second sound signal 92.
If the wavelength of the sound signal is shorter than the distance between the first microphone 10 and the second microphone 20, it will result in difficulty of determining the signals to be compared. Therefore, in this embodiment, the low-frequency sound signal analysis module 31 of the microcontroller 30 of the present invention will only use, from the first sound signal 91 and the second sound signal 92, sound signals having their frequencies within a specific range (i.e., the position low-frequency sound signals) for position determination. In a specific embodiment of the present invention, the frequency of the position low-frequency sound signal is selected from, without limiting the scope of the present invention, 500, 700, 900, 1100, 1300 and 1500 Hz.
Furthermore, to determine the source orientation of the input sound 90A or 90B more precisely, the low-frequency sound signal analysis module 31 of the microcontroller 30 of the present invention will further take samples of a plurality of sound frames of each of the position low-frequency sound signals. For example, the present invention takes samples of first ten sound frames of each of the position low-frequency sound signals from the first sound signal 91 and the second sound signal 92 as determination data.
As a result, the low-frequency sound signal analysis module 31 of the microcontroller 30 of the present invention analyzes and determines whether the input sound 90A or 90B originates from the target orientation according to a phase difference between the same sound frames at the same frequency of the position low-frequency sound signals of the first sound signal 91 and the second sound signal 92 so as to determine and acquire a plurality of sound source position data according to each of the determination results. In a specific embodiment of the present invention, if the first sound frames at 500 Hz of the position low-frequency sound signals of the first sound signal 91 and the second sound signal 92 indicate that the input sound 90A originates from the target orientation, the sound source position data having a code of “1” will be acquired; furthermore, if the second sound frames at 500 Hz of the position low-frequency sound signals of the first sound signal 91 and the second sound signal 92 indicate that the input sound 90B does not come from the target orientation, the sound source position data having a code “0” will be acquired. The corresponding sound source position data will be acquired according to the determination results by means of applying the same computation to the remaining sound frames. Likewise, the corresponding sound source position data of the position low-frequency sound signals at other frequency bands of the first sound signal 91 and the second sound signal 92 can also be acquired by means of applying the same computation.
Generally speaking, a talker and a listener will usually face each other during a conversation; in this case, if it is determined that the main direction of the input sound 90A received by the first microphone 10 and the second microphone 20 originates from the front of the user, the input sound 90A will be determined as not an interference sound; in contrast, if it is determined that the main direction of the input sound 90B does not come from the front of the user, the input sound 90B will be determined as an interference sound. Similarly, when a user holds a smart phone or a tablet computer to play an online game with others via the Internet, in the event that the user wants to talk to other garners, the user will also face the smart phone or the tablet computer and talk to its screen. Therefore, in the embodiment of the present invention, the abovementioned “target orientation” refers to a sector-shaped range extending in a front direction of the user from a center point of a straight line between the first microphone 10 and the second microphone 20, under the condition that the first microphone 10 and the second microphone 20 are respectively disposed at two relative ends, wherein the inclined angle θ of the sector is 40 degrees (as shown by dotted lines of
Performing step S3: determining a probability that a main direction of the input sound 90A or 90B is in accordance with a target orientation according to each of the sound source position data.
After the plurality of sound source position data are acquired in step S2, the computing module 33 of the microcontroller 30 of the present invention will determine the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation according to each of the sound source position data. In a specific embodiment of the present invention, as described above, if the plurality of sound source position data acquired from the first ten sound frames at 500 Hz of the position low-frequency sound signal from the first sound signal 91 and the second sound signal 92 are “1,0,1,1,1,1,0,1,0,1”, the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation is 70% (according to the computation of 7/10*100%). Likewise, according to the plurality of sound source position data acquired from the first ten sound frames at other frequency bands, the respective probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation can also be determined, for example, as 80%, 80%, 80%, 70% and 70%, respectively. Finally, the computing module 33 will calculate an average probability of the above 6 probabilities, which is 75% (according to the computation of (70+80+80+80+70+70)/6*%) for being determined as the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation.
Performing step S4: adjusting, according to the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation, the sound volume of low-frequency sound signals of the first sound signal 91 and the second sound signal 92 being outputted.
In a specific embodiment of the present invention, if the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation is 75%, the low-frequency sound signal processing module 35 of the microcontroller 30 will lower by 25% the sound volume of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92 being outputted. That is, the low-frequency sound signal processing module 35 will multiply an originally-outputted sound volume of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92 by the determined probability so as to determine an adjusted sound volume of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92. In other words, the higher the probability that the main direction of the input sound 90A or 90B is in accordance with the target orientation is, the less the sound volume of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92 being outputted will be adjusted and lowered. In a specific embodiment of the present invention, the low-frequency sound signal refers to a sound signal with a frequency below 4000 Hz. This means that only the sound volume of the sound signal with a frequency below 4000 Hz will possibly be adjusted. Please note that the method of adjusting the sound volume of the present invention is not limited to the above description. The sound volume can be adjusted according to different probabilities and respective definitions without limiting the method of multiplying the originally-outputted sound volume by the probability.
Performing step S5: recording a sound volume change of the low-frequency sound signals of the first sound signal and the second sound signal and performing a smoothing process.
Because a sudden drop in the sound signal at each frequency band will sound unnatural to the user, after step S4 is performed, the filtering module 37 of the microcontroller 30 of the present invention will record the sound volume change of the low-frequency sound signals of the first sound signal 91 and the second sound signal 92 and then perform a smoothing process. In a specific embodiment, the filtering module 37 can perform a smoothing process on the low-frequency sound signals according to the following formula:
Y(n)=Y(n)*α+Y(n−1)*(1−α);
where 0<α<1, and preferably α is 0.9; Y(n) refers to a current low-frequency sound signal; and Y(n−1) refers to a previous low-frequency sound signal. Because the smoothing process is a common technique used in the signal processing field and its related techniques and theories are widely published in many journals and articles, the present invention is not limited to using a particular algorithm and there is no need for further description.
According to the above description, when the method of decreasing the effect of an interference sound of the present invention is applied to a hearing aid, sounds outside of the target orientation can be eliminated or the sound volume of the sounds outside of the target orientation can be lowered such that the user of the hearing aid can more clearly hear speech from the talker. Furthermore, if the method of decreasing the effect of an interference sound of the present invention is applied to a smart phone or a tablet computer, upon usage of a smart phone during an online game session, sounds outside of the target orientation can be eliminated or the sound volume of the sounds outside of the target orientation can be lowered such that participants of the online game can more clearly hear speech from the talker.
Although the present invention has been explained in relation to its preferred embodiments, it is to be understood that many other possible modifications and variations can be made without departing from the spirit and scope of the invention as hereinafter claimed.
| Number | Date | Country | Kind |
|---|---|---|---|
| 107139180 | Nov 2018 | TW | national |
