The application is a National Stage Patent Application under 35 U.S.C. § 371 of PCT International Patent Application No. PCT/CN2019/094569 which was filed on Jul. 3, 2019, which claims the priority of a Chinese application 201810815645.9 which was filed with the Chinese patent office on Jul. 24, 2018 and titled as “A noise reduction headset having multi-microphone and a noise reduction method”, and the entire contents thereof are all incorporated herein by reference.
The application relates to the field of noise reduction of headsets. More specifically, the application relates to a noise reduction headset having multi-microphone and a noise reduction method.
The conventional headphone, especially the headset, generally has an uplink noise reduction function. The uplink noise reduction function mainly eliminates the local environmental noise as much as possible when a user makes a call by using the headset, and ensures that the voice signal is transmitted to the opposite end as clearly as possible to ensure the call quality.
Currently, the uplink noise reduction of the headset is mainly realized by a single microphone or a dual microphone cooperating with a noise reduction algorithm. Wherein, the general principle of combining the dual microphone with the noise reduction algorithm is as follows: In a dual microphone, the main microphone is located close to the target sound source, i.e., the user's mouth, and the auxiliary microphone is located farther away from the user's mouth. Since a certain distance exists between the main microphone and the auxiliary microphone, but the certain distance is not too far, and since the distance between the user's mouth and the main microphone and the auxiliary microphone is far less than the distance between the noise source in the surrounding environment and the main microphone and the auxiliary microphone, the noise signals in the surrounding environment in the sound signals picked up by the main microphone and the auxiliary microphone are not different. When the user wears the headset in a normal wearing manner as shown in
The noise reduction performance of the dual microphone combined with the noise reduction algorithm depends largely on the position of the main and auxiliary microphones. In particular, on the one hand, the distance between the main microphone and the auxiliary microphone is relatively far, usually not less than 20 mm. On the other hand, the angle between the line between the main microphone and the auxiliary microphone and the line between the main microphone and the mouth of the user should be sufficiently small, and ideally the angle is zero, that is, the line between the auxiliary microphone, the main microphone and the target sound source forms a straight line. In summary, the distance between the main microphone and the auxiliary microphone is large, and the included angle is small, so that the noise reduction performance is good.
With respect to the connection line between the main microphone and the auxiliary microphone and the connection line between the main microphone and the mouth of the user, the headset is designed so that the connection lines of the auxiliary microphone, the main microphone and the target sound source form a straight line when the user wears the headset in a normal wearing manner as shown in
Accordingly, there is a need to provide a noise reduction headset having multi-microphone and a noise reduction method for ensuring noise reduction performance, particularly in the case where a user does not normally wear the headset.
It is an object of the present application to provide a noise reduction headset having multi-microphone and a multi-microphone noise reduction method for ensuring noise reduction performance, in particular, when a user is not normally wearing a headset.
To achieve the above object, the present application adopts the following technical solution:
A first aspect of the present application provides a noise reduction headset having multi-microphone comprising a headband and headset bodies respectively connected to both ends of the headband, wherein the headset further comprises a microprocessor and at least three microphones disposed on an outer surface of the headset body;
The microprocessor is configured to select the microphone closest to a target sound source as a main microphone according to a comparison of sound signals picked up by respective microphones, select the microphone farthest from the main microphone as an auxiliary microphone according to a preset relative position of respective microphones, and execute a noise reduction algorithm by using a first sound signal picked up by the main microphone and a second sound signal picked up by the auxiliary microphone as inputs of the noise reduction algorithm so as to realize noise reduction.
In some embodiments, the at least three microphones are respectively arranged on an edge of the outer surface of the headset body.
In some embodiments, the noise reduction headset having multi-microphone comprises at least four microphones, wherein the at least four microphones are circumferentially and uniformly distributed on the edge of the outer surface of the headset body.
In some embodiments, the microprocessor is configured to fuse and compare the sound signals picked up by the microphones other than the main and auxiliary microphones with the second sound signal picked up by the auxiliary microphone according to the preset relative positions of the microphones, so as to obtain the virtually picked-up fused sound signal from the position of the edge of the outer surface of the headset body remote from the main microphone in the extension line of the line between the main microphone and the target sound source, and use the first sound signal and the fused sound signal as inputs of the noise reduction algorithm.
In some embodiments, at least one other microphone is arranged in the vicinity of the auxiliary microphone.
A second aspect of the present application provides a multi-microphone noise reduction method comprising:
arranging at least three microphones on the outer surface of the headset body;
selecting the microphone closest to a target sound source as a main microphone according to a comparison of sound signals picked up by respective microphones, selecting the microphone farthest from the main microphone as an auxiliary microphone according to a preset relative position of respective microphones, and executing a noise reduction algorithm by using a first sound signal picked up by the main microphone and a second sound signal picked up by the auxiliary microphone as inputs of the noise reduction algorithm so as to realize noise reduction.
In some embodiments, the arranging at least three microphones on the outer surface of the headset body further comprises arranging at least three microphones on the edge of the outer surface of the headset body.
In some embodiments, the arranging at least three microphones on the edge of the outer surface of the headset body further comprises circumferentially and uniformly distributing at least four microphones on the edge of the outer surface of the headset body.
In some embodiments, the method further comprises:
fusing and comparing the sound signals picked up by the microphones other than the main and auxiliary microphones with the second sound signal picked up by the auxiliary microphone according to the preset relative position of the microphones, so as to obtain the virtually picked-up fused sound signal from the position of the edge of the outer surface of the headset body remote from the main microphone in the extension line of the line between the main microphone and the target sound source, and use the first sound signal and the fused sound signal as inputs of the noise reduction algorithm.
Advantageous effects of the present application are as follows:
According to the technical solution of the present application, the noise reduction performance can be ensured, and in particular, the noise reduction performance can be ensured when the user wears the headset abnormally.
A more detailed description of an embodiment of the present application is given below in conjunction with the accompanying drawings.
The technical solution of the embodiments of the present application will be described with reference to the accompanying drawings. Apparently, the embodiments described below are merely a portion of but not all-inclusive embodiments. Based on the embodiments of the application, other embodiments obtained by those skilled in the art without any inventive efforts are also included in the protection scope of the application.
As shown in
The microprocessor is configured to select the microphone 30 closest to the target sound source as the main microphone by comparing sound signals respectively picked up by the at least three microphones, select the microphone 30 farthest from the main microphone as the auxiliary microphone according to the preset relative positions of the microphones 30, use the first sound signal picked up by the main microphone and the second sound signal picked up by the auxiliary microphone as inputs of a noise reduction algorithm, and execute the noise reduction algorithm to reduce noise.
Wherein the sound signals picked up by the microphones 30 include a target sound signal emitted by the target sound source and a noise signal generated by the noise source in the surrounding environment, and the comparison of the sound signals picked up by the microphones 30 can be made in accordance with one or more of an amplitude difference, a time difference, and a phase difference of the waveforms of the sound signals. The noise reduction algorithm may employ various algorithms such as a delay-accumulation method (conventional beam method), an adaptive beam method, and a microphone array method based on post-adaptive filtering, which are not limited in the present embodiment.
As shown in
According to the noise reduction headset having multi-microphone provided in the present embodiment, at least three microphones 30 are arranged, and the microphone 30 closest to the target sound source is selected as the main microphone, and the microphone 30 farthest from the main microphone is selected as the auxiliary microphone according to the preset relative position of each microphone 30. In comparison with the conventional dual microphone, in the case of abnormal wearing by the user, it is possible to make the included angle between the connection line between the main microphone and the auxiliary microphone and the connection line between the main microphone and the target sound source (for example, the mouth of the user) be reduced, or to arrange the auxiliary microphone approximately on the extended line of the connection line between the main microphone for picking up the target sound signal emitted by the target sound source and the target sound source (most desirably, on the connection line between the auxiliary microphone, the main microphone and the target sound source forms a straight line), so that the two sound signals picked up by the main microphone and the auxiliary microphone according to which the microprocessor performs the noise reduction algorithm are more compatible with the theoretical angle of the noise reduction algorithm, and the noise reduction performance is better. The noise reduction headset having multi-microphone provided by the present embodiment is suitable for various environments, in particular, environments where noises are high, such as bars, farmers' markets, machinery processing plants, and the like.
In some alternative implementations of the present embodiment, at least three microphones 30 are arranged at the edge of the outer surfaces of the headset body 20, respectively. With this implementation, it can be ensured that the distance between the main microphone and the auxiliary microphone is as far as possible, and two sound signals picked up by the main microphone and the auxiliary microphone according to which the microprocessor performs the noise reduction algorithm are more compatible with the theoretical angle of the noise reduction algorithm, and the noise reduction performance is better.
In some alternative implementations of the present embodiment, as shown collectively in
In some alternative implementations of the present embodiment, the microprocessor fuses and compares the sound signals picked up by the microphones other than the main and auxiliary microphones with the second sound signal picked up by the auxiliary microphone according to the preset relative positions of the microphones 30, so as to obtain the virtually picked-up fused sound signal from the position of the edge of the outer surface of the headset body 20 remote from the main microphone in the extension line of the line between the main microphone and the target sound source, and use the first sound signal and the fused sound signal as inputs of the noise reduction algorithm. According to this implementation, the angle between the line between the main microphone and the auxiliary microphone and the line between the main microphone and the target sound source cannot be approximately zero when the user wears the headset abnormally, thus, the sound signals picked up by the other microphones and the second sound signal picked up by the auxiliary microphone are fused and compared according to the fixed preset relative positions of the microphones 30, so as to obtain the virtually picked-up fused sound signal from the position of the edge of the outer surface of the headset body 20 remote from the main microphone in the extension line of the line between the main microphone and the target sound source, and the noise reduction algorithm is executed by using the first sound signal and the fused sound signal as inputs of the noise reduction algorithm, thereby improving the noise reduction performance. Specifically, an amplitude difference, a time difference or a phase difference of a target sound signal emitted from a target sound source in a sound signal picked up by respective microphone 30 may be compared and fused, the fused amplitude difference, the fused time difference or the fused phase difference (usually using the time difference or the phase difference) in combination with a preset relative position of respective microphone 30 (a constant relative distance between the adjacent microphones 30 and a constant included angle between the lines between one microphone and adjacent microphones caused by a constant preset relative position) is analyzed to obtain information such as an estimated sound signal waveform of respective position on the outer surface of the headset body 20 in an extension line of a connection line between the main microphone and the target sound source, so as to estimate a virtually picked-up fused sound signal from the position of the edge of the outer surface of the headset body 20 remote from the main microphone in the extension line of the line between the main microphone and the target sound source, also namely, an estimated sound signal of the position. The fused sound signal and the first sound signal are used as inputs to perform a noise reduction algorithm, and noise reduction performance is improved. It should be noted that this implementation is more suitable for improving the noise reduction performance in the condition that the angle between the line between the main microphone and the auxiliary microphone and the line between the main microphone and the user's mouth is increased by a limited amplitude when rotating the headset body 20.
In some alternative implementations of the present embodiment, as shown in
Another embodiment of the present application provides a multi-microphone noise reduction method comprising:
arranging at least three microphones on the outer surface of the headset body;
selecting the microphone closest to a target sound source as a main microphone according to a comparison of sound signals picked up by respective microphones, selecting the microphone farthest from the main microphone as an auxiliary microphone according to a preset relative position of respective microphones, and executing a noise reduction algorithm by using a first sound signal picked up by the main microphone and a second sound signal picked up by the auxiliary microphone as inputs of the noise reduction algorithm so as to realize noise reduction.
In some alternative implementations of the present embodiment, arranging at least three microphones on the outer surface of the headset body further comprises arranging at least three microphones on the edge of the outer surface of the headset body.
In some alternative implementations of the present embodiment, arranging at least three microphones at the edge of the outer surface of the headset body further comprises uniformly distributing at least four microphones at the edge of the outer surface of the headset body circumferentially.
In some alternative implementations of this embodiment, the multi-microphone noise reduction method provided in this embodiment further comprises:
Fusing and comparing the sound signals picked up by the microphones other than the main and auxiliary microphones with the second sound signal picked up by the auxiliary microphone according to the preset relative positions of the respective microphones, so as to obtain the virtually picked-up fused sound signal from the position of the edge of the outer surface of the headset body 20 remote from the main microphone in the extension line of the line between the main microphone and the target sound source, and using the first sound signal and the fused sound signal as inputs of the noise reduction algorithm.
It should be noted that the multi-microphone noise reduction method provided in the present embodiment is similar to the principle and working flow of the noise reduction headset having multi-microphone provided in the foregoing embodiment. Reference may be made to the above description, and details are not described herein.
As shown in
The following components are connected to the I/O interface: an input portion including a keyboard, a mouse, and the like; an output portion including a liquid crystal display (LCD) or the like and a speaker or the like; a storage portion including a hard disk or the like; and a communication portion including a network interface card such as a LAN card, a modem, or the like. The communication portion performs communication processing via a network such as the Internet. The driver is also connected to the I/O interface as desired. A removable medium, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is mounted on the driver as required so that a computer program read therefrom is mounted into the storage portion as required.
In particular, according to the present embodiment, the process described in the flowchart above may be implemented as a computer software program. For example, the present embodiment includes a computer program product comprising a computer program tangibly embodied on a computer readable medium, wherein the computer program comprises program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network through the communication portion, and/or installed from a removable medium.
Flowcharts and schematic diagrams in the drawings illustrate architectures, functions, and operations of possible implementations of the systems, methods, and computer program products of the embodiments. In this regard, each block in a flowchart or diagram may represent a module, program segment, or portion of code that contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in an order different from that noted in the drawings. For example, two successively represented blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functionality involved. It is also noted that each block in the schematic and/or flowchart illustrations, and combinations of blocks in the schematic and/or flowchart illustrations, may be implemented with a dedicated hardware-based system that performs the specified functions or operations, or may be implemented with a combination of dedicated hardware and computer instructions.
As another aspect, the present embodiment further provides a non-volatile computer storage medium, which may be a non-volatile computer storage medium included in the above-described apparatus in the above-described embodiment, or a non-volatile computer storage medium which exists separately and is not installed in a terminal. The non-volatile computer storage medium stores one or more programs that, when executed by a device, cause the device to:
select the microphone closest to a target sound source as a main microphone according to a comparison of sound signals picked up by respective microphones, select the microphone farthest from the main microphone as an auxiliary microphone according to a preset relative position of respective microphones, and execute a noise reduction algorithm by using a first sound signal picked up by the main microphone and a second sound signal picked up by the auxiliary microphone as inputs of the noise reduction algorithm so as to realize noise reduction.
In the description of the present application, it is to be noted that orientation relation or position relation represented by the terms “on” and “under” is only the orientation relation or position relation shown in the drawings, which is illustrative but not limited, that is to say, it does not indicate or imply that the device or element indicated must have the specific orientation, or must be constructed or handled in such specific orientation; Unless expressly stated and defined otherwise, the terms “mount” and “connect” are to be understood in a broad sense, for example, as a fixed connection, as a detachable connection, or as an integrated connection; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected by means of an intermediate medium, and it may be internal communication of the two elements. The specific meaning of the above terms in the present application may be understood by one of ordinary skill in the art, depending on the specific circumstances.
It should also be noted that in the description of the present application, relational terms such as first and second and the like are used merely to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying any such actual relationship or order between such entities or operations. Moreover, the terms “comprise” “include” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus. Without more limitations, the element defined by the statement “comprising a/an” does not exclude the condition that there are additional identical elements in a process, method, article, or apparatus that includes the elements.
Obviously, the above-described embodiments of the present application are merely illustrative of the present application and are not intended to limit the embodiments of the present application. Those skilled in the art, on the basis of the above description, will be able to make other variations or variations, which are not intended to be exhaustive of all the embodiments, and obvious variations or variations, which fall within the scope of the present application, may be made.
Number | Date | Country | Kind |
---|---|---|---|
201810815645.9 | Jul 2018 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2019/094569 | 7/3/2019 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/019956 | 1/30/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20100081487 | Chen | Apr 2010 | A1 |
20170238109 | Gong | Aug 2017 | A1 |
Number | Date | Country | |
---|---|---|---|
20210144469 A1 | May 2021 | US |