1. Field of the Invention
The present invention relates to noise suppression and, more particularly, to noise suppression for multi-microphone sound pick-up systems.
2. Description of the Related Art
Suppressing interfere noise is still a major challenge for most communication devices involving a sound pick up system such as a microphone or a multi-microphone array. The multi-microphone array can selectively enhance sounds coming from certain directions while suppressing interferes coming from other directions. The pattern of the direction selection can be fixed or adaptive. Adaptive selection is more attractive because it intends to maximize SNR depending on the sound environment. However, because the relative low frequency range of audio applications, existing adaptation techniques are effective only for microphone array with large physical dimension. For applications where physical dimension is limited, such as the case in hearing aid applications, traditional adaptation using Finite-Impulse-Response (FIR) adaptive filtering techniques is not effective. As a result, most hearing aids that have directional processing can only give a fixed directional pattern which is effective in improving Signal-to-Noise Ratio (SNR) in some conditions but less effective in other conditions.
a)-2(c) illustrate polar patterns of a directional processing system corresponding to three different delay values. The term “polar pattern” has often been used to describe the characteristics of a directional processing system. The physical distance between the two microphones of the directional processing system is fixed. When a sound source is at 0 degrees, which is the direction along the axis of the two microphones and on the side of the front microphone, the directional processing system has a maximum output. When the sound source is away from 0 degrees, the output is reduced. The direction at which the output of the directional processing system has a maximum reduction is called directional null. Ideally, the directional null occurs at the direction of an unwanted noise source. The location of the directional null is related to the value of the delay. If the noise source is in the direction of 180 degrees, the delay should be set to a value so that the polar pattern is a cardioids with the directional null at 180 degrees (see
delay=d/c*cos(180°−q),
where d is distance of the two microphones, c is sound propagation speed, and q is direction angle in degree of the noise source.
One problem with conventional noise suppression approaches is that the direction of a noise source to be suppressed by the directional processing is often unknown. Conventionally, the estimating of the direction of a noise source is difficult because the frequency of audio sounds is relative low. The direction of the noise source is often merely a rough estimate from which a delay is then fixed to provide directional processing. In fact, most hearing aids currently available in the market merely set the delay to a fixed value so that directional processing has a fixed polar pattern for all conditions. Unfortunately, the noise suppression of such devices is often inadequate because the noise source is often at a direction other than that corresponding to the fixed delay.
Thus, there is a need for improved approaches to directional processing by adapting a directional null according to the direction of interfering noise source.
Broadly speaking, the invention relates to improved approaches adaptively suppress interfering noise in a multi-microphone directional system. These approaches operate to adapt the direction null for the multi-microphone directional system. These approaches are particularly useful for hearing aid applications in which directional noise suppression is important.
One aspect of the invention pertains to techniques for adjusting a delay adaptively so that a directional null is placed in the direction of a dominant noise source. This would produce maximum Signal-to-Noise Ratio (SNR) improvement across all conditions. In other words, the dominant noise source is attenuated (e.g., suppressed) but the desired sound from a particular direction is not attenuated
The invention can be implemented in numerous ways including as a method, system, apparatus, device, and computer readable medium. Several embodiments of the invention are discussed below.
As an adaptive directional sound processing system, one embodiment of the invention includes at least: a least two microphones spaced apart by a predetermined distance, each of said microphones producing an electronic sound signal; a delay circuit that delays the electronic sound signal from at least one of said microphones by an adaptive delay amount; a subtraction circuit operatively connected to said microphones and said delay circuit, said subtraction circuit producing an output difference signal from the electronic sound signals following said delay circuit; and a delay amount determination circuit operatively coupled to receive the output difference signal, said delay amount determination circuit produces a delay control signal that is supplied to said delay circuit so as to control the adaptive delay amount.
As an adaptive directional sound processing system, another embodiment of the invention includes at least: a least two microphones spaced apart by a predetermined distance, each of said microphones producing an electronic sound signal; a delay circuit that delays the electronic sound signal from at least one of said microphones by an adaptive delay amount; a logic circuit operatively connected to said microphones and said delay circuit, said logic circuit producing an output signal from the electronic sound signals following said delay circuit; and a delay amount determination circuit operatively coupled to receive the output signal, said delay amount determination circuit produces a delay control signal based on the output signal, the delay control signal being is supplied to said delay circuit so as to control the adaptive delay amount.
As an adaptive directional sound processing system, another embodiment of the invention includes at least: at least two microphones spaced apart by a predetermined distance, each of said microphones producing an electronic sound signal; a delay circuit that delays the electronic sound signal from at least one of said microphones by an adaptive delay amount; logic means for producing an output signal from the electronic sound signals following said delay circuit; and delay determination means for producing a delay control signal based on the output signal, the delay control signal being is supplied to said delay circuit so as to control the adaptive delay amount.
As a method for adaptively controlling delay induced on a sound signal so that unwanted noise is directionally suppressed, one embodiment of the invention includes at least the acts of: producing a difference signal from at least first and second sound signals respectively obtained by first and second microphones; estimating an energy amount of the difference signal; and producing a delay signal to control a delay amount induced on at least one of the first and second sound signals based on the energy amount of the difference signal.
As an adaptive delay method for directional noise suppression in a hearing aid device, the hearing aid device having at least first and second microphones, one embodiment of the invention includes at least the acts of: receiving first and second microphone outputs; delaying at least the second microphone output by an adaptive delay amount; combining the first microphone output and the delayed second microphone output to produce an output signal; estimating an energy amount associated with the output signal; and adapting the adaptive delay amount based on the energy amount.
As a method for adaptively controlling delay induced on a sound signal in a multi-microphone directional processing system so that unwanted noise is directionally suppressed, another embodiment of the invention includes at least the acts of: receiving at least first and second sound signals respectively obtained by first and second microphones; delaying at least one of the first and second sound signals by a plurality of different delay amounts; producing, following the delaying act, a plurality difference signals from at least first and second sound signals respectively obtained by first and second microphones; estimating energy amounts for each of the difference signals; and choosing the one of the difference signals as an output of the directional processing system based on the energy amounts of the difference signals.
As an adaptive directional sound processing system, another embodiment of the invention includes at least: at least two microphones spaced apart by a predetermined distance, each of the microphones producing an electronic sound signal; a plurality of delay circuits that each delay the electronic sound signal from at least one of the microphones by a different delay amount; logic means for producing candidate output signals from the electronic sound signals following the delay circuits; and output selection means for selecting one of the candidate output signals as an output based on energy levels of the candidate output signals.
Other aspects and advantages of the invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the invention.
The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
a)-2(c) illustrate polar patterns of a directional processing system corresponding to three different delay values;
The invention relates to improved approaches adaptively suppress interfering noise in a multi-microphone directional system. These approaches operate to adjust a direction null for the multi-microphone directional system.
One aspect of the invention pertains to techniques for adjusting a delay adaptively so that a directional null is placed in the direction of a dominant noise source. This would produce maximum Signal-to-Noise Ratio (SNR) improvement across all conditions. In other words, a dominant noise source is attenuated (e.g., suppressed) but the desired sound from a particular direction is not attenuated
Consequently, the invention enables multi-microphone directional processing systems to adaptively suppress a noise source. The invention is described below with respect to embodiments particularly well suited for use with hearing aid applications. However, it should be recognized that the invention is not limited to hearing aid applications, but is applicable to other sound pick-up systems.
Embodiments of this aspect of the invention are discussed below with reference to
The two-microphone directional processing system 300 also includes an optimal delay determination unit 310. The output signal produced by the substation unit 308 is supplied to the optimal delay determination unit 310. The optimal delay determination unit 310 determines a delay amount (e.g., optimal delay) that the delay unit 306 should induce on the second electronic sound signal so that the directional null associated with the directional processing occurs at the direction of a noise source. The delay amount, or a corresponding control signal, is supplied to the delay unit 306 where the delay is imposed. Hence, the optimal delay determination unit 310 causes the delay amount for the delay unit 306 to self-adjust based on the output energy (e.g., output signal) of the two-microphone directional processing system 300. In other words, the delay induced by the delay unit 306 automatically adjusts based on the output energy.
When interfering noise is present, the total energy of the signals picked up by the microphones 302 and 304 are greater than the output energy would be if the interfering noise were not present. According to one embodiment, the delay amount for the delay unit 306 can be adjusted so that the output of the two-microphone directional processing system 300 has minimum energy. Because change in the delay amount does not change the system response to desired sound coming from 0 degrees, minimizing the output energy by adjusting the delay is equivalent to achieving a maximum attenuation of noise (assuming the desired sound is coming from 0 degrees).
The output signal of the directional processing system 300 can be further processed by other processing functions. In the case of hearing aid applications, the output of the directional processing is further processed by other hearing aid functions such as amplification and noise suppression.
The energy estimator 402 can create the energy signal 408 by any one of the following: (1) forcing its input into positive signal; (2) squaring the input; (3) calculating a Root-Mean-Square (RMS) signal for the input; or (4) estimating a minimum signal from the input. The energy signal 408 can be down-sampled first before being used to generate the delay signal 410.
The delay generator 404 produces the delay signal 410 based on the energy signal 408. In one embodiment, the delay signal 410 is a delay amount obtained by determining a change in the energy signal, creating a delay increment signal in accordance with the change, and adding the delay increment signal to a current delay amount to produce a next delay amount.
It should be noted that the optimal delay determination unit 400 can also utilize a down sampling process between the energy estimator 402 and the delay generator 404 as typically the energy estimate from the energy estimator 402 will have a higher sampling rate than that of the delay generator 404. The result is that the output of the energy estimator 402 changes fast while the output from the delay generator 404 changes slowly. For example, in one embodiment, the input to and output from the energy estimator 402 can be digital signals at a higher sampling rate, e.g., 16 kHz, while the input to and output from the delay generator 404 can be digital signals at a lower sampling rate (e.g., 1 kHz). A down sampling process can thus be provided between the energy estimator 402 and the delay generator 404 to accommodate the difference in sampling rates. Down sampling is a term frequently used in digital signal processing to describe a process that reduces the sampling frequency from high to low.
Alternatively, instead of reducing the sampling frequency through down sampling, a similar effect can be achieved by using a slower time constant in the delay generator 404 than that of the energy estimator 402. Time constant describes how fast the output of a processing block changes with its input. Here, the time constant for the delay generator 404 can be slower than the time constant of the energy estimator 402 so that the output of the energy estimator 402 changes fast while the output from the delay generator 404 changes slowly.
The delay increment calculation circuit 506 calculates a current delay increment based on the energy change signal. The current delay increment is then supplied to an add circuit 508. The add circuit 508 adds the current delay increment to a previous delay increment 509 to output an unrestricted optimal delay. The unrestricted optimal delay is then supplied to a maximum delay circuit 510 and a minimum delay circuit 512. The unrestricted optimal delay, after passing through the maximum delay circuit 510 and the minimum delay circuit 512, outputs an optimal delay 516. The maximum delay circuit 510 limits the upper range for the optimal delay to a maximum value, and the minimum delay circuit 512 limits the minimum delay to a minimum value. Although the limits will vary widely with application, in one embodiment, the maximum value can be 36 and the minimum value can be zero. The optimal delay 516 is also fed back through a sample delay circuit 518 which produces the previous delay increment 509 that is supplied to the add circuit 508. The optimal delay 516 is, for example, the delay signal 410 illustrated in
The circuitry for the delay increment calculation circuit 506 can take many forms.
The switch circuit 522 is controlled in accordance with the energy difference signal. When the switch circuit 522 determines that the energy difference signal is greater than zero (0), then the delay increment signal being output by the circuit 520 corresponds to the previous delay increment signal. Alternatively, when the switch circuit 522 determines that the energy difference signal is less than zero (0), then the delay increment signal being output by the circuit 520 corresponds to the inverted previous delay increment. Hence, when the energy difference signal is greater than zero (0), the delay increment signal remains the same as it previously was. On the other hand, when the energy difference signal is less than zero (0), then the delay increment signal is negated from its previous value. As an example, the energy difference signal and the delay increment being output can be represented in multiple bits, such as 16 bits, of either integer or floating point numerical storage.
The directional processing system 600 also includes a series of different delay units 606, 608 and 610. Each of these delay units 606, 608 and 610 operate to induce different delays to the second electronic sound signal. In addition, the directional processing system 600 also includes subtract circuits 612, 614 and 616. Each of the subtract circuits 612, 614 and 616 receives the first electronic sound signal from the first microphone 604. In addition, the subtract circuit 614 receives the delayed second electronic sound signal from the delay unit 606. The subtract circuit 614 receives the delayed second electronic sound signal from the delay unit 608. The subtract circuit 616 receives the delayed second electronic sound signal from the delay unit 610. Each of the subtract circuits 612, 614 and 616 produce a difference signal. The difference signals produced by the subtract circuits 612, 614 and 616 are each supplied to a signal selection circuit 618. Under the control of a control signal, the signal selection circuit 618 outputs one of the difference signals as the output signal. At this point, the output signal has undergone directional processing by the directional processing system 600. Such directional processing enables unwanted interference from certain directions to be suppressed.
The control signal to the signal selection circuit 618 is provided by a selector 620 together with energy estimators 622, 624 and 626. The energy estimator 622 estimates the energy on the difference signal produced by the subtract circuit 612, and supplies the energy estimate to a first input to the selector 620. The energy estimator 624 estimates the energy on the difference signal produced by the subtract circuit 614, and supplies the energy estimate as a second input to the selector 620. The energy estimator 626 estimates the energy of the difference signal produced by the subtract circuit 616 and supplies the energy estimate to a third input to the selector 620. The selector 620 then selects one of the estimated energy values supplied by the energy estimators 622, 624 and 626 as the selected output which forms the control signal that controls the signal selection circuit 618.
The directional processing system 600 selects the difference signal that has the lowest energy as the system output (output signal). The lowest energy means that the channel or path undergoing the most noise suppression is selected. The different delay units 606, 608 and 610 together with the subtract units 612, 614 and 616 for the channels or paths. In this embodiment, the delays for the delay elements are fixed and thus do not adapt. Instead, the various delay units offer different delays and the channel or path providing the best noise suppression is chosen. Although the directional processing system 600 provided only three channels or paths, it should be recognized that additional paths can be provided. In general, the directional processing system 600 operates with two or some channels or paths.
The signal energy can be estimated in a variety of ways. For example, the energy signal can be estimated using one of the followings: (1) forcing its input into positive signal; (2) squaring the input; (3) calculating a Root-Mean-Square (RMS) signal for the input; or (4) estimating a minimum signal from the input. Also, it should be noted that the rate at which the energy signal is estimated need not be the same as the rate in which the delay signal is updated. In other words, the energy signal can be updated with a different time constant that a time constant used in updating the delay signal. For example, for a fixed sampling rate, the energy signal can be updated for every sample, while the delay signal can be updated every 100 samples.
The adaptive directional processing system includes at least two microphones, typically physically spaced by a distance of at least three (3) mm. The microphones are used to convert sound into electronic signals. The electronic signals can be either analog or digital. The system further includes delay means to delay the electronic signals from one or both microphones. The system further includes addition or subtraction means to generate a differential signal of the microphone outputs as delayed by the delay means. The system also includes means for estimating the energy of the differential signal. The delay from the delay means is used to adapt the directional null to suppress a dominant noise source. The delay means, the addition/subtraction means, and the energy estimate means can be used more than once in parallel so that multiple delayed signals, multiple differential signals, and multiple energy signals are created.
Although the above-described embodiments of the directional processing systems have utilized two microphones, it should be understood that the directional processing systems can also use more than two microphones. Furthermore, following directional processing, the output of the directional processing system can be further processed by other processing functions. In the case of hearing aid applications, the output of the directional processing is further processed by other hearing aid functions such as amplification and noise suppression.
The invention is preferably implemented in hardware, but can be implemented in software or a combination of hardware and software. The invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can be thereafter be read by a computer system. Examples of the computer readable medium include read-only memory, random-access memory, CD-ROMs, magnetic tape, optical data storage devices, carrier waves. The computer readable medium can also be distributed over a network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
The advantages of the invention are numerous. Different embodiments or implementations may yield one or more of the following advantages. One advantage of the invention is that a dominant noise source can be directionally suppressed. Another advantage of the invention is that the directional suppression is adaptive and thus changes as the directional of the dominant noise source changes. Still another advantage of the invention is that desired sound from a particular direction is not interfered with even though a dominant noise source is able to be directionally suppressed.
The many features and advantages of the present invention are apparent from the written description and, thus, it is intended by the appended claims to cover all such features and advantages of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention.
This application is a continuation of U.S. application Ser. No. 09/788,271, filed Feb. 16, 2001 now abandoned, and entitled “NULL ADAPTATION IN MULTI-MICROPHONE DIRECTIONAL SYSTEM”, which claims the benefit of U.S. Provisional Application No. 60/183,241, filed Feb. 17, 2000, and entitled “METHODS FOR NULL ADAPTATION IN MULTI-MICROPHONE DIRECTIONAL SYSTEM”, the contents of both of which are hereby incorporated by reference. This application is also related to (i) U.S. application Ser. No. 09/808,694, filed Mar. 14, 2001, and entitled “ADAPTIVE MICROPHONE MATCHING IN MULTI-MICROPHONE DIRECTIONAL SYSTEM”, the contents of which is hereby incorporated by reference; and (ii) U.S. application Ser. No. 09/813,430, filed Mar. 20, 2001, and entitled “AUTOMATIC DIRECTIONAL PROCESSING CONTROL FOR MULTI-MICROPHONE SYSTEM”, the contents of which is hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
3836732 | Johanson et al. | Sep 1974 | A |
3975599 | Johanson | Aug 1976 | A |
4131760 | Christensen et al. | Dec 1978 | A |
4701953 | White | Oct 1987 | A |
4712244 | Zwicker et al. | Dec 1987 | A |
4751738 | Widrow et al. | Jun 1988 | A |
4956867 | Zurek et al. | Sep 1990 | A |
5214709 | Ribic | May 1993 | A |
5325436 | Soli et al. | Jun 1994 | A |
5390254 | Adelman | Feb 1995 | A |
5434924 | Jampolsky | Jul 1995 | A |
5479522 | Lindemann et al. | Dec 1995 | A |
5524056 | Killion et al. | Jun 1996 | A |
5625684 | Matouk et al. | Apr 1997 | A |
5737430 | Widrow | Apr 1998 | A |
5740256 | Castello Da Costa et al. | Apr 1998 | A |
5757933 | Preves et al. | May 1998 | A |
6539096 | Sigwanz et al. | Mar 2003 | B1 |
6757394 | Matsuo | Jun 2004 | B2 |
Number | Date | Country |
---|---|---|
569216 | Nov 1993 | EP |
0856833 | Aug 1998 | EP |
982971 | Mar 2000 | EP |
982971 | Mar 2000 | EP |
63-002500 | Jan 1988 | JP |
06 269085 | Sep 1994 | JP |
11-220796 | Aug 1999 | JP |
WO 9903091 | Jan 1999 | WO |
Number | Date | Country | |
---|---|---|---|
20010028720 A1 | Oct 2001 | US |
Number | Date | Country | |
---|---|---|---|
60183241 | Feb 2000 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09788271 | Feb 2001 | US |
Child | 09858299 | US |