This invention is generally related to mobile units and more particularly to portable communication devices operable in speakerphone mode.
Speakerphones are used in many settings by both individuals and businesses to facilitate communication between multiple parties and to provide a hands-free setting. Speakerphones are frequently used in automobiles so that a user will not have to handle a receiver while operating the automobile. Many speakerphones are half duplex speakerphones, in which only one party can occupy a communication channel at a time. Once one party gets the channel, the other party must wait until the channel is free to proceed.
If a speakerphone is used in an environment in which the noise level increases suddenly, outbound audio may become temporarily muted. For example, automobile acceleration increases the overall noise level such as in a car, such that when an automobile starts moving, the outbound audio will become muted for a period of time that may encompass 8 to 10 seconds.
The muting is caused by an inbound voice activated detector (VAD) detecting the sudden increase in noise as near-end speech. Since the VAD detects speech rather than noise, it locks the inbound channel. It takes about 8 to 10 seconds for the VAD to revert back to its normal operation. The VAD is unable to adapt quickly enough to recognize the increase in the background noise level. This causes the noise level to break in and lock the channel. Accordingly, a technique is needed for more quickly detecting the increased noise level and releasing the channel for possible outbound use to avoid blocking outbound speech.
Accordingly, in order to overcome the aforementioned deficiencies, an aspect of the invention provides a method for dynamically estimating background noise. The method comprises generating a periodicity indicator and a current comfort noise level for an incoming voice frame; comparing the periodicity indicator with a predetermined threshold if the current comfort noise level is equal to a previous comfort noise level; and maintaining a background noise estimate if the periodicity indicator exceeds the predetermined threshold and revising the background noise estimate if the periodicity indicator does not exceed the predetermined threshold.
In yet another aspect, the invention comprises a method for detecting an increase in noise level in a half-duplex speakerphone environment so as to avoid blocking outgoing speech. The method comprises determining a current comfort noise level; comparing the current comfort noise level to a previous comfort noise level; determining if a current periodicity indicator is greater than a predetermined threshold if the current comfort noise level equals the previous comfort noise level; and maintaining a background noise estimate if the periodicity indicator exceeds the predetermined threshold and revising the background noise estimate and keeping an outbound channel open if the current periodicity indicator does not exceed the predetermined threshold.
In yet another aspect, the invention comprises a system for dynamically estimating background noise. The system comprises a portable communication device for receiving incoming information and a vocoder for determining parameters related to the incoming information. The parameters include a voicing mode that indicates periodicity of the incoming information. The system additionally comprises a voice activated detector for processing the parameters for determining a background noise estimate. The voice activated detector comprises a mechanism for comparing the current voicing mode to a predetermined threshold, wherein an outbound channel remains open unless the voicing mode exceeds the predetermined threshold.
While the specification concludes with claims defining the features of the invention that are regarded as novel, it is believed that the invention will be better understood from a consideration of the following description in conjunction with the drawing figures, in which like reference numerals are carried forward. Generally in audio equipment, speech and other audio data are broken into frames. Various parameters are contained within each frame, such as an energy parameter and a voicing mode parameter. The voicing mode parameter is a value indicative of tonal content or periodicity of a frame. In general, a low voicing mode value indicates a fricative sound, wherein a high value indicates a tonal sound, such as a vowel.
These aforementioned parameters may be generated by transmitting equipment so that a portable communication device receiving the information has the parameters available. Alternatively, the receiving device may compute the above-identified parameters. The receiving portable communication device further uses the values of these parameters to define average values and threshold values.
With reference to
The portable communication device 102 additionally includes a voice activated detector 116. The DSP or vocoder 210 outputs multiple parameters related to incoming information. One of these parameters is “r0”, which indicates amount of energy in a segment of speech. A high r0 indicates loud speech and a low r0 indicates soft speech. Another of these parameters is Vm, or voicing mode. The voicing mode indicates how periodic a segment of incoming information is. Periodic speech has a high voicing mode. Vowels have a high voicing mode. Noise other than speech that has no pattern has a low voicing mode. Therefore, in general, a high voicing mode indicates the presence of speech.
Another parameter output by the vocoder 210 is the comfort noise level “CNR0”. Since transmitting silence is wasteful, the vocoder 210 estimates comfort noise and transmits CNR0 when it doesn't detect speech.
As set forth above, a problem with prior art is that while background noise increases, the portable communication device 102 fails to register an immediate increase in CNR0. However, the r0 increase is not delayed, so 8-10 seconds of speech is declared when there is no speech. Accordingly, the present system and method aim to better estimate CNR0. “Ib_r0_avg” is the name given to the CNR0 curve.
Since the increase in CNR0 is not immediately recognized, the processing tools of the present invention including the VAD 116 compare the CNR0 for each consecutive segment of incoming information. If the CNR0 has not changed or is equal between two segments, the processing tools further investigate to determine whether any CNR0 increase should be present. The investigation process is further described below with reference to the method of the invention.
The method for dynamically estimating background noise in order to avoiding locking an outbound channel is shown in detail in
If the CNR0 of the two voice frames is not equal, in step 302 the VAD 116 sets ib_r0_avg equal to the current CNR0:
ib—r0_avg(n)=CNR0(n) (1)
and sets ib_vm_avg to the current value of the voicing mode.
ib—vm_avg(n)=Vm(n) (2)
If however in step 300, the CNR0 of the two voice frames is equal, further investigation is required because the equality may be due to a delayed response.
Accordingly, in step 304, the VAD 116 determines whether the current Vm is less than ib_vm_avg. If the VAD 116 determines that the current Vm is less than ib_vm_avg, the VAD 116 modifies ib_vm_avg with a smoothing factor “alpha” in step 306. More specifically, the VAD 116 employs the formula:
ib—vm_avg(n)=ib—vm_alpha×Vm(n)+(1−ib—vm_alpha)×ib—vm_avg(n−1) (3)
If in step 304, the VAD 116 determines that Vm is not less than ib_vm_avg, the VAD sets ib_vm_avg equal to the current Vm in step 308:
ib—vm—avg(n)=Vm(n) (4)
Following steps 306 and 308, the VAD 116 determines in step 310 if the ib_vm_avg is greater than ib_vm_thresh. If the smoothed voicing mode ib_vm_avg is greater than the threshold ib_vm_thresh, no adjustment is needed. However if ib_vm_avg is not greater than iv_vm_thresh, the background noise estimate must be updated. If the smoothed voicing mode is lower than a threshold, then the voice frame energy is low passed and used to estimate the background noise level. This is based on the assumption that noise has a low voicing mode. In the case of a sudden increase in noise level, the voicing mode stays low and hence the threshold is updated. Updating of the threshold prevents the noise energy from being detected as speech. Accordingly, in step 312, the VAD 116 updates ib_r0_avg:
ib—ro_avg(n)=(1−ib—r0_avg_alpha)×ib—r0_avg_alpha×r0 (5)
To correctly detect the in-bound speech, a smoothed version of the in-bound energy is compared against a dynamically adjusted threshold. This threshold is a function of the in-bound background noise. The louder the background noise, the higher the threshold should be to avoid false detection. Therefore, the present technique adjusts the threshold dynamically such that the in-bound VAD does not falsely detect even under extreme noise situations. The adaptation is based on the voicing mode of the voice frame as well as the energy of that frame.
As shown in
The use of the voicing mode to estimate background noise prevents false detection of speech in many instances. Prior to the implementation of the above-identified technique, a device may have experienced an 8-10 second delay in the increase in CNR0. With the implementation of the above-identified technique, the delay in the same devices may be reduced to about ½ second.
While the preferred embodiments of the invention have been illustrated and described, it will be clear that the invention is not so limited. Numerous modifications, changes, variations, substitutions and equivalents will occur to those skilled in the art without departing from the spirit and scope of the present invention as defined by the appended claims.
This application is related to U.S. Provisional Application Serial No. 60/398,577 filed Jul. 26, 2002 entitled “METHOD FOR FAST DYNAMIC ESTIMATION OF BACKGROUND NOISE”, from which this application claims priority, and which application is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
4015088 | Dubnowski et al. | Mar 1977 | A |
5012519 | Adlersberg et al. | Apr 1991 | A |
5357567 | Barron et al. | Oct 1994 | A |
5410632 | Hong et al. | Apr 1995 | A |
5485522 | Solve et al. | Jan 1996 | A |
5504473 | Cecic et al. | Apr 1996 | A |
5537509 | Swaminathan et al. | Jul 1996 | A |
5677960 | Unno et al. | Oct 1997 | A |
5708754 | Wynn | Jan 1998 | A |
5742694 | Eatwell | Apr 1998 | A |
5784476 | Bird | Jul 1998 | A |
5949888 | Gupta et al. | Sep 1999 | A |
6223154 | Nicholls et al. | Apr 2001 | B1 |
6389391 | Terauchi | May 2002 | B1 |
6556967 | Nelson et al. | Apr 2003 | B1 |
6766020 | Tian et al. | Jul 2004 | B1 |
7171357 | Boland | Jan 2007 | B2 |
Number | Date | Country | |
---|---|---|---|
20040137846 A1 | Jul 2004 | US |
Number | Date | Country | |
---|---|---|---|
60398577 | Jul 2002 | US |