Close talk detector for noise cancellation

Information

  • Patent Grant
  • 9094744
  • Patent Number
    9,094,744
  • Date Filed
    Friday, December 21, 2012
    12 years ago
  • Date Issued
    Tuesday, July 28, 2015
    9 years ago
Abstract
A close talk detection method and system is provided for active noise cancellation system on a cellular telephone or the like, based on two properly located microphones. Given the location of the microphones and the way people use the phone, the power ratio (difference) at the two microphones implies the location of the speaker within a given range. The improved close-talk detector is not affected by power levels or SNR of non-close-talk ambient disturbances. Power levels of both a voice and a reference microphone are measured and the ratio r of these power levels is determined. If the ratio r is greater than a predetermined threshold (e.g., 7 dB), then close talk is occurring. If the ratio r is less than the predetermined threshold, then the signal is determined to be loud ambient noise or some other non-close-talking signal and noise cancellation processing is not affected.
Description
FIELD OF THE INVENTION

A detection system and method for detecting when a background noise measured in a noise cancellation circuit contains speech from a person speaking too closely to the device is disclosed. In particular, the present detection system and method are directed toward a close talk detector for a noise cancellation system for a cell phone or the like.


BACKGROUND OF THE INVENTION

A personal audio device, such as a wireless telephone, may include a noise canceling circuit to reduce background noise in audio signals. One example of such a noise cancellation circuit is an active noise cancellation circuit that adaptively generates an anti-noise signal from a reference microphone signal and injects the anti-noise signal into the speaker or other transducer output to cause cancellation of ambient audio sounds. An error microphone may also be provided proximate the speaker to measure the ambient sounds and transducer output near the transducer, thus providing an indication of the effectiveness of the noise canceling. A processing circuit uses the reference and/or error microphone, optionally along with a microphone provided for capturing near-end speech, to determine whether the noise cancellation circuit is incorrectly adapting or may incorrectly adapt to the instant acoustic environment and/or whether the anti-noise signal may be incorrect and/or disruptive and then take action in the processing circuit to prevent or remedy such conditions.


Examples of such noise cancellation systems are disclosed in published U.S. Patent Application 2012/0140943, published on Jun. 7, 2012, and in Published U.S. Patent Application 2012/0207317, published on Aug. 16, 2012, both of which are incorporated herein by reference. Both of these references are assigned to the same assignee as the present application and one names at least one inventor in common and thus are not prior art to the present application but are provided to facilitate the understating of noise cancellation circuits as applied in the field of use. These references are provided by way of background only to illustrate one problem solved by the present invention. They should not be taken as limiting the close-talk detector for noise cancellation to any one type of multi-microphone application or noise cancellation circuit.


Referring now to FIG. 1, a wireless telephone 10 is shown in proximity to a human ear 5. Wireless telephone 10 includes a transducer, such as speaker SPKR that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ring tones, stored audio program material, injection of near-end speech (i.e., the speech of the user of wireless telephone 10) to provide a balanced conversational perception, and other audio that requires reproduction by wireless telephone 10, such as sources from web-pages or other network communications received by wireless telephone 10 and audio indications such as battery low and other system event notifications. A near-speech microphone NS is provided to capture near-end speech, which is transmitted from wireless telephone 10 to the other conversation participant(s).


Wireless telephone 10 includes active noise canceling circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment and is positioned away from the typical position of a user's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. Prior art noise cancellation circuits rely on the use of two microphones E and R. The embodiment of FIG. 1 also provides a third microphone, near-speech microphone NS, in order to further improve the noise cancellation operation by monitoring the ambient disturbance to the noise cancellation system when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS, and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver.


In general, the noise cancellation techniques measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the noise cancellation processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events at error microphone E. Since acoustic path P(z) (also referred to as the Passive Forward Path) extends from reference microphone R to error microphone E, the noise cancellation circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z) (also referred to as Secondary Path) that represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment, which is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone is not firmly pressed to ear 5.


The dual microphone (microphones R and NS) system of FIG. 1 is widely used in mobile telephony for uplink noise suppression. In order to protect the noise cancellation system, an oversight mechanism requires audio signals from microphones R and NS in order to detect certain situations, such as close talk, wind/scratch noise, howling, and the like. Close talk, as the term is known, occurs when the near-end user is talking while holding the phone to his/her ear. Howling occurs when an anti-noise signal is picked up by microphone R, and it is played out speaker SPKR. The speaker output gets coupled back to the reference microphone R and sets up a positive feedback loop. Howling can occur, for example, if a user cups their hand from the speaker back to the reference microphone R or if there is some internal leakage path. Scratching is a term used to describe physical contact with a microphone, which produces a loud scratching noise.


Close talk, as the term is known, occurs when the near-end user is talking while holding the phone to his/her ear. When close talking occurs, the noise cancellation system may not work properly, as the local loud speech (close talk) may distract the adaptive filter, due to the path-change of acoustic path P(z). Preferably, a loud close talk event should be detected and the noise cancellation system adaptive filter should then be frozen (e.g., discontinue adapting, at least temporarily) so as to not react to the event. If close talking is not loud enough—e.g., it is not as strong as the ambient noise, there is no need to detect it. The traditional voice activity detector also treats the ambient highly non-stationary noise, including the ambient speech, as the voice. However, the ANC system needs to properly measure the ambient noise, no matter if they are stationary or non-stationary, as long as the noise is not too close to the ANC device.


Published U.S. Patent Application No. 2011/0106533 to Yu, published on May 5, 2011 and incorporated herein by reference, discloses a multi-microphone Voice Activity Detector (VAD) as illustrated in FIG. 2. Referring to FIG. 2, the VAD system 300 includes a near microphone 102a, a far microphone 102b, analog to digital converters 302a and 302b, band pass filters 304a and 304b, signal level estimators 306a and 306b, noise level estimators 308a and 308b, dividers 310a and 310b, unit delay elements 312a and 312b, and a VAD decision block 314.


The system of FIG. 2 detects close talking based on the Signal-to-Noise Ratio (SNR) estimations at the two channels. The system tries to detect close talking even at low SNR values. However, impulsive ambient noise (non-close talk) may falsely trigger the close talk detector, as the VAD decision is based on a difference between the two SNR ratios.


Thus, it remains a requirement in the art to provide a system for detecting loud close talking reliably, such that when close talking occurs, the noise cancellation system can be adjusted to not adapt to the close talk signal which causes path change of acoustic path P(z). On the other hand, the ambient impulsive/non-stationary noise can still be properly measured to maintain the accurate estimation of ambient noise level.


SUMMARY OF THE INVENTION

The present detection system and method provide an improved close-talk detector, which is not affected by the power levels or SNR of non-close-talk ambient disturbances. Power levels of both a voice and a reference microphone are measured, and the ratio r of these power levels is determined. The inventors have discovered through mathematical analysis and testing that this ratio of power levels is directly proportional to the distance that a close talker is located relative to the two microphones. If the ratio r is greater than a predetermined threshold (e.g., 7 dB), then close talking is determined to be occurring, and the noise cancellation circuit may be suitably attenuated to disregard the close talking signal in the noise cancellation process. If the ratio r is less than the predetermined threshold, then the signal is determined to be loud ambient noise or some other non-close-talking signal, and noise cancellation processing is not affected by the close talk detection circuit due to a path-change of acoustic path P(z).


The present detection system and method reliably detects close talking without being falsely triggered by other events, such as loud ambient noise and the like. As a result, artifacts that result in an audio signal when a noise cancellation circuit in accordance with the prior art tries to compensate for close talking, do not occur. The present detection system and method can be readily implemented within an integrated circuit and even within noise cancellation circuitry, without the need for any additional external hardware (third microphone, or the like). Thus, the present detection system and method can be readily implemented into existing cellular phone designs with little modification and in a cost-effective manner, providing performance improvement at little or no additional hardware cost.


The present invention may be applied to cellular telephones, pad devices and other portable audio devices where close talk detecting is desired. While disclosed herein in the context of a cellular telephone in the preferred embodiment, the present invention may be applied generally to portable devices as well as other applications where close talk detection is used. In addition, the present invention may be applied to other audio devices and telecommunication devices, including telephone headsets, portable phones, teleconferencing equipment, public address systems, and the like.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a diagram illustrating how dual microphones may be used in a noise cancellation circuit in a cellular telephone.



FIG. 2 is a block diagram that illustrates an example voice activity detector system according to the prior art.



FIG. 3 is a diagram illustrating the distance of a close talker from both the dual microphones on a typical cell phone.



FIG. 4 is a block diagram of the system of the present detection system and method.





DETAILED DESCRIPTION OF THE INVENTION


FIG. 3 is a diagram illustrating the distance of a close talker from both the dual microphones on a typical cell phone. Referring to FIG. 3, a cell phone 350 is provided with an earpiece speaker 360 on the front side of the panel for the user to hear communications. Cell phone 350 is approximately 10-15 centimeters in height, as represented by reference letter d. Two microphones are provided, as discussed above in connection with FIGS. 1 and 2. A near-speech microphone (NS) 370 designed to pick up the user's voice and ambient background noise is provided at the bottom of the device. A reference microphone 355 is provided at the back of the device to pick up ambient noise levels. In FIG. 3, a “close talker” is represented pictorially by speaker 365, even though the close talker is a person. The close talker may be located at a distance l1 from the near-speech microphone (NS) 370 and a distance l2 from the reference microphone (R).


If the close talker 365 is close enough, and the talker is closer to one microphone 370 than the other 355, which is usually the case, the acoustic sound wave arrives at the two microphones 370, 355, with different amounts of pressure. The digital signals received at the two microphones have different power, which are proportional to the inverse of distance from the close talker to the microphone. This power level may be represented as:










P
i



1

l
i
2






(
1
)








where Pi is the power level, li is the distance, and i indicates at which microphone the signal is received. For the purposes of this application, i=1 indicates the reference microphone (R) 355 and i=2 indicates the near-speech microphone (NS) 370 of FIG. 3.


Power level P may be calculated in a number of ways. In the preferred embodiment, power level is a root-mean-square (RMS) based power estimation. Traditionally, this power level would be calculated using a strict RMS calculation such as:









P
=



1
N






i
=
1

N




x
2



(
i
)




2





(
2
)








Where x(i) is the input signal and i represents the frequency bin. However, in the present invention, to save computations in the preferred embodiment, only the sum of the squares of a block of input signals x(i) is used:









P
=




i
=
1

N




x
2



(
i
)







(
3
)








This simplified calculation works as both microphone channels are using the same length of data and the square root is calculated when converting the smoothed power level P into decibels (dB).


The powers P1 and P2, received at different microphones have the following relationship which can be defined as a ratio, r. The distance l2 will always be less than the sum of distance d and l1 (i.e., l2<l1+d):









r
=



P
1


P
2


=



l
2
2


l
1
2


<



(


l
1

+
d

)

2


l
1
2








(
4
)







When the talker is closer to near-speech microphone (NS) 370 than reference microphone 355, and l1 is smaller than l2, then the range of the ratio r can be expressed as:









1
<
r
<



(


l
1

+
d

)

2


l
1
2






(
5
)







This ratio, r could be very large. On the other hand, when the talker is far away, l1 is too large, l1>>d, r≈1. Therefore, the following is the close talk detection criterion:

if r>γ, close talk
if r≦γ, no close talk  (6)

where γ represents a predetermined cutoff level for determining close talking. In the preferred embodiment, γ=7 dB.


The ratio r, although calculated from power levels, represents the ratio of the distance of the speaker to the two microphones. When the ratio r is large, it means that the close talker 365 is much closer to the near-speech microphone (NS) 370 than to the reference microphone (R) 365. Given r and d, the distance between the two microphones, the actual location of the close talker is calculated within a certain range. Without a loss of generality, when the close talker is closer to the near-speech microphone 370, then r>1.


If the three-dimensional locations of the close talker 365 are denoted as position s, and the position of the near-speech microphone (NS) 370 as position m1 and the reference microphone 355 as position m2, then these three positions are defined in terms of three-dimensions as:

s=[xs,yx,zx]T,m1=[x1,y1,z1]T and m2=[x2,y2,z2]T  (7)

The location of source s can be expressed as follows:









r
=



P
1


P
2


=



l
2
2


l
1
2


=





s
-

m
2




2





s
-

m
1




2








(
8
)












s
-

[


m
1

+


1

r
-
1




(


m
1

-

m
2


)



]




2


=


r


(

r
-
1

)

2








m
1

-

m
2




2






(
9
)







The value of r, in effect, defines a sphere. The location of the close talker 365 resides on the surface of a sphere defined by equation (9) above. Given the ratio r, equation (9) yields the center and radius of the sphere where the close talker 365 could be. As r→∞, the center of this sphere becomes the location m1 of the near-speech microphone (NS) 370, and the radius goes to 0, which means the loud talker is at the same location m1 as the near-speech microphone (NS) 370. As r→1, the center and the radius approach towards infinity. This means the loud talker is either located at an infinite far field (background ambient noise) or is located on a surface that exactly between the two microphones 370, 355.


Thus, if r≈1, the sound source has an equal distance to the two microphones, either a far field, or at the middle between the two microphones. However, if r>>1 the sound source is much closer to near-speech microphone (NS) 370 than to reference microphone 355. Again the criteria of Equation (6) can be used to determine the presence of close talking.


In a loud ambient environment, the value for r may be calculated as follows:









r
=




N
1

+

P
1




N
2

+

P
2



=





N
1


N
2


·


1
+


P
1

/

N
1




1
+


P
2

/

N
2












N
1


N
2




1






(
10
)








where N1 and N2 are ambient noise, no matter if they are stationary or non-stationary, received at the near-speech microphone (NS) 370 and the reference microphone 355, respectively. When the ambient noise is loud, r will become much smaller than when the ambient noise is quiet. This event causes the close-talk flag value r to vanish, which is exactly as desired for a close-talk detector. In other words, the detector of the present detection system and method will not trigger a “false positive” based on loud ambient noise.



FIG. 4 is a block diagram of the system of the present detection system and method. Referring to FIG. 4, close talk detect system 400 includes the reference microphone 355, the near-speech microphone (NS) 370, analog to digital converters 312a and 312b, band pass filters 304a and 304b, and power level estimators 316a and 316b. The output of power level estimators 316a and 316b are fed to block 324, where the ratio r is calculated according to equation (4). In block 326, the value of r is compared to value γ, which in the preferred embodiment is 7 dB. If r>γ, then close talking is detected in block 325, and a signal sent to adaptive noise cancellation system 328, suppressing the action of the noise cancellation circuit with regard to the close talk signal. This suppression may be achieved by “freezing” the noise cancellation circuit to not update the model of P(z)/S(z) for the noise cancellation signal, until the close talk event ends. If r<γ, then no close talk event is indicated, and no action is taken.


Other actions may be taken in response to the detection of close talking. If close talk is detected, then the updating of the noise cancellation circuit may be modified to slow adaptation of the noise cancellation circuit. Alternately, altering updating of the noise cancellation circuit may comprise stopping adaptation of the noise cancellation circuit. In addition, altering updating of the noise cancellation circuit comprises increasing a least means square filter leakage term in the noise cancellation circuit.


While the preferred embodiment and various alternative embodiments of the invention have been disclosed and described in detail herein, it may be apparent to those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope thereof.

Claims
  • 1. In a portable device including at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation, and a noise cancellation circuit, a close talk detector, comprising: a power level detector, coupled to the at least first and second microphones, receiving the audio signals from the at least first and second microphones, measuring power levels of the audio signals from the first and second microphones, and comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones; anda comparator for comparing the ratio of the power levels of the at least first and second microphones to a predetermined threshold and detecting close talk if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold,wherein the comparator outputs a signal to the noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected to prevent the noise cancellation circuit from adapting to the talker's voice.
  • 2. The close talk detector of claim 1, wherein altering updating of the noise cancellation circuit comprises slowing adaptation of the noise cancellation circuit.
  • 3. The close talk detector of claim 1, wherein altering updating of the noise cancellation circuit comprises increasing a least means square filter leakage term in the noise cancellation circuit.
  • 4. In a portable device including at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation, and a noise cancellation circuit, a close talk detector, comprising: a power level detector, coupled to the at least first and second microphones, receiving the audio signals from the at least first and second microphones, measuring power levels of the audio signals from the first and second microphones, and comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones; anda comparator for comparing the ratio of the power levels of the at least first and second microphones to a predetermined threshold and detecting close talk if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold,wherein the comparator outputs a signal to the noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected, andwherein altering updating of the noise cancellation circuit comprises stopping adaptation of the noise cancellation circuit.
  • 5. In a portable device including at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation, and a noise cancellation circuit, a close talk detector, comprising: a power level detector coupled to the at least first and second microphones receiving the audio signals from the at least first and second microphones measuring power levels of the audio signals from the first and second microphones and comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones; anda comparator for comparing the ratio of the power levels of the at least first and second microphones to a predetermined threshold and detecting close talk if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold,wherein the comparator outputs a signal to the noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected, andwherein the predetermined threshold is 7 dB, and if the ratio of the power levels of the at least first and second microphones is greater than the pre-determined, the close talk is detected, and if the ratio of power levels of the at least first and second microphones is less than or equal to the predetermined threshold, the close talk is not detected.
  • 6. A method of detecting a close talker near a portable device including at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation, and, the method comprising: calculating power level values of the audio signals from the at least first and second microphones;comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones;comparing the ratio of power levels of the at least first and second microphones to a predetermined threshold;determining when close talk of the talker is detected if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold; andoutputting a signal to a noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected to prevent the noise cancellation circuit from adapting to the talker's voice.
  • 7. The method of claim 6, wherein altering updating of the noise cancellation circuit comprises slowing adaptation of the noise cancellation circuit.
  • 8. The method of claim 6, wherein altering updating of the noise cancellation circuit comprises increasing a least means square filter leakage term in the noise cancellation circuit.
  • 9. A method of detecting a close talker near a portable device including at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation, and, the method comprising: calculating power level values of the audio signals from the at least first and second microphones;comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones;comparing the ratio of power levels of the at least first and second microphones to a predetermined threshold;determining when close talk of the talker is detected if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold; andoutputting a signal to a noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected,wherein altering updating of the noise cancellation circuit comprises stopping adaptation of the noise cancellation circuit.
  • 10. A method of detecting a close talker near a portable device including at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation, and, the method comprising: calculating power level values of the audio signals from the at least first and second microphones;comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones;comparing the ratio of power levels of the at least first and second microphones to a predetermined threshold;determining when close talk of the talker is detected if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold; andoutputting a signal to a noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected,wherein the predetermined threshold is 7 dB, and if the ratio of power levels of the at least first and second microphones is greater then 7 dB, the close talk is detected, and if the ratio of power levels of the at least first and second microphones is less than or equal to 7 dB, the close talk is not detected.
  • 11. A telecommunications device, comprising: at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation;a noise cancellation circuit including a close talk detector, comprising:at least a first microphone and a second microphone, on the cellular telephone, receiving sounds in the vicinity of the cellular telephone and outputting audio signals, each of the at least first and second microphones being located on the cellular phone at different distances respective to a talker's mouth in ordinary operation;a power level detector, coupled to the at least first and second microphones, receiving the audio signals from the at least first and second microphones, measuring power levels of the audio signals from the first and second microphones, and comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones; anda comparator for comparing the ratio of the power levels of the at least first and second microphones to a predetermined threshold and detecting close talk if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold,wherein the comparator outputs a signal to the noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected to prevent the noise cancellation circuit from adapting to the talker's voice.
  • 12. The telecommunications device of claim 11, wherein altering updating of the noise cancellation circuit comprises slowing adaptation of the noise cancellation circuit.
  • 13. The telecommunications device of claim 11, wherein altering updating of the noise cancellation circuit comprises increasing a least means square filter leakage term in the noise cancellation circuit.
  • 14. A telecommunications device, comprising: at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation;a noise cancellation circuit including a close talk detector, comprising:at least a first microphone and a second microphone, on the cellular telephone, receiving sounds in the vicinity of the cellular telephone and outputting audio signals, each of the at least first and second microphones being located on the cellular phone at different distances respective to a talker's mouth in ordinary operation;a power level detector, coupled to the at least first and second microphones, receiving the audio signals from the at least first and second microphones, measuring power levels of the audio signals from the first and second microphones, and comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones; anda comparator for comparing the ratio of the power levels of the at least first and second microphones to a predetermined threshold and detecting close talk if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold,wherein the comparator outputs a signal to the noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected, andwherein altering updating of the noise cancellation circuit comprises stopping adaptation of the noise cancellation circuit.
  • 15. A telecommunications device, comprising: at least a first microphone and a second microphone receiving sounds in the vicinity of the portable device and outputting audio signals, each of the at least first and second microphones being located on the portable device at different distances respective to a talker's mouth in ordinary operation;a noise cancellation circuit including a close talk detector, comprising:at least a first microphone and a second microphone, on the cellular telephone, receiving sounds in the vicinity of the cellular telephone and outputting audio signals, each of the at least first and second microphones being located on the cellular phone at different distances respective to a talker's mouth in ordinary operation;a power level detector coupled to the at least first and second microphones receiving the audio signals from the at least first and second microphones measuring power levels of the audio signals from the first and second microphones and comparing the power levels from the at least first and second microphones to produce a ratio of the power levels of the at least first and second microphones; anda comparator for comparing the ratio of the power levels of the at least first and second microphones to a predetermined threshold and detecting close talk if the ratio of the power levels of the at least first and second microphones exceeds the predetermined threshold,wherein the comparator outputs a signal to the noise cancellation circuit to alter updating of the noise cancellation circuit when the close talk is detected, andwherein the predetermined threshold is 7 dB, and if the ratio of the power levels of the at least first and second microphones is greater than the pre-determined, the close talk is detected, and if the ratio of power levels of the at least first and second microphones is less than or equal to the predetermined threshold, the close talk is not detected.
CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority from Provisional U.S. Patent Application No. 61/701,187 filed on Sep. 14, 2012, and incorporated herein by reference.

US Referenced Citations (180)
Number Name Date Kind
5251263 Andrea et al. Oct 1993 A
5278913 Delfosse et al. Jan 1994 A
5321759 Yuan Jun 1994 A
5337365 Hamabe et al. Aug 1994 A
5359662 Yuan et al. Oct 1994 A
5410605 Sawada et al. Apr 1995 A
5425105 Lo et al. Jun 1995 A
5445517 Kondou et al. Aug 1995 A
5465413 Enge et al. Nov 1995 A
5548681 Gleaves et al. Aug 1996 A
5586190 Trantow et al. Dec 1996 A
5640450 Watanabe Jun 1997 A
5699437 Finn Dec 1997 A
5706344 Finn Jan 1998 A
5740256 Castello Da Costa et al. Apr 1998 A
5768124 Stothers et al. Jun 1998 A
5815582 Claybaugh et al. Sep 1998 A
5832095 Daniels Nov 1998 A
5946391 Dragwidge et al. Aug 1999 A
5991418 Kuo Nov 1999 A
6041126 Terai et al. Mar 2000 A
6118878 Jones Sep 2000 A
6219427 Kates et al. Apr 2001 B1
6278786 McIntosh Aug 2001 B1
6282176 Hemkumar Aug 2001 B1
6418228 Terai et al. Jul 2002 B1
6434246 Kates et al. Aug 2002 B1
6434247 Kates et al. Aug 2002 B1
6522746 Marchok et al. Feb 2003 B1
6683960 Fujii et al. Jan 2004 B1
6766292 Chandran Jul 2004 B1
6768795 Feltstrom et al. Jul 2004 B2
6850617 Weigand Feb 2005 B1
6940982 Watkins Sep 2005 B1
7103188 Jones Sep 2006 B1
7181030 Rasmussen et al. Feb 2007 B2
7330739 Somayajula Feb 2008 B2
7365669 Melanson Apr 2008 B1
7680456 Muhammad et al. Mar 2010 B2
7742790 Konchitsky et al. Jun 2010 B2
7817808 Konchitsky et al. Oct 2010 B2
8019050 Mactavish et al. Sep 2011 B2
8249262 Chua et al. Aug 2012 B2
8290537 Lee et al. Oct 2012 B2
8325934 Kuo Dec 2012 B2
8379884 Horibe et al. Feb 2013 B2
8401200 Tiscareno et al. Mar 2013 B2
8442251 Jensen et al. May 2013 B2
20010053228 Jones Dec 2001 A1
20020003887 Zhang et al. Jan 2002 A1
20030063759 Brennan et al. Apr 2003 A1
20030185403 Sibbald Oct 2003 A1
20040047464 Yu et al. Mar 2004 A1
20040165736 Hetherington et al. Aug 2004 A1
20040167777 Hetherington et al. Aug 2004 A1
20040202333 Csermak et al. Oct 2004 A1
20040264706 Ray et al. Dec 2004 A1
20050004796 Trump et al. Jan 2005 A1
20050018862 Fisher Jan 2005 A1
20050117754 Sakawaki Jun 2005 A1
20050207585 Christoph Sep 2005 A1
20050240401 Ebenezer Oct 2005 A1
20060035593 Leeds Feb 2006 A1
20060069556 Nadjar et al. Mar 2006 A1
20060153400 Fujita et al. Jul 2006 A1
20070030989 Kates Feb 2007 A1
20070033029 Sakawaki Feb 2007 A1
20070038441 Inoue et al. Feb 2007 A1
20070047742 Taenzer et al. Mar 2007 A1
20070053524 Haulick et al. Mar 2007 A1
20070076896 Hosaka et al. Apr 2007 A1
20070154031 Avendano et al. Jul 2007 A1
20070258597 Rasmussen et al. Nov 2007 A1
20070297620 Choy Dec 2007 A1
20080019548 Avendano Jan 2008 A1
20080101589 Horowitz et al. May 2008 A1
20080107281 Togami et al. May 2008 A1
20080144853 Sommerfeldt et al. Jun 2008 A1
20080177532 Greiss et al. Jul 2008 A1
20080181422 Christoph Jul 2008 A1
20080226098 Haulick et al. Sep 2008 A1
20080240455 Inoue et al. Oct 2008 A1
20080240457 Inoue et al. Oct 2008 A1
20090012783 Klein Jan 2009 A1
20090034748 Sibbald Feb 2009 A1
20090041260 Jorgensen et al. Feb 2009 A1
20090046867 Clemow Feb 2009 A1
20090060222 Jeong et al. Mar 2009 A1
20090080670 Solbeck et al. Mar 2009 A1
20090086990 Christoph Apr 2009 A1
20090175466 Elko et al. Jul 2009 A1
20090196429 Ramakrishnan et al. Aug 2009 A1
20090220107 Every et al. Sep 2009 A1
20090238369 Ramakrishnan et al. Sep 2009 A1
20090245529 Asada et al. Oct 2009 A1
20090254340 Sun et al. Oct 2009 A1
20090290718 Kahn et al. Nov 2009 A1
20090296965 Kojima Dec 2009 A1
20090304200 Kim et al. Dec 2009 A1
20090311979 Husted et al. Dec 2009 A1
20100014683 Maeda et al. Jan 2010 A1
20100014685 Wurm Jan 2010 A1
20100061564 Clemow et al. Mar 2010 A1
20100069114 Lee et al. Mar 2010 A1
20100082339 Konchitsky et al. Apr 2010 A1
20100098263 Pan et al. Apr 2010 A1
20100124336 Shridhar et al. May 2010 A1
20100124337 Wertz et al. May 2010 A1
20100150367 Mizuno Jun 2010 A1
20100158330 Guissin et al. Jun 2010 A1
20100166203 Peissig et al. Jul 2010 A1
20100195838 Bright Aug 2010 A1
20100195844 Christoph et al. Aug 2010 A1
20100246855 Chen Sep 2010 A1
20100266137 Sibbald et al. Oct 2010 A1
20100272276 Carreras et al. Oct 2010 A1
20100272283 Carreras et al. Oct 2010 A1
20100274564 Bakalos et al. Oct 2010 A1
20100284546 De Brunner et al. Nov 2010 A1
20100291891 Ridgers et al. Nov 2010 A1
20100296666 Lin Nov 2010 A1
20100296668 Lee et al. Nov 2010 A1
20100310086 Magrath et al. Dec 2010 A1
20100322430 Isberg Dec 2010 A1
20110007907 Park et al. Jan 2011 A1
20110106533 Yu May 2011 A1
20110129098 Delano et al. Jun 2011 A1
20110130176 Magrath et al. Jun 2011 A1
20110142247 Fellers et al. Jun 2011 A1
20110144984 Konchitsky Jun 2011 A1
20110158419 Theverapperuma et al. Jun 2011 A1
20110206214 Christoph et al. Aug 2011 A1
20110222698 Asao et al. Sep 2011 A1
20110249826 Van Leest Oct 2011 A1
20110288860 Schevciw et al. Nov 2011 A1
20110293103 Park et al. Dec 2011 A1
20110299695 Nicholson Dec 2011 A1
20110305347 Wurm Dec 2011 A1
20110317848 Ivanov et al. Dec 2011 A1
20120135787 Kusunoki et al. May 2012 A1
20120140917 Nicholson et al. Jun 2012 A1
20120140942 Loeda Jun 2012 A1
20120140943 Hendrix et al. Jun 2012 A1
20120148062 Scarlett et al. Jun 2012 A1
20120155666 Nair Jun 2012 A1
20120170766 Alves et al. Jul 2012 A1
20120207317 Abdollahzadeh Milani Aug 2012 A1
20120215519 Park et al. Aug 2012 A1
20120250873 Bakalos et al. Oct 2012 A1
20120259626 Li et al. Oct 2012 A1
20120263317 Shin et al. Oct 2012 A1
20120300958 Klemmensen Nov 2012 A1
20120300960 Macak et al. Nov 2012 A1
20120308021 Kwatra et al. Dec 2012 A1
20120308024 Alderson et al. Dec 2012 A1
20120308025 Hendrix et al. Dec 2012 A1
20120308026 Kamath et al. Dec 2012 A1
20120308027 Kwatra Dec 2012 A1
20120308028 Kwatra et al. Dec 2012 A1
20120310640 Kwatra et al. Dec 2012 A1
20130010982 Elko et al. Jan 2013 A1
20130083939 Fellers et al. Apr 2013 A1
20130243198 Van Rumpt Sep 2013 A1
20130243225 Yokota Sep 2013 A1
20130272539 Kim et al. Oct 2013 A1
20130287218 Alderson et al. Oct 2013 A1
20130287219 Hendrix et al. Oct 2013 A1
20130301842 Hendrix et al. Nov 2013 A1
20130301846 Alderson et al. Nov 2013 A1
20130301847 Alderson et al. Nov 2013 A1
20130301848 Zhou et al. Nov 2013 A1
20130301849 Alderson et al. Nov 2013 A1
20130343556 Bright Dec 2013 A1
20130343571 Rayala et al. Dec 2013 A1
20140044275 Goldstein et al. Feb 2014 A1
20140050332 Nielsen et al. Feb 2014 A1
20140086425 Jensen et al. Mar 2014 A1
20140177851 Kitazawa et al. Jun 2014 A1
20150010403 Wilson et al. Jan 2015 A1
20150092953 Abdollahzadeh Milani et al. Apr 2015 A1
Foreign Referenced Citations (21)
Number Date Country
102011013343 Sep 2012 DE
1880699 Jan 2008 EP
1947642 Jul 2008 EP
2133866 Dec 2009 EP
2216774 Aug 2011 EP
2395500 Dec 2011 EP
2395501 Dec 2011 EP
2401744 Nov 2004 GB
2455821 Jun 2009 GB
2455824 Jun 2009 GB
2455828 Jun 2009 GB
2484722 Apr 2012 GB
H06-186985 Jul 1994 JP
03015074 Feb 2003 WO
WO03015275 Feb 2003 WO
WO2004009007 Jan 2004 WO
WO2004017303 Feb 2004 WO
2007007916 Jan 2007 WO
2007113487 Nov 2007 WO
2010117714 Oct 2010 WO
2012134874 Oct 2012 WO
Non-Patent Literature Citations (53)
Entry
Campbell, Mikey, “Apple looking into self-adjusting earbud headphones with noise cancellation tech”, Apple Insider, Jul. 4, 2013, pp. 1-10 (10 pages in pdf), downloaded on May 14, 2014 from http://appleinsider.com/articles/13/07/04/apple-looking-into-self-adjusting-earbud-headphones-with-noise-cancellation-tech.
Erkelens et al., “Tracking of Nonstationary Noise Based on Data-Driven Recursive Noise Power Estimation”, IEEE Transactions on Audio Speech, and Language Processing, vol. 16, No. 6, Aug. 2008.
Rao et al., “A Novel Two Stage Single Channle Speech Enhancement Technique”, India Conference (INDICON) 2011 Annual IEEE, IEEE, Dec. 15, 2011.
Rangachari et al., “A noise-estimation algorithm for highly non-stationary environments” Speech Communication, Elsevier Science Publishers, vol. 48, No. 2, Feb. 1, 2006.
Jin, et al. “A simultaneous equation method-based online secondary path modeling algorithm for active noise control”, Journal of Sound and Vibration, Apr. 25, 2007, pp. 455-474, vol. 303, No. 3-5, London, GB.
Toochinda, et al. “A Single-Input Two-Output Feedback Formulation for ANC Problems,” Proceedings of the 2001 American Control Conference, Jun. 2001, pp. 923-928, vol. 2, Arlington, VA.
Kuo, et al., “Active Noise Control: A Tutorial Review,” Proceedings of the IEEE, Jun. 1999, pp. 943-973, vol. 87, No. 6, IEEE Press, Piscataway, NJ.
Johns, et al., “Continuous-Time LMS Adaptive Recursive Filters,” IEEE Transactions on Circuits and Systems, Jul. 1991, pp. 769-778, vol. 38, No. 7, IEEE Press, Piscataway, NJ.
Shoval, et al., “Comparison of DC Offset Effects in Four LMS Adaptive Algorithms,” IEEE Transactions on Circuits and Systems II: Analog and Digital Processing, Mar. 1995, pp. 176-185, vol. 42, Issue 3, IEEE Press, Piscataway, NJ.
Mali, Dilip, “Comparison of DC Offset Effects on LMS Algorithm and its Derivatives,” International Journal of Recent Trends in Engineering, May 2009, pp. 323-328, vol. 1, No. 1, Academy Publisher.
Kates, James M., “Principles of Digital Dynamic Range Compression,” Trends in Amplification, Spring 2005, pp. 45-76, vol. 9, No. 2, Sage Publications.
Gao, et al., “Adaptive Linearization of a Loudspeaker,” IEEE International Conference on Acoustics, Speech, and Signal Processing, Apr. 14-17, 1991, pp. 3589-3592, Toronto, Ontario, CA.
Silva, et al., “Convex Combination of Adaptive Filters With Different Tracking Capabilities,” IEEE International Conference on Acoustics, Speech, and Signal Processing, Apr. 15-20, 2007, pp. III 925-928, vol. 3, Honolulu, HI, USA.
Akhtar, et al., “A Method for Online Secondary Path Modeling in Active Noise Control Systems,” IEEE International Symposium on Circuits and Systems, May 23-26, 2005, pp. 264-267, vol. 1, Kobe, Japan.
Davari, et al., “A New Online Secondary Path Modeling Method for Feedforward Active Noise Control Systems,” IEEE International Conference on Industrial Technology, Apr. 21-14, 2008, pp. 1-6, Chengdu, China.
Lan, et al., “An Active Noise Control System Using Online Secondary Path Modeling With Reduced Auxiliary Noise,” IEEE Signal Processing Letters, Jan. 2002, pp. 16-18, vol. 9, Issue 1, IEEE Press, Piscataway, NJ.
Liu, et al., “Analysis of Online Secondary Path Modeling With Auxiliary Noise Scaled by Residual Noise Signal,” IEEE Transactions on Audio, Speech and Language Processing, Nov. 2010, pp. 1978-1993, vol. 18, Issue 8, IEEE Press, Piscataway, NJ.
Pfann, et al., “LMS Adaptive Filtering with Delta-Sigma Modulated Input Signals”, IEEE Signal Processing Letters, vol. 5, No. 4, Apr. 1998.
Milani, et al., “On Maximum Achievable Noise Reduction in ANC Systems”, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010, Mar. 14-19, 2010 pp. 349-352.
Ryan, et al., “Optimum near-field performance of microphone arrays subject to a far-field beampattern constraint”, 2248 J. Acoust. Soc. Am. 108, Nov. 2000.
Cohen, et al., “Noise Estimation by Minima Controlled Recursive Averaging for Robust Speech Enhancement”, IEEE Signal Processing Letters, Vol. 9, No. 1, Jan. 2002.
Martin, “Noise Power Spectral Density Estimation Based on Optimal Smoothing and Minimum Statistics”, IEEE Trans. on Speech and Audio Processing, col. 9, No, 5, Jul. 2001.
Martin, “Spectral Subtraction Based on Minimum Statistics”, Proc. 7th EUSIPCO '94, Edinburgh, U.K., Sep. 13-16, 1994, pp. 1182-1195.
Cohen, “Noise Spectrum Estimation in Adverse Environments: Improved Minima Controlled Recursive Averaging”, IEEE Trans. on Speech & Audio Proc., vol. 11, Issue 5, Sep. 2003.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2014/017343, mailed Aug. 8, 2014, 22 pages.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2014/018027, mailed Sep. 4, 2014, 14 pages.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2014/017374, mailed Sep. 8, 2014, 13 pages.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2014/019395, mailed Sep. 9, 2014, 14 pages.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2014/019469, mailed Sep. 12, 2014, 13 pages.
Feng, Jinwei et al., “A broadband self-tuning active noise equaliser”, Signal Processing, Elsevier Science Publishers B.V. Amsterdam, NL, vol. 62, No. 2, Oct. 1, 1997, pp. 251-256.
Zhang, Ming et al., “A Robust Online Secondary Path Modeling Method with Auxiliary Noise Power Scheduling Strategy and Norm Constraint Manipulation”, IEEE Transactions on Speech and Audio Processing, IEEE Service Center, New York, NY, vol. 11, No. 1, Jan. 1, 2003.
Lopez-Gaudana, Edgar et al., “A hybrid active noise cancelling with secondary path modeling”, 51st Midwest Symposium on Circuits and Systems, 2008, MWSCAS 2008, Aug. 10, 2008, pp. 277-280.
Widrow, B. et al., Adaptive Noise Cancelling; Principles and Applications, Proceedings of the IEEE, IEEE, New York, NY, U.S. vol. 63, No. 13, Dec. 1975, pp. 1692-1716.
Morgan, Dennis R. et al., A Delayless Subband Adaptive Filter Architecture, IEEE Transactions on Signal Processing, IEEE Service Center, New York, New York. US, vol. 43, No. 8, Aug. 1995, pp. 1819-1829.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2014/040999, mailed Oct. 18, 2014, 12 pages.
International Search Report and Written Opinion of the International Searching Authority, International Patent Application No. PCT/US2034/049407, mailed Jun. 18, 2914, 13 pages.
Hurst, et al., “An improved double sampling scheme for switched-capacitor delta-sigma modulators”, 1992 IEEE Int. Symp. On Circuits and Systems, May 10-13, 1992, vol. 3, pp. 1179-1182, San Diego, CA.
Senderowicz, et al., “Low-Voltage Double-Sampled Delta-Sigma Converters”, IEEE Journal on Solid-State Circuits, Dec. 1997, pp. 1907-1919, vol. 32, No. 12, Piscataway, NJ.
Lopez-Caudana, Edgar Omar, “Active Noise Cancellation: The Unwanted Signal and The Hybrid Solution”, Adaptive Filtering Applications, Dr. Lino Garcia (Ed.), Jul. 2011, pp. 49-84, ISBN: 978-953-307-306-4, InTech.
Kuo, et al., “Residual noise shaping technique for active noise control systems”, J. Acoust. Soc. Am. 95 (3), Mar. 1994, pp. 1665-1668.
Booij, et al., “Virtual sensors for local, three dimensional, broadband multiple-channel active noise control and the effects on the quiet zones”, Proceedings of the International Conference on Noise and Vibration Engineering, ISMA 2010, Sep. 20-22, 2010, pp. 151-166, Leuven.
Black, John W., “An Application of Side-Tone in Subjective Tests of Microphones and Headsets”, Project Report No. NM 001 064.01.20, Research Report of the U.S. Naval School of Aviation Medicine, Feb. 1, 1954, 12 pages (pp. 1-12 in pdf), Pensacola, FL, US.
Peters, Robert W., “The Effect of High-Pass and Low-Pass Filtering of Side-Tone Upon Speaker Intelligibility”, Project Report No. NM 001 064.01.25, Research Report of the U.S. Naval School of Aviation Medicine, Aug. 16, 1954, 13 pages (pp. 1-13 in pdf), Pensacola, FL, US.
Lane, et al., “Voice Level: Autophonic Scale, Perceived Loudness, and the Effects of Sidetone”, The Journal of the Acoustical Society of America, Feb. 1961, pp. 160-167, vol. 33, No. 2., Cambridge, MA, US.
Liu, et al., “Compensatory Responses to Loudness-shifted Voice Feedback During Production of Mandarin Speech”, Journal of the Acoustical Society of America, Oct. 2007, pp. 2405-2412, vol. 122, No. 4.
Paepcke, et al., “Yelling in the Hall: Using Sidetone to Address a Problem with Mobile Remote Presence Systems”, Symposium on User Interface Software and Technology, Oct. 16-19, 2011, 10 pages (pp. 1-10 in pdf), Santa Barbara, CA, US.
Therrien, et al., “Sensory Attenuation of Self-Produced Feedback: The Lombard Effect Revisited”, PLOS ONE, Nov. 2012, pp. 1-7, vol. 7, Issue 11, e49370, Ontario, Canada.
James G. Ryan, Rafik A. Goubran, “Optimum near-field performance of microphone arrays subject to a far-field beampattern constraint ”, 2248 J. Acoust. Soc. Am. 108, Nov. 2000.
I. Cohen, B. Berdugo, “Noise Estimation by Minima Controlled Recursive Averaging for Robust Speech Enhancement”, IEEE Signal Processing Letters, vol. 9, No. 1, Jan. 2002.
R. Martin, “Noise Power Spectral Density Estimation Based on Optimal Smoothing and Minimum Statistics”, IEEE Trans. on Speech and Audio Processing, col. 9, No. 5, Jul. 2001.
R. Martin, “Spectral Subtraction Based on Minimum Statistics”, Proc. 7th EUSIPCO '94, Edinburgh, U.K., Sep. 13-16, 1994, pp. 1182-1195.
I. Cohen, “Noise Spectrum Estimation in Adverse Environments: Improved Minima Controlled Recursive Averaging”, IEEE Trans. on Speech & Audio Proc., vol. 11, Issue 5, Sep. 2003.
A.A. Miliani, G. Kannan, and I.M.S. Panahi, “On maximum achievable noise reduction in ANC systems”, in Proc. ICASSP, 2010, pp. 349-352, Mar. 2010.
Provisional Applications (1)
Number Date Country
61701187 Sep 2012 US