Today mobile phones and other portable devices provides high quality stereo music, users listen to music on the go. If the user uses wireless headset such as Bluetooth headset, he wears a relatively big headset as two speakers are attached to the pinna.
In mobile phone with standard earpiece the user hears the incoming voice call via one ear, the ear to which he attaches the phone or the headset. It is well known that when the user hears the voice call in both ears, he hears the call significantly better and the intelligibility and pleasantness of the call significantly increases. The importance of hearing the voice call in both ears increases when the user is surrounded by a high noise environment. In order to hear a voice call in both ears and still keep the privacy of the call, the user needs to use a headset with two earpieces that are attached to both ears. Using such a headset is inconvenient as it isolates the user from his surrounding, this can be very dangerous when people are talking and walking in public places. In addition, driving a car with a headset that uses two earpieces is very dangerous and in some countries it is forbidden by the law.
In mobile phone when the user uses one earpiece to listen to a voice call, he picks up the ambient noise in the uncovered ear. This can be very problematic in an environment with high ambient noise.
There is a need for providing a high quality audio by using one earpiece wherein the user hears voice call or music in both ears.
An earpiece for providing an audio signal to two ears of a user, includes: an audio interface for providing an audio signal that includes a first input signal and a second input signal; a bone conduction speaker coupled to the audio interface for outputting an output signal; wherein the outputting of the output signal causes an audio signal to reach a first ear of a user and causes a leakage signal to reach a second ear of the user; an adaptive filter with an adjustable impulse response for filtering the first input signal to provide a filtered signal that once played to the second ear of a user, by an in-ear speaker, reduces an audio effect of the leakage signal on the second ear of the user; an in-ear speaker coupled to the audio interface for providing an in-ear audio signal to the second ear of the user, in response to the filtered signal and the second input signal; an in-ear microphone for sensing a sensed audio signal; and a processor for updating an impulse response of the adaptive filter in order to reduce a contribution of the leakage signal to the sensed audio signal.
A method for providing an audio signal to two ears of a user by using a single earpiece, the method includes: receiving an input signal that includes a first input signal and a second input signal; injecting the first input signal to a bone conductor speaker;
outputting an output signal by the bone conductor speaker in response to the first input signal; wherein the outputting of the output signal causes an audio signal to reach a first ear of the user and causes a leakage signal to reach a second ear of the user;
filtering the first input signal by an adaptive filter to provide a filtered signal that once played to the second ear of a user by an in-ear speaker reduces an audio effect of the leakage signal on the second ear of the user; sending, to an in-ear speaker, the filtered signal and the second input signal; providing an in-ear audio signal to the second ear of the user, by the in-ear speaker, in response to the filtered signal and the second input signal; sensing, by an in-ear microphone, a sensed audio signal; and updating an impulse response of the adaptive filter in order to reduce a contribution of the leakage signal to the sensed audio signal.
A method for providing a audio signal to two ears of a user by using a single earpiece, the method includes: receiving a first input signal; sending the first input signal to an in-ear speaker; providing an inner ear audio signal to a second ear of a user, by the in-ear speaker, in response to the second input signal; sensing, by an in-ear microphone that is proximate to the second ear of the user, a sensed audio signal; wherein the sensed audio signal is affected by the inner ear audio signal and by another signal that represents a second audio signal that is heard by the second ear of the user; and calculating a compensating signal that once provided to a bone conductor speaker will cause the bone conductor speaker to output an output signal that reduces an audio effect of the second audio signal on a first ear of the user.
An earpiece that includes: an audio interface for receiving an input signal;
an in-ear speaker for providing an inner ear audio signal to a second ear of a user, by the in-ear speaker, in response to the input signal; an in-ear microphone that is proximate to the second ear of the user, for sensing a sensed audio signal; wherein the sensed audio signal is affected by the inner ear audio signal and another signal that represents a second audio signal that is heard by the second ear of the user; and a processor for calculating a compensating signal that once provided to a bone conductor speaker will cause the bone conductor speaker to output an output signal that reduces an audio effect of the second audio signal on a first ear of the user.
A phone providing an audio signal to two ears of a user, includes: a bone conduction speaker for outputting an audio signal; wherein the outputting of the output signal causes a leakage signal to reach a second ear of a user; an adaptive filter with an adjustable impulse response for filtering the first input to provide a filtered signal that once played to the second ear of a user by an in-ear speaker reduces an audio effect of the leakage signal on the second ear of the user; an in-ear speaker coupled to the audio interface for providing an in-ear audio signal to the second ear of the user, in response to the filtered signal and the second input signal; an in-ear microphone for sensing a sensed audio signal; and a processor for updating an impulse response of the adaptive filter in order to reduce a contribution of the leakage signal to the sensed audio signal.
A headset with two earpieces that includes: an audio interface for providing an audio signal that includes a first input signal and a second input signal; a first in-ear speaker for providing a first inner ear audio signal to a first ear of a user, in response to the first input signal and a second in-ear speaker for providing a second inner ear audio signal to a second ear of a user, in response to the second input signal; at least one in-ear microphone that is proximate to the first ear of the user, for sensing a sensed audio signal; wherein the sensed audio signal is affected by the first inner ear audio signal and another signal that represents a second audio signal that is heard by the first ear of the user; and a processor for calculating a compensating signal that once provided to the in-ear speakers will cause the in-ear speakers to output an output signal that reduces an audio effect of the second audio signal.
An earpiece for providing an audio signal to two ears of a user, includes:
an audio interface for providing an audio signal that includes a first input signal and a second input signal; a bone conduction speaker coupled to the audio interface for outputting an output signal; wherein the outputting of the output signal causes an audio signal to reach a first ear of a user and causes a leakage signal to reach a second ear of the user; an adaptive filter with an adjustable impulse response for filtering the first input signal to provide a filtered signal that once played to the second ear of a user, by an in-ear speaker, reduces an audio effect of the leakage signal on the second ear of the user; and a processor for updating an impulse response of the adaptive filter in order to reduce a contribution of the leakage signal to the sensed audio signal.
The subject matter regarded as the invention is particularly pointed out and distinctly claimed in the concluding portion of the specification. The invention, however, both as to organization and method of operation, together with objects, features, and advantages thereof, may best be understood by reference to the following detailed description when read with the accompanying drawings in which:
It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present invention.
A headset with one earpiece is provided, the headset is capable of providing sound that can be heard by both ears (without sound being audible to parties not wearing the headset).
The headset contains at least a bone conduction speaker, a microphone, a digital signal processor, and at least one speaker. The ear on which the earpiece is positioned hears sound provided by the headset, while the second ear remains uncovered. To provide sound to the uncovered ear, the bone conduction speaker is used. The DSP processes the sound signal in such a way that the sound travels through bone of the user and is heard at the uncovered ear as if an earpiece was placed over that ear as well.
The uncovered ear is opened to capture the ambient noise. To reduce, or cancel the noise, few different techniques may be used. A first technique is amplifying the signal that is transmitted by the bone conduction speaker so that this signal is stronger than the signal that is played via the speaker to the covered ear. By doing this, the signal that is heard by the uncovered ear is actually louder, however, the noise causes this sound seem equal to the signal played to the covered ear. A second technique includes using the microphone on the headset so as to analyze noise. A noise reduction signal is then produced, so that when the noise reduction signal is combined with the audio signal transmitted to the uncovered ear by the bone conduction speaker, the uncovered ear hears the sounds produced by the headset with minimal noise interference.
In the following description the term “covered ear” refers to a user ear on which an earpiece is placed. The covered ear is also referred to as “a second ear”. The term “uncovered ear”, means: the ear that does not hold an earpiece and is also referred to as “a first ear”.
The earpiece includes a bone conduction speaker 120 that can be placed in various locations, closed to a bone, such as the Zygomatic bone or the Temporal bone, by using an attachment device, such as a headset ring, that is placed behind the ear and is used for receiving a signal that is delivered to the earpiece. Bone conduction speaker 120 produces vibrations and is used for conducting the signal to the other (uncovered) ear by using the bone as a conducting media.
The earpiece also has an in-ear part 110 that includes an in-ear speaker that delivers an audio to the covered ear and an in-ear microphone that is used for picking up the in-ear signal, i.e. the audio that is heard by the user. It should be noted that in-ear part 110 can be attached to the pinna instead of being placed inside the ear, although, for simplicity, it will be referred to it as an in-ear part (in-ear speaker and in-ear microphone). The picked up in-ear signal is used for calculation of undesired audio, by subtracting the desired signal from the picked up in-ear signal. The undesired audio can be: an ambient noise, a leakage signal which is a side effect of the bone conducting or a combination of both ambient noise and the leakage signal.
The headset can also include a standard or in-ear microphone (not shown) to pick up the voice of the user during the voice call.
The earpiece can be used for different modes of operation such as: (i) Delivering a stereo signal to both the covered ear and the uncovered ear; (ii) Delivering mono voice calls to both ears simulating the effect of using a headset with two earpieces wherein each earpiece attached to one ear; (iii) Hearing voice calls with a special earpiece that reduces the ambient noise effect in the covered and uncovered ear; and (iv) Delivering stereo or mono signal like in (i) or (ii), and in addition reducing the ambient noise like in (iii).
Earpiece 200 includes: (i) an in-ear speaker 210; (ii) an in-ear microphone 220 for sensing the signal that is in the ear canal; (iii) a bone conduction speaker 230 for conducting of audio to the uncovered ear through the bone. bone conduction speaker 230 is placed closed to the bone of the user on the same side of the user's face where in-ear speaker 210 is located; (iv) a processor 240 for receiving: two audio signals in case of a stereo mode and one audio signal in case of a mono mode (namely R(n)=L(n)); a signal that was picked up from the ear canal by in-ear microphone 220; and a signal from an audio interface 260. Processor 240 further processes the received signals. Processor 240 can be a Digital Signal Processing (DSP), an ARM processor or any other processor; Audio interface 260 is an interface between an audio device (not shown, e.g. an audio player or a cellular phone) and earpiece 200. Audio interface 260 can include a splitter for splitting a mono signal into two equal signals. Audio interface 260 can communicate with the audio device by using a wireless technique (e.g. Bluetooth, Wi-Fi) or a wired connection. In the former case audio interface 260 includes a wireless receiver and in the latter case audio interface 260 includes an analog interface or a digital interface, in case of analog interface 260 will include ADC (Analogue to Digital Convertor) to convert the analog signal into digital signal; Power source 255 for supplying power for earpiece 200; An ADC and DAC (Digital to Analogue Convertor) units 241 are coupled to processor 240 and converts an analog signal to a digital signal and a digital signal to an analog signal, respectively; and a memory 250 to be used by processor 240 for intermediate storing of calculation data. The earpiece can also include a standard microphone or an in-ear microphone for picking up the voice of the user during a voice call.
A stereo signal 280 is transmitted from the audio device and received by audio interface 260. Stereo signal 280 includes two signals: a left signal, denoted L(n) 282 that is excepted to be heard by the left ear of the user and a right signal, denoted R(n) 281 that is expected to be heard by the right ear. Assuming that earpiece 200 is attached to the right ear of the user, in this configuration, in-ear speaker 210 will deliver the right signal R(n) 281 and bone conduction speaker 230 that is also attached to the right ear will deliver left signal L(n) 282. L(n) 282 signal propagates through the bone to the left ear with an attenuation α. L(n) 282 propagates to the right ear as well, but with a different attenuation β. It should be noted that α and β may be frequency dependent, however for the sake of simplicity, we refer to α and β as frequency independent. The modification to frequency dependent is straight forward and can be understood by a person skilled in the art.
Conveniently, the signal that is fed to the bone conduction is equalized in order to improve the signal, however for simplicity of the explanation, we assume that no equalization is done. The modification with equalizer is straight forward and can be understood by those skilled in the art.
Thus, supposed only L(n) 282 is applied, the left and right ear will hear:
Left-ear(n)=αL(n)and Right-ear(n)=βL(n). (i)
Adding the contribution of in-ear speaker 210 that delivers R(n) 281 results:
Left-ear(n)=αL(n)and Right-ear(n)=βL(n)+R(n). (ii)
The target is to process these pair of signals such that the user will hear the original right signal, R(n) 281, in his right ear and the original left signal, L(n) 282, in his left ear as in a standard stereo headset. Thus, the targeted Left-ear(n) and Right-ear(n) should be: Left-ear(n)=L(n) and Right-ear(n)=R(n).
It worthwhile to mention that a similar process will be conducted, if earpiece 200 is placed on the left ear with the appropriate modifications applied to the left and right signals.
Processor 240 receives the input signals: L(n) 282 and R(n) 281 from audio interface 260. A Volume and balance control 245 is also provided to processor 240. Volume and balance control 245 is controlled by the user that operates the audio device and is delivered to earpiece 200 through a wired channel or a wireless channel.
Processor 240 performs all the necessary processing to meet the target of Left-ear(n)=L(n) and Right-ear(n)=R(n), as described for
An amplifier 320 is controlled by the user via volume and balance control 245. Amplifier 320 is fed with Left signal L(n) 282. The user chooses a gain G for left signal L(n) 282 in order to balance between the left and right signals that he hears. The amplifying results an amplified signal 361 of a magnitude L(n)G. Amplified signal 361 is fed to bone conduction speaker 230 that is on the right side of the skull and amplified signal 361 propagates to the left side of the skull via the bone. During the propagation the signal is attenuated by α, this effect is represented by block 310. Thus the user will hear in his left ear an attenuated signal 362 of a magnitude: L(n)Gα.
In his right ear the user is supposed to hear R(n) 281. Assuming that R(n) and L(n) should be balanced, it is expected that the user will choose a gain G such that Gα≈1, hence, the signal heard in the left ear:
Left-ear(n)=L(n)Gα≈L(n). (iii)
Left signal L(n) 282 also propagates via the bone to the right ear. In this route, left signal L(n) 282 is attenuated by a magnitude of β, as represented by block 330. Since it was assumed that bone conduction speaker 230 is attached to the right ear of the user, the distance between bone conduction speaker 230 and the right ear is shorter than the distance between bone conduction speaker 230 and the left ear. Hence the attenuation β, which is the attenuation applied to the signal during to its propagation to the right ear, is different than the attenuation α, that is applied to the signal during to its propagation to the left ear. The portion of left signal L(n) 282 that will arrive the right ear is: L(n)Gβ.
Right signal R(n) is injected by in-ear speaker 210 to the right ear, hence the total signal that is heard by the right ear is:
R(n)+L(n)Gβ. (iv)
This addition of signals, that is taking place in the ear canal, is demonstrated by an addition symbol 323. Note that dashed block 370 demonstrates phenomena that take place in the ear canal and not processes that are being handled by processor 240.
In order that the user will hear in his right ear only the right signal R(n), processor 240 performs the following process.
Left signal L(n) 282 is fed to an adaptive filter 340 with an impulse response H(n). Impulse response H(n) is updated by a process update calculation 350, as described later on. Adaptive filter 340 results a signal −L(n)*H(n) 364 that is injected to in-ear speaker 210. Signal 364 of −L(n)*H(n) is added in the ear to signal 365 of R(n)+L(n)Gβ as presented by an addition symbol 321. The output of this addition is denoted as {circumflex over (R)}(n) where:
{circumflex over (R)}(n)=R(n)+L(n)*(Gβ−H(n)) (v)
Equation (v) represents a right output signal 366 that is heard by the user in the right ear. Right output signal 366 is picked up by in-ear microphone 220 and the signal is also denoted as in-ear-mic(n).
To achieve the target of {circumflex over (R)}(n)=R(n) we calculate at an error calculator 322 an error e(n) where:
e(n)=in_ear_mic(n)−R(n). (vi)
Error calculator 322 feeds update calculation 350 with error e(n) 367. Error calculation 350 can use LMS (Least mean square) algorithm or any other algorithm to find coefficients of the filter response H(n) of adaptive filter 340, that minimizes e(n). Once the minimum of e(n) is achieved, the right ear will hear: {circumflex over (R)}(n)≈R(n)
In the case of mono voice call, the same process is done where R(n)=L(n). In this case, if the minimum of e(n) is not small enough, the user still hear a mono signal in both ears which will give him the desired impression.
According to some embodiments of the invention, earpiece 200 can reduce the ambient noise in the uncovered ear. This is important especially when earpiece 200 is used for receiving voice call, in which case the ambient noise can significantly affect the intelligibility of the speech. The following embodiments are provided for the ambient noise reduction.
When earpiece 200 is placed on the right ear, the ambient noise penetrating the right ear does not significantly block the voice, as the user can increase the volume of the voice call as to mask the ambient noise in the covered ear. However the ambient noise that is penetrating the uncovered ear cannot be masked by increasing the volume in the covered ear.
Earpiece 200 can reduce the ambient noise effect significantly as follows: The voice of the call is injected to in-ear speaker 210 and to the bone conduction speaker 230. The voice that is injected to the bone will be heard on the left side as was described for
According to another embodiment of the invention, a blocking or reduction of the ambient noise in the uncovered ear is done by a noise subtraction mechanism. The following description refers to an example in which earpiece 200 is attached to the right ear of the user and the left ear is uncovered.
The voice of an incoming call is injected to in-ear speaker 210 and a noise reduction signal is injected to bone conduction speaker 230. The canceling signal reflects an estimated ambient noise with an appropriate phase change applied to it. The ambient noise will enter the left ear and will be partially eliminated by the noise reduction signal that also enters the uncover ear through the bone, such that the total noise that is heard in the left ear is reduced.
The ambient noise can be estimated by adding an external microphone for picking up the ambient noise, or alternatively, by using in-ear microphone 220, with some additional processing.
Earpiece 200 can be embedded in a mobile phone 400, as illustrated in
There are many headsets that are designed to cancel ambient noise, most of them cover the pinna and estimate the ambient noise by using external microphone. According to an embodiment of the invention, in-ear microphone 220 does not measure the ambient noise, but rather the signal in the ear canal which is the actual signal the user hear.
Processor 240 can be a DSP, ARM or any other processor. Processor 240 is attached to ADC and DAC units 241 that converts analog signal to digital or digital signal to analog signal. The input of processor 240 are left and right signals L(n) 282 and R(n) 281 supplied by audio interface 260. In addition volume and a balance control 245 is provided to processor 240.
Although
Processor 240 estimates the ambient noise and cancels it or part of it, from both ears.
The right in-ear microphone 221 picks up the sum of right signal R(n) 281 and the noise in the right ear canal N_canal_right(n). The left in-ear microphone 222 picks up the sum of left signal L(n) 282 and the noise in the left ear canal N_canal_left(n). The aim of processor 240 is to process the received in-ear microphone signals so that the user will hear the original left signal L(n) 282 on his left ear and the original right signal R(n) 281 on the right ear.
wherein Sl(n) is a picked up signal 710 and Nl(n) is the noise that is picked up by the left ear.
The ambient noise is estimated and at least partially subtracted from the left picked up signal 710. The user can decide not to cancel all the ambient noise but only a portion thereof, namely {circumflex over (L)}(n)=Sl(n)−δ{circumflex over (N)}l(n) where δ is chosen by the user.
Conveniently, processor 240 can analyzed the type of the ambient noise and detect some predefined signal types such as ambulance/police siren, horn from a car or some other predefined signals. Once a predefined signal type is detected, processor 240 will automatically reduce the volume of the music sound in order that the user will be able to hear the external sound. Alternatively, processor 240 will signal the user by a synthesized sound or in any other way that the predefined signal type was detected.
Method 800 begins with a stage 810 of receiving an audio signal. The audio signal can be a stereo signal or a mono voice call. The audio signal includes a first input signal that is intended to be heard by an uncovered ear of a user and a second signal that is intended to be heard by a covered ear of the user. If the audio signal is a mono signal, stage 810 further includes splitting the audio signal, such that the first input signal is equal to the second input signal.
Stage 810 is followed by stages 820, and 850 that are simultaneously executed.
Stage 820 includes amplifying the first input signal by a gain factor G, for producing an amplified signal. The gain factor G is set by the user and stage 820 can include receiving, from the user device, a volume and balance control indicating the gain factor. Controlling the gain can partially masks the ambient noise in the uncovered ear.
Stage 820 is followed by stage 840 of injecting the amplified signal to a bone conduction speaker and outputting an output signal by the bone conducting speaker in response to the first input signal.
The output signal propagates through the bone and arrives to the covered ear with an attenuation β. Thus, when the first input signal arrives to the covered ear it is multiplied by a propagation factor Gβ. This signal is referred to as a leakage signal.
Stage 850 includes filtering the first input signal by an adaptive filter to provide a filtered signal that once played to the second ear of a user by an in-ear speaker reduces an audio effect of the leakage signal on the second ear of the user.
Stages 840 and 850 are followed 870 of sending, to an in-ear speaker, the filtered signal and the second input signal providing an in-ear audio signal to the second ear of the user, by the in-ear speaker, in response to the filtered signal and the second input signal.
Stage 870 is followed by stage 880 of sensing, by an in-ear microphone, a sensed audio signal. The sensed audio signal is responsive to the second input signal, the leakage signal and the filtered signal.
Stage 880 is followed by stage 890 of updating an impulse response of the adaptive filter in order to reduce a contribution of the leakage signal to the sensed audio signal. Stage 890 is followed by stage 850.
Stage 900 starts with a stage 910 of receiving an input signal. The input signal can be a mono or a stereo signal. If the input signal is a stereo signal then the input signal includes a first input signal that is different than the second input signal and if the input signal is a mono signal then the input signal includes a first input signal that is the same as the second input signal.
Stage 910 is followed by stage 920 of sending the first input signal to a first ear by a bone conduction speaker.
Stage 920 is followed by stage 930 of providing an in-ear audio signal to a second ear of a user, by the in-ear speaker, in response to the second input signal.
Stage 930 is followed by stage 940 of sensing, by an in-ear microphone that is proximate to the second ear of the user, a sensed audio signal; wherein the sensed audio signal is affected by the in-ear audio signal and another signal that represents an interference audio signal that is heard by the second ear of the user. The interference audio signal can be an ambient noise.
Stage 940 is followed by stage 950 of calculating a compensating signal that once provided to a bone conductor speaker will cause the bone conductor speaker to output an output signal that reduces an audio effect of the interference audio signal on a first ear of the user. The interference audio signal is an undesired signal such as an ambient noise. This stage can either eliminate or reduce the ambient noise. The compensating signal can be provided by using adaptive filter 340 of
Method 900 can include stage 980 of closing the first ear of the user by an earplug or even a finger as to improve a signal to noise in the first ear due to an occlusion effect. Since the audio is provided to the first ear through the bone, closing the ear does not interfere the providing of the input audio, but rather reduces the ambient noise effect.
While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.
This application claims the benefit of U.S. provisional application Ser. No. 61/112,785, filed on Nov. 10, 2008 (and entitled Stereo Method And System), which is incorporated in their entirety herein by reference.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IL09/01053 | 11/10/2009 | WO | 00 | 8/23/2011 |
Number | Date | Country | |
---|---|---|---|
61112785 | Nov 2008 | US |