The present disclosure relates to a system and microphone headrest configurations for cancelling in-cabin noise from a vehicle at a far-end user of a telecommunications system.
Current vehicle cabin acoustics predicate that any sound that occurs in the cabin will generally be perceived as one noisy stimulus. Common examples of interference sources include road noise, wind noise, passenger speech, and multimedia content. The presence of these noise sources complicates speech perception by reducing speech intelligibility, signal-to noise ratio, and subjective call quality. Many modern techniques exist to improve the telecommunications experience for the near-end participants (i.e., driver or other occupants of the source vehicle), but thus far nothing has attempted to improve call quality for the far-end participants of telecommunication.
A system of one or more computers can be configured to perform particular operations or actions by virtue of having software, firmware, hardware, or a combination of them installed on the system that in operation causes or cause the system to perform the actions. One or more computer programs can be configured to perform particular operations or actions by virtue of including instructions that, when executed by data processing apparatus, cause the apparatus to perform the actions. One general aspect includes a noise cancellation system for a vehicle including: at least one microphone array having at least two microphones mounted to a first headrest and spaced apart in a longitudinal direction, where a distance separating the two microphones creates at least a first listening zone and a second listening zone, and where the second listening zone is oriented in the longitudinal direction relative to the first listening zone. The noise cancelation system may further include a digital signal processor programmed to: receive microphone signals indicative of sound from the at least one microphone array; and identify whether the sound is received from the first listening zone or the second listening zone based on the microphone signals. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.
Implementations may include one or more of the following features. The microphones may be positioned within the first listening zone, and the digital signal processor may be further programmed to suppress sound received from the second listening zone. The second listening zone may be rearward of the first listening zone. The digital signal processor being programmed to identify whether the sound is received from the first listening zone or the second listening zone may be programmed to: compare the microphone signals from the two microphones; and localize a direction of the sound from either the first listening zone or the second listening zone based on a time difference of arrival of the microphone signals at each of the two microphones. The microphones may be omnidirectional. The microphones may be located on an inboard side surface of the first headrest. Alternatively, the microphones may be located on a bottom surface of the first headrest. The two microphones may be further separated in a lateral direction with respect to the vehicle, and the first listening zone may include two listening subzones oriented in the lateral direction relative to each other. The digital signal processor may be further programmed to suppress sound received from one of the listening subzones.
The noise cancellation system may further include a second microphone array having at least two microphones. The microphones in the second microphone array may be mounted to a bottom surface of a second headrest laterally adjacent to the first headrest. The two microphones in the second headrest may be spaced apart in both the longitudinal direction and the lateral direction.
The noise cancellation system may further include a second microphone array having at least two microphones mounted in a rearview mirror assembly. The at least two microphones in the second microphone array may be spaced apart in a lateral direction with respect to the vehicle. The at least two microphones in the rearview mirror assembly may be directional microphones such that the first listening zone includes two listening subzones oriented in the lateral direction with respect to the vehicle Implementations of the described techniques may include hardware, a method or process, or computer software on a computer-accessible medium.
Another general aspect includes a microphone array for a communications system associated with a vehicle. The microphone array may include: a first microphone mounted adjacent to an external surface of a headrest; and a second microphone mounted adjacent to the external surface of the headrest and spaced-apart from the first microphone in a longitudinal direction. At least a longitudinal distance may separate the first microphone from the second microphone to create at least a first listening zone and a second listening zone oriented in a longitudinal direction with respect to the vehicle.
Implementations may include one or more of the following features. The first microphone and the second microphone may be omnidirectional microphones. The first and second microphones may be located on an inboard side surface of the headrest. Alternatively, the first and second microphones may be located on a bottom surface of the first headrest. The first microphone and the second microphone may be further separated by a lateral distance such that the first listening zone includes two listening subzones oriented in a lateral direction with respect to the vehicle. Another general aspect may include a headrest for a vehicle having a communications system including a headrest body having an external surface and a microphone array. The microphone array may include: a first microphone mounted adjacent to an external surface of a headrest; and a second microphone mounted adjacent to the external surface of the headrest and spaced-apart from the first microphone in a longitudinal direction. At least a longitudinal distance may separate the first microphone from the second microphone to create at least a first listening zone and a second listening zone oriented in a longitudinal direction with respect to the vehicle.
Implementations may include one or more of the following features. The external surface may include an inboard side surface and the first and second microphones may be mounted to the inboard side surface. The external surface may include a bottom surface and the first and second microphones may be mounted to the bottom surface.
As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
Any one or more of the controllers or devices described herein include computer executable instructions that may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies. In general, a processor (such as a microprocessor) receives instructions, for example from a memory, a computer-readable medium, or the like, and executes the instructions. A processing unit includes a non-transitory computer-readable storage medium capable of executing instructions of a software program. The computer readable storage medium may be, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semi-conductor storage device, or any suitable combination thereof.
The present disclosure describes an in-vehicle noise-cancellation system for optimizing far-end user experience. The noise-cancellation system may improve the intelligibility of near-end speech at the far-end of a communications exchange, including a telecommunications exchange or dialogue with a virtual personal assistant, or the like. The noise-cancellation system may incorporate real-time acoustic input from the vehicle, as well microphones from a telecommunications device. Moreover, audio signals from small, embedded microphones mounted in the car can be processed and mixed into an outgoing telecommunications signal to effectively cancel acoustic energy from one or more unwanted sources in the vehicle. Audio playing from a known audio stream (e.g., music, sound effects, and dialog from a film audio) in the vehicle's infotainment system, in addition to unwanted noise (e.g., children yelling and background conversations) captured by the embedded microphones, may be used as direct inputs to the noise-cancellation system. As direct inputs, these streams can, therefore, be cancelled from the outgoing telecommunications signal, thus providing the user's far-end correspondent with much higher signal-to-noise ratio, call quality, and speech intelligibility.
A first microphone array 124 may be located in the vehicle cabin 120 to receive speech of the near-end participant (i.e., driver or another occupant of the source vehicle) in a telecommunication. A second microphone array 126 may be located in the vehicle cabin 120 to detect unwanted audio sources (e.g., road noise, wind noise, background speech, and multimedia content), collectively referred to as noise. Collectively, the telecommunications system 110, the DSP 114, the infotainment system 116, the transducers 118, 122, and the microphone arrays 124, 126 may form an in-cabin noise cancellation system 128 for far-end telecommunications.
The output of the equalizer 206 may be received by a limiter 208. A limiter is a circuit that allows signals below a specified input power or level to pass unaffected while attenuating the peaks of stronger signals that exceed this threshold. Limiting is a type of dynamic range compression; it is any process by which a specified characteristic (usually amplitude) of the output of a device is prevented from exceeding a predetermined value. Limiters are common as a safety device in live sound and broadcast applications to prevent sudden volume peaks from occurring. A digitally processed incoming telecommunications signal 112a′ may then be received by the first transducer 118 for audible transmission to the near-end participant of the telecommunications exchange.
As also shown in
Both inputs to the first and second microphone arrays, near-end speech and noise, respectively, may be processed using the DSP 114. A set of first audio signals 209 (i.e., indicative of the near-end speech) from the first microphone array 124 may be fed into a first beamformer 210 for beamforming, while a set of second audio signals 211 (i.e., indicative of noise) may be fed into a second beamformer 212. Beamforming or spatial filtering is a signal processing technique used in sensor arrays for directional signal transmission or reception. This is achieved by combining elements in an array in such a way that signals at particular angles experience constructive interference while others experience destructive interference. Beamforming can be used at both the transmitting and receiving ends to achieve spatial selectivity. The improvement compared with omnidirectional reception/transmission is known as the directivity of the array. To change the directionality of the array when transmitting, a beamformer controls the phase and relative amplitude of the signal at each transmitter, to create a pattern of constructive and destructive interference in the wavefront. When receiving, information from different sensors is combined in a way where the expected pattern of radiation is preferentially observed.
The first beamformer 210 may output a near-end speech signal 213 indicative of the near-end speech detected by the first microphone array 124. Alternatively, the near-end speech signal 213 may be received by the DSP 114 directly from the first microphone array 124 or an individual microphone in the first microphone array. The second beamformer 212 may output a noise signal 218 indicative of the unpredictable, background noise detected by the second microphone array 126. Alternatively, the noise signal 218 may be received by the DSP 114 directly from the second microphone array 126 or an individual microphone in the second microphone array.
The near-end speech signal 213 may be received by an echo canceller 214 along with the digitally processed incoming telecommunications signal 112a′ from the far-end participant 106. Echo cancellation is a method in telephony to improve voice quality by removing echo after it is already present. In addition to improving subjective quality, this process increases the capacity achieved through silence suppression by preventing echo from traveling across a network. There are various types and causes of echo with unique characteristics, including acoustic echo (sounds from a loudspeaker being reflected and recorded by a microphone, which can vary substantially over time) and line echo (electrical impulses caused by, e.g., coupling between the sending and receiving wires, impedance mismatches, electrical reflections, etc., which varies much less than acoustic echo). In practice, however, the same techniques are used to treat all types of echo, so an acoustic echo canceller can cancel line echo as well as acoustic echo. Echo cancellation involves first recognizing the originally transmitted signal that re-appears, with some delay, in the transmitted or received signal. Once the echo is recognized, it can be removed by subtracting it from the transmitted or received signal. Though this technique is generally implemented digitally using a digital signal processor or software, although it can be implemented in analog circuits as well.
The output of the echo canceller 214 may be mixed with the noise signal 218 (i.e., unpredictable noise) from the second beamformer 212 and an infotainment audio signal 220 (i.e., predictable noise) from the infotainment system 116 at a noise suppressor 216. Mixing the near-end speech signal 213 with the noise signal 218 and/or the infotainment audio signal 220 at the noise suppressor 216 can effectively cancel acoustic energy from one or more unwanted sources in the vehicle 104. The audio playing from a known audio stream (e.g., music, sound effects, and dialog from a film audio) in the vehicle's infotainment system 116 may be considered predictable noise and may be used as a direct input to the noise-cancellation system 128 and cancelled or suppressed from the near-end speech signal 213. Moreover, additional unwanted and unpredictable noise (e.g., children yelling and background conversations) captured by the embedded microphones may also be used as direct inputs to the noise-cancellation system 128. The unwanted noise may be cancelled or suppressed from the near-end speech signal 213 by the noise suppressor 216 based on the noise signal 218 and the infotainment audio signal 220 before being communicated to the far-end participant as an outgoing telecommunications signal 112b. Noise suppression is an audio pre-processor that removes background noise from the captured signal.
A noise-suppressed, near-end speech signal 213′ may be output from the noise suppressor 216 and may be mixed with the processed incoming telecommunications signal 112a′ from the far-end participant at an echo suppressor 222. Echo suppression, like echo cancellation, is a method in telephony to improve voice quality by preventing echo from being created or removing it after it is already present. Echo suppressors work by detecting a voice signal going in one direction on a circuit, and then inserting a great deal of loss in the other direction. Usually the echo suppressor at the far-end of the circuit adds this loss when it detects voice coming from the near-end of the circuit. This added loss prevents the speaker from hearing their own voice.
The output from the echo suppressor 222 may then undergo automatic gain control at an automatic gain controller (AGC) 224. The AGC 224 may provide a controlled signal amplitude at its output, despite variation of the amplitude in the input signal. The average or peak output signal level is used to dynamically adjust the input-to-output gain to a suitable value, enabling the circuit to work satisfactorily with a greater range of input signal levels. The output from the AGC 224 may then be received by an equalizer 226 to equalize the near-end speech signal. Equalization is the process of adjusting the balance between frequency components within an electronic signal. Equalizers strengthen (boost) or weaken (cut) the energy of specific frequency bands or “frequency ranges.”
The output from the equalizer 226 may be sent to a loss controller 228 to undergo loss control. The output may then be passed through a comfort noise generator (CNG) 230. CNG 230 is a module that inserts comfort noise during periods that there is no signal received. CNG may be used in association with discontinuous transmission (DTX). DTX means that a transmitter is switched off during silent periods. Therefore, the background acoustic noise abruptly disappears at the receiving end (e.g. far-end). This can be very annoying for the receiving party (e.g., the far-end participant). The receiving party might even think that the line is dead if the silent period is rather long. To overcome these problems, “comfort noise” may be generated at the receiving end (i.e., far-end) whenever the transmission is switched off. The comfort noise is generated by a CNG. If the comfort noise is well matched to that of the transmitted background acoustic noise during speech periods, the gaps between speech periods can be filled in such a way that the receiving party does not notice the switching during the conversation. Since the noise constantly changes, the comfort noise generator 230 may be updated regularly.
The output from the CNG 230 may then be transmitted by the telecommunications system to the far-end participant of the telecommunications exchange as the outgoing telecommunications signal 112b. By cancelling noise inputs directly from the outgoing telecommunications signal, a user's far-end correspondent may be provided with much higher signal-to-noise ratio, call quality, and speech intelligibility.
Although shown and described as improving near-end speech intelligibility at a far-end participant of a telecommunications exchange, the noise-cancellation system 128 may be employed to improve near-end speech intelligibility at a far-end of any communications exchange. For instance, the noise-cancellation system 128 may be used in connection with virtual personal assistance (VPA) applications to optimize speech recognition at the far-end (i.e., a virtual personal assistant). Accordingly, background (unwanted) noise may be similarly suppressed or canceled from the near-end speech of a communications exchange with the VPA.
The near-end speech signal may be received at a noise suppressor along with the noise inputs received at step 310 and an incoming telecommunications signal for the far-end participant (step 320). During noise cancelling, the noise may be cancelled or suppressed from the near-end speech signal, as provided at step 325. At step 330, intelligibility of the speech in the near-end speech signal may be restored by reducing or cancelling the effects of masking by extraneous sounds. The near-end speech signal may then undergo echo suppression using the incoming telecommunications signal, as provided at step 335. As previously described, echo suppression, like echo cancellation, is a method in telephony to improve voice quality by preventing echo from being created or removing it after it is already present. The near-end speech signal may undergo additional audio filtering at step 340 before it is transmitted to the far-end participant (step 345) via the telecommunications network as an outgoing telecommunications signal. Meanwhile, the incoming telecommunications signal may be played in the vehicle cabin through speakers (step 350).
The external surface 712 of the first headrest 714 may include an inboard side surface 716 and an outboard side surface 718. The inboard side surface 716 may be nearer a center of the vehicle cabin 120 than the outboard side surface 718, which is nearer a side of the vehicle 104, including reflective surfaces 412 (see
The digital signal processor 114 may be programmed to receive microphone signals indicative of sound from the microphone array 710, as shown in
According to an embodiment, the first and second microphones 710a,b may be omnidirectional microphones. According to another embodiment, the first and second microphones 710a,b may be directional microphones having a directivity in the direction of the corresponding listening zones. Accordingly, incoming sound may be attenuated based on the directivity of the microphones such that sound from the first listening zone 720 may be transmitted to a far-end participant while sound from the second listening zone 722 may be suppressed.
As shown in
As is further shown in
At least one headrest 1042 in a second row of seating 1044 may include a third microphone array 1046 similar to the microphone array 710 depicted in
While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention. Additionally, the features of various implementing embodiments may be combined to form further embodiments of the invention.
This application is the U.S. National Stage of International Application No. PCT/IB2018/060741 filed on Dec. 31, 2018, which claims the benefit of U.S. Provisional Application No. 62/612,252, filed Dec. 29, 2017, and U.S. Provisional Application No. 62/613,206, filed Jan. 3, 2018, the disclosures of which are hereby incorporated in their entirety by reference herein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2018/060741 | 12/31/2018 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2019/130282 | 7/4/2019 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
10219072 | Sullivan, Jr. | Feb 2019 | B1 |
20020031234 | Wenger et al. | Mar 2002 | A1 |
20030097257 | Amada | May 2003 | A1 |
20060147063 | Chen | Jul 2006 | A1 |
20060269072 | Mao | Nov 2006 | A1 |
20110054891 | Vitte | Mar 2011 | A1 |
20120197637 | Gratke | Aug 2012 | A1 |
20130251159 | Buck et al. | Sep 2013 | A1 |
20140056435 | Kjems et al. | Feb 2014 | A1 |
20150325251 | Dusan et al. | Nov 2015 | A1 |
20160027428 | Gul et al. | Jan 2016 | A1 |
20160257227 | Takada | Sep 2016 | A1 |
20170032806 | Konjeti | Feb 2017 | A1 |
20180295443 | Takada | Oct 2018 | A1 |
20190251955 | Degraye | Aug 2019 | A1 |
Number | Date | Country |
---|---|---|
10200034237 | Oct 2011 | DE |
1830348 | Sep 2007 | EP |
Entry |
---|
EP-0624046-A1, Andrae, Apr. 27, 1994 (translated in English). (Year: 1994). |
Number | Date | Country | |
---|---|---|---|
20210067873 A1 | Mar 2021 | US |
Number | Date | Country | |
---|---|---|---|
62612252 | Dec 2017 | US | |
62613206 | Jan 2018 | US |