Patent Grant
10154355
This application claims priority to and the benefit of Danish Patent Application No. PA 2013 70827 filed on Dec. 30, 2013, pending, and European Patent Application No. 13199856.9 filed on Dec. 30, 2013, pending. The entire disclosures of both of the above applications are expressly incorporated by reference herein.
The present disclosure relates to a hearing device and a method of operating a hearing device. In particular, the present disclosure relates to a hearing device with position data and related method for improving the correspondence of the visual and the auditory cues of a hearing aid user in a crowded environment.
It is known to stream audio to hearing devices via a telecoil solution having a limited bandwidth with limited possibilities of separating different audio streams. Further, wireless communication to and from hearing devices has been increasing in continuation of the developments within wireless communication technology. In an environment where audio is distributed to the crowd via a number of external microphones or other audio sources the present technology provides limited possibilities of separating audio signals from different positions.
There is a need for a hearing device that improves separation of audio signals from different audio sources in an audio system.
Despite the known solutions there is still a need for improved user experience in a crowded area with multiple microphones/audio sources.
Accordingly, a hearing device is provided, the hearing device comprising a first antenna, a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream; a primary processing unit adapted for processing an input signal according to a hearing prescription in order to alleviate a hearing loss; an acoustic output transducer coupled to an output of the primary processing unit for conversion of an output signal from the primary processing unit into an audio output signal; at least one microphone; a secondary processing unit with a first input coupled to an output of the first transceiver for receiving a first wireless input signal representative of the first audio stream from the first transceiver; and a position controller for detecting position data of the hearing device, the position controller having an output coupled to a position input of the secondary processing unit for sending a position control signal to the secondary processing unit; wherein the secondary processing unit is configured to process the first wireless input signal from the first transceiver based on the position control signal.
Also disclosed is a method for operating a hearing device, the method comprising: receiving a first audio stream; converting the first audio stream to a first wireless input signal; determining position data of the hearing device; processing the first wireless audio signal based on the position data of the hearing device to form an output signal; and converting the output signal to an audio output signal.
It is an advantage that processing of wireless input signal(s) in the hearing device is based on the position (direction and/or distance) of the hearing device, thereby improving the user experience of the hearing device. Thus, the position (distance and/or orientation) of the hearing device may provide prioritization of input signals.
Further, the disclosed hearing aid and methods improve the correspondence of the visual and the auditory cues of the listener, otherwise lost in crowd amplification.
The primary processing unit and/or the secondary processing unit of the hearing device may be configured to compensate for hearing loss or hearing disability of the user of the hearing device. The primary processing unit and/or the secondary processing unit of the hearing device may be configured to alter a received audio stream, e.g. the first audio stream, a wireless input signal, e.g. the first wireless input signal, and/or the input signal to compensate for hearing loss or hearing disability of the user of the hearing device.
The hearing device comprises a secondary processing unit and a primary processing unit. The secondary processing unit and the primary processing unit may be embedded as a single processing unit performing the tasks of both the secondary processing unit and the primary processing unit.
A hearing device includes: a first antenna; a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream; a primary processing unit configured to perform signal processing according to a hearing prescription to alleviate a hearing loss; an acoustic output transducer coupled to an output of the primary processing unit for conversion of an output signal from the primary processing unit into an audio output signal; a secondary processing unit with a first input coupled to an output of the first transceiver for receiving a first wireless input signal representative of the first audio stream from the first transceiver; a position controller for determining position data of the hearing device, the position controller having an output for sending a position control signal to the secondary processing unit; and at least one microphone coupled to the secondary processing unit; wherein the secondary processing unit is configured to process the first wireless input signal from the first transceiver based on the position control signal.
Optionally, the position controller comprises a motion detector, and a position processing unit connected to the motion detector and configured to determine the position data of the hearing device based on an output from the motion detector.
Optionally, the position data comprises angular position data of the hearing device, and wherein the position control signal is based on the angular position data of the hearing device.
Optionally, the hearing device is configured to determine a first gain for application to the first wireless input signal based on the position data of the hearing device.
Optionally, the one or more audio streams includes a second audio stream, and wherein the secondary processing unit is configured to receive a second wireless input signal representative of the second audio stream from the first transceiver, and process the second wireless input signal based on the position control signal.
Optionally, the hearing device is configured to determine a second gain for application to the second wireless input signal based on the position data of the hearing device.
Optionally, the hearing device further includes a second antenna connected to the position controller for communication with the audio system.
Optionally, the position controller is configured for receiving audio system position data, and wherein the position control signal is based on the audio system position data.
Optionally, the at least one microphone includes a first microphone for receiving an acoustic audio signal and converting the acoustic audio signal to an audio input signal, the first microphone coupled to a second input of the secondary processing unit and configured to provide the audio input signal to the secondary processing unit, and wherein the secondary processing unit is configured to process the audio input signal based on the position control signal.
A method for operating a hearing device includes: receiving a first audio stream; converting the first audio stream to a first wireless input signal; determining position data of the hearing device; processing the first wireless audio signal based on the position data of the hearing device to form an output signal; and converting the output signal to an audio output signal.
Optionally, the method further includes receiving an acoustic audio signal; and converting the acoustic audio signal to an audio input signal; wherein the output signal is formed by processing the audio input signal and the first wireless audio signal based on the position data of the hearing device.
Other features and embodiments will be described below in the detailed description.
The above and other features and advantages will become readily apparent to those skilled in the art by the following detailed description of exemplary embodiments thereof with reference to the attached drawings, in which:
Various embodiments are described hereinafter with reference to the figures. It should be noted that the figures are not necessarily drawn to scale and that elements of similar structures or functions are represented by like reference numerals throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or if not so explicitly described.
The present disclosure relates to a hearing device and a method enabling adaptation of signal processing in the hearing device based on position data of the hearing device and/or position data of an audio system comprising one or more audio sources.
The hearing device comprises a first transceiver coupled to the first antenna and configured to wirelessly receive one or more audio streams from an audio system, the one or more audio streams including a first audio stream. The first transceiver may be configured to receive and/or sent position data of the audio system and/or the hearing device.
The hearing device comprises a position controller for detecting position data of the hearing device. The position controller has an output coupled to a position input of the secondary processing unit for sending a position control signal to the secondary processing unit. The position controller may comprise a motion detector and a position processing unit connected to the motion detector. The position processing unit is configured to estimate position data of the hearing device based on motion sensor output. The motion detector may comprise one or a plurality of sensors e.g. one or more gyroscopes and/or one or more accelerometers.
The position controller may be configured for determining a position control signal based on the position data of the hearing device. The position controller may comprise a position port and may be configured to receive audio system position data and/or send hearing device position data via the position port. Accordingly, the position controller may be configured for receiving audio system position data, and the position control signal may be based on the audio system position data. The position port may be coupled to the first transceiver and/or second transceiver. Thus, the position controller may be configured to determine and send position control signal based on audio system position data received via the position port. The position controller may comprise a control port for coupling to the primary processing unit for exchange of control signals.
The position data of the hearing device may comprise angular position data of the hearing device, and the position control signal is based on angular position data of the hearing device.
For example, the position data may comprise information of the azimuth angle of the hearing device. The azimuth angle may be indicative of the looking direction of the user wearing the hearing device. Alternatively, or additionally, the position data may comprise information of the altitude angle.
The position data may comprise distance position data of the hearing device. For example, the position data may comprise information of the distance of the hearing device relative to an audio source and/or a reference point.
The secondary processing unit is configured to process input signal(s) such as audio input signal and/or wireless input signal(s) depending on the position control signal.
The position control signal may select the value(s) of gain(s) applied to input signal(s) to the secondary processing unit. Thus the position control signal may be indicative of gain(s) to be applied to input signal(s) to the secondary processing unit. Accordingly, the position control signal may select a value of a first gain to be applied to the first wireless input signal based on the position data of the hearing device.
The one or more audio streams may include a second audio stream that is converted to a second wireless input signal in the first transceiver. The secondary processing unit may be configured to process the second wireless input signal from the first transceiver based on the position control signal. The position control signal may select a value of a second gain to be applied to the second wireless input signal based on the position data of the hearing device. The secondary processing unit may apply a second gain to the second wireless input signal based on the position control signal from the position controller.
The hearing device may comprise a second antenna and/or a second transceiver connected to the position controller for receiving and/or sending position data from/to an audio system.
The at least one microphone may include a first microphone for receiving an acoustic audio signal and converting the acoustic audio signal to an audio input signal. The first microphone may have an output coupled to a second input of the secondary processing unit for feeding the audio input signal to the secondary processing unit. The secondary processing unit may be configured to process the audio input signal based on the position control signal. For example, the position control signal may select a value of a microphone gain to be applied to the audio input signal from the first microphone based on the position data of the hearing device.
The method for operating a hearing device comprises receiving a first audio stream and converting the first audio stream to a first wireless input signal. A first audio stream may be converted into a first and a second wireless input signal.
The method comprises determining position data of the hearing device and processing the first wireless audio signal based on the position data of the hearing device to form an output signal. The method may comprise obtaining position data of an audio system and processing the first wireless audio signal based on the position data of the hearing device and the position data of the audio system to form an output signal; and converting the output signal to an audio output signal.
In an audio system, one or more transceivers or transmitter units comprising transceivers are configured for broadcasting or transmitting audio track(s) and/or audio stream(s), e.g. to one or more hearing devices. The audio system may comprise a first transceiver and optionally a second transceiver. A transceiver may transmit one or more audio streams. A transceiver may be identified by a transceiver address. A transmitter unit may be configured to wirelessly transmit audio track(s) and/or audio stream(s).
An audio track is an audible signal. Exemplary audible signals are speech, music, an airport call, a movie sound track or a combination thereof.
An audio stream is an electromagnetic signal representative of an audio track. An audio stream is represented by a number of audio blocks each comprising one or more audio packets. An audio packet comprises a finite part of an audio stream.
An audio packet may comprise an audio stream identifier, which may comprise one or more elements such as audio track identification, transceiver address or identification, audio group identification, audio source identification, etc. Audio track identification may enable selection of audio streams representative of the same audio track, and audio group identification may identify a certain group of audio tracks or audio streams e.g. an audio group may be audio tracks in the same or similar language, e.g. English, Danish or Chinese.
An audio packet may comprise transceiver address of the transceiver transmitting the audio packet, thus enabling the hearing device to sort out or separate audio packets sent from other transceivers.
Transmitting and receiving the wireless audio stream(s) may be achieved by using wireless technology, thus transmitting/receiving audio blocks at one or more frequencies, e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
In the hearing device, the primary processing unit may be configured to control the first transceiver. The first transceiver and/or the second transceiver may be configured to receive and/or send audio streams and/or position data at frequencies in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz. The first transceiver and/or the second transceiver may be configured to receive audio streams at frequencies in the range from 169 MHz to 218 MHz and/or in the range from 480 MHz to 520 MHz.
The first and/or second transceiver may be configured to transmit and/or receive wirelessly from/to an audio system with one or more audio sources or other external devices, such as other hearing devices, mobile phone.
The hearing device may be configured for pairing the hearing device with an audio system, e.g. with one or more audio sources of the audio system. Pairing may comprise transmitting hearing device information from the hearing device to the audio system. The hearing device information may comprise one or more of hearing device identification, hearing device manufacturer, hearing device model, and/or hearing device configuration data. Pairing of the hearing device with the audio system may additionally or alternatively comprise transmitting audio system information from the audio system to the hearing device and/or receiving audio system information from the audio system. The audio system information may comprise one or more of audio system identification, audio source identification(s), transceiver identification(s) and/or audio stream configuration data. The audio system may be configured to adapt the format of the first audio stream to be sent to the hearing device based on hearing device information received from the hearing device, e.g. model and/or manufacturer, data encoding format etc. Furthermore, pairing of the hearing device with the audio system may comprise exchanging an encryption key, such as to enable encryption of an audio stream, such as the first audio stream, before sending from the audio system, and decryption of the received wireless input signal, e.g. the first wireless input signal, in the hearing device.
Pairing of the hearing device with the audio system may initiate sending of an audio stream, e.g. the first audio stream, from the audio system.
Pairing of the hearing device with the audio system may cause the hearing device to initiate receiving audio stream(s), which is/are sent by the audio system.
The secondary processing unit is configured to process input signal(s) from microphone(s) and/or transceiver(s) to form an input signal to the primary processing unit. The secondary processing unit may apply gain(s) to the input signal(s) and subsequently mix the amplified input signals to form the input signal to the primary processing unit, wherein the gain(s) are controlled by the position controller with the position control signal.
The position controller may be configured to determine a gain or a vector of gains based on position data of the hearing device and/or position data of the audio system.
The first gain G1 may be given by:
G1=f(PHD),
where PHD is position data for the hearing device.
In a hearing device with a plurality of input signals, processing of the input signals may comprise applying a vector of gains. The vector of gains may comprise a gain for each of the input signals. The vector of gains G may be given by:
G=f(PHD)
The plurality of gains and/or the first gain may comprise further inputs, such as position data of the audio system:
G=f(PHD,PAS),
Where PHD is position data for the hearing device, and PAS is position data for the audio system. PAS may be a vector with position data of the audio system.
The position controller may be configured to set the first gain to a first value if a first field of listening (FIL) criterion is fulfilled, i.e. if the position of the hearing aid indicates that the hearing aid user wishes to listen to a first audio source of the audio system. The position controller may be configured to set the first gain to a second value if the first FIL criterion is not fulfilled or if a secondary first FIL criterion is fulfilled. The first value may be larger than the second value.
The first FIL criterion may be based on the first view angle being the angle between the users direction of view and the direction from the hearing device to the first audio source. The first FIL criterion may be given by:
|α1|<T1,1,
where α1 is the first view angle and T1,1 is a first threshold angle for the first audio source. The first threshold angle T1,1 may be in the range from 15 to 60 degrees.
The position controller may be configured to set the second gain to a first value if a second field of listening (FIL) criterion is fulfilled, i.e. if the position of the hearing aid indicates that the hearing aid user wishes to listen to a second audio source of the audio system. The position controller may be configured to set the second gain to a second value if the second FIL criterion is not fulfilled or if a secondary second FIL criterion is fulfilled. The first value may be larger than the second value.
The second FIL criterion may be based on the second view angle being the angle between the users direction of view and the direction from the hearing device to the second audio source. The second FIL criterion may be given by:
|α2|<T2,1,
where α2 is the second view angle and T2,1 is a first threshold angle for the second audio source. The first threshold angle T2,1 may be in the range from 15 to 60 degrees.
The position controller may be configured to set the microphone gain to a first value if a criterion, such as the first FIL criterion and/or the second FIL criterion, is fulfilled. The position controller may be configured to set the microphone gain to a second value if a criterion, such as the first FIL criterion and/or the second FIL criterion, is not fulfilled. The first value may be less than the second value.
The position controller may be configured to determine a gain or a vector of gains based on an audio input signal from a microphone. Thus, the position controller may be coupled to an output of the first microphone. Accordingly, the gains applied to the input signals may be given by:
G=f(PHD,PAS,Smic),
Where G is a vector with gains for the wireless input signal(s) and/or the audio input signal, PHD is position data for the hearing device, PAS is position data from the audio system, and Smic is a control signal received by the microphone. The control signal S received by the microphone may be within a selected frequency range outside the audible range. PAS and/or Smic may be omitted.
The hearing device 1 is configured to pair with an audio system including one or more audio sources. For example, pairing of the hearing device 1 with the one or more audio sources is achieved by pairing the hearing device 1 with the audio system.
The secondary processing unit 16 is configured to process wireless input signal(s) including the first wireless input signal 56 and optionally the audio input signal 58 to form the input signal 60 on an output of the secondary processing unit 16.
The primary processing unit 8 may perform signal processing such as noise reduction, filtering, amplification, etc. of the input signal 60. The primary processing unit 8 may perform signal processing of the input signal 60 to account for hearing disability of the user of the hearing device 1.
The secondary processing unit 16 and the primary processing unit 8 may be embedded as a single processing unit as also indicated with the dotted box in
The position controller 12 is configured for detecting position data of the hearing device. Based on the position data of the hearing device, the position controller 12 determines gain(s) to be applied to the respective input signals to the secondary processing unit 16 and sends position control signal 66 indicative thereof to the secondary processing unit 16. The secondary processing unit processes the input signal(s) including the first wireless input signal from the first transceiver based on the position control signal 66 from the position controller 12. The first transceiver 6 may be coupled to the position controller 12 for receiving audio system position signal 68 indicative of position data of an audio system and/or sending position data of the hearing device to an audio system.
Although particular features have been shown and described, it will be understood that they are not intended to limit the claimed invention, and it will be made obvious to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the claimed invention. The specification and drawings are, accordingly to be regarded in an illustrative rather than restrictive sense. The claimed invention is intended to cover all alternatives, modifications and equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013 70827 | Dec 2013 | DK | national |
| 13199856 | Dec 2013 | EP | regional |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6845338 | Willins et al. | Jan 2005 | B1 |
| 7072480 | Rass | Jul 2006 | B2 |
| 9078070 | Samuels | Jul 2015 | B2 |
| 9374647 | Han | Jun 2016 | B2 |
| 9565502 | Pontoppidan | Feb 2017 | B2 |
| 20040156512 | Parker | Aug 2004 | A1 |
| 20050094834 | Chalupper | May 2005 | A1 |
| 20080008342 | Sauk | Jan 2008 | A1 |
| 20080080705 | Gerhardt et al. | Apr 2008 | A1 |
| 20080165994 | Caren | Jul 2008 | A1 |
| 20090052703 | Hammershoi | Feb 2009 | A1 |
| 20100189293 | Imamura et al. | Jul 2010 | A1 |
| 20110293123 | Neumeyer et al. | Dec 2011 | A1 |
| 20110299707 | Meyer | Dec 2011 | A1 |
| 20130094683 | Hansen | Apr 2013 | A1 |
| 20130177187 | Mentz | Jul 2013 | A1 |
| 20130315425 | Lunner | Nov 2013 | A1 |
| 20130316679 | Miller et al. | Nov 2013 | A1 |
| 20130343584 | Bennett | Dec 2013 | A1 |
| 20140056452 | Moss | Feb 2014 | A1 |
| 20150003653 | Recker | Jan 2015 | A1 |
| 20150124975 | Pontoppidan | May 2015 | A1 |
| 20150189449 | Udesen | Jul 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 1684550 | Oct 2005 | CN |
| 101142851 | Mar 2008 | CN |
| 103118321 | May 2013 | CN |
| 1 638 367 | Mar 2006 | EP |
| 2 584 794 | Apr 2013 | EP |
| 2 675 189 | Dec 2013 | EP |
| WO 2007112756 | Oct 2007 | WO |
| WO 2007112756 | Oct 2007 | WO |
| WO 2009118424 | Oct 2009 | WO |
| WO 2012177139 | Dec 2012 | WO |
| Entry |
|---|
| Extended European Search Report dated Apr. 2, 2014, for related EP Patent Application No. 13199856.9, 6 pages. |
| First Technical Examination and Search Report dated Aug. 15, 2014, for related Danish Patent Application No. PA 2013 70827, 6 pages. |
| Extended European Search Report dated Mar. 27, 2014, for related European Application No. 13199857.7, 7 pages. |
| First Danish Office Action and Search Report dated Sep. 12, 2014, for related Danish Patent Application No. PA 2013 70828, 4 pages. |
| Non-final Office Action dated Jun. 24, 2016 for related U.S. Appl. No. 14/576,160. |
| Final Office Action dated Feb. 24, 2017 for related U.S. Appl. No. 14/576,160. |
| Advisory Action dated Aug. 8, 2017 for related U.S. Appl. No. 14/576,160. |
| Notice of Allowance and Fee(s) due dated Sep. 11, 2017 for related U.S. Appl. No. 14/576,160. |
| First Office Action dated Aug. 1, 2018 for corresponding Chinese Patent Application No. 201410841044.7. |
| Number | Date | Country | |
|---|---|---|---|
| 20150189453 A1 | Jul 2015 | US |
