Patent Application
20250175748
This application claims the priority, under 35 U.S.C. § 119, of German Patent Application DE 10 2023 211 689.8, filed Nov. 23, 2023; the prior application is herewith incorporated by reference in its entirety.
The invention relates to a method for ascertaining the wearing as intended of a binaural hearing system having a first hearing instrument and a second hearing instrument. The invention also relates to a binaural hearing system.
For hearing instruments in general, i.e. devices having an electro-acoustic sound transducer for producing an output sound from an electrical audio signal, and for hearing aids in particular, i.e. hearing instruments intended and appropriately configured to treat a hearing impairment of a wearer, it can be of interest to detect the wearing of a hearing instrument.
Whereas most hearing instruments have a hardware switch on the housing, which can be used to switch the hearing instrument on and off, possibly in addition to other functions assigned to the switch, whereby the power drain from a battery of the hearing instrument concerned can be suspended completely, the provision of individual functions of the hearing instrument can be linked to the wearing of same. That can be the case in particular if the hearing instrument is put into a type of standby mode when not in use, and hence not being worn as stipulated by requirements, so as to reduce the power consumption significantly by disabling most of the functions, yet is still ready to resume full operation immediately (including the temporarily disabled functions). As a result, the hearing instrument does not have to be restarted first (including loading the firmware, etc.), which could lead to a time delay for the user, i.e. the wearer.
Such a standby operating mode can be of interest in particular for hearing aids in the narrower sense (i.e. the hearing instruments intended to treat a hearing impairment), because firstly the range of functions during the intended operation of the hearing aid can include a large number of signal processing processes, some of which are computationally intensive and hence power intensive, which are preferably meant to be deactivated when the hearing aid is temporarily removed. Secondly, the full range of functions should be available again as soon as possible when the hearing aid is refitted. In addition, if the correct wearing is identified, signal amplification can also be reduced because it can be assumed that an output sound produced is fed optimally to the designated eardrum. Moreover, that can reduce the risk of feedback occurring.
It is accordingly an object of the invention to provide a method for ascertaining the wearing as intended of a binaural hearing system, and a binaural hearing system, which overcome the hereinafore-mentioned disadvantages of the heretofore-known methods and systems of this general type and which detect in the simplest possible manner the wearing as intended, and in particular the correct wearing, of hearing instruments.
With the foregoing and other objects in view there is provided, in accordance with the invention, a method for ascertaining the wearing as intended of a binaural hearing system having a first hearing instrument and a second hearing instrument, wherein a first motion signal is captured by a first motion sensor of the first hearing instrument, and a second motion signal is captured by a second motion sensor of the second hearing instrument, and/or wherein a distance between the first hearing instrument and the second hearing instrument is estimated or ascertained by a communication system of the two hearing instruments, and it is identified on the basis of the first motion signal and the second motion signal and/or on the basis of the ascertained distance, whether the two hearing instruments are each being worn in their intended position on respective ears of a user.
The subject matter of the dependent claims and of the description below contains advantageous embodiments, some of which are inventive in their own right.
A hearing instrument in this case generally encompasses any apparatus that is configured to produce a sound signal from an electrical signal-which can also be an internal signal of the apparatus-and to feed the sound signal to an ear of a wearer of this apparatus, so in particular headphones (e.g. as an “earbud”), a headset, smart glasses containing a loudspeaker, etc. A hearing instrument also encompasses a hearing aid in the narrower sense, however, i.e. a device for treating a hearing impairment of the wearer, in which device an input signal produced from an ambient signal by a microphone is processed into an output signal and amplified in the process, in particular according to frequency band, and an output sound signal produced from the output signal by a loudspeaker or the like is suitable for correcting, at least partially, the hearing impairment of the user, in particular in a user-specific manner.
In the binaural hearing system, the wearer is meant to wear the first and second hearing instruments each on a different ear, so for instance the first hearing instrument on the left ear and the second hearing instrument on the right ear. The wearing as intended of the binaural hearing system encompasses in particular the wearing of the two hearing instruments on the respective ears in the designated, including model-dependent, wearing position.
In the case of behind-the ear (BTE) hearing aids as the hearing instruments, this includes, for example, positioning each hooked housing (earhook) behind the ear and inserting the earpiece into the concha or the entrance to the auditory canal. In the case of headphones in the form of earplugs, but also in the case of in-the-ear (ITE) hearing aids, this includes positioning each housing in the concha.
The first and second motion sensors are both in particular accelerometers. In particular, an acceleration with respect to gravity can be determined from the first motion signal at least given a relatively long time average in the range of 0.2 s to 2 s and preferably up to 5 s and/or by using low-pass filtering, from which acceleration can also be ascertained an absolute pitch angle with respect to gravity.
The communication system of the two hearing instruments includes a first transmission unit in the first hearing instrument and a second transmission unit in the second hearing instrument, wherein the first and second transmission units are each configured to send transmission signals to the other transmission unit in each case, and to receive transmission signals from the other transmission unit in each case. The transmission units preferably each have for this purpose at least one appropriately configured antenna for emitting and receiving electromagnetic waves and/or magnetic fields. The transmission signals can be transmitted in particular in the RF and/or microwave and/or infrared region and/or as near field magnetic induction (NFMI). In particular, standardized protocols such as Bluetooth, for example, can be used for the transmission of the transmission signals. A proprietary protocol, in particular developed specifically for this application, can also be used, however, for the transmission of the transmission signals.
The invention uses the fact that when a binaural hearing system is being worn as intended as described above, it has a fixed spatial relationship between the two hearing instruments. This spatial relationship includes a constant distance between each one, known in advance for the particular wearer, and also that the absolute roll angles and pitch angles of the two hearing instruments are correlated with each other and, in the ideal case, are identical to each other. Moreover, the changes in the stated angles (i.e. movements of the hearing instruments) are also correlated with each other.
While the aforementioned mutual angular relationships of the two hearing instruments can be determined from the respective motion signals, the distance between the two hearing instruments can be ascertained by using the communication system, for which purpose can be used in particular a transmission quality of a transmission signal. An estimate or measurement of the transmission quality is often already provided between both transmission units of the communication system as a function, and therefore no additional overhead is created in this case for estimating the distance because a correlation of the transmission quality with the distance can be exploited.
Preferably, a first roll angle and/or a first pitch angle of the first hearing instrument is ascertained from the first motion signal, wherein a second roll angle and/or a second pitch angle of the second hearing instrument is ascertained from the second motion signal, and wherein the wearing as intended is ascertained on the basis of the first and second roll angles and the first and second pitch angles respectively.
In particular, a difference is then formed between the first and second roll angles and/or between the first and second pitch angles, and the wearing as intended is ascertained on the basis of the difference in the roll angles and the difference in the pitch angles, respectively.
In the ideal case, the difference between the two roll angles and the difference between the two pitch angles should equal zero during wearing as intended. Since, however, minimum imprecision in fitting a hearing instrument and even small anatomical asymmetries (for instance pinna that differ minimally in size) result in the differences potentially retaining non-zero values, even during wearing as intended, the respective differences are preferably compared with a limit value that can be selected to be sufficiently low (for example 20°, preferably 10°, particularly preferably) 5°, and in particular continuously or persistently being below the limit value is assessed as a possible indicator of wearing as intended.
Advantageously, the first roll angle and/or the first pitch angle is compared with a reference roll angle and a reference pitch angle respectively, and the wearing as intended is also ascertained on the basis of the comparison of the first roll angle and/or the first pitch angle with the reference roll angle and the reference pitch angle respectively. This uses the fact that for a normal, i.e. substantially upright, head posture, each of the hearing instruments adopts a certain positioning with respect to the longitudinal axis (and hence also with respect to gravity). Thus preferably, the roll angle and the pitch angle in a wearing position designated for the wearing as intended are used as the reference roll angle and the reference pitch angle respectively. This positioning can depend in particular on the configuration of the hearing instrument concerned (i.e. BTE or ITE) and/or on anatomical characteristics of the wearer (for instance the shape of the pinna or of the concha). In particular, for this purpose, the respective reference roll angles and/or pitch angles can be custom-measured for the wearer in advance.
Preferably, in the comparison of the first and second roll angle/pitch angle respectively with the associated reference value, a difference (i.e. a difference angle) is formed, and this is compared with a preset limit value (for example 20°, preferably 10°, particularly preferably) 5°. In particular, continuously or persistently being below the limit value can then be assessed as a possible indicator of wearing as intended.
Advantageously, for the determining of the first and/or second roll angle and/or the first and/or second pitch angle, an average value is formed over a suitable time window of at least 0.2 s in length, and preferably at least 0.5 s in length, or signal components of the first and second motion signal respectively are used for which the angle concerned is sufficiently stationary over a defined time window of at least 0.2 s and preferably at least 0.5 s in length. The stationarity can be ascertained in this case suitably by using a corresponding measure (e.g. sliding standard deviation over the traveling time window and comparison with a correspondingly defined limit value).
It also proves advantageous if a change in the first roll angle and/or in the first pitch angle is ascertained from the first motion signal, wherein a change in the second roll angle and/or in the second pitch angle is ascertained from the second motion signal, and wherein the wearing as intended is ascertained from a difference and/or a correlation in the changes in the first roll angle and second roll angle and in the first pitch angle and second pitch angle respectively. This uses the fact that the changes in the stated angles, which correspond to respective movements of the associated hearing instrument, occur in a correlated manner during the wearing as intended because both hearing instruments are affected by the movement and hence by the change in the angle concerned.
The difference in the change preferably lies below a suitably defined limit value in order to be assessed as a possible indicator of wearing as intended. The correlation is preferably ascertained by using a suitable correlation measure (e.g. cross-correlation) and preferably lies above a suitably defined limit value in order to be assessed as a possible indicator of wearing as intended.
In a further advantageous embodiment, at least one quantitative measure of a signal quality of a transmission signal by the communication system is ascertained, wherein the distance between the first hearing instrument and the second hearing instrument is estimated or ascertained on the basis of the measure of the signal quality.
The quantitative measure is preferably ascertained as a bit error rate (BER) of a defined data packet and/or a bit error rate of a randomized data packet and/or an error vector magnitude and/or a correlation with a defined signal content. A synchronization sequence (known as a “pilot sequence”) can be used in this case as the defined data packet. The synchronization sequence is used to synchronize the data transmission in numerous protocols, and the content of which is known to both the sender and the recipient. The BER can be estimated appropriately from the synchronization sequence. It is also possible to use a data packet randomized on the basis of a shared “seed” by using a pseudorandom number generator (BER). An error vector magnitude (EVM) can be ascertained in particular in a transmission by using phase shift keying or quadrature phase shift keying (PSK or QPSK) on the basis of an ascertained error vector of the received signal in relation to the ideal signal points. The quantities have a high correlation with the distance and are therefore particularly suitable for estimating or measuring same.
Advantageously, the transmission signal is transmitted by using NFMI between a first transmission unit of the communication system, which transmission unit is located in the first hearing instrument, and a second transmission unit of the communication system, which transmission unit is located in the second hearing instrument. NFMI has practically negligible absorption in human body tissue and is therefore particularly suitable for a transmission in a binaural hearing system.
Expediently, the second motion signal is transmitted from the second hearing instrument to the first hearing instrument, and the wearing as intended of the binaural hearing system is ascertained in the first hearing instrument on the basis of the first motion signal and on the basis of the second motion signal. The wearing as intended can thereby be identified locally in the first hearing instrument.
With the objects of the invention in view, there is concomitantly provided a binaural hearing system having a first hearing instrument and a second hearing instrument, wherein the binaural hearing system is configured to perform the above-described method. Preferably, in the binaural hearing system, the first hearing instrument and/or the second hearing instrument is provided as a behind-the-ear hearing aid.
The binaural hearing system according to the invention shares the advantages of the method according to the invention. The advantages stated for the method and its developments can be applied mutatis mutandis to the binaural hearing system and its developments, and vice versa.
Other features which are considered as characteristic for the invention are set forth in the appended claims.
Although the invention is illustrated and described herein as embodied in a method for ascertaining the wearing as intended of a binaural hearing system, and a binaural hearing system, it is nevertheless not intended to be limited to the details shown, since various modifications and structural changes may be made therein without departing from the spirit of the invention and within the scope and range of equivalents of the claims.
The construction and method of operation of the invention, however, together with additional objects and advantages thereof will be best understood from the following description of specific embodiments when read in connection with the accompanying drawings.
Referring now in detail to the figures of the drawings, in which corresponding parts and variables are denoted by the same reference signs, and first, particularly, to
The first output transducer 15 can be constituted in this case in particular by a loudspeaker. The first hearing instrument 10 can also have a bone conduction receiver or the like, however. The first hearing instrument 10 can also have in particular further input transducers (not shown) that produce additional input signals from the ambient sound for in particular directional signal processing in the first signal processing unit 13.
The binaural hearing system 2 moreover has a communication system 4 for the transmission of the transmission audio signal. The communication system 4 has a first transmission facility 17 in the first hearing instrument 10 and a second transmission facility 27 in the second hearing instrument 20. The first hearing instrument 10 also has a first motion sensor 18, which in this case is in the form of an accelerometer and is configured to produce a first motion signal 19 on the basis of movements. The first motion signal 19 can have in particular a multi-channel configuration, for instance in order to be able to resolve accelerations and/or movements into the three spatial directions.
The second hearing instrument 20 is substantially identical in configuration (or mirror symmetrical in shape) to the first hearing instrument 10, and includes a second input transducer 21 for producing the second input signal 22, a second signal processing facility 23 for producing a second output signal 24, and also a second output transducer 25 for reproducing same, and a second earpiece 26. In addition, the second hearing instrument 20 includes the second transmission unit 27 and a second motion sensor 28 for producing a second motion signal 29.
When the binaural hearing system 2 is being worn as intended, i.e. when the first hearing instrument 10 is being worn on one ear of the wearer (for instance on the left ear) in the designated wearing position, and the second hearing instrument 20 is being worn on the other ear of the wearer (for instance the right ear) in the appropriately designated wearing position, it is the case that the two hearing instruments 10, 20 have precisely defined positional relationships to one another. Even during movement of the head of the wearer (for instance when the wearer lowers his or her head or tilts it sideways), this movement or an associated change in position is performed by both hearing instruments 10, 20. It is also the case that the two hearing instruments 10, 20 have a precisely defined distance between each other given by the size (strictly speaking the width) of the head of the wearer. This can be used to detect wearing of the binaural hearing system 2, which shall be described later.
In particular, the first and second motion signals 19, 29 are used for this purpose. For local processing, for example of the two motion signals 19, 29 in the first hearing instrument 10, the second motion signal 29 or a signal (not shown) derived therefrom by preprocessing can be transmitted by using the communication system 4 from the second hearing instrument 20 to the first hearing instrument 10. The processing for ascertaining the respective positional relationships of the hearing instruments 10, 20 can be performed in particular in the first signal processing facility 13, which in this case is in the form of an apparatus for general signal processing (i.e. not only for processing audio signals) and is equipped with appropriate signal processors.
For ascertaining the distance between the two hearing instruments 10, 20, a generic transmission signal 7 can be sent by using the communication system 4 from the first transmission unit 17 to the second transmission unit 27 (or vice versa), and a characteristic value of the signal quality, for instance the BER or the EVM, can be measured. This is shown for the BER using
In addition, a reference pitch angle αNR is also shown in
The reference pitch angle αNR thus equals 50, which takes account of the fact that when being worn as intended, the respective hearing instruments10, 20 in terms of the main direction 35, 36 are appreciably tilted with respect to gravity g (see the first hearing instrument 10 in
As is evident in the top diagram, the two hearing instruments 10, 20 remain slightly longer than 30 seconds in positions that each have a correct pitch angle αN1=αN2=0° and opposite roll angle αR1 =−αR2 of nearly 90°. It can be inferred from the roll angles R1, αR2 that the hearing instruments 10, 20 are each lying on their sides. At approximately 32 seconds, the two hearing instruments 10, 20, as evidenced by their roll angles αR1, αR2, are each brought into the upright position corresponding to the reference roll angle RR, which they adopt at approximately 40 seconds.
Roughly the same time curve arises for the pitch angles αN1, αN2. The hearing instruments 10, 20 are tilted slightly at a time of about 32 seconds onwards, resulting in each adopting the reference pitch angle αNR at about 40 second onwards. Once the reference pitch angle αNR and reference roll angle αRR are adopted by the associated angles of the respective hearing instruments 10, 20, this can be assessed in each case to be an indicator of the wearing as intended of the hearing instrument 10, 20 and hence in particular of the binaural hearing system 2 (but not significantly before).
The second diagram shows the difference ΔαN in the pitch angles (symbol “o”) and the difference AR in the roll angles (symbol “x”) and an associated threshold value th. Based on the data from the top diagram, the difference αaN in the pitch angles is always almost zero, even when the pitch angles αN1, αN2 themselves undergo a change (between 32 and 40 seconds). This could be used a priori as a positive indicator of the wearing as intended because the difference ΔαN in the pitch angles is constantly below the threshold value th. Until 36 seconds, however, the difference αaR in the roll angles exceeds the threshold value th, and therefore in this case there is no such indicator until the difference αaR in the roll angles goes below the threshold value th (at about 36 seconds onwards).
In the third diagram, the L1-norms of the Cartesian movements (symbols “x” and “o” respectively for the first and second hearing instruments 10, 20) and identified movement intensities (continuous and dashed lines) are plotted for each hearing instrument 10, 20. A movement is assumed in this case if the associated L1-norm exceeds the value 1 in the last 10 seconds. It is evident that the movement of both hearing instruments 10, 20 starts already at about 20 seconds, and thus significantly before the hearing instruments 10, 20 are first brought into the upright position (at 32 seconds onwards), and then brought into the correct wearing position (at about 40 seconds onwards, see pitch angles αN1, αN2 in the top diagram and their difference AN in the second diagram). It can be inferred therefrom that the wearer picks up the hearing instruments 10, 20 at about 20 seconds (and possibly takes them out of a charging station or the like in which the hearing instruments 10, 20 have a well-defined position), in order to fit them. In order to do this, he or she brings the hearing instruments 10, 20 into the upright position at about 32 seconds onwards, and at 40 seconds into the correct inclination of the respective pitch angles αN1, αN2.
The bottom diagram of
In particular, it is also possible to use in this case as an additional indicator a distance measurement, performed as described above.
Although the invention has been illustrated and described in detail using the preferred exemplary embodiment, the invention is not limited by the disclosed examples, and a person skilled in the art can derive other variations therefrom without departing from the scope of protection of the invention.
The following is a summary list of reference numerals and the corresponding structure used in the above description of the invention:
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2023 211 689.8 | Nov 2023 | DE | national |
