Patent Application
20130121496
The invention relates to the field of hearing devices, and in particular to the fitting of hearing devices. It relates to methods and apparatuses according to the opening clauses of the claims.
Under a hearing device, a device is understood, which is worn in or adjacent to an individual's ear with the object to improve the individual's audiological perception. Such improvement may also be barring acoustic signals from being perceived in the sense of hearing protection for the individual. If the hearing device is tailored so as to improve the perception of a hearing impaired individual towards hearing perception of a normal-hearing individual, then we speak of a hearing-aid device. With respect to the application area, a hearing device may be applied, e.g., behind the ear, in the ear, completely in the ear canal or may be implanted.
A hearing system comprises at least one hearing device. In case that a hearing system comprises at least one additional device, all devices of the hearing system are operationally connectable within the hearing system. Typically, said additional devices such as another hearing device, a remote control or a remote microphone, are meant to be worn or carried by said individual.
Under audio signals we understand electrical signals, analogue and/or digital, which represent sound.
The adapting of a hearing device to the hearing needs and preferences of an individual, also referred to as “fitting”, is an important and complicated process, in particular in case of hearing-aid devices. Usually, the competence of a hearing device professional such as an audiologist is needed in order to achieve satisfactory fitting results.
But if the individual is a baby or is mentally handicapped, the normal way of carrying out the fitting is not feasible, as proper spoken responses to test signals will not be provided by the individual.
In EP 1 617 705 A2, a hearing device is disclosed which can be fitted by the individual (the hearing device user) without need of further assistance.
In US 2010/0076339 A1, a system for determining the hearing ability of an individual is disclosed. For determining the hearing capacity of an individual, it is suggested in said US 2010/0076339 A1 to connect the individual to an electrophysiological instrument, i.e. to place electrodes on the individual's head and monitor fluctuations in monitored electrical potentials, in a synchronized manner with presenting a stimulus signal to the individual.
One object of the invention is to create an alternative way of fitting a hearing device. Besides a method for adapting a hearing device to the hearing needs and preferences of an individual, also a use of such a method, a corresponding apparatus (for carrying out the method) and also a corresponding computer program product along with a corresponding computer-readable medium shall be provided.
Another object of the invention is to provide a way of fitting a hearing device which can be applied to people suffering from dementia and other mentally handicapped people.
Another object of the invention is to provide a way of fitting a hearing device which can be applied to babies and small children.
Another object of the invention is to provide a way of fitting a hearing device which can be applied by the hearing device user without or largely without help from other people, in particular from hearing device professionals.
Another object of the invention is to provide a way of fitting a hearing device which does not require to fix one or more electrodes to the individual.
Another object of the invention is to provide a way of fitting a hearing device which allows to achieve improved fitting results.
Another object of the invention is to provide a way of fitting a hearing device which can be carried out in relatively short time.
Further objects emerge from the description and embodiments below.
At least one of these objects is at least partially achieved by apparatuses and methods according to the patent claims.
The method for adapting a hearing device to the hearing needs and preferences of an individual, wherein sound processing in said hearing device is programmable by means of adjustable parameters, comprises the steps of
This method is applicable to almost all people, irrespective of age.
In a particular aspect of the invention, the method is a method for automatically adapting a hearing device to the hearing needs and preferences of an individual.
As stated further above, the “adapting a hearing device to the hearing needs and preferences of an individual” is also referred to as “fitting”. In hearing device fitting, it is frequently distinguished between a “first fit” or initial fitting, and “fine-tuning”. The present invention is applicable to both.
In one embodiment, said auditory test signal is a signal for auditory perception (a signal to be auditorily perceived), more particularly, it is an acoustic test sound signal (i.e. sound waves). It is also possible, e.g., to provide electrical stimuli as auditory test signals, such as, e.g., in case of cochlea implants.
In one embodiment which may be combined with the before-addressed embodiment, the method comprises the step of
In one embodiment which may be combined with one or more of the before-addressed embodiments, the step c) is carried out in an automated fashion.
In one embodiment which may be combined with the before-addressed embodiment, the step b) is carried out in an automated fashion.
In one embodiment which may be combined with the before-addressed embodiment, the step a) is carried out in an automated fashion.
In one embodiment which may be combined with the before-addressed embodiment, the step e) is carried out in an automated fashion.
In one embodiment which may be combined with the before-addressed embodiment, the step j) is carried out in an automated fashion.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said auditory test signal is an acoustic test signal.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said at least one image is or comprises a digital image.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said at least one image is or comprises a video recording, more particularly a digital video recording.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said portion of said individual's body is said individual's face or a portion thereof.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said reaction is an unintentional reaction, e.g., an uncontrolled reaction or a reflex reaction.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said reaction is or comprises a change in the facial expression of said individual's face.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said reaction is or comprises a change in diameter of at least one of said individual's pupils.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said reaction is or comprises a movement of at least one of said individual's eyelids, in particular of at least one of said individual's lower eyelids.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said at least one auditory test signal is or comprises speech.
In one embodiment referring to the before-addressed embodiment, the method comprises the step of
In one embodiment referring to the before-addressed embodiment, step f) is carried out before step a).
In one embodiment referring to one or both of the most recent addressed embodiments, the step f) is carried out in an automated fashion.
In one embodiment which may be combined with one or more of the before-addressed embodiments, the method comprises, between steps d) and e), the step of
In one embodiment referring to the before-addressed embodiment, step g) is carried out in an automated fashion.
In one embodiment which may be combined with one or more of the before-addressed embodiments, the method comprises the steps of
In one embodiment referring to the before-addressed embodiment, the step h) is carried out in an automated fashion.
In one embodiment referring to one or both of the most recent addressed embodiments, the step i) is carried out in an automated fashion.
In one embodiment which may be combined with one or more of the before-addressed embodiments, said hearing device is a hearing-aid device.
The use according to the invention is a use of one of the methods above for adapting a hearing device to the hearing needs and preferences of an individual being at least one of a mentally handicapped person, a person suffering from dementia, a baby, a child.
The apparatus for adapting a hearing device to the hearing needs and preferences of an individual, wherein sound processing in said hearing device is programmable by means of adjustable parameters, comprises
In one embodiment, the apparatus comprises said hearing device.
In one embodiment which may be combined with the before-addressed embodiment, the apparatus comprises a storage unit comprising data indicative of dependencies between possible reactions of said individual and the way said individual perceived an auditory test signal, in particular wherein said way said individual perceived an auditory test signal concerns at least one of
The invention comprises apparatuses with features of corresponding methods according to the invention, and vice versa.
The advantages of the apparatuses basically correspond to the advantages of corresponding methods and vice versa.
The computer program product comprises program code for causing a computer to perform the steps of
In one embodiment, said program code is configured to cause said computer to perform at least one of the following steps
The invention comprises computer program products with features of corresponding methods or apparatuses according to the invention, and vice versa.
The advantages of the computer program products basically correspond to the advantages of corresponding methods and apparatuses, respectively, and vice versa.
The computer-readable medium comprises program code as described in the computer program products.
Further embodiments and advantages emerge from the dependent claims and the figures.
Below, the invention is described in more detail by means of examples and the included drawing. The figure shows:
The reference symbols used in the figure and their meaning are summarized in the list of reference symbols. The described embodiments are meant as examples and shall not confine the invention.
In order to adapt one or both hearing devices 6, 7 to the hearing needs and preferences of user U, i.e. to “fit” the hearing device(s) 6, 7, test signal generator 1 generates one or more test signals 1a to be auditorily perceived by user U. E.g., test signal generator 1 synthesizes, amplifies and outputs (via a loudspeaker) test tones, e.g., narrow-band signals, or present real-world sounds, in particular speech-containing sounds, wherein sampled sounds may be used.
During the presenting of the test signals 1a, or at least shortly after that, images 2a are taken by imaging unit 2, which show at least a portion of the user's body, in particular one or both eyes of user U. Preferably, the images are images of a video, i.e. a video is recorded.
In image analysis unit 3, the images are analyzed, so as to detect therein a reaction of user U. Image recognition software can be used here. In particular, unintentional reactions of user U shall be detected. E.g., a change in diameter of one or both of the user's pupils can be detected, or a movement of one or both lower eyelids. It is also possible, e.g., in case of very soft test signals 1a, that user U does not show any reaction upon the playing of the test signal, which is a valid result of the image analysis and also a valuable information for the fitting.
Now, it is possible to determine settings for one or more adjustable parameters of the hearing device(s) 6, 7, in particular for sound processing parameters, in dependence of the user's reaction (as determined in the image analysis) and of the presented test signal, and possibly also in dependence of the time relation between the presentation of the test signals and the image taking.
For facilitating and improving the determination of the parameter settings, in storage unit 5, data may be provided and used by parameter setting unit 4, which describe dependencies between possible reactions of said individual and the way said individual perceived an auditory test signal. For example, a certain way of changing the diameter of a pupil may be indicative of a certain degree of discomfort or stress. Considering the played test signal, it is possible to deduce from the reaction valuable information for adjusting parameters. E.g., if a test signal has been played to user U, which is assumed to be particularly loud, and user U thereupon showed certain indications of discomfort, there is a high probability that that test signal has been perceived as too loud.
Accordingly, it could be advisable to reduce a maximum output level of the hearing device accordingly, or to adjust a compression ratio for preventing the occurrence of too loud signals presented to user U, and/or to carry out other parameter adjustments.
Or, if user U has been asked to try to understand speech presented to him as a test signal or as a part thereof, and user U shows certain stress indications upon being presented these test signals, it is very likely that user U has problems to understand the presented speech, i.e. that there are intelligibility problems. Considering the properties of the presented test signal, new parameter settings can be found. E.g., if the speech was embedded in a lot of noise, parameters of a speech-in-noise program of the hearing device(s) 6, 7 can be adjusted, or if the speech was high-pitched speech without noise, parameters of a frequency shifter may be refined.
From the determined user reaction, one can also deduce information allowing to choose test sounds to presented to user U later on, for example thereby implementing an adaptive bracketing procedure as it is known from conventional automatic audiometry.
Usually, it will be preferable to sequentially present several test signals to user U. This way, settings for several parameters can be found, and rather reliable parameter settings can be found.
Moreover, it will usually be preferable to capture and analyze more than one details in the images 2a. E.g., one could analyze the user's facial expression (in particular considering the shape of the user's lips/mouth) and the pupil diameter for both eyes and movements of both lower eyelids and movements of both user's hands and arms. This way, the user's reaction can be detected and interpreted more reliably and more refinedly, distinguishing an increased number of different reactions, thus achieving more reliable parameter settings.
Note that it is possible to carry out the method, while user U is wearing the hearing device(s) 6, 7 (in particular for fine-tuning), but it is also possible to carry out the method at the user's unaided ears (in particular for accomplishing a first fit). And, moreover, it is possible to provide the test signals as sound waves in the room in which user U is located, but it is also possible to provide the hearing device(s) 6, 7 with corresponding audio signals (in a wireless or in a wirebound fashion), in particular with digital audio signals, while user U is wearing the hearing device(s) 6, 7, and let the hearing device(s) 6, 7 convert these into signal to be (auditorily) perceived by user U, in particular into acoustic sound.
For example, a fitting session or a portion thereof can be carried out as set forth in the following, wherein in this case, we assume that the user is using his hearing device(s) 6, 7:
The user (user 6) is instructed to look at a camera (imaging unit 2) and listen to sounds (test sounds 1a) which are going to be presented. If speech is presented, the user may be asked to repeat what has been spoken or may be incited to try to understand what has been spoken (for some other reason).
Then, the system (or apparatus) presents a test sound. Typically, the system will start with a presentation of test sounds which are estimated as not-challenging with respect to mental stress (audibility and discriminability of speech) and unpleasantness (loudness, extreme tonal imbalance). (In later steps, the estimated difficulty and unpleasantness of test sounds will be increased.)
The system checks, using image analysis unit 3 and parameter setting unit 4 and possibly also storage unit 5, if facial expression or width of pupillae indicate cognitive stress or sensual unpleasantness, the latter indicating hearing discomfort.
If cognitive stress or sensual unpleasantness is detected, the system will modify parameter settings of the sound processing in the hearing device(s) 6, 7 and repeat the presentation and analysis of facial parameters until the indicators of stress and/or discomfort disappear. Therein, it is to be noted that it would also be possible to continue with different test sounds while possibly leaving parameter settings unchanged.
If no cognitive stress and no sensual unpleasantness is detected, the system will select test sounds of a higher estimated difficulty and/or unpleasantness level and analyze the image 2a of the user's face with regard to indications of stress and discomfort and then optimize the parameter settings as far as required.
The procedure may be finished when neither on the mental stress reduction dimension nor on the discomfort reduction dimension, better settings with respect to stresslessness and comfort can be achieved by further attempts to optimize the parameter settings.
The invention allows to fit hearing devices to people who cannot reliably reply to questions or cannot be instructed or follow instructions.
The invention can lead to particularly good fitting results, because within relatively short time, many valuable responses of the user can be obtained. The invention can be carried out under more relaxed circumstances than in case of conventional fitting, since the individual does not or not as often have to consciously react to test signals, e.g., by forming and producing spoken responses. This allows to obtain more realistic results and/or to carry out the fitting procedure more refinedly and/or during a longer time (without overstraining the individual).
The invention can be carried out without a hearing device professional, and even by the user U alone, although presence and guidance by a hearing device professional, such as an audiologist, will usually be helpful and advisable. It is also possible to use the invention as a supporting and complementing constituent in hearing device fitting. For example, a hearing device professional may manually enter data indicative of, e.g., discomfort and mental stress, wherein these manually entered data are compared to automatically determined data for verification. It is also possible to confirm results of a conventional dialog-based fitting by comparison with concurrently automatedly obtained (computer-vision based) results.
It is possible to obtain audiograms using the invention, wherein the image-captured user reaction practically replaces the commonly used user's pressing of a button upon perceiving a test signal. Other, usually short test signals can be used, too. But a great advantage of the invention is that complex test signals can readily be used, in particular relatively long test signals and long sequences of test signals following in quite fast succession. Therein, test signal or test signal sequence lengths of more than half a minute or even in excess of one or even several minutes may be applied. Recording a video through such a long presentation allows to later on analyze the user's reactions and determine then, on a correspondingly strong data basis, quite reliable parameter settings. Or, a real-time analysis is carried out, which in addition allows to a real-time select or change the test sounds to be played (even in the same, long test sound sequence).
It is readily possible to carry out the invention in such a way that the correlation between the visually recorded user reaction and the test signal is very close, thus allowing to achieve useful and reliable results. This applies in particular, when unintentional physiological reactions are analysed and when the method is carried out in a suitable environment such as in a calm room, in particular a sound booth.
Aspects of the embodiments have been described in terms of functional units. As is readily understood, these functional units may be realized in virtually any number of hardware and/or software components adapted to performing the specified functions. For example, test signal generator 1, image analysis unit 3, parameter setting unit 4 and storage unit 5 may be realized in one and the same computer; in particular in a computer equipped with or connected to
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP10/60447 | 7/19/2010 | WO | 00 | 1/18/2013 |
