Patent Application
20220080198
The present disclosure relates to a cochlear implant system configured to code an audio signal based on multiple coding parameters.
Known multichannel cochlear implant systems (CI) encode environmental sounds directly into a plurality of stimulation pulses using specific sound coding strategies, such as Continuous Interleaved Sampling (CIS) and Temporal Fine Structure (TFS). The coded plurality of stimulation pulses is then transmitted to the inner ear via electrical stimulations.
One of the targets of optimizing a cochlear implant system is to provide the recipient access to different perceptual aspects of hearing, e.g. pitch, timbre, loudness, perceived sound direction, and/or a distance to a sound source, which are controlled by coding parameters such as pulse rate, pulse width, pulse amplitude, pulse shape, pulse temporal onset pulse, perceived interaural timing difference, perceived interaural level differences, stimulation position, etc.
For example, perceptual information, such as loudness, pitch, timbre, sound direction and/or distance to a sound source can be coded into the plurality of stimulation pulses by changing one of the coding parameters. For example, for loudness the following coding parameters can be adjusted: pulse rate, pulse width, pulse amplitude, pulse shape.
In current implementations, the cochlear implant system chooses either the pulse amplitude or the pulse width as the variable parameter, while other coding parameters are kept constant. In this case, an electric dynamic range of an electrode of the electrode array and resolution of the perceived loudness may however be limited when the chosen coding parameter has certain restrictions on the patient. For example, when coding loudness through pulse amplitude with other parameters fixed, the usable range of amplitudes between the patients hearing threshold (T-level) and comfort level (C-level) may be narrow, and the CI system may be able to output a small number of pulse amplitude steps within that range.
In another example, changes in pitch may be coded by changing either the stimulation position (place coding) in the inner ear, the pulse stimulation rate or the pulse amplitude/width modulation rate. In Continuous Interleaved Sampling (CIS) based stimulation strategies, the stimulation pulses are delivered to the inner ear at a fixed rate. Therefore, the place coding method is the only considered path for delivering pitch information. Strategies that exploit the temporal fine structure (TFS) of the sound, may combine stimulation position with temporal coding by delivering stimulation pulses with different pulse stimulation rates to the inner ear according to the cochlear tonotopy. In this case, the place coding and the temporal coding may be highly correlated to the input signal frequency as in the normal cochlea: the frequency of the stimulation pulses monotonically increases from the most apical electrode to the most basal electrode of the electrode array in relation to the cochlear tonotopy, and there is no overlap between the frequency ranges assigned to each of the electrodes of the electrode array.
To summarize, all the examples describing how to code perceptual information into the stimulation pulses show that current strategies for the cochlear implant systems have only one degree of freedom, using either only one parameter or two highly correlated parameters for delivering a certain perceptual information to the patient via electrical stimulation. Therefore, the perceptual information is compressed to fit the electrical dynamic range of the chosen coding parameter, and the resolution and number of steps for that parameter within that dynamic range may be limited. This may lead to the degradation of perceptual outcomes and sound quality for the CI recipient, particularly when the coding parameter range on that certain recipient is further limited. Therefore, a cochlear implant system which can code perceptual information using all the available coding parameters in a joint way may improve the dynamic range and resolution of perceptual information while being robust to the limitations on any of the coding parameters.
An aspect of the disclosure is to provide a cochlear implant system that improves the patient's ability to perceive perceptual information coded into stimulation pulses provided by the cochlear implant system to the auditory nerve fibers of the patient.
The aspect of the disclosure is achieved by a cochlear implant system comprising a microphone unit configured to receive an acoustical input and provide an audio signal based on the acoustical input, and where the audio signal includes multiple acoustic parameters, and an electrode array including a plurality of electrodes configured to apply a plurality of stimulation pulses to auditory nerve fibers of a recipient of the cochlear implant system, and a memory unit including a plurality of multidimensional perceptual models where each multidimensional perceptual model includes perceptual information as a function of coding parameter groups.
A multidimensional perceptual model may for example include pitch (i.e. perceptual information) as a function of pulse rate (i.e. a first coding parameter) of the plurality of stimulation pulses and stimulation positions (i.e. a second coding parameter), i.e. electrode number of the plurality of electrodes of the electrode array. In this example, a pitch level is determined at a given pulse rate for a given electrode for the recipient of the system. The multidimensional perceptual pitch model may be generated during a fitting procedure where a number of an electrical stimulation patterns are presented to the recipient with both the electrode and pulse rate of those stimuli varied, and the recipient provides feedback about the perceived pitch of those stimuli. The fitting procedure may be performed at a hearing clinic, remotely from a hearing clinic or during use of the cochlear implant system in combination with an external input device that assists in the fitting procedure. The external input device, which may be a smartphone, leads the fitting procedure by introducing the recipient of the cochlear implant system to different inputs, and the recipient is able provided with feedback to the external input device.
The external input device may be provided by a computer, such as a fitting computer.
Furthermore the fitting procedure may be a computer-implemented system and/or a computer implemented method which comprises
an audio interface configured to provide an acoustical input to the microphone unit or an RF interface, such as Bluetooth, Low Energy Bluetooth, WIFI, telephone network or any other kind of communication links, of the cochlear implant system,
a recipient interface configured to receive recipient feedback based on the acoustical input,
a perceptual modelling logger configured to receive the recipient feedback from the recipient interface, acoustical parameters from the audio interface where the acoustical parameters characterizes the acoustical input.
Each of the plurality of multidimensional perceptual models may be customized for the recipient of the cochlear implant system via the fitting procedure, or, each of the plurality of multidimensional perceptual models may be predetermined based on similar multidimensional perceptual models of other recipients of a cochlear implant system. The customization of the plurality of multidimensional perceptual models may be done during the fitting procedure or during normal use of the cochlear implant system. The predetermined plurality of multidimensional perceptual models may be determined by interpolating between similar multidimensional perceptual models of the other recipients.
The customization and/or the predetermination of multidimensional perceptual models may be performed by a computer which may be connected to the cochlear implant system.
Predetermining the multidimensional perceptual models based on similar multidimensional perceptual models of other recipients results in a reduced time for generating multidimensional perceptual models in relation to the example where the model is customized.
Normal use of the cochlear implant system implies that the recipient is using the cochlear implant system for enhancing the recipient's ability to hear.
The cochlear implant system may comprise a perceptual modelling unit configured to retrieve at least one multidimensional perceptual model of the plurality of multidimensional perceptual models which relates to a perceptual information of interest. The perceptual information of interest may vary with respect to the acoustical input, i.e. variation in acoustical parameters of the acoustical input may result in variation in the perceptual information of interest. For example, for a given time period the perceptual information of interest is loudness but for a subsequent time period a fundamental frequency of the audio signal has changed such the perceptual information of interest will change from loudness to pitch.
Thereby, the perceptual modelling unit may be configured to retrieve at least one multidimensional perceptual model based on the multiple acoustic parameters.
The perceptual information of interest may be determined by a signal processing unit based on;
The acoustical parameter may acoustically characterize the acoustical input including, frequencies and/or sound levels, envelope, energy at fundamental frequencies of the audio signal, spectral shape of energy of the acoustical input, detections of phonemic and/or phonetic, sound level, Crest factors, Signal-To-Noise ratio, and/or variation of amplitudes with respect to time.
The acoustical parameter may be measured or determined by a signal processor unit of the cochlear implant system.
The cochlear implant system may comprise an optimization unit configured to select a sequence of coding parameter groups by performing an optimization analysis of the retrieved at least one multidimensional perceptual model which fulfils at least one objective criterion while adhering to at least one constraint criterion.
The multidimensional perceptual model may comprise perceptual information as a function of coding parameter groups, where the sequence of coding parameter includes a selected part of the perceptual information as a function of coding parameter groups. The selected part fulfills the at least one objective criterion while adhering to at least one constraint criterion. The analysis may be performed during use of the cochlear implant system. For example, the at least one objective criterion is to obtain a sequence of electrode place and stimulation rate pairs that maximize the perceived pitch range for the recipient and the at least one constraint criterion could be that the pulse rate cannot exceed a defined maximum on any electrode. The optimization unit analyse the retrieved multidimensional perceptual model by going through numerous sequences of coding parameter groups within the model until the at least one objective criterion is obtained while adhering to the constraint criterion. More sophisticated optimization algorithms could be used to solve this optimization problem. The selected sequence of coding parameter groups which fulfills the at least one objective criterion will result in an optimal maximized perceived pitch range performance for the given moment the recipient listens to the received acoustical input.
The at least one objective criterion may be determined by the signal processor unit or by an external input device computer based on the perceptual information of interest.
The at least one objective criterion may be determined by the signal processor unit or by an external input device based on the perceptual information of interest, and wherein the at least one objective criterion is at least one of following;
By including one of the mentioned objective criteria in determining the coding parameters will result in a coding of the stimulation pulses that improves the hearing capability of the recipient when using the cochlear implant system.
The at least one constraint criterion may be determined by the signal processor unit or by an external input device based on the perceptual information of interest, and where the at least one constraint criterion is at least one of following;
The constrains are not only preventing uncomfortable sensations for the patient, but also to guide the optimization algorithm to a sensible solution, by narrowing down the pool of solutions. Without constraint criteria, the optimization algorithm could reach a huge number of solutions, many of which are not viable. For example, without any constraint criteria for the pitch case, the algorithm could output a sequence of stimulation parameters that causes non-monotonic changes in pitch.
By including one of the mentioned constraint criteria in determining the coding parameters will result in a coding of the stimulation pulses that improves the hearing capability of the recipient without being uncomfortable when using the cochlear implant system. For example, the loudness can be increased to a level where the recipient is able to hear more but is not comfortable, i.e. the loudness is above the C-level, and by applying a constraint criterion which defines that the loudness should not be increased above the C-level the improvement of the hearing capability is done without being uncomfortable for the recipient.
If the at least one objective criterion is to maximize range of pitch, the optimization unit is configured to perform the optimization analysis by selecting a sequence of coding parameter groups that fulfills the at least one objective criterion and the at least one constraint criterion. The coding parameters may include pulse stimulation rate and stimulating electrode. The constraint criteria for the optimization method could, for example, include i) the perceived pitch elicited by the selected sequence of parameter groups must increase monotonically and ii) the electrode index of each group in the sequence must be greater than or equal to the electrode index of the preceding groups in the sequence. The selected sequence of coding parameter groups is then coded into the plurality of stimulation pulses.
The cochlear implant system may comprise the signal processor unit which includes a filter bank unit configured to process the audio signal into a plurality of band limited audio signals, and a mapping unit configured to map each of coding parameter group of the sequence of coding parameter groups to each of the plurality of band limited audio signals based on an acoustic parameter of the multiple acoustic parameters. Each of the band limited audio signal includes one or more frequencies of the audio signal within a frequency range defined by a bandwidth of a bandpass filter of the filter bank.
The signal processor unit may comprise a coding unit configured to code each of the plurality of band limited audio signals into a plurality of stimulation pulses based on the mapped coding parameter group and transfer the coded stimulation pulses to the plurality of electrodes.
Each electrode of the electrode array may be allocated to a frequency range predetermined via a fitting procedure or determined dynamically by the signal processor unit based on the audio input, and each of the stimulation pulses is allocated to each electrode of the electrode array when the frequency of the stimulation pulse is within the frequency range of the electrode.
The at least one objective criterion may be to maximize the range of loudness and the at least one constraint criterion may be to maximize the range of loudness for a specific number of electrodes of the plurality of electrodes within an electrical dynamic range defined between the hearing threshold (T-level) and the hearing comfortable level (C-level) of the recipient. The optimization unit analyses numerous of sequence of coding parameters using optimization techniques to select a sequence of coding parameters which fulfills the objective criterion while adhering to the constraint criterion, and the coding unit may code each of the plurality of band limited audio signals based on the coding parameter group of the selected sequence of coding parameter groups. And in this specific example, the recipient will experience an improved hearing capability.
The hearing threshold (T level) defines the lowest level of electrical stimulation current necessary for a person to perceive a sound, and the hearing comfortable level (C-level) defines the highest electoral level that will be output by the implant, where that level elicits a loudness that comfortable.
C level may be defined and set different. Sometimes it is defined as the maximum electrical level that will still produce a comfortable sensation (i.e. it is just below the level that would cause discomfort). This level is sometimes also called the ‘maximum comfort’ (MC) level. Other times that patient is simply asked to indicate a level that is loud and comfortable, which may lower than the MC.
The at least one constraint criterion may be a limitation of a coding parameter of the coding stimulation group determined by a min and max value of the coding parameter.
The optimization analysis for selecting the sequence of coding parameter groups may comprise selecting a first sequence of coding parameter groups and selecting a second sequence of coding parameter groups, and then, selecting either the first or the second sequence of coding parameter groups based on which of the first or the second sequence of coding parameter groups fulfills the at least one objective criterion while adhering to the at least one constraint criterion.
The optimization analysis may be performed in an iterative manner to obtain an optimal sequence of coding parameter groups of the first and second sequence of coding parameter groups.
The perceptual information of interest may vary with respect to the acoustical input, and thereby, different perceptual models will be retrieved along with the variation in the acoustical input. Thereby, for minimizing the computational power and delay for selecting the models, it is an advantage that the perceptual modelling unit may be configured to retrieve a group of multidimensional perceptual models of the plurality of multidimensional perceptual models which relates to one or more perceptual information of interests.
The optimization unit may be configured to shift between the retrieved multidimensional perceptual models of the group of multidimensional perceptual models based on a criteria.
The criteria may be one of following;
A coding parameter of a coding parameter group may be a selection of at least one or more of following;
a stimulation position provided by selection of one or more electrodes of the electrode array to receive the plurality of stimulation pulses.
The cochlear implant system may comprise an external input device, an external part, and an implantable unit; and wherein the memory unit, the perceptual modelling unit and the optimization unit may be part of the external input device, and the microphone unit and the signal processor may be part of the external part, and the electrode array may be part of the implantable unit, where the external part may be configured to communicate with the implantable unit via a transcutaneously link, and the external input device may be configured to communicate with the external part and/or the implantable unit; or wherein the memory unit, the perceptual modelling unit, the optimization unit, the microphone unit and the signal processor may be part of the external part and the electrode array may be part of the implantable unit, where the external part may be configured to communicate with the implantable unit.
The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:
The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, etc. (collectively referred to as “elements”). Depending upon particular application, design constraint criteria or other reasons, these elements may be implemented using other equivalent elements.
The hearing aid that is adapted to improve or augment the hearing capability of a recipient by receiving an acoustic signal from a recipient's surroundings, generating a corresponding audio signal, possibly modifying the audio signal and providing the possibly modified audio signal as an audible signal to at least one of the recipient's ears. Such audible signals may also be provided in the form of an acoustic signal transferred as mechanical vibrations to the recipient's inner ears through bone structure of the recipient's head.
The hearing aid is adapted to be worn in any known way. This may include arranging a unit of the hearing aid attached to a fixture implanted into the skull bone such as in a Bone Anchored Hearing Aid or at least a part of the hearing aid may be an implanted part.
A “hearing system” or a “cochlear implant system” refers to a system comprising one or two hearing aids, one or two cochlear implants, and a “binaural hearing system” refers to a system comprising two hearing aids or two cochlear implants where the devices are adapted to cooperatively provide audible signals to both of the recipient's ears or the hearing aid of bone conduction type or an acoustical hearing aid may be part of a bimodal system comprising a cochlear implant and a hearing aid or a bone conduction hearing aid. The system may further include an external device(s) that communicates with at least one hearing aid, the external device affecting the operation of the hearing aids and/or benefitting from the functioning of the hearing aids. A wired or wireless communication link between the at least one hearing aid and the external device is established that allows for exchanging information (e.g. control and status signals, possibly audio signals) between the at least one hearing aid and the external device. Such external devices may include at least one of remote controls, remote microphones, audio gateway devices, mobile phones, public-address systems, car audio systems or music players or a combination thereof. The audio gateway is adapted to receive a multitude of audio signals such as from an entertainment device like a TV or a music player, a telephone apparatus like a mobile telephone or a computer, a PC. The audio gateway is further adapted to select and/or combine an appropriate one of the received audio signals (or combination of signals) for transmission to the at least one hearing aid. The remote control is adapted to control functionality and operation of the at least one hearing aids. The function of the remote control may be implemented in a SmartPhone or other electronic device, the SmartPhone/electronic device possibly running an application that controls functionality of the at least one hearing aid.
In general, a hearing aid or a cochlear implant includes i) an input unit such as a microphone for receiving an acoustic signal from a recipient's surroundings and providing a corresponding input audio signal, and/or ii) a receiving unit for electronically receiving an input audio signal. The hearing aid further includes a signal processing unit for processing the input audio signal and an output unit for providing an audible signal to the recipient in dependence on the processed audio signal.
The input unit may include multiple input microphones, e.g. for providing direction-dependent audio signal processing. Such directional microphone system is adapted to enhance a target acoustic source among a multitude of acoustic sources in the recipient's environment. In one aspect, the directional system is adapted to detect (such as adaptively detect) from which direction a particular part of the microphone signal originates. This may be achieved by using conventionally known methods. The signal processing unit may include amplifier that is adapted to apply a frequency dependent gain to the input audio signal. The signal processing unit may further be adapted to provide other relevant functionality such as compression, noise reduction, etc. The output unit may include an output transducer for providing mechanical vibrations either transcutaneously or percutaneously to the skull bone.
The signal processor unit 22 includes a mapping unit 26 configured to map each of coding parameter group 48 of the sequence of coding parameter groups 36 to each of the plurality of band limited audio signals 34 based on an acoustic parameter 32 of the multiple acoustic parameters.
The signal processor unit 22 includes a coding unit configured to code each of the plurality of band limited audio signals 34 into a plurality of stimulation pulses based on the mapped coding parameter group 48 and transfer the coded stimulation pulses 50 to the electrode array 5.
In another example the perceptual modelling unit and the optimization unit may be combined into one single unit.
for a sound coding strategy Continuous-Interleaved Sampling (CIS).
In
As used, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “includes,” “comprises,” “including,” and/or “comprising,” when used in this specification, specify the presence of stated features, elements, components, and/or steps but do not preclude the presence or addition of one or more other features, elements, components, and/or steps thereof. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element, but an intervening element may also be present, unless expressly stated otherwise. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method are not limited to the exact order stated herein, unless expressly stated otherwise.
It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.
The scope should be judged in terms of the claims that follow.
| Number | Date | Country | Kind |
|---|---|---|---|
| 20195989.7 | Sep 2020 | EP | regional |
