Hearing loss, which can be due to many different causes, is generally of two types: conductive and sensorineural. Sensorineural hearing loss is due to the absence or destruction of the hair cells in the cochlea that transduce sound signals into nerve impulses. Various hearing prostheses are commercially available to provide individuals suffering from sensorineural hearing loss with the ability to perceive sound. For example, cochlear implants use an electrode array implanted in the cochlea of a recipient (i.e., the inner ear of the recipient) to bypass the mechanisms of the middle and outer ear. More specifically, an electrical stimulus is provided via the electrode array to the auditory nerve, thereby causing a hearing percept.
Conductive hearing loss occurs when the normal mechanical pathways that provide sound to hair cells in the cochlea are impeded, for example, by damage to the ossicular chain or the ear canal. Individuals suffering from conductive hearing loss can retain some form of residual hearing because some or all of the hair cells in the cochlea function normally.
Individuals suffering from conductive hearing loss often receive a conventional hearing aid. Such hearing aids rely on principles of air conduction to transmit acoustic signals to the cochlea. In particular, a hearing aid typically uses an arrangement positioned in the recipient's ear canal or on the outer ear to amplify a sound received by the outer ear of the recipient. This amplified sound reaches the cochlea causing motion of the perilymph and stimulation of the auditory nerve.
In contrast to conventional hearing aids, which rely primarily on the principles of air conduction, certain types of hearing prostheses commonly referred to as bone conduction devices, convert a received sound into vibrations. The vibrations are transferred through the skull to the cochlea causing motion of the perilymph and stimulation of the auditory nerve, which results in the perception of the received sound. Bone conduction devices are suitable to treat a variety of types of hearing loss and can be suitable for individuals who cannot derive sufficient benefit from conventional hearing aids.
The technologies disclosed herein relate to systems and methods for providing settings adjustments to auditory prostheses. One or more settings adjustments can be provided to an auditory prosthesis in response to a request for the adjustments or a notification that the recipient desires a settings adjustment. The technologies disclosed herein can dynamically adapt based upon information received from a set of auditory prostheses. The information received from the set of auditory prostheses can be used to update the settings adjustments.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
The same number represents the same element or same type of element in all drawings.
When a recipient first receives an auditory prosthesis, the audio prosthesis is fitted for the user. Fitting the audio prosthesis involves determining settings for the auditory prosthesis which provides the recipient with best hearing experience. The settings adjustments determined during the fitting can be based upon the type of auditory prosthesis, the condition of the recipient, and/or other factors. Due to such differences, the settings adjustments from one recipient to the next can vary. Because of this, the fitting process is often a complex process that is performed by an audiologist with specialized training for a particular auditory prosthesis. Due to the complexity, recipients of auditory prostheses are often not capable of adjusting settings themselves. Furthermore, the optimal settings for an auditory prosthesis can vary from one sound environment to another. For example, the sound characteristics of a concert differ from the sound characteristics of a restaurant. To further exacerbate these problems, incorrect settings could cause a poor experience for the recipient (e.g., distortions, feedback, artifacts, low output, high output, etc.). Often, settings adjustments are required for different sound environments to provide the recipient with an improved experience. Unfortunately, for the difficulties previously described, many recipients are unable to adjust the settings of their auditory prosthesis based upon their current sound environment.
Examples disclosed herein relate to systems and methods that dynamically provide settings for a recipient's auditory prosthesis based upon the current sound environment that the recipient is in. Determining proper settings for a particular sound environment generally requires a significant amount of testing. Furthermore, the settings can differ depending on the type of a user's auditory prosthesis. The systems and methods disclosed herein can modify stored settings adjustment based upon analysis of information from a group of recipients, that is, a number of recipients having a similar audio prosthesis. Settings adjustments can be a set or profile of settings that can be applied by an auditory prosthesis. Settings adjustments can also be one or more instructions to adjust one or more operational parameters of the setting device. While specific examples of settings adjustments have been discussed herein, one of skill in the art will appreciate that other types of settings adjustments can be employed without departing from the spirit of this disclosure. Exemplary settings adjustments can include, but are not limited to, noise reduction management, a compressor system to give the best amplification for signals with loudness close to normal speech, beam forming, and other modifications to stimulation output, sound processing, etc. Additionally, while settings adjustments is referred to in plural form throughout this disclosure, settings adjustments can also be an adjustment or instruction to adjust a single setting.
The technologies disclosed herein relate to systems and methods for performing evolutionary adaption based upon information received from a group of auditory prosthesis recipients. For example, if a subject recipient in a particular sound environment requests setting adjustments, an auditory prosthesis for that recipient can receive an indication of the recipient's poor experience. In response to receiving the indication, the auditory prosthesis can collect or otherwise determine information about the current sound environment. The information about the current sound environment can be sent or associated with a request for a settings adjustment to a remote device (e.g., a server) or a plurality of remote devices (e.g., a distributed network) by the auditory prosthesis or an intermediary device in communication with an auditory prosthesis. In response to transmitting the request, the auditory prosthesis can receive a settings adjustment from the server (or servers). The received settings adjustment can be selected from a plurality of different settings adjustments stored on the remote device. The selection of the received settings adjustment can be based on a priority or ranking such that the higher priority (or higher ranked) settings adjustments are provided to the auditory prosthesis before the lower priority settings adjustments. The received settings adjustment can then be applied to the auditory prosthesis. If the recipient is not satisfied with the settings adjustment, the auditory prosthesis can received another indication of the recipient's desire for new settings and, in turn, send another request for a subsequent settings adjustment. The process can be repeated until the auditory prosthesis is adjusted to the recipient's satisfaction.
The technologies described herein can provide settings adjustments to a large number of recipients of auditory prostheses. The technologies can collect information from each recipient that requests a settings adjustment as well as track whether or not the recipient accepted or rejected a provided settings adjustment. The collected and tracked information can be used to adjust a prioritization of a particular settings adjustment. For example, a prioritization value associated with a particular settings adjustment that has been accepted by many different recipients can be positively modified. Conversely, a prioritization value associated with a particular settings adjustment that has been rejected by many different recipients can be negatively modified. In doing so, a library of settings adjustments can undergo evolutionary adaption such that the better settings adjustments (e.g., settings adjustments that are more frequently accepted by recipients) are initially provided. Over time, a library of settings adjustments can undergo evolutionary adaption as the prioritization values of the different settings adjustments continually change. This allows for the selection of improved settings adjustments over time. Additionally, the technologies described herein are capable of adapting to changes in environment, auditory prostheses, and/or recipient preferences to modify which settings adjustments are selected as circumstances change.
The technologies disclosed herein can be used in conjunction with various types of auditory prostheses, including active transcutaneous bone conduction devices, passive transcutaneous devices, middle ear devices, cochlear implants, and acoustic hearing aids, or other devices acting as an auditory prosthesis. The devices can be wearable (i.e., entirely external to the recipient), partially implanted or totally implantable (either in or on the head, including in specific portions of the anatomy, e.g., in the mouth or below the skin of the skull). Additionally, the technologies can be incorporated into other devices that process sound for a member of a conversation, such as, for example a smartphone, a tablet, a laptop, or other devices. For ease of discussion, the description and examples will be directed to cochlear implants. However, one of skill in the art will appreciate that the technology disclosed herein can be practiced with any type of auditory prosthesis.
In certain examples, external coil 130 transmits electrical signals (e.g., power and stimulation data) to internal coil 136 via a radio frequency (RF) link, as noted above. Internal coil 136 is typically a wire antenna coil comprised of multiple turns of electrically insulated single-strand or multi-strand platinum or gold wire. The electrical insulation of internal coil 136 is provided by a flexible silicone molding (not shown). In use, implantable receiver unit 132 can be positioned in a recess of the temporal bone adjacent auricle 110 of the recipient. Various types of energy transfer, such as infrared (IR), electromagnetic, capacitive and inductive transfer, can be used to transfer the power and/or data from external device to cochlear implant.
Upon receiving the request from the auditory prosthesis 202, the server 204 determines a settings adjustment. In examples, the determination is based upon information about the current sound environment, the auditory prosthesis type, the recipient's ailment or condition, and/or other information received from the recipient's auditory prosthesis or from other audio prostheses. In examples, the server 204 can be associated with a library of settings adjustments. The library of settings adjustments can be stored on server 204, or on a datastore communicatively coupled to server 204, such as datastore 216. The library of settings adjustments includes settings adjustments that are dynamically determined by the server 206, settings adjustments received from experts (e.g., an audiologist), prior settings provided by the recipient or by other recipients, etc. The settings adjustments resident in the library can be determined based on other types of information departing from the spirit of this disclosure. In examples, the library can be organized according to sound environment, device type, type of hearing loss, age, or other characteristics of a recipient such as the recipient's hobbies (e.g., producing different settings adjustments when playing the drums versus play a flute). The additional information, such as the information about the recipient, can be provided at the time or prior to the time of the request. The information can be provided by the recipient, by an audiologist setting up a profile for the recipient, or by other parties. Upon determining a settings adjustment, the server 204 can transmit the settings adjustment to the auditory prosthesis 202 via network 206.
In examples, the settings adjustment can be prioritized or ranked. For example, a number of different settings adjustments can be stored by the server 204. When the server 204 receives a request for a settings adjustment, it can determine a subset of settings adjustments based upon information associated with the request. For example, there can be subsets of setting adjustments grouped by type of auditory prosthesis (e.g., cochlear implant, traditional hearing aid, bone conduction device, etc.), by recipient status or ailment (e.g., single-sided deafness, sensorineural hearing loss, conductive hearing loss, mixed hearing loss, etc.), by sound environment (e.g., a restaurant, a concert hall, outdoors, etc.), or by any other type of categorization. Different settings adjustments can be prioritized or ranked for each category. The prioritization or ranking can depend upon feedback received from multiple auditory prostheses (e.g., worn by other recipients). For example, server 204 can also receive requests from and provide settings adjustments to auditory prosthesis 208, auditory prosthesis 210, auditory prosthesis 212, and/or auditory prosthesis 214. Auditory prostheses 208-214 can have the same type or different types. In response to providing the settings adjustments, server 204 can receive feedback from auditory prostheses 208-214. Based on the feedback, server 204 can determine the effectiveness of the settings adjustment. For example, if the server 204 receives positive feedback from a number of auditory prostheses 208-214, the ranking or priority of the settings adjustment can be positively modified. Conversely, negative feedback can result in a settings adjustment being negatively adjusted. The priority or ranking of settings adjustments can determine which particular settings adjustment is selected by the server 204. In a further example, the positive and/or negative feedback can be provided with additional information that can be used by the server 204 to develop additional settings adjustments. The library can be updated with the adjusted priority or ranking. In examples where a library is organized into multiple categories, a particular settings adjustment can be included in more than one category. If a particular settings adjustment is included in more than one category, the settings adjustment can be associated with different priority or rankings for each category in which it is included.
In response to receiving the indication or request, flow continues to operation 304 where information about the current sound environment is collected. Collecting information about the current sound environment can include, but is not limited to, performing operations such as such as identifying the presence of wind, identifying the presence of additional speakers and/or the loudness of surrounding speech, autocorrelation of the environment, identifying tonality, performing logPowerSpectrum, identifying spectral jaggedness, detecting distortion, timbre, duration of sounds, phase of sounds, and/or signal to noise ratio (SNR), determining a zero-crossing rate, determining a minima/maxima of periodogram, determining reverberation, determining whether the hearing prosthesis has registered feedback, and/or receiving user inputted data about the sound environment. Collecting information about the current sound environment can also include making a short recording of the current sound environment. The short recording can then be analyzed by the hearing prosthesis or by a remote device. It is contemplated that other methods can be employed to collect information about the sound environment. Any type of information about the sound environment that can be used to determine a settings adjustment can be collected at operation 304.
Flow continues to operation 306 where a request for a settings adjustment is sent to a remote device. An exemplary remote device can be a server. Alternatively, the request can be sent to a distributed network consisting of multiple servers and/or datastores. In one example, the request is sent by itself. In alternate examples, the request can be sent with information about the current sound environment and/or information about an auditory prosthesis. In one example, the request and/or the additional information can be transmitted to a remote device by the auditory prosthesis. For example, the auditory prosthesis can include a wireless interface, such as, for example, a WiFi or Bluetooth interface. In alternate example, the request and/or information can be routed through an intermediary device connected to an auditory prosthesis, such as a smartphone, a tablet, a laptop, and so forth. The intermediary device can be connected to the auditory prosthesis using a wired or wireless connection.
In response to sending the request and/or additional information, flow continues to operation 308 where one or more settings adjustments are received. The one or more settings adjustments can be a profile of settings that can be applied. Settings adjustments can also be one or more instructions to adjust one or more operational parameters of the device. Exemplary settings adjustments can include, but are not limited to, noise reduction management, a compressor system to give the best amplification for signals with loudness close to normal speech, beam forming, and other modifications to stimulation output, sound processing, modifying the aggressiveness of a feedback manager, applying wind noise reduction, etc. In one example, the one or more settings adjustment can be received directly by the auditory prosthesis, for example, in instances where the auditory prosthesis generating the request for settings adjustments has an interface to a network. In other examples, the one or more settings adjustments can be received via an intermediary device that is connected to a network, such as, for example, a smartphone, a tablet, a laptop, or other network connected computing devices. In such examples, the intermediary device can process or modify the one or more settings adjustments prior to providing the one or more settings adjustments to an auditory prosthesis. Upon receiving the one or more settings adjustments, flow continues to operation 310 where the one or more settings adjustments are applied to the auditory prosthesis. For example, the one or more settings adjustments can be used to adjust the configuration settings and/or operation of an auditory prosthesis at operation 310. In one example, the one or more settings adjustments can be automatically applied. In alternate examples, a physical interface or a GUI can be used to provide information to the recipient about the one or more settings adjustments. In such examples, the one or more settings adjustments are not applied unless an acceptance of the one or more settings adjustments is received via the physical interface or GUI.
Flow continues to decision operation 312 where a determination is made as to whether or not the recipient accepts the one or more settings adjustments. In one example, an indication or acceptance can be received via an interface, such as a physical interface (e.g., a button on the auditory prosthesis) or a GUI. In another example, if input has not been received from the user within a predefined window of time, a determination can be made that the user accepts the one or more settings adjustments. If the determination is made that the received settings adjustment is accepted, then flow branches YES to optional operation 314. At optional operation 314, feedback information is sent to the server and/or distributed network that provided the one or more settings adjustment. For example, additional information about the auditory prosthesis, the one or more settings, and/or the sound environment can optionally be provided at operation 314. The additional information provided at operation 314 can be used for the prioritization or ranking or the one more settings adjustments and/or for the creation of new settings adjustments. After providing feedback information at optional operation 314, the method 300 can complete.
Returning to decision operation 312, if a denial of the one or more settings adjustments is received then a determination can be made that the one or more settings adjustments were denied. In alternate examples, a subsequent request for new settings adjustments can also be an indicator that the one or more previously provided settings adjustments were not accepted. If the one or more settings adjustments are not accepted, then flow branches NO and returns to operation 304. Upon returning to operation 304, additional information about the current sound environment can be collected. The method 300 then continues from operation 304. In alternate examples, it is not be necessary to collect additional information about the current sound environment. In such examples, operation 304 can be skipped. Under such circumstances, decision operation 312 can branch NO to operation 306. In further examples, if more than one settings adjustment is received at operation 308, flow can branch NO to operation 308 where another settings adjustment is applied before sending another request to the remote device. In certain embodiments, the method 300 can repeat multiple times until a received settings adjustment is accepted.
Flow continues to operation 406 where information about the sound environment is analyzed. In further examples, additional information, such as information about the auditory prosthesis, information about the recipient, and/or third party information, can also be analyzed. For example, analyzing the received data can be used to determine a type or category of settings adjustment. In one example, a fixed ranking of importance can be determined based off of the information about the sound environment. For example, the fixed ranking can give different weights to different characteristics based on importance (e.g., “signal-to-noise ratio” can be weighted relative to “phase of sounds” information based upon a determination that the signal-to-noise ratio is more important when determining a settings adjustment). In another example, the information about the sound environment can be analyzed to determine if there is any significant difference (e.g., higher or lower) of a characteristic as compared to what is considered normal. In such examples, characteristics with significant differences can be prioritized when determining a settings adjustment. In yet another example, a multivariate analysis or principle component analysis can be performed on the information about the sound environment to determine a settings adjustment. While specific types of analysis are described herein, other types of analysis can be performed without departing from the scope of this disclosure. Based upon the analysis, flow continues to operation 408 where one or more settings adjustments are selected and provided to the auditory prosthesis. In example, one or more settings adjustments can be stored in a library, such as the exemplary library described with respect to
After providing the one or more settings adjustments to an auditory prosthesis, flow continues to decision operation 410, where it is determined whether or not the recipient accepted the one or more provided settings adjustment. If a subsequent request for settings adjustments is received, or if an indication that the one or more settings adjustments were not accepted, flow branches NO to operation 412 where the rejection of the one or more provided settings adjustments is logged or otherwise stored. In one example, logging the rejection of the one more provided settings adjustments can include recording the one or more provided settings adjustments, the information about the sound environment, information about the auditory prosthesis, third party information, and/or other types of information. Other types of information can include information that relates the one or more provided settings adjustments to a prior selected settings adjustment. That way, if the request received at is a subsequent request for a settings adjustment, a series of requests and rejections can be recorded.
After logging the rejection, flow continues to operation 416 where the prioritization or ranking of the one or more provided settings adjustment are modified. At operation 416, the prioritization or rank of the one or more provided settings adjustments can be negatively affected because the provided settings adjustments were rejected. Negatively affecting the priority or ranking makes it less likely that the one or more settings adjustments will be selected in response to a future request by the same recipient or by a different recipient. Among other benefits, this provides the benefit of making it more likely that an acceptable settings adjustment will be initially selected upon receiving a first request for settings adjustments. As such, the library of settings adjustments can adapt based upon feedback received from an audio prosthesis or an intermediary device. In other examples, a determination can be made about how long a user has been using a provided settings adjustment without requesting another update. In such examples, the longer a recipient keeps the settings can be correlated with user satisfaction, which can result in an adjustment of the priority or ranking of the settings adjustment. In another example, the recipient can be queried to determine a satisfaction level of the settings adjustments. For example, a message can be sent to the recipient to rate the settings adjustment, for example, on a scale, and/or request a written review of the settings adjustments. In such examples, the priority or rankings of the provided settings adjustment can be based on the feedback information from the recipient. In yet another example, multiple setting adjustments can be sent to a recipient for selection. Depending on which settings adjustment is selected by the recipient, the priority or ranking of the different settings adjustments can be modified. Flow then returns to operation 404 where additional information can be collected, if necessary. If it is not necessary to collect additional information, operation 404 can be skipped. Method 400 then repeats.
Returning to decision operation 412, a determination that the one more provided settings adjustment can be made upon receiving an indication that the recipient accepted the one or more provided settings adjustments. Alternatively, the absence of a response from the auditory prosthesis within a predetermined period of time can also indicate that the one or more provided settings adjustments were accepted. If the one or more provided setting adjustments are selected, flow branches YES to operation 414. At operation 414, the acceptance of the one or more provided settings adjustments is logged or otherwise stored. In one example, logging the acceptance of the one more provided settings adjustments can include recording the one or more provided settings adjustments, information about the sound environment, information about the auditory prosthesis, third party information, and/or other types of information. Other types of information can include information that relates the one or more provided settings adjustments to a prior selected settings adjustment. That way, if the request received is a subsequent request for a settings adjustment, a series of requests and rejections that preceded the acceptance can be recorded.
Flow continues to operation 418 where the prioritization or ranking of the one or more provided settings adjustments are positively modified. At operation 418, the prioritization or rank of the one or more provided settings adjustments can be positively modified because the provided settings adjustments were rejected. Positively modifying the priority or ranking makes it more likely that the one or more settings adjustments will be selected in response to a future request by the same recipient or by a different recipient. Among other things, this provides the benefit of making it more likely that an acceptable settings adjustment will be initially selected upon receiving a first request for settings adjustments. As such, the library of settings adjustments can adapt based upon feedback received from an audio prosthesis or an intermediary device. For example, the different techniques previously discussed can be applied at operation 418. The method 400 can then complete.
While operations 416 and 418 are described during execution of the method 400, one of skill in the art will appreciate that the modification or the prioritization or ranking of a settings adjustment can be performed at a later time. For example, the modifications can be performed by a batch process once a day, once a week, etc., rather than in response to receiving a request as described in
In its most basic configuration, operating environment 500 typically includes at least one processing unit 502 and memory 504. Depending on the exact configuration and type of computing device, memory 504 (storing, among other things, instructions to implement and/or perform the functionality disclosed herein) can be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or some combination of the two. This most basic configuration is illustrated in
Operating environment 500 typically includes at least some form of computer readable media. Computer readable media can be any available media that can be accessed by processing unit 502 or other devices comprising the operating environment. By way of example, and not limitation, computer readable media can comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EEPROM, flash memory or other memory technology, solid state storage, or any other tangible or non-transitory medium which can be used to store the desired information. Communication media embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.
The operating environment 500 can be a single device operating in a networked environment using logical connections to one or more remote devices. The remote device can be an auditory prosthesis, a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above as well as others not so mentioned. The logical connections can include any method supported by available communications media. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
In some examples, the components described herein comprise such modules or instructions executable by operating environment 500 that can be stored on computer storage medium and other non-transitory mediums and transmitted in communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Combinations of any of the above should also be included within the scope of readable media. In some examples, computer system 500 is part of a network that stores data in remote storage media for use by the computer system 500.
The examples described herein can be employed using software, hardware, or a combination of software and hardware to implement and perform the systems and methods disclosed herein. Although specific devices have been recited throughout the disclosure as performing specific functions, one of skill in the art will appreciate that these devices are provided for illustrative purposes, and other devices can be employed to perform the functionality disclosed herein without departing from the scope of the disclosure.
This disclosure described some examples of the present technology with reference to the accompanying drawings, in which only some of the possible examples were shown. Other aspects can, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein. Rather, these embodiments were provided so that this disclosure was thorough and complete and fully conveyed the scope of the possible examples to those skilled in the art.
Although specific examples were described herein, the scope of the technology is not limited to those specific examples. One skilled in the art will recognize other examples or improvements that are within the scope of the present technology. Therefore, the specific structure, acts, or media are disclosed only as illustrative embodiments. The scope of the technology is defined by the following claims and any equivalents therein.
This application is a continuation of U.S. patent application Ser. No. 16/597,414, filed Oct. 9, 2019, which is a continuation of U.S. patent application Ser. No. 15/009,618, filed Jan. 28, 2016, now U.S. Pat. No. 10,477,325, and which claims priority to U.S. Provisional Application No. 62/146,013, filed Apr. 10, 2015. All of these applications are titled “SYSTEMS AND METHOD FOR ADJUSTING AUDITORY PROSTHESES SETTINGS” and are incorporated herein by reference in their entirety for any and all purposes.
Number | Date | Country | |
---|---|---|---|
62146013 | Apr 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16597414 | Oct 2019 | US |
Child | 18462950 | US | |
Parent | 15009618 | Jan 2016 | US |
Child | 16597414 | US |