This disclosure relates generally to hearing aids, and more particularly to hearing aids that are user adjustable.
Hearing deficiencies can range from partial hearing impairment to complete hearing loss. Often, an individual's hearing ability varies across the range of audible sound frequencies, and many individuals have hearing impairment with respect to only select acoustic frequencies. For example, an individual's hearing loss may be greater at higher frequencies than at lower frequencies.
A hearing health professional typically takes measurements using calibrated and specialized equipment to assess an individual's hearing capabilities in a variety of sound environments, and then adjusts the hearing aid based on the calibrated measurements. Subsequent adjustments to the hearing aid can require a second exam and further calibration by the hearing health professional, which can be costly and time intensive. In some instances, the hearing health professional may create multiple hearing profiles for the user for use in different sound environments.
However, merely providing stored hearing profiles to the user often leaves the user with a subpar hearing experience because each acoustic environment may vary in some way from the stored hearing aid profiles provided by the hearing health professional. Simply, storing more profiles on the hearing aid provides for better coverage of environmental systems but requires larger memories and increases the processing requirements in the hearing aid. Increased memory and enhanced processing increase the size requirements of the hearing aid that users want to be small and unobtrusive.
Some hearing aid systems allow the user to adjust their hearing aid after an initial programming by a hearing health professional by connecting the hearing aids to their personal computer (PC) and allowing the user to adjust the hearing aids while in use so that the user can hear the differences between each adjustment. However, while these hearing aid to PC systems allow for easier adjustments it is very difficult for a user to take into consideration acoustic environmental changes when adjusting a hearing aid because the home acoustic environment may be externally different form the intended use acoustic environment.
In the following description, the use of the same reference numerals in different drawings indicates similar or identical items.
Embodiments of systems, hearing aids, computing devices, and methods are described below that allow for environmental simulation during programming of a hearing aid profile (sound-shaping profile) of a hearing aid. In an example, the hearing aid and the computing device communicate through a radio frequency communication channel, wirelessly, to exchange profile data and/or acoustic samples that can be used by one or both devices to simulate the experience of utilizing a hearing aid profile in an acoustic environment represented by the acoustic sample. The computing device can be any electronic device including a processor, a memory, and a transceiver for communicating data to a hearing aid through a wireless (radio frequency) communication channel.
Computing device 120 is a personal digital assistant (PDA), smart phone, portable computer, or other computing device adapted to send and receive radio frequency signals according to any protocol compatible with hearing aid 102. One representative embodiment of computing device 120 includes the Apple iPhone®, which is commercially available from Apple, Inc. of Cupertino, Calif. or Blackberry®, available from Research In Motion Limited of Waterloo, Ontario. Other types of mobile telephone devices with short range wireless capability can also be used.
Computing device 120 includes computer-readable storage media 122, which is accessible by a processor 134. Computing device 120 further includes a transceiver 138, which is coupled to processor 134, such that processor 134 may send and receive data packets to and from transceiver 112 through transceiver 138. Computing device 120 also includes a display interface 140 and an input interface 136 to display information to a user and to receive user input, respectively. In some embodiments, a touch screen display may be used, in which case display interface 140 and input interface 136 are combined into a user interface.
Computer-readable storage media 122 stores a plurality of instructions that are executable by processor 134, including a configuration utility 124 with graphical user interface (GUI) generator instructions 126 and hearing aid profile adjustment instructions 128, a plurality of hearing aid profiles 130, and a plurality of acoustic environment samples 132. The acoustic environment samples are a collection of sounds representative of specific acoustic environments, such as a busy road, a park, a concert or other acoustic environment. Depending on the configuration of the computing device 120, the one or more computer-readable storage media 122 may be an example of non-transitory computer storage media and may include volatile and nonvolatile memory and/or removable and non-removable media implemented in any type of technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Such computer-readable media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other computer-readable media technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, solid state storage, magnetic disk storage, RAID storage systems, storage arrays, network attached storage, storage area networks, cloud storage, or any other medium that can be used to store information and which can be accessed by the processor 134 directly or through another computing device. Accordingly, the computer-readable storage media 122 may be computer-readable media able to maintain instructions, modules or components executable by the processor 134.
Additionally, computing device 120 includes speaker 142 for reproducing the acoustic environment samples as audible sound. In some instances, such as where computing device 120 is a portable computer, speaker 142 may be external to computing device 120 and coupled to an audio output interface of computing device 120.
The term “hearing aid profile” refers to a collection of acoustic configuration settings for hearing aid 102, which are used by processor 106 within hearing aid 102 to shape acoustic signals. Each of the hearing aid profiles of the plurality of hearing aid profiles 130 are based on the user's hearing characteristics and designed to compensate for the user's hearing loss or otherwise shape the sound received by microphone 108. Each hearing aid profile includes one or more parameters to shape or otherwise adjust sound signals for a particular acoustic environment. In particular, the one or more parameters are configurable to customize the sound shaping and to adjust the response characteristics of hearing aid 102, so that processor 106 can apply a customized hearing aid profile to a sound-related signal to compensate for hearing deficits of the user or otherwise enhance the sound-related signals. Such parameters can include signal amplitude and gain characteristics, signal processing algorithms, frequency response characteristics, coefficients associated with one or more signal processing algorithms, or any combination thereof.
In an embodiment, a user initiates a hearing aid profile configuration process by launching an application on computing device 120, which triggers configuration utility 124. Configuration utility 124 causes processor 134 to execute hearing aid profile adjustment instructions 128 and GUI generator instructions 126. GUI generating instructions 128 when executed cause processor 124 to display a user interface on display interface 140 and wait for user selections from input interface 136.
In one example, the user interface provides the user with a list representative of the plurality of hearing aid profiles 130, which the user may select to adjust. The user interface also provides a second representative list comprising the acoustic environment samples 132 for the user to select from while adjusting the selected hearing aid profile. Once the user selects a hearing aid profile from the representative list, hearing aid adjustment instructions 128 allow the user to make modifications to the sound shaping instruction included within the selected hearing aid profile to generate a modified hearing aid profile. In another example, the user may select to generate a new hearing aid profile and may utilize hearing aid adjustment instructions 128 to generate a hearing aid profile from scratch or from the stored values representative of their hearing loss.
Once a modified hearing aid profile has been generated and an acoustic environment samples has been selected, processor 134 provides the modified hearing aid profile to hearing aid 102 through the communication channel and the selected acoustic environment to speaker 142 for reproduction as audible sound. In this manner, the user is able to determine if the modified hearing aid profile is suitable to the acoustic environment represented by the acoustic environment sample without being in the actual acoustic environment. Thus the user may generate hearing aid profiles for specific acoustic environments in the comfort of their own home.
In an example, processor 134 may alternatively provide hearing aid 102 with the modified hearing aid profile and the original hearing aid profile in an iterative manner, while speaker 142 is reproducing the acoustic environment sample as sound, such that the user may hear the difference between the original and the modified profile.
In another example, once the acoustic environment sample is selected computing device 120 may begin to reproduce the sample as audible sound during the adjustment process and processor 134 may provide the adjustments to the selected hearing aid profile to hearing aid 102 in real time, such that the user may make an adjustment and then hear how the adjustment changed the sound shaping of the hearing aid profile as the user makes each individual adjustment.
It should also be understood, that multiple acoustic environment samples may be played simultaneously to provide an acoustic environment including two or more environments. For example, an acoustic sample of road noise may be played with an acoustic sample of a crowd to simulate a street full of automobiles and pedestrians.
In another embodiment once the modified hearing aid profile is generated, processor 134 applies both the modified hearing aid profile to the acoustic sample to generate a first adjusted acoustic sample and the original hearing aid profile to the acoustic sample to generate a second adjusted acoustic sample. The first and second adjusted acoustic samples are then provided to either speaker 142 or to hearing aid 102 for reproduction as audible sound without the need for further modification.
In yet another embodiment once the modified hearing aid profile is generated, both the modified hearing aid profile and the original hearing aid profile together with the selected acoustic environment are provided to hearing aid 102. Processor 106 of hearing aid 102 applies both the modified hearing aid profile and the original hearing aid profile to the selected acoustic environment to produce a first and second modified acoustic sample respectively. The first and second modified acoustic samples are provided iteratively to speaker 110 for reproduction as audible sound.
Advancing to 206, the hearing aid profile is adjusted to generate an adjusted hearing aid profile. The hearing aid profile may be adjusted by the user via input interface 136 and display interface 140 or adjusted automatically by processor 134 executing hearing aid profile adjustment instructions 128. For example, hearing aid profile adjustment instruction 128 may cause processor 134 to apply the hearing aid profile to the acoustic environmental sample until the resulting sample's sound characteristics are within a predetermined threshold. In another example, hearing aid profile adjustment instruction 128 may cause processor 134 to determine sound characteristics of the acoustic environmental sample and by analyzing the user's hearing loss characteristics and the sound characteristics generating a suitable hearing aid profile.
Once the adjusted hearing aid profile is generated, method 200 proceeds to 208 and the acoustic environment sample is filtered with the adjusted hearing aid profile to generate a filtered sound sample. In one example, processor 134 of computing device 120 applies the adjusted hearing aid to the acoustic environmental sample to generate the filtered sound sample. In another example, the adjusted hearing aid profile and the acoustic environmental sample may be provided to hearing aid 102 and processor 106 applies the adjusted hearing aid profile to the acoustic environmental sample to generate the filtered sound sample. Proceeding to 212, the filtered sound sample is reproduced as audible sound, such that the user can determine what the adjusted hearing aid profile would sound like in the adjusted hearing aid profile's intended acoustic environment.
In an alternative method, the acoustic environment sample may also filtered with the hearing aid profile to generate a second filtered sound sample, which may be reproduced for the user in an alternating manner with the filtered sound sample. In this manner the user is able to determine the differences in operation between the hearing aid profile and the adjusted hearing aid profile as if the user was in the intended acoustic environment.
Proceeding to 308, computing device 120 provides the adjusted hearing aid profile to hearing aid 102 through the communication channel. Hearing aid 102 is programmed to filter sound with the hearing aid profile provided by computing device 120, in this case the adjusted hearing aid profile. Moving to 310, computing device 120 reproduces the acoustic environmental sample as sound via speaker 142. Thus method 300 allows the user to simulate the acoustic environment represented by the acoustic environment sample in a realistic way. Method 300 does so by allowing hearing aid 102 to detect the sound (the reproduced acoustic environmental sample) at microphone 108 convert the sound to an audio signal (electrical signals) and processor 108 filtering the audio signal as dictated by the adjusted hearing aid profile to generate a filtered audio signal. The filtered audio signal is then provided to speaker 110 for reproduction as audible sound at the user's ear. By filtering the sound at hearing aid 102 and producing the sound at computing device 120, hearing aid 102 is able to filter sound as if the user was actually in the acoustic environment represented by the acoustic environmental sample.
In some cases method 300 continues to 312 and computing device 120 provides the hearing aid profile to hearing aid 102 through the communication channel, such that hearing aid 102 filters sounds using the original hearing aid profile instead of the adjusted hearing aid profile. Advancing to 314, computing device 120 reproduces the acoustic environment sample as sound once again, such that the user can compare the adjusted hearing aid profile with the original hearing aid profile. Method 300 may continue to alternate between providing the adjusted hearing aid profile and the original hearing aid profile to hearing aid 102 until computing device 120 receives a signal to stop. It should also be understood that as computing device 120 alternatively provides the adjusted hearing aid profile and the original hearing aid profile to hearing aid 102, computing device 120 may continuously reproduce the acoustic environmental sample as sound nonstop.
Although the present invention has been described with reference to preferred embodiments, workers skilled in the art will recognize that changes may be made in form and detail without departing from the scope of the invention.
This application is a continuation of 13/782,710, filed Mar. 1, 2013 (now U.S. Pat. No. 9,479,876), which is a non-provisional application of and claims priority to Provisional Application No. 61/621,234 filed on Apr. 6, 2012 and entitled “PROCESSOR-READABLE MEDIUM, APPARATUS AND METHOD FOR UPDATING A LISTENING DEVICE.” The foregoing patent application are incorporated herein by reference in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
4759070 | Voroba | Jul 1988 | A |
4947432 | Topholm | Aug 1990 | A |
4972487 | Mangold et al. | Nov 1990 | A |
5721783 | Anderson | Feb 1998 | A |
5785661 | Shennib | Jul 1998 | A |
6741712 | Bisgaard et al. | May 2004 | B2 |
7200237 | Zhang et al. | Apr 2007 | B2 |
7519194 | Niederdränk et al. | Apr 2009 | B2 |
7933419 | Roeck et al. | Apr 2011 | B2 |
8077891 | Hasler et al. | Dec 2011 | B2 |
8280369 | Reeves et al. | Oct 2012 | B1 |
8379871 | Michael et al. | Feb 2013 | B2 |
8406442 | Ribic et al. | Mar 2013 | B2 |
8457335 | Imamura et al. | Jun 2013 | B2 |
8526649 | Foo et al. | Sep 2013 | B2 |
8588442 | Schmitt et al. | Nov 2013 | B2 |
8611570 | Neumeyer et al. | Dec 2013 | B2 |
8649538 | Apfel et al. | Feb 2014 | B2 |
8654999 | Mindlin et al. | Feb 2014 | B2 |
8761421 | Apfel et al. | Jun 2014 | B2 |
8787603 | Fichtl et al. | Jul 2014 | B2 |
8810392 | Teller et al. | Aug 2014 | B1 |
8965017 | Bryant et al. | Feb 2015 | B2 |
9191756 | Neumeyer et al. | Nov 2015 | B2 |
9479876 | Neumeyer | Oct 2016 | B2 |
20030008659 | Waters et al. | Jan 2003 | A1 |
20030059076 | Martin et al. | Mar 2003 | A1 |
20030215105 | Sacha et al. | Nov 2003 | A1 |
20040059446 | Goldberg et al. | Mar 2004 | A1 |
20050036637 | Janssen et al. | Feb 2005 | A1 |
20060182294 | Grasbon et al. | Aug 2006 | A1 |
20070098195 | Holmes et al. | May 2007 | A1 |
20070255435 | Cohen | Nov 2007 | A1 |
20090047994 | Sommer et al. | Feb 2009 | A1 |
20090154741 | Woods | Jun 2009 | A1 |
20100027822 | Dietz et al. | Feb 2010 | A1 |
20100255782 | Klemmensen et al. | Oct 2010 | A1 |
20100273452 | Rajann et al. | Oct 2010 | A1 |
20100290654 | Wiggins et al. | Nov 2010 | A1 |
20110176697 | Apfel et al. | Jul 2011 | A1 |
20120183165 | Foo et al. | Jul 2012 | A1 |
20120213393 | Foo et al. | Aug 2012 | A1 |
20120219159 | Burk et al. | Aug 2012 | A1 |
20120237064 | Garratt | Sep 2012 | A1 |
20130266165 | Neumeyer et al. | Oct 2013 | A1 |
20150156596 | Bryant et al. | Jun 2015 | A1 |
Number | Date | Country |
---|---|---|
2008071236 | Jun 2008 | WO |
2009001559 | Dec 2008 | WO |
Entry |
---|
“Good Practice Guidance for Adult Hearing Aid Fittings and Services,” prepared for International Society of Audiology, Nov. 2004, 8 pages. Exhibit 1012, Case IPR2017-00781. |
American Heritage Dictionary of the English Language, 5th edition, 2011, p. 1652. Exhibit 1011, Case IPR2017-00783. |
Aug. 16, 2013 Response to Jun. 4, 2013 Office Action in Prosecution History of U.S. Pat. No. 8,611,570, 9 pages. Exhibit 1004, Case IPR2017-00367. |
Barron's Dictionary of Computer and Internet Terms, 11th edition, 2013, p. 457. Exhibit 1012, Case IPR2017-00783. |
Certified English language translation of German Patent Publication No. DE19542961, May 15, 1997, 16 pages. Exhibit 1009 Case IPR2017-00781. |
Certified English language translation of WIPO Patent Publication No. WO2009/001559 to Imamura et al., Dec. 31, 2008, 79 pages. Exhibit 1006, Case IPR2017-00367. |
Consumer Reports “Hear Well in a Noisy World—features at a glance,” Jul. 2009, 2 pages. Exhibit 1009, Case IPR2017-00414. |
Declaration of Dr. Les Atlas, Exhibit 1008, Case IPR2017-00781. Jan. 26, 2017, 145 pages. |
Declaration of Dr. Robert E. Morley, Jr., Exhibit 1002, Case IPR2017-00496. Dec. 21, 2016, 87 pages. |
Declaration of Dr. Robert K. Morrow, Exhibit 1003, Case IPR2017-00783. Jan. 27, 2017, 85 pages. Exhibit 1003, Case IPR2017-00783. |
Declaration of Dr. Sayfe Kiaei, Exhibit 1002, Case IPR2017-00367. Dec. 4, 2016, 102 pages. |
Declaration of Les Atlas PhD, Exhibit 1003 Case IPR2017-00414. Dec. 6, 2016, 111 pages. |
Dillon et al., “The trainable hearing aid: What will it do for clients and clinicians?” The Hearing Journal, vol. 59, No. 4, Apr. 2006, 6 pages. Exhibit 1014, Case IPR2017-00781. |
Jul. 10, 2013 Response to May 30, 2013 Office Action in Prosecution History of U.S. Pat. No. 8,761,421, 13 pages. Exhibit 1008, Case IPR2017-00496. |
Kasoff, B., “A Closer Look: The Evolution of the Smart Phone,” Sep. 19, 2014, 2 pages. <blog.wipp.org/2014/09/a-closer-look-the-evolution-of/> Exhibit 1016, Case IPR2017-00783. |
Keidser, Gitte et al., “Variation in preferred gain with experience for hearing-aid users,” 2008, International Journal of Audiology 47:10, 621-635. Exhibit 1013, Case IPR2017-00781. |
Mar. 1, 2013 Response to Dec. 12, 2012 Office Action in Prosecution History of U.S. Pat. No. 8,761,421, 22 pages. Exhibit 1006, Case IPR2017-00496. |
Martin, T. “The evolution of the srnartphone,” Jul. 29, 2014, 20 pages. <pocketnow.com/2014/07/28/the-evolution-of-the-smartphone> Exhibit 1014, CaseIPR2017-00783. |
Mukherjee, S., “Smartphone Evolution: From IBM Simon to Samsung Galaxy S3,” May 8, 2012, p. 3. <ibtimes.com/smartphone-evolution-ibm-simon-samsung-galaxy-s3-697340> Exhibit 1015. Case IPR2017-00783. |
Prosecution History of U.S. Pat. No. 8,649,538 to Apfel et al., 166 pages; patent application filed Feb. 8, 2011. Exhibit 1002, Case IPR2017-00414. |
Prosecution History of U.S. Pat. No. 8,654,999 to Mindlin et al., 194 pages; patent application filed Apr. 12, 2011. Exhibit 1002, Case IPR2017-00781. |
Prosecution History of U.S. Pat. No. 9,191,756 to Neumeyer et al., 71 pages; patent application filed Dec. 7, 2012. Exhibit 1002, Case IPR2017-00783. |
Rodriguez, Gary P. et al. “Preferred Hearing Aid Response Characteristics Under Acoustic and Telecoil Coupling Conditions,” American Journal of Audiology55, Nov. 1993, 5 pages. Exhibit 1011, Case IPR2017-00414. |
Sager, I., “Before IPhone and Adroid Came Simon, the First Smartphone,” Jun. 29, 2012, 3 pages. <bloomberg.com/news/articles/2012-06-29/before-iphone-and-android-came-simon-the-first-smartphone> Exhibit 1013, Case IPR2017-00783. |
United States Patent and Trademark Office, Dec. 12, 2012 Office Action from Prosecution History of U.S. Pat. No. 8,761,421, 19 pages. Exhibit 1003, Case IPR2017-00496. |
United States Patent and Trademark Office, Jun. 4, 2013 Office Action from Prosecution History of U.S. Pat. No. 8,611,570, 6 pages. Exhibit 1003, Case IPR2017-00367. |
United States Patent and Trademark Office, May 30, 2013 Office Action from Prosecution History of U.S. Pat. No. 8,761,421, 19 pages. Exhibit 1007, Case IPR2017-00496. |
United States Patent and Trademark Office, Patent Trial and Appeal Board, K/S HIMPP v. III Holdings 4, LLC, Case IPR2017-00367 (U.S. Pat. No. 8,611,570), Petition for Inter Partes Review, Dec. 6, 2016, 81 pages. |
United States Patent and Trademark Office, Patent Trial and Appeal Board, K/S HIMPP v. III Holdings 4, LLC, Case IPR2017-00414 (U.S. Pat. No. 8,649,538), Petition for Inter Partes Review, Dec. 6, 2016, 84 pages. |
United States Patent and Trademark Office, Patent Trial and Appeal Board, K/S HIMPP v. III Holdings 4, LLC, Case IPR2017-00496 (U.S. Pat. No. 8,761,421), Petition for Inter Partes Review, Dec. 21, 2016, 91 pages. |
United States Patent and Trademark Office, Patent Trial and Appeal Board, K/S HIMPP v. III Holdings 4, LLC, Case IPR2017-00781 (U.S. Pat. No. 8,654,999), Petition for Inter Partes Review of claims 1-9 and 16-19, Jan. 27, 2017, 69 pages. |
United States Patent and Trademark Office, Patent Trial and Appeal Board, K/S HIMPP v. III Holdings 4, LLC, Case IPR2017-00782 (U.S. Pat. No. 8,654,999), Petition for Inter Partes Review of claims 10-15 and 20, Jan. 27, 2017, 56 pages. |
United States Patent and Trademark Office, Patent Trial and Appeal Board, K/S HIMPP v. III Holdings 4, LLC, CaseIPR2017-00783 (U.S. Pat. No. 9,191,756), Petition for Inter Partes Review, Jan. 27, 2017, 79 pages. |
Valente, Michael, “Guideline for Audiologic Management of the Adult Patient,” Audiology Online 2016, Oct, 30, 2006, 8 pages. Exhibit 1011, Case IPR2017-00781. |
Widrow, Bernard et al. “Microphone Arrays for Hearing Aids: An Overview,” Journal of Speech Communication, Jan. 2003, pp. 139-146. Exhibit 1010, Case IPR2017-00414. |
United States Patent and Trademark Office, Final Office Action, U.S. Appl. No. 13/782,710, dated Dec. 2, 2015, 15 pages. |
United States Patent and Trademark Office, Final Office Action, U.S. Appl. No. 13/782,710, dated Oct, 23, 2014, 16 pages. |
United States Patent and Trademark Office, Final Office Action, U.S. Appl. No. 14/611,944, dated Nov. 4, 2016, 21 pages. |
United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 13/723,667, dated Mar, 13, 2014, 14 pages. |
United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 13/782,710, dated Apr. 11, 2014, 19 pages. |
United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 13/782,710, dated Mar. 2, 2015, 14 pages. |
United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 14/611,944, dated May 17, 2016, 19 pages. |
United States Patent and Trademark Office, Notice of Allowance, U.S. Appl. No. 13/723,667, dated Oct. 17, 2014, 7 pages. |
United States Patent and Trademark Office, Notice of Allowance, U.S. Appl. No. 13/782,710, dated Jun. 15, 2016, 10 pages. |
United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 14/611,944, dated Sep. 11, 2017, 16 pages. |
United States Patent and Trademark Office, Notice of Allowance, U.S. Appl. No. 14/611,944, dated Apr. 6, 2018, 16 pages. |
Number | Date | Country | |
---|---|---|---|
20170142530 A1 | May 2017 | US |
Number | Date | Country | |
---|---|---|---|
61621234 | Apr 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13782710 | Mar 2013 | US |
Child | 15268470 | US |