A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
The present invention pertains to hearing aids that are modular, scalable to the hearing deficiencies of the user. In particular, the invention pertains to methods and apparatus of implementing and controlling the different components of a hearing aid system, using an array of processors.
Electronic hearing aids typically include a microphone to receive sound and convert it to an electrical signal, a signal processor connected to the microphone that is operable to process the electrical signal and an earpiece or loudspeaker operable to convert the electrical signal to an acoustic signal produced at the ear of the user. The signal processor in such a hearing aid will carry out both amplification and filtering of the signal so as to amplify or attenuate the particular frequencies where the user suffers hearing loss. Such hearing aids can be mono, comprising a single earpiece, or stereo comprising a left and right earpiece for the user. Such devices are shown in U.S. application Ser. No. 10/475,568 by Zlatan Ribic filed Apr. 18, 2002 PCT/AT02/00114 and U.S. application Ser. No. 11/877,535 filed Oct. 23, 2007 also by Mr. Ribic.
Hearing aids come in different varieties, such as analog hearing aids and digital hearing aids. Analog hearing aids use transistors in a circuit to amplify and modify the incoming sound signal. Analog hearing aids are cheaper than digital hearing aids, but have limitations when used in noisy environments, as analog hearing aids amplify both sound signal (speech) and noise. Also, if the user needs any further adjustments with hearing, the user has to send the hearing aid back to the manufacturer to have the components changed.
Digital hearing aids provide improved processing power and programmability, allowing hearing aids to be customized to a specific hearing impairment and environment. Instead of a simple sound amplification, more complex processing strategies can be achieved to improve the sound quality presented to the impaired ear. However, to implement complex processing strategies, the hearing aid requires a very sophisticated digital signal processor (DSP). Owing to the computational burden of such processing, and the consequent requirements of complexity and speed, a main problem in using digital signal processing for hearing aids has been the size of the processor and the large amount of power used.
Hearing aid systems with remote control units allow configuring of hearing aid systems. Existing remote control units typically use cables to connect to the ear pieces. This wired approach is typically only used by medical professionals, such as audiologists, in a medical office environment. Wireless communication and specifically in the realm of radio frequency (RF) uses an antenna to receive a signal and a receiver for tuning the frequency to the desired signal frequency. At the other end is a simple transmitter to produce a signal at a certain frequency and an antenna for transmitting the signal. RF devices come in different varieties such as analog receivers and transmitters and digital receivers and transmitters. Analog receivers and transmitters are cheaper than digital receivers and transmitters, but have limitations such as changing components for changing the tunable frequencies.
Existing hearing aid systems thus far have properties which are predetermined after receiving power. Said properties are normally fixed by design and configured during manufacturing, for the purpose of targeting a specific marketing application, such as the hearing aid system described herein. Changing or expanding the properties of said systems to satisfy new application needs is limited to the static functions built in during manufacturing.
Thus, there exists a need for a digital hearing aid that can be programmed and customized to a specific hearing impairment and environment without posing limitations of significant power consumption, size requirements and speed requirements, plus utilizes a wireless remote control unit for convenient user programming in any environment.
The proposed hearing aid system combines the advantages of digital signal processing and wireless digital receiving and transmission. It allows for much greater flexibility for the user in customizing the hearing aid to the environment and specific needs of the user based on their hearing loss. This is accomplished without imposing limitations of significant power consumption, size requirements and also speed requirements. It is also anticipated that this type of system would not be restricted to being used only by a medical professional. This system would be designed to allow the user to control the earpieces himself in any normal living environment. In addition, a wide variety of applications would be available to the user, over and above the typical hearing improvement functions.
Advances in semiconductor technology have enabled more and faster circuits that can operate with lower power consumption to be placed in a given die area, and advances in microprocessor architecture have provided single-die multiprocessor array, and stacked-die array, type computer systems in extremely compact form with capabilities for processing signals enormously faster and with very low operating power. One form of such a computer system is a single-die multiprocessor array, comprising a plurality of substantially similar, directly-connected computers (sometimes also referred to as “processors”, “cores” or “nodes”), each computer having processing capabilities and at least some dedicated memory, and adapted to operate asynchronously, both internally and for communicating with other computers of the array and with external devices. Moore, et al. (U.S. Pat. App. Pub. No. 2007/0250682A1) discloses such a computer system. Operating speed, power saving, and size improvements provided by such computer systems can be advantageous for signal processing application especially in digital hearing aids.
With an array of processors (also referred to as “cores”), some of the cores can be used to reconfigure a second set of cores, even while a third set of cores continue to run operations not related to the reconfiguration process. This process is known in the art as partial reconfiguration in the field, without doing any manufacturing. This ability greatly enhances the utility and lifetime of a product, such as, but not limited to, the hearing aid system described herein.
The hearing aid system described combines the advantages of digital signal processing and wireless digital receiving and transmission. This system allows for much greater flexibility for the user in customizing the hearing aid to the environment and specific needs of the user, based on their hearing loss without posing limitations of significant power consumption, size requirements and also speed requirements. This system is not restricted to being used only by a medical professional. The system allows the user to control the earpieces himself in any normal living environment. In addition, a wide variety of applications are available to the user, over and above the typical hearing improvement functions.
The proposed invention uses multiple processors or multiple computers for customizing a hearing aid to a user's hearing loss profile or to the hearing environment. A user interface device and hearing earpiece connect wirelessly, incorporating the digital receiver and transmitter onto an array of processors reducing power and improving the speed of the operations. A method for reconfiguring one set of an array of processors within a single system while the remaining array of processors in said system are simultaneously executing other operations.
a is a side elevation view of the physical components of the
a is a block diagram of an array of processors in an embodiment of the invention;
b is a continuation of the block diagram of an array of processors in the
c is a continuation of the block diagram of an array of processors in the
d is a continuation of the block diagram of an array of processors in the
e is a continuation of the block diagram of an array of processors in the
a is a block diagram of an array of processors in an embodiment of the invention;
b is a continuation of the block diagram of an array of processors in the
a is a flow diagram of an embodiment of the method performing multiple frequency band processing;
b is a flow diagram of an embodiment of the method performing the spectral and temporal masking;
a is a flow diagram of an embodiment of the method performing the transmit of electromagnetic RF (wireless) energy;
b is a flow diagram of an embodiment of the method performing the receive of electromagnetic RF (wireless) energy;
a is a flow diagram of an embodiment of the method performing the reconfiguration module; and
b is a continuation of the
a is a side elevation view of the physical components of an alternate to the
An array user interface 260, including a user interface engine 265, is operable by user 120 of
In the
A to D converter 310 converts the analog electrical signal received from pre-amplifier 305 into a discrete digital signal that can subsequently be processed by digital signal processing means. The output of A to D converter 310 is connected to the input of a directional microphone 312. The output of directional microphone 312 is connected to the input of the multi-band processing unit 315 which is, in turn, connected to the instant amplitude control unit (IACU) 320. Multi-band processing unit 315 includes a filter bank 315a, which includes a bank of band pass filters operable to separate the input signal into a plurality of frequency bands. The output of IACU 320 is connected to the input of the post processing amplifier 325. Post processing amplifier 325 amplifies the signal received from compensation unit 320 to a level where it can be reproduced as sound at earphones 105 or 110 of
IACU 320 processes the signal received from multi-band processing unit 315 to compensate for the hearing defects present in a person suffering from hearing loss, including cochlear hearing loss. IACU 320 is operable to receive corresponding frequency band signals from multi-band processing unit 315 and process each frequency band signal separately. Processing the frequency bands is accomplished by means of a distinct analytic magnitude divider (AMD) 320a, each operable to provide dynamic compression, attenuating signals of amplitude greater than a threshold value and amplifying signals below said threshold. The threshold value and compression ratio of each AMD 320a is predetermined to the hearing loss profile of a particular user 120 of
Reconfiguration module 250 includes a non-volatile memory (“NVM”) 335 connected to a code processor unit 340, whose output is connected to reconfiguration unit 345. The path 245 connects a reconfiguration unit 345 and code processor unit 340 with earpiece antenna module 235 of
The code processor unit 340 is operable to download a set of commands which subsequently execute instructions that configure the reconfiguration unit 345. Optionally, some or all of the commands used to configure reconfiguration unit 345 may come from NVM 335. In the latter case, a reconfigure initiate command received from earpiece antenna module 235 of
In one embodiment pre-amplifier 305, analog to digital converter 310, directional microphone 312, multi-band processing unit 315, compensation unit 320, post processing amplifier 325, and digital to analog converter 330 are all functionally reconfigured. In an alternate embodiment, not all of the functional blocks as part of the signal processing unit 220 are reconfigured. Device partial reconfiguration will proceed without interrupting other functional components of the array hearing aid system.
In an alternative embodiment, reconfiguration module 250 is operable to functionally manipulate data used in signal processing unit 220. For example, compensation unit 320 uses a compression ratio parameter, gain for each frequency, and a master gain parameter which are used in the reformulation of the audio signal from the eight frequency bands. It is possible to update any of the three parameters in compensation unit 320 for each clock sample. Path 245 from earpiece antenna module 235 (
Returning to
The output from dual purpose receive and transmit antenna 405 is connected to simple receiver 410 when earpiece antenna module 235 is receiving a signal from array user interface 260 of
The input to the dual purpose receive and transmit antenna 405 is connected from simple transmitter 415 when earpiece antenna module 235 is transmitting a signal to array user interface 260 of
User interface antenna module 270 is functionally equivalent to the earpiece antenna module 235. However, dual purpose receive and transmit antenna 405, as part of the user interface antenna module 270, is operable to transmit to array earpiece 205 and receive from array earpiece 205.
In one embodiment, the task of each unit of the hearing aid system is further divided into a plurality of smaller tasks, such that the smaller tasks can be executed by one or more of the processing devices 505(aa) to 505(zw). Dividing the tasks into smaller tasks and distributing the tasks to the plurality of the processing devices allows the system to execute the multiple tasks simultaneously in parallel. Furthermore, once the individual processing unit completes the tasks assigned to it, the processing device can enter into a power saving mode. For example, the processors 505(aa) to 505(zj) are assigned to perform the tasks of the signal processing unit 220, processors 505(aj) to 505(zk) are assigned to perform the tasks of the reconfiguration module 250, processors 505(al) to 505(zo) are assigned to perform the tasks of the earpiece antenna module 235, processors 505(ap) to 505(zs) are assigned to perform the tasks of the array user interface 260, and processors 505(at) to 505(zw) are assigned to perform the tasks of the user interface engine 265.
In
Returning to the
Moving on to
In one embodiment, the processing devices of
In another embodiment, processing devices 505(xa), 505(wa) and 505(zc) in
In another embodiment as illustrated in
In yet another embodiment, the array of processors may be asynchronous in the communication between the processors, with asynchronous instruction execution by the individual processors. The synchronicity necessary for signal processing functionality is accomplished by synchronizing software running on each processor in the asynchronous array of processors.
c illustrates the array of processors 505(ah) through 505(zj) used to perform data compensation as part of signal processing unit 220. Processing device 505(uh) down converts (“DCVT”) the processed band samples and passes them to the six processing devices 505(vh), 505(vh), 505(vi), 505(ui), 505(vi), and 505(vj) that perform the function of the analytic magnitude divider (“AMD”). A distinct AMD associated with each band provides dynamic compression, attenuating signals of amplitude greater than a threshold value and amplifying signals below said threshold. The threshold and compression ratio of each AMD is predetermined to the hearing loss profile of a particular user. Dynamic compression acts to reduce the dynamic range of signals received at the ear accordingly reduces the masking effect of loud sounds. The compression algorithm of each AMD provides spectral contrast enhancements to compensate for simultaneous masking at nearby frequencies in the frequency domain and introduces inter-modulation distortion that mimics the distortion produced naturally by a healthy cochlea. An equalizer bank within the signal reconstruction unit applies a predetermined amount of gain to the output of each AMD when reformulating the signal to produce sound at the ear of the user. Cache update 505(tj) transmits information to con
The outputs from the multi-band audio processor are compressed to provide spectral and temporal unmasking. The real and real/imaginary & magnitude/phase components of the signals in the band are first generated using a simple Hilbert transform. The Hilbert transform is performed by four processing devices, 505(vh), 505(uh), 505(vi), and 505(ui). The absolute value of the magnitude component is then offset by a minimal threshold and compressed using a pre-calculated compression ration term as an exponent. The compression ratio for all bands is adjustable by a compression ratio parameter, which is determined by the hearing loss profile of user 120. At higher compression ratio states, the amount of IM distortion is enhanced in the output signal as well. The slope of the compression ratio parameters over the filter spectrum is adjustable over a range of zero to one.
d illustrates the array of processors 505(aj) through 505(zk) used to perform the function of the reconfiguration module 250,
e array of processors 505(al) through 505(zo) illustrates the array of processors used to operate as earpiece antenna module 235. The input from the physical antenna (not shown) is connected to a switch 505(so). A switching logic 505(ro) controls the switch and determines if the switch 505(so) will send or receive a wireless RF signal. In one embodiment, the earpiece antenna module 235 (
In an alternate model, earpiece antenna module 235 (
Signals are received at the antenna and are initially amplified (using an LNA) and filtered to produce a strong enough signal to allow reliable sampling. The sampling here is done with a super regenerative receiver (“SRR”) technique.
The oscillator 505(um) for the SRR is intentionally designed with positive feedback, and a very narrow Q. Also, it is designed to have a ramp up delay time which is a known value when the received signal does not contain the desired frequency. The ramp delay time rapidly decreases when the desired frequency is present at the LNA. The SEAforth® code is very well suited to measuring signal delay times. So the code can quickly determine if the desired signal frequency is present, by tracking the oscillator ramp up time. When that happens, the code can essentially disable the oscillator briefly with a digital bit line (known as Q-quenching), then release the line, allowing the oscillator to ramp up again. Also, when the “quick” ramp up occurs, the oscillator current (Iosc) increases proportionally to the ramp up time. When Iosc crosses a pre-determined threshold (Ithresh), the SEAforth® code records that as a valid sample of the desired frequency. This entire sampling process then repeats for each sample. At this point, the sampling process follows techniques well known in the art such as the Nyquist requirement that you must sample at least 2× faster than the detected frequency. One method for detecting Iosc is to convert it to a voltage with a resistance, then use the SEAforth® on-chip ADC to measure the voltage. Currently, some other analog functions may have to be done externally, such as signal pre-conditioning. But eventually those small circuits could be included on the SEAforth® chip.
a and 7b illustrate an embodiment of the array of processors used to operate as user interface antenna module 260 and user interface engine 265 shown in
Returning to
a is a flow chart depicting how step 925 of flowchart in
b is a flow chart depicting how step 930 of flowchart in
a is a flow chart depicting an embodiment of the method of the operation of the digital transmitter on an array hearing aid system. In the power up condition, the state machine is in an idle state 1005. In a step 1010, the state machine verifies if the signal generator is ready. If the signal generator is ready in a step 1010, then in a step 1015 a puck oscillator is executed in digital form. Otherwise, the state machine returns to the idle state 1005. In a step 1020, an OOK gate is executed in digital form, followed by a power amplification in a step 1025. The signal is then sent and transmitted by means of an antenna in a step 1030.
b is a flow chart depicting an embodiment of the method of the operation of the digital receiver on an array hearing aid system. In the power up condition, the state machine is in an idle state 1040. In a step 1045, the state machine verifies if the antenna is receiving a signal. If the antenna is receiving a signal, then in a step 1050 a low noise amplifier of the signal is executed in digital form. Next in a step 1055, an RF detector is executed in digital form. In a step 1060, the state machine verifies if a frequency selector and a feedback have been processed in the RF detector. If in a step 1060, the frequency selector and the feedback have been processed in the RF detector, then a baseband amplifier is applied to the signal in a step 1065.
a is a flow chart depicting the first portion of an embodiment of the method of operation of the reconfiguration on an array hearing aid system. The array earpiece is programmed to operate in normal mode (step 1105) upon receiving power. For the purpose of describing this flow diagram, normal operating mode means all operations other than the reconfiguration operation. One of the functions of the normal operating mode is to monitor data and commands being received via array earpiece antenna module 235 of
b is the continuation of the
Various modifications may be made to the invention without altering its value or scope. For example, while this invention has been described herein using the example of the particular computers 505, many or all of the inventive aspects are readily adaptable to other computer designs, other sorts of computer arrays, and the like.
Similarly, while the present invention has been described primarily herein in relation to use in a hearing aid, the reconfiguration methods and apparatus are usable in many array computers, the same principles and methods can be used, or modified for use, to accomplish other inter-device reconfigurations, such as in general digital signal processing as used in communications between a transmitter and a receiver whether wireless, electrical or optical transmission further including analysis of received communications and radio reflections.
While specific examples of the inventive computer arrays 220, 250, 235, 270 and 265 computers 505, paths 510 and associated apparatus, and the wireless communication method (as illustrated in
All of the above are only some of the examples of available embodiments of the present invention. Those skilled in the art will readily observe that numerous other modifications and alterations may be made without departing from the spirit and scope of the invention. Accordingly, the disclosure herein is not intended as limiting and the appended claims are to be interpreted as encompassing the entire scope of the invention.
The inventive computer logic array signal processing 220 reconfiguration modules 250 wireless connections 235 and 270 and signal processing methods are intended to be widely used in a great variety of communication applications, including hearing aid systems. It is expected that they will be particularly useful in wireless applications where significant computing power and speed are required.
As discussed previously herein, the applicability of the present invention is such that the inputting information and instructions are greatly enhanced, both in speed and versatility. Also, communications between a computer array and other devices are enhanced according to the described method and means. Since the inventive computer logic array signal processing 220 reconfiguration modules 250 wireless connections 235 and 270 and signal processing methods may be readily produced and integrated with existing tasks, input/output devices and the like, and since the advantages as described herein are provided, it is expected that they will be readily accepted in the industry. For these and other reasons, it is expected that the utility and industrial applicability of the invention will be both significant in scope and long-lasting in duration.
This application is a continuation-in-part of co-pending U.S. patent application Ser. No. 12/410,206 entitled “Method and Apparatus for Implementing Hearing Aid with Array of Processors”, filed on Mar. 24, 2009, which is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12410206 | Mar 2009 | US |
| Child | 12483998 | US |