Patent Grant
11153677
An aspect of the disclosure here relates to digital audio signal processing techniques for automatically controlling how sound is amplified and produced by an against-the-ear hearing device, such as a headphone or a mobile phone handset, in loud and quiet environments. Other aspects are also described.
Consumer electronic devices referred to as against-the-ear hearing devices, such as headphones and mobile phone handsets, are used in a variety of different ambient sound environments and are worn and then removed by their user quite often. The listening experience of users of these devices may be affected by changing ambient sound environments.
An aspect of the disclosure here relates to an audio system that has an ambient sound enhancement function, also referred to here as a transparency mode of operation, in which an against-the-ear audio device having one or more speakers converts a digitally processed version of an input audio signal into amplified sound (that is, louder as compared to the user hearing the ambient sound without the device against their ear.) The amplification may be in accordance with a stored hearing profile of the user. When the ambient sound enhancement function is active, the input audio signal contains ambient or environmental sound pick up from one or more microphones in the device; in a “playback” situation, the input audio signal is a combination signal that also contains program audio, such as music, the voice of a far end user during a phone call, or the voice of a virtual assistant program. When the ambient sound enhancement function is inactive, the input audio signal may contain program audio but not ambient sound pick up.
In one aspect, while reproducing the ambient sound according to a frequency dependent “transparency” gain that may or may not be set according to the hearing profile of the user, a digital processor (configured as an ambient sound environment analyzer or noise profile analyzer) detects that the ambient sound changes from quiet to loud (e.g., its sound pressure level rises above a threshold.) In response, the processor reduces the transparency gain (where this reduction may or may not be in accordance with the hearing profile of the user.) This automatic reduction in level of the reproduced ambient sound may reduce distortion or maintain a comfortable sound level in certain situations, such as when the user enters a significantly louder sound environment (e.g., a restaurant or a social club.) If the against-the-ear device can produce anti-noise for acoustic noise cancellation (ANC), then in that case the processor could raise a level of the produced anti-noise in a low frequency band (where ANC is more effective) in response to detecting that the ambient sound changes from quiet to load. That may mitigate the occlusion effect in the low frequency band. Also, the reduction in the frequency dependent transparency gain may be limited to a high frequency band where ANC is less effective. Since a majority of the anti-noise is in the low frequency band and not in the high frequency band, raising the anti-noise does not turn down the high frequency band. As a result, the reproduced ambient sound in the high frequency band would sound too loud but for the reduction in the frequency dependent transparency gain. Such automatic control of the ambient sound enhancement function results in a more desirable user experience as the audio system automatically adapts to changing ambient sound environments, and to the frequent donning and removal of the against the ear audio device being for example a headphone or a mobile handset.
In another aspect here, the processor starts producing anti-noise or raises a level of existing anti-noise being produced in the low frequency band, in response to detecting a louder ambient sound environment, but without necessarily reducing the transparency gain in the high frequency band (for reproducing the ambient sound.)
In yet another aspect, the ambient sound is reproduced (in accordance with the hearing profile of the user) with more gain in a high frequency band than in a low frequency band, while producing anti-noise whose level is greater in the low frequency band than in the high frequency band.
Another aspect of the disclosure here is how to control ANC during ambient sound enhancement, in order to improve intelligibility of speech in the ambient sound environment. In that aspect, while reproducing the ambient sound (which may or may not be in accordance with the user's hearing profile), the processor detects speech in the ambient sound. So long as no speech is being detected, the anti-noise continues to be produced (while reproducing the ambient sound), but whenever speech is detected the anti-noise level is lowered. This helps make the speech (that is present in the reproduced ambient sound) more easily heard or more intelligible. This response (lowering the anti-noise during speech intervals and raising it back up during non-speech) may be fast acting, e.g., may vary on a per audio frame basis and per frequency bin and may conform to psychoacoustics.
The above summary does not include an exhaustive list of all aspects of the present disclosure. It is contemplated that the disclosure includes all systems and methods that can be practiced from all suitable combinations of the various aspects summarized above, as well as those disclosed in the Detailed Description below and particularly pointed out in the Claims section. Such combinations may have particular advantages not specifically recited in the above summary.
Several aspects of the disclosure here are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” aspect in this disclosure are not necessarily to the same aspect, and they mean at least one. Also, in the interest of conciseness and reducing the total number of figures, a given figure may be used to illustrate the features of more than one aspect of the disclosure, and not all elements in the figure may be required for a given aspect.
Several aspects of the disclosure with reference to the appended drawings are now explained. Whenever the shapes, relative positions and other aspects of the parts described are not explicitly defined, the scope of the invention is not limited only to the parts shown, which are meant merely for the purpose of illustration. Also, while numerous details are set forth, it is understood that some aspects of the disclosure may be practiced without these details. In other instances, well-known circuits, structures, and techniques have not been shown in detail so as not to obscure the understanding of this description.
Consumer electronic devices referred to as against-the-ear hearing devices, such as headphones and mobile phone handsets, are used in a variety of different ambient sound environments. For instance, consider a user who is at a train station and is wearing a headset. While waiting for a train to arrive the user could be talking to a friend standing next to them when the train arrives and creates the typically loud train sound. The headset occludes the user's ear and therefore passively attenuates the voice of the friend. If the headset has an ambient sound enhancement function, where the ambient sound is being actively reproduced at the user's ear (optionally according to the user's hearing profile), then it will allow the friend's speech to be heard more easily. The arrival of the train however will result in the train sound also being reproduced and in some cases amplified (according to the user's hearing profile), thereby making it difficult for the user to hear the friend's speech. In another example, the user (while wearing the headset or holding the mobile handset again their ear) is walking with their friend to a local social club or restaurant, and upon entering will hear an undesirable, significant increase in babble noise (being reproduced by the ambient sound enhancement function.) The same ambient sound environment is also heard differently by different users of the system, as some users have lower dynamic range in their hearing than others such that soft or quiet sounds are barely heard by those particular users. A further problem that is especially apparent with certain headphones is the occlusion effect (body conducted sound such as the user's own voice becomes trapped in the ear canal that is blocked by the headphone.) A desirable audio system may also be one that can automatically adapt to such changing ambient sound environments, and to the frequent donning and removal of the headphone or mobile handset, in order to provide a more pleasing hearing experience to the user.
There are many instances where a user, while wearing an against-the-ear device 1, may have a preference or need for hearing at a higher sound pressure level, SPL, than would the average person. To meet the preference or need of such a user, the ambient sound could be amplified by the audio system in accordance with a hearing profile of the user (e.g., a data structure stored in memory), and reproduced through the speaker 2 as an ambient sound enhancement function. This may be performed without any anti-noise being produced by an acoustic noise cancellation, ANC, function. If the user, while wearing the headset or holding the smartphone against their ear, then enters a social club that has a much louder ambient sound level, the amplified sound may appear (be heard as) distorted or uncomfortably loud. The audio system should automatically reduce the reproduced ambient sound level in such a condition, based on the wearer's hearing profile and based on the ambient sound level. And as described below, the audio system may also take advantage of an available ANC function in that case, by activating or increasing the anti-noise level to cancel the elevated levels of leaked ambient sound.
Turning now to
As used herein, the “hearing profile” defines the hearing needs and preferences of the user including hearing level or hearing loss, as dB HL, across various frequencies of interest within the range of normal human hearing (also referred to here as auditory sub-bands.) The hearing profile may additionally specify quiet, comfortable and loud listening levels, frequency-dependent amplification preferences across different types of audio content (e.g., voice phone call, podcast, music, movies) or the user's sensitivity to noise or sound processing artifacts. The hearing profile may be derived from for example a stored audiogram of the user and may include outcomes of other standard hearing evaluation procedures such as Speech-in-Noise testing or measurement of otoacoustic emissions. In addition, or as an alternative to objective hearing evaluations such as the audiogram, the hearing profile may be the result of a process that generates acoustic stimuli using the speakers in the against-the-ear audio device and monitors or evaluates the user's responses to those acoustic stimuli (e.g., as verbal responses that have been picked up by a microphone of the audio device, or as manual responses entered by the user through a graphical user interface of the audio system.) The hearing profile may thus define the hearing preference or hearing sensitivity of the user, for example in terms of hearing level in dB (dB HL).
Here it should be noted that while the figures show a single microphone symbol in each instance (external microphone 3 and internal microphone 2), as producing a sound pickup channel, this does not mean that the sound pickup channel must be produced by only one microphone. In many instances, the sound pickup channel may be the result of combining multiple microphone signals, e.g., by a beamforming process performed on a multi-channel output from a microphone array.
The ambient sound as picked up in a sound pickup channel (e.g., a microphone signal from the external microphone 3) is filtered in a frequency-dependent transparency gain block Gase, which is controlled by an ambient sound environment analyzer 8 according to the hearing profile of the user (based on input from the hearing loss compensation block.) The ambient sound content is then combined with a playback signal which contains program audio. The program audio may be music, the voice of a far end user during a phone call, or the voice of a virtual assistant program, which has not yet been converted to sound in the ambient environment. This combined audio signal then drives the speaker 2, thereby reproducing the ambient sound (and optionally program audio, if present.) Note that when the ambient sound enhancement function is inactive, e.g. the combined audio signal at the output of the gain block Gase is essentially zero, the input audio signal that drives the speaker 2 may contain program audio but not ambient sound pick up.
When the ambient sound enhancement function is active (the ambient sound is being reproduced, as described above), the ambient sound environment analyzer 8 may detect that the ambient sound environment changes from quiet to loud. A noise profile analyzer, an automatic sound event detector, or a sound environment detector (any of which may be based on a machine learning model) may be used for this purpose, to distinguish between a loud environment and a quiet or active talker environment. The loud environment may, for example, be one where the SPL is above a threshold, such that the audio system should perform an active earplug function to reduce the SPL at the user's ears to more comfortable levels. The quiet or active talker environment is one which may call for the sound enhancement function to be activated, so that speech in the ambient environment may reproduced in a more intelligible manner. In response to detecting that the ambient sound environment changes from quiet to loud, the analyzer 8 signals the Gase gain block to reduce its gain, and it may do so in accordance with a hearing profile of the user (information from the hearing loss compensation block). At that point therefore, the ambient sound is being reproduced in accordance with the reduced gain of Gase, where that gain reduction may also have been determined as a function of the hearing profile of the user.
The changes made to Gase may be slow (in contrast to changes made to the ASE filter 6.) For example, changes to Gase might occur no faster than once per second, e.g., requiring a few seconds to change between one setting and another, as the user leaves a quiet office and walks outside, and then walks into a relatively loud restaurant or social club, or into a bus or a train station (where an arriving train makes for a loud environment.) This also means that the decision to reduce Gase (including any signal processing of the microphone signals needed to make such a decision) may be made by software executing in a separate device, e.g., an application program or an operating system executing in a companion device such as a smartphone, tablet, or laptop computer, which has more computing resources than the against the ear device being for example a wireless earbud. In addition, the decision to reduce Gase may also be based on receiving and processing sensor signals (e.g., a microphone signal, an ambient light sensor output) from a smartwatch that is also worn by the user.
In a basic implementation, the ambient sound environment analyzer 8 may simply compute SPL as derived from the signal from the external microphone 3, and then monitors the SPL; when the SPL drops below a threshold, it may respond by signaling that Gase be reduced, based on for example having consulted a look up table that was previously prepared based on the hearing profile of the user. A more complex implementation of the analyzer 8 may be a machine learning model that receives as input SPL measurements that were made at several different frequency bands, and has been trained to evaluate the noise profile in its input SPL measurements to output a Gase value (also referred to here as a tuning setting) for the Gase gain block. In most instances, the analyzer 8 would be configured to output one of at least two different tuning settings for Gase, when responding to changes in the ambient sound environment; a practical implementation is expected to have finer granularity, with more than two tuning settings for the Gase gain block.
Still referring to
The audio system combines the benefits of ANC with the ambient sound enhancement function to reduce occlusion effect at low frequencies and personalize the ambient sound enhancement at high frequencies, as follows. In response to detecting that the ambient sound changes from quiet to loud, the analyzer 8 signals a Ganc block to raise the level of the produced anti-noise (during reproduction of the ambient sound.) The Ganc block may be a scalar (wideband) gain block. Raising the level of the anti-noise mitigates the occlusion effect. Similar to the changes in Gase, changes in the level of the anti-noise (by the Ganc block) are performed no faster than once per second. The audio system thus combines this adjustment, namely an increase in Ganc which boosts only a low frequency band due to the nature of ANC, with a reduction in Gase in a high frequency band and not in the low frequency band (the low and high frequency bands do not overlap.)
An effect of the combining the ANC and ambient sound enhancement functions as described above may be that while the ambient sound is loud, dynamic range of a combination of the reproduced ambient sound and the anti-noise becomes smaller when the anti-noise starts or when the level of existing anti-noise is raised. Since a majority of the anti-noise is in a low frequency band, this may cause the reproduced ambient sound in the high frequency band to be perceived by the user as too loud but for the gain reduction in Gase.
Another aspect of the disclosure here is a method performed by an audio system for speech-aware sound enhancement by an against the ear audio device, where the device can produce anti-noise for acoustic noise cancellation, ANC. In such a method, ambient sound is amplified and reproduced by the against the ear audio device in accordance with a hearing profile of the user of the against the ear audio device. The ambient sound is the sound that is in an acoustic environment of the against the ear audio device and as such may be heard by the user. While reproducing the ambient sound, the processor detects speech in the ambient sound (e.g., via voice activity detection, VAD, operating upon the external microphone signal). While reproducing the ambient sound, the against the ear device also produces anti-noise; it does that so long as no speech is detected in the ambient sound; whenever speech is detected, it reduces a level of the produced anti-noise. This enables the user to better perceive the speech in the reproduced ambient sound.
Such a response (reducing the level of the anti-noise, even to the point of deactivating ANC) is a relatively fast acting response, i.e., faster than the transitions described above that respond to changes in detected ambient sound level (between quiet and loud.) The speech-responsive changes to the ANC function may conform to psychoacoustics, and may be on a per audio frame basis and on a per frequency bin basis. In other words, the anti-noise is suppressed (e.g., deactivated) only in time frames and frequency bins (of the external microphone signal) that have been detected to be speech (as opposed to non-speech.) Note here that the VAD need not be a binary decision (speech/non-speech); it could instead be a speech presence probability according to which the anti-noise is varied with finer granularity (than just a binary decision.)
The speech-responsive approach described above (that adjusts the anti-noise responsive to detecting speech on a per audio frame basis) may be augmented by adjusting how the ambient sound is being reproduced. Whenever speech is detected in a given audio frame, the ambient sound is filtered with more gain in a high frequency band than in a low frequency band. At the same time, the anti-noise may be maintained at a greater level in the low frequency band than in the high frequency band. The latter may be in addition to the anti-noise being adjusted on a per frequency bin basis responsive to the speech detection.
In one aspect, referring now to the flow diagram of
The user context encompasses any one or more the following. In one aspect, the determined user context discriminates between different types of ambient sound environments in which the wearer can find themselves, e.g., a concert, a public transport arena, a loud social gathering at a restaurant, in a coffee shop, in an office, and outdoors. The determination can be made by digitally processing a variety of input data, in real time. The input data may include an ambient sound pickup channel (from one or more microphones in the against the ear audio device or in a smartwatch being worn by the wearer, including a beamforming sound pickup channel), speech pickup via a vibration sensor, e.g., an accelerometer that is embedded in the headphone and is responding to bone conduction of the wearer's own voice, and sensor data from a variety of other types of sensors including time of day, and user location using a global positioning system or radio frequency triangulation. The input data may be processed to, for example, determine that the wearer is walking, running sitting, driving, or riding in a car, bus, train or boat, or is at a particular venue such as a train station or airport. The input data may also be processed to detect the type of ambient sounds that are being picked up, e.g., fire alarm, mechanical machine noise, city street sound, highway noise, construction site noise, train subway noise, babble, nature sounds, television, etc. More generally, the determination of user context may be the result of processing the input data using machine learning tools.
Note that user context may be determined automatically by the audio system (without instruction by the user) during any one of several operating modes, e.g., transparency, attenuated transparency, and active ear plug, as also described below
The context determined in operation 20 may coincide with operation 24 in which the ANC block 10 may or may not be producing an anti-noise signal; also, the Ganc block may be attenuating but not eliminating entirely the anti-noise at its output (depending upon its gain setting.) Now, as part of or a result of the user context determination, if the ambient sound level is detected to be too high (by the ambient sound environment analyzer 8—see
On the other hand, still referring to
Although
In another aspect of the transparency mode, the system enhances spectral flatness of the reproduced ambient sound whenever the system determines a certain user context, e.g., “wearer is at a concert.” This may be achieved by appropriately shaping the filtering function of the Gase block. But when the wearer starts talking to someone at the concert, the determined user context changes, e.g., “wearer is talking with someone in their environment”, because the system detects speech by another person in the environment and/or speech by the wearer, the Gase block is signaled to emphasize speech frequencies (e.g., by appropriately shaping the filtering function of the Gase block.) The frequency response in that case is no longer flat.
In yet another aspect of operating in transparency mode, the system reduces the transparency gain that it applies (in the Gase block), differently in different user contexts. For instance, when the determined context indicates that the wearer is “talking over” ambient noise, the transparency gain is reduced more than when the wearer is passively listening to their environment. This helps the wearer better understand or hear the speech of someone who is talking in the otherwise noisy environment.
In still another aspect, the wearer may be at a concert when during a lull in the performance the wearer starts talking to a friend next to them (who is also at the concert.) In that case, the audio system detects a drop in the ambient noise/sound level (below a threshold) and perhaps also a contemporaneous increase in speech activity. The speech activity may be either the wearer's own voice or that of the friend nearby. In response the system may reduce its anti-noise output (e.g., raise attenuation by Ganc), and perhaps increase its transparency gain Gase that it applies to an ambient sound pickup channel, and also perhaps emphasize the speech frequency range—this is also referred to as spectral shaping. When the concert performance resumes, the detected ambient sound level increases (above the threshold), in response to which the system resumes its focus on achieving spectral flatness of the reproduced ambient sound while still being ready to protect the wearers hearing by increasing anti-noise.
The operating modes of the audio system may include at least the following three modes: transparency (pass-through) mode; attenuated transparency mode; and active ear plug mode. Persons skilled in the art will appreciate that the system may include any suitable number of modes, and in some instances, there may not be discrete modes, but rather the audio system may seamlessly perform tuning based on current ambient sound conditions and, more generally, based on user context.
For purposes of explanation, the transparency mode may be referenced at or set to 0 dB, which is when the amplitude gain applied to the reproduced ambient sound is set just enough to overcome the passive attenuation that is due to the ear being occluded by the against the ear device such that the resulting sound output level is the same as if the wearer were not wearing the against the ear device. This gain may be higher for example in a high frequency band, if the user's hearing profile shows some high frequency hearing loss. The attenuated transparency mode may for example be set to −10 dB or other suitable level of attenuation that still allows some amount of transparency; the amplitude gain may be set in that case to for example enable the wearer to better hear someone talking in an otherwise noisy environment. The active ear plug mode (also referred to here as noise reduction mode or full ANC mode) is when maximum anti-noise is being produced to protect the wearer's hearing when the wearer's environment has become too loud. Note that such ANC may only be effective in cancelling ambient sound at lower frequencies, e.g., below 2 kHz, while passive attenuation due to simply wearing the against the ear device is effective at high frequencies, e.g., above 2 kHz.
Referring back to
One aspect of the disclosure described above is a method for speech-aware sound enhancement by an against the ear audio device that can produce anti-noise for acoustic noise cancellation, the method comprising: amplifying and reproducing ambient sound by an against the ear audio device in accordance with a hearing profile of a user of the against the ear audio device, wherein the ambient sound is in an acoustic environment of the against the ear audio device; while reproducing the ambient sound in a), detecting speech in the ambient sound; and while reproducing the ambient sound in a), producing anti-noise so long as no speech is detected in the ambient sound, and reducing a level of the produced anti-noise whenever speech is detected. Whenever speech is detected, the ambient sound is amplified with more gain in a high frequency band than in a low frequency band. While the ambient sound is being amplified with more gain in the high frequency band than in the low frequency band, the anti-noise is being produced at a greater level in the low frequency band than in the high frequency band.
Another aspect of the disclosure described above is an audio headset having acoustic noise cancellation capability, the audio headset comprising: a left headphone speaker; a right headphone speaker; a processor; and memory having stored therein instructions that configure the processor to a) drive the left or right headphone speaker so as to amplify and reproduce ambient sound in accordance with a hearing profile of a user of the headset, wherein the ambient sound is in an acoustic environment of the headset, b) while the ambient sound is being reproduced according to a), detect that the ambient sound changes from quiet to loud, and c) in response to detecting that the ambient sound changes from quiet to loud, drive the left or right headphone speaker to start producing anti-noise, or raise a level of existing anti-noise being produced by the left or right headphone speaker. The memory may have stored therein further instructions that configure the processor to, in response to detecting that the ambient sound changes from loud to quiet, drive the left or right headphone speaker to reduce the level of anti-noise being produced. The anti-noise being produced may be in a low frequency band and not in a high frequency band. While the ambient sound is loud, dynamic range of the reproduced ambient sound becomes smaller when the anti-noise starts or when the level of existing anti-noise is raised.
Yet another aspect of the disclosure here as described above is a method for automatic sound enhancement by an against the ear audio device, the method comprising: a) reproducing ambient sound by an against the ear audio device, wherein the ambient sound is in an acoustic environment of a user who is wearing the against the ear audio device, and wherein the ambient sound is filtered in accordance with a frequency dependent gain; b) while reproducing the ambient sound in a), detecting that the ambient sound changes from quiet to loud; c) in response to detecting that the ambient sound changes from quiet to loud, reducing the frequency dependent gain in accordance with a hearing profile of the user; and d) reproducing the ambient sound, by the against the ear audio device, as filtered in accordance with the reduced frequency dependent gain. In the case where the against the ear audio device produces anti-noise for acoustic noise cancellation, the method further comprises: producing anti-noise by the against the ear audio device during a); and in response to detecting that the ambient sound changes from quiet to loud, raising a level of the produced anti-noise during d). In one aspect, the changes in the level of the anti-noise are performed no faster than once per second. In another aspect, the frequency dependent gain comprises reduced gain in a high frequency band and not in a low frequency band.
As described above, one aspect of the present technology is the gathering and use of data available from specific and legitimate sources to determine user context and adjust how ambient sound is reproduced for the user. The present disclosure contemplates that in some instances, this gathered data may include personal information data that uniquely identifies or can be used to identify a specific person. Such personal information data can include demographic data, location-based data, online identifiers, telephone numbers, email addresses, home addresses, data or records relating to a user's health or level of fitness (e.g., vital signs measurements, medication information, exercise information), date of birth, or any other personal information including any hearing loss.
The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to deliver enhanced ambient sound reproduction in accordance with their preferences or to protect their hearing health.
The present disclosure contemplates that those entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities would be expected to implement and consistently apply privacy practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy of users. Such information regarding the use of personal data should be prominent and easily accessible by users, and should be updated as the collection and/or use of data changes. Personal information from users should be collected for legitimate uses only. Further, such collection/sharing should occur only after receiving the consent of the users or other legitimate basis specified in applicable law. Additionally, such entities should consider taking any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices. In addition, policies and practices should be adapted for the particular types of personal information data being collected and/or accessed and adapted to applicable laws and standards, including jurisdiction-specific considerations that may serve to impose a higher standard. For instance, in the US, collection of or access to certain health data may be governed by federal and/or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); whereas health data in other countries may be subject to other regulations and policies and should be handled accordingly.
Despite the foregoing, the present disclosure also contemplates aspects in which users selectively block the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, the present technology can be configured to allow users to select to “opt in” or “opt out” of allowing the enhanced ambient sound reproduction process to access their hearing loss profile or access their location.
Moreover, it is the intent of the present disclosure that personal information data should be managed and handled in a way to minimize risks of unintentional or unauthorized access or use. Risk can be minimized by limiting the collection of data and deleting data once it is no longer needed. In addition, and when applicable, including in certain health related applications, data de-identification can be used to protect a user's privacy. De-identification may be facilitated, when appropriate, by removing identifiers, controlling the amount or specificity of data stored (e.g., collecting location data at city level rather than at an address level), controlling how data is stored (e.g., aggregating data across users), and/or other methods such as differential privacy.
Therefore, although the present disclosure broadly covers use of personal information data to implement one or more various disclosed embodiments, the present disclosure also contemplates that the various embodiments can also be implemented without the need for accessing such personal information data. That is, the various embodiments of the present technology are not rendered inoperable due to the lack of all or a portion of such personal information data. For example, the ambient sound enhancement functions can still tune the Gase and Ganc blocks and the ASE filter 6 without having to know the location of the user or that the user has any hearing loss.
To aid the Patent Office and any readers of any patent issued on this application in interpreting the claims appended hereto, applicant wishes to note that they do not intend any of the appended claims or claim elements to invoke 35 U.S.C. 112(f) unless the words “means for” or “step for” are explicitly used in the particular claim.
While certain aspects have been described and shown in the accompanying drawings, it is to be understood that such are merely illustrative of and not restrictive on the broad invention, and that the invention is not limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those of ordinary skill in the art. For example, although not shown in
This non-provisional patent application claims the benefit of the earlier filing date of U.S. provisional application No. 62/855,333 filed May 31, 2019.
| Number | Name | Date | Kind |
|---|---|---|---|
| 8358799 | Gresko et al. | Jan 2013 | B1 |
| 8515089 | Nicholson | Aug 2013 | B2 |
| 9825598 | Kraft et al. | Nov 2017 | B2 |
| 9886954 | Meacham et al. | Feb 2018 | B1 |
| 10034092 | Nawfal et al. | Jul 2018 | B1 |
| 10074354 | Gauger, Jr. et al. | Sep 2018 | B2 |
| 10102843 | Le et al. | Oct 2018 | B1 |
| 20140079235 | Lyons | Mar 2014 | A1 |
| 20140169579 | Azmi | Jun 2014 | A1 |
| 20150071453 | Po et al. | Mar 2015 | A1 |
| 20150170645 | Di Censo et al. | Jun 2015 | A1 |
| 20150222977 | Angel, Jr. | Aug 2015 | A1 |
| 20160081595 | Hui et al. | Mar 2016 | A1 |
| 20170194020 | Miller et al. | Jul 2017 | A1 |
| 20170345408 | Hong et al. | Nov 2017 | A1 |
| 20180097495 | Kok et al. | Apr 2018 | A1 |
| 20190116430 | Schnell | Apr 2019 | A1 |
| 20190268686 | Degraye | Aug 2019 | A1 |
| 20200357374 | Verweij et al. | Nov 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 2015-173369 | Oct 2015 | JP |
| 2017-507550 | Mar 2017 | JP |
| 2018-157484 | Oct 2018 | JP |
| Entry |
|---|
| Serizel, Romain, et al., “Integrated Active Noise Control and Noise Reduction in Hearing Aids”, IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, No. 6, Aug. 2010, pp. 1137-1146. |
| Kuk, Francis, “Selecting the Right Compression”, Audiology Online, retrieved from the Internet <https://www.audiologyonline.com/articles/selecting-the-right-compressoin-18120>, Sep. 19, 2016, 22 pages. |
| Examination Report for Australian Application No. 2020203567 dated Nov. 6, 2020, 13 pages. |
| Extended European Search Report for European Application No. 20175819.0 dated Oct. 6, 2020, 10 pages. |
| Non-Final Office Action for U.S. Appl. No. 16/871,661 dated Jun. 8, 2021, 26 pages. |
| Notice of Preliminary Rejection for Korean Application No. 10-2020-0064167 dated Mar. 31, 2021, 9 pages. |
| Notification of Reasons for Refusal for Japanese Application No. 2020-094512 dated May 27, 2021, 7 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20200382859 A1 | Dec 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62855333 | May 2019 | US |
