Examples described herein relate to listening devices, more particularly hearing devices with high directionality and incorporating vital sign and activity sensing. For the purpose of this application, a hearing device refers to any device for listening purposes including a hearing aid, an earphone, earbud, hearables, etc. for delivering sound or audible vibrations in or around the ear.
Wearables including hearing aids, personal sound amplifiers, hearables, earbuds, etc. are increasingly incorporating biosensors for sensing vital signs and activity. Prior art hearing device configurations such as Behind-The-Ear (BTE), Receiver-In-Canal (RIC), In-The-Ear (ITE), In-The-Canal (ITC), earbud. Completely-In-Canal (CIC), etc., rely on placement of electronics in or behind the ear as shown in
Placement of a receiver 12 in the ear cavity 22 is generally desirable for electroacoustic advantages including reduced feedback, lower power consumption, longer battery operation, reduced distortion, and improved high frequency response. To achieve these desirable effects, a speaker of a hearing device is preferably inserted in the ear cavity, at least into the concha cavity, for direct and efficient sound delivery to the eardrum.
Incorporating two microphones in prior art hearing device configurations, as shown in
The superficial temporal artery 28 runs vertically anterior (front) with respect to the external ear 20. The region above mandibular condyle 27 is highly vascular underneath the skin, mainly due to the presence of the superficial temporal artery 28 and its branches 29, as well as the superficial temporal vein (not shown) adjacent to the temporal artery 28. Vital signs such as heart rate, blood pressure, oxygen saturation level, temperature, etc. can be obtained non-invasively by placing biosensors generally at the temple 26 or condyle 27 areas, along the path of superficial temporal artery. Placement of biosensors within a hearing device is generally known in the art but limited to placement on traditional hearing aids, away from the superficial temporal artery 28. For example, commercially available earbud may provide heart rate sensing through photoplethysmography (PPG) with limited accuracy due to the low blood flow in the tissue surrounding these devices, and due to the instability of the devices and motion artifacts during activity. The present disclosure describes examples of a new hearing device configuration and methods which address the aforementioned shortcomings.
A hearing device for enhancing the hearing ability, particularly in noisy conditions, while providing reliable non-invasive sensing of vital signs, comprising a main module incorporating a front microphone and a main module comprising sensors positioned in front of the ear along the path of the superficial temporal artery for detecting vital signs, such as any one or more of heart rate, oxygen saturation level, glucose level, blood pressure, respiration rate and temperature. A speaker may be provided directly in the ear cavity for efficient sound delivery while significantly reducing feedback in hearing aid applications. A rear microphone provided in an extension over the ear, section enabling high directionality for enhancing speech recognition in noisy environments.
In a preferred embodiment, the hearing device is wirelessly coupled to a smartphone for telephony, audio streaming, and for selecting the directionality of sound pickup. Multiple processors may be employed for dedicated tasks such as biosensing, audio processing, AI and voice recognition. The hearing device may be configured as a digital assistant. Applications may include hearing aid, voice detection, voice authentication, speaker isolation, audio recording, language translation, acoustic scene detection for automatic adjustment of hearing enhancement parameters, health monitoring, vital sign detection, deep noise cancellation, text-to-audio conversion, speech recognition, and stress monitoring. A camera and vibration sensor may be incorporated.
The above and still further objectives, features, aspects and attendant advantages of the present invention will become apparent from the following detailed description of certain preferred and alternate embodiments and method of manufacture and use thereof constituting the best mode presently contemplated of practicing the invention, when taken in conjunction with the accompanying drawings, in which:
Before the present invention is described, it is to be understood that this invention is not limited to particular embodiments described, as such may, of course, vary. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting, since the scope of the present invention will be limited only by the appended claims.
All publications mentioned herein are incorporated herein by reference to disclose and describe the methods and/or materials in connection with which the publications are cited. It is understood that the present disclosure supersedes any disclosure of an incorporated publication to the extent there is a contradiction.
It must be noted that as used herein and in the appended claims, the singular forms “a”, “an”, and “the” include plural referents unless the context clearly dictates otherwise.
Certain details are set forth below to provide a sufficient understanding of embodiments of the invention. However, it will be appreciated by one skilled in the art that some embodiments may not include all details described. In some instances, well-known structures, hearing aid components, circuits, and controls, have not been shown in order to avoid unnecessarily obscuring the described embodiments of the invention.
The present disclosure describes examples of hearing devices for enhancing the hearing ability, particularly in noisy conditions, while maintaining reliable biosensing of vital signs. One embodiment of the present disclosure, as shown in
In preferred embodiments, the speaker section 48 extends downward from the main module 41 and comprises a speaker 49 (sometimes referred to as receiver) for placement into the ear cavity behind the tragus 21 to deliver sound 32 directly to the ear cavity. In the preferred embodiments, the speaker section 48 is configured for fitting and concealing within the upper or lower notches of the tragus 21. An ear tip 50 may be provided at the receiver 49 to secure the FTE hearing device 40 to the ear 20. The ear tip 50 may be an open-fit type as shown in
Various electronic components, sensors, transducers and power sources (battery) may be incorporated in the main module 41 or the posterior portion 43, for implementing the form and function as disclosed in the example embodiments of the present disclosure.
In an embodiment, biosensors 42 are configured for placement generally at the condyle area 27, in proximity to superficial temporal artery 28 and the adjacent superficial temporal vain, for sensing one or more vital signs. In an example implementation shown in the simplified block diagram of
In some embodiments shown in
In another embodiment, multiple microphones are provided for achieving highly directional hearing ability. Directionality is particularly important for improving speech perception in certain situations. For example, the wearer can turn their head in the direction of interest to enhance speech perception in a noisy environment such as a restaurant. The directional enhancement is achieved by aligning a front microphone 61 and a rear microphone 62 generally along the horizontal direction 15 with a substantial distance between the two microphones. This arrangement enables for suppression of competing sounds, in conjunction with an algorithm executed by audio processor 59. In one embodiment, voice pick up (VPU) microphone 65 is provided in the main module to pick up skull vibrations created by the person wearing the FTE hearing device 40 when talking. The VPU is sometimes referred to as vibration sensor. The microphone array 61-63, in conjunction with audio processor 59 and directionality algorithms, are employed to improve signal to noise (S/N) ratio as shown in
A voice pick-up (VPU) microphone 65, in conjunction with algorithms, may be provided to enhance self-voice, or to cancel it, depending on the application. Self-voice enhancement may be applied for voice commands, voice authentication applications, while self-voice cancellation may be applied for hands-free phone calls and for hearing aid applications, according to some examples. It should be understood that other microphone arrangements may be provided to achieve desired audibility and directionality. In preferred embodiments, Signal to Noise (S/N) ratio improvement of 6 dB or higher is desirable in the example embodiments. The high directionality achieved by the FTE hearing device 40 as described herein is partially achieved by the relatively large distance between a front microphone 61 and a rear microphone 62, compared to conventional hearing aids (i.e., BTE and RIC hearing aids), whereby two microphones are arranged at relatively close distance and at substantial vertical orientation, limiting the S/N improvement to about 3 dB as known in the field of hearing aids. In the preferred embodiments, the distance between the two microphones, or the microphone ports thereof, is at least 3 cm.
In some embodiments, an additional speaker or vibrator may be employed to enhance the functionality such as improving the frequency response. The FTE hearing device 40 may comprise electronic components including wireless electronics 66 and wireless antenna 67 for wireless communications with a smartphone or other wireless devices in proximity. In some examples, the wireless antenna 67 may be a chip antenna, for example a ceramic chip antenna. In some embodiments, the wireless antenna 67 may be communicatively coupled to wireless electronics 66 of the eyeglass hearing device 40. The wireless electronics 66 may include functionality to transmit and receive wireless signals. The wireless electronics 66 may utilize standardized protocols, such as Bluetooth, near-field magnetic induction, Wi-Fi, Zigbee or any other known wireless protocol. In some examples, the wireless electronics 66 include low power and low energy functionalities compatible with miniature button cell or coin cell batteries that are commonly used for hearing aids and miniature electronic devices. Bluetooth, including Low Energy (LE) versions, is particularly suited.
In some embodiments, the FTE hearing device 40 further comprises one or more biosensors 42 for detecting one or more vital signs such as, any one or more of a heart rate, oxygen saturation level, glucose level, blood pressure, respiration rate and temperature of the user wearing the FTE hearing device 40. Other vital signs and activity sensing are well within the scope of the present disclosure utilizing the anatomical advantage along the path of superficial temporal artery in front of the ear. The medially oriented receiver portion 48 (interchangeably also called as speaker section 48) delivers sound directly into the ear cavity while securing the FTE hearing device 40 to the ear. Secure placement enables reliable long-term vital sign monitoring, even during exercise and vigorous activities.
In some embodiments, the FTE hearing device 40 is wirelessly coupled to a smartphone for variety of applications including relaying to and displaying biosensor data from biosensors 42 and activity sensor 57, for receiving audio streaming for music listening, and for telephony communications. In preferred embodiments, bidirectional wireless audio streaming is provided for hand-free telephony communications via a smartphone paired to the FTE hearing device 40. In other embodiments, telephony communications may be embedded in the FTE hearing device 40 for connecting to a wireless network or directly to a cellular network.
The selection for a particular mode of operation or a communication mode may be achieved via on-board switch 45 (i.e., buttons) provided on the main electronic module 41, or via wireless commands from a smartphone APP paired to the FTE hearing device 40. Buttons 45 may be manual for activation by finger, or contactless type such as a capacitive or optical switch, or by gesture sensing via the on-board motion sensor 57. Biological and physical activity data sensed by the FTE hearing device 40 may be transferred to a smartphone, a remote wireless device, or a remote service via the Internet.
In further embodiments, the FTE hearing device 40 enhances live sound picked up by microphones, or audio signals streamed by a wireless device such as smartphone, TV, car radio, music player, etc., via Bluetooth for example. In another embodiment, the user can select the mode of operation, such as directionality of sound, wireless audio streaming or telephony communication, among examples that will become obvious to those skilled in the art of wearables and communications. This selection can be made from on-board switches 45, a smartphone APP, or by voice activation. The FTE hearing device 40 may be configured to respond to voice commands, and subsequently enable or control other devices including a smartphone or electronic appliances in proximity. In other embodiments, the FTE hearing device 40 may be configured as a digital assistant when connected to a network. For example, configuring the FTE hearing device 40 as an Alexa-enabling device when connected via WIFI or Bluetooth® to a wireless network. In other examples, voice command may increase the volume, initiate or pick up phone calls. Text-to-speech and AI generated voice may be incorporated.
Motion-related sensors (i.e., accelerometer, gyroscope) maybe be utilized to monitor the position, activity (or inactivity) of the wearer. For example, sleeping, walking, exercise or for detecting a fall and alerting others about such an adverse event via a wireless network. In a preferred embodiment, the FTE hearing device 40 is configured as a telephony device, for receiving and initiating phone calls. In further embodiments, the FTE hearing device 40 comprises multiple processors including an audio processor 59, AI processor 58, and a general-purpose processor (MCU) 55. In some embodiments, the FTE hearing device 40 further comprises power management circuitry 77 and one or more rechargeable batteries 78.
The FTE hearing device 40 may be chargeable by electrical charge contacts 47 (
The disclosed embodiments may combine wireless connectivity, cloud-based services, artificial intelligence (AI) and machine learning (ML), enabling advanced communications, health, and safety monitoring for a person wearing the FTE hearing device 40. Functions enabled include but not limited to voice detection, voice authentication, speaker isolation, audio recording, language translation, acoustic scene detection for automatic adjustment of hearing enhancement parameters, vital sign monitoring, deep noise cancellation, and stress monitoring among other features which will become obvious to those skilled in the art. For example, the FTE hearing device 40 may be configured, or trained by ML to detect specific sounds, such as a crying baby, or detect certain spoken words, convert text messages and other information to audible messages for delivery via the speaker 49. The detection mode maybe be always-on, or on demand. In other embodiments, a camera (not shown) may be incorporated in the main electronic module 41. It should be understood that the FTE hearing device 40 may be provided in a singular configuration (monaural for one ear), or binaurally for right and left ears.
Although examples of the invention have been described herein, it will be recognized by those skilled in the art to which the invention pertains from a consideration of the foregoing description of presently preferred and alternate embodiments and methods of fabrication and use thereof, and that variations and modifications of this exemplary embodiment and method may be made without departing from the true spirit and scope of the invention. Thus, the above-described embodiments of the invention should not be viewed as exhaustive or as limiting the invention to the precise configurations or techniques disclosed. Rather, it is intended that the invention shall be limited only by the appended claims and the rules and principles of applicable law.
This application claims the benefit under 35 U.S.C. § 119 of the earlier filing date of U.S. Provisional Application No. 63/468,305 entitled “FRONT OF THE EAR HEARING DEVICE WITH BIOSENSORS PROXIMAL TO SUPERFICIAL TEMPORAL ARTERY,” filed May 23, 2023. This application is related to concurrently filed utility non-provisional patent application titled “EYEGLASS HEARING DEVICE WITH BIOSENSORS”, filed May 17, 2024. The aforementioned applications are incorporated herein by reference in their entirety, for any purpose.
Number | Date | Country | |
---|---|---|---|
63468305 | May 2023 | US |