Traditionally field workers such as fire fighters and plant workers communicate using two way radios such as radios supplied by Motorola, Inc. As mentioned in United States Patent 20070142072, two way radios allow users the ability to wirelessly communicate with others on a small network. Most two way radios use various channels or frequencies for communication. Monitoring of more than one channel allows a user to communicate with a plurality of people for a variety of purposes. In a security environment, for instance, channel 1 may be used to communicate about and monitor emergency conditions. Channel 2 may be used to communicate about and monitor major security threats. Channel 3 may be used to communicate about and monitor minor security threats. A user may monitor all three channels by using a two way radio having a scanning mode. Other devices that can be used instead of two way radios include cellular telephones. These devices enable personal communication by allowing telephone access from anywhere within reach of wireless network infrastructure (e.g., cellular networks, communication satellites, or other infrastructure of other wireless networks adapted for voice communications). However, one restriction is that these devices are typically desktop devices or hand-held devices and thus do not provide hands-free communications capability.
Moreover, in as much as the use of handheld wireless voice communication devices is not restricted to homes and offices, such devices will often be used in environments where there is considerable ambient noise. Examples of such environments include busy urban settings, inside moving vehicles and on factory floors. Ambient noise in an environment can degrade the intelligibility of received voice audio and thereby interfere with users' ability to communicate.
U.S. Pat. No. 6,917,688 discloses an adaptive noise canceling microphone system for extracting a desired signal, in particular a desired speech signal, having two microphones being arranged at a predefined distance from each other; a signal forming system (SFS) being adapted to receive a first and second input signals resulting from sounds received by the two microphones wherein an acoustical signal component in the first input signal is determined, wherein an acoustical signal component in the second input signal is determined, wherein the acoustical signal component in the first input signal is enhanced to generate a speech enhanced signal, and wherein the acoustical signal component in the second input signal is suppressed to generate a speech nulled signal; an adaptive noise cancellation filtering circuit being adapted to receive the speech enhanced signal and the speech nulled signal, wherein the noise in the speech enhanced signal is cancelled using the speech nulled signal as reference, thereby generating an output filtered signal representing the desired signal.
United States Patent 20060270467 discusses enhancing the intelligibility of speech emitted into a noisy environment by filtering ambient noise with a filter that simulates the physical blocking of noise by at least a part of a voice communication device and determining a frequency dependent SNR of received voice audio relative to ambient noise is computed on a perceptual (e.g. Bark) frequency scale. Formants are identified and the SNR in bands including certain formants are modified with formant enhancement gain factors in order to improve intelligibility.
However, in certain industrial, emergency, government and military applications, such noise filtering is insufficient to provide high quality, hands-free, yet inconspicuous communication capability for field personnel.
In one aspect, systems and methods are disclosed for capturing sound including user speech for communication by mounting one or more intra-oral microphones to capture sound such as user speech; and mounting a mouth wearable communicator in the oral cavity to communicate sound with a remote unit.
Implementations of the above aspect may include one or more of the following. The system performs noise cancellation. The intra-oral microphones can include a cardioid-type directional microphone and an omni-directional microphone. The system can point a first intra-oral microphone toward the oral cavity and a second intra-oral microphone away from the oral cavity. The system can perform spatial and temporal filtering to enhance the sound from a predetermined direction and over a predetermined frequency band, and suppress signals from other directions. The one or more intra-oral microphones can be tissue mounted or can be mounted on one or more teeth. The system can render sound output using a bone conduction device.
In another aspect, a communication device includes a mouth wearable communicator to communicate sound with a remote unit; and one or more intra-oral microphones coupled to the mouth wearable communicator and positioned near the front of a mouth to capture sound.
Implementations of the above aspect may include one or more of the following. The one or more intra-oral microphones can be noise canceling microphones. The one or more intra-oral microphones can include a cardioid-type directional microphone and an omni-directional microphone. One of the intra-oral microphones can be pointed toward a mouth cavity and the other intra-oral microphone can be pointed away from the mouth cavity. The one or more intra-oral microphones can perform spatial and temporal filtering to enhance the sound or user speech from a predetermined direction and over a predetermined frequency band, and suppress signals from other directions. The intra-oral microphones can be positioned on one or more teeth or oral tissue. The mouth wearable communicator can include a bone conduction device to render sound audible to the wearer. The mouth wearable communicator can be a custom oral device. One or more medical sensors can be embedded therein. A data storage device can also be embedded in the device.
Turning now to more details on the system 1, as shown in
The two way communication assembly 14 can have a microphone array with paired microphones 15A and 15B to pick up sound. The microphones 15A and 15B can be mounted on the oral appliance, on the rear molars or alternatively on the lingual side of the front teeth. In other embodiments, the microphones 15A and 15B can be intraoral microphones or extraoral microphones. In one embodiment, the microphones can be mounted on an oral appliance, on the rear molars or alternatively on the lingual side of the front teeth. In
The microphone cancels environmental noise and transmits a user's voice to a remote user, station or building. This embodiment provides the ability to cancel environmental noises while transmitting subject's own voice to the remote station such as another user or a call center. As the microphone is in a fixed location (compared to ordinary wireless communication devices) and very close to user's own voice, the system can handle environmental noise reduction that is important in working in high noise areas. As such, the two way communication device can be used by workers in loud environments such as a professional entertainer or athlete and/or support personnel, a soldier, a medic, a fireman, an emergency worker, among others.
In one embodiment, the mouth wearable communication assembly 14 has a housing having a shape which is conformable to at least a portion of at least one tooth; an actuatable transducer disposed within or upon the housing and in vibratory communication with a surface of the at least one tooth; and a wireless communication transceiver coupled to the transducer to provide received sound to the user and to provide communication for the user. The two way communication device can be an oral appliance having a shape which conforms to the at least one tooth. An electronic assembly can be disposed within or upon the housing and which is in communication with the transducer.
In one embodiment, the microphones 15A and 15B face outwardly away from the mouth to focus on the sound coming out of the mouth only and the microphone pair would cancel any sounds not directly in front of the mouth. This embodiment would be used as a communication device for picking up the user's voice. In one embodiment, the microphone pair can include a cardioid-type directional microphone and an omni-directional microphone combined in an acoustically coupled way. The two microphones, together with an adaptive control circuit, produce a very narrow 3-dimensional beam for acquiring the desired speech signal. In addition to microphones, accelerometers or other devices applicable for detecting sound waves can be used.
In another embodiment, the microphones 15A and 15B face in opposite directions with one facing inwardly toward the mouth and the other facing outwardly away from the mouth. In another embodiment, the microphones 15A and 15B face in opposite directions with one facing inwardly toward the mouth and the other facing outwardly away from the mouth.
In one embodiment, the paired microphones 15A-15B detect ambient noise in a first sound waveform, and convert the waveform to electrical signals. An onboard processor processes the recorded signal so that it is exactly out of phase with the ambient noise detected by the microphones 15A-15B, thus canceling ambient noise and leaving only the user's speech.
In one duo-microphone embodiment, both microphones can be positioned near the front of the user's mouth to pick-up the user's voice as the primary desired signal as well as external noise as a secondary signal. Since the speech is very close to the microphone pair, the speech signal picked up by the microphones can be separated using clustering techniques into a strong signal (speech) and a distant, weak signal (noise) pair. The weak signal can be discarded and only the strong signal is used as the speech signal.
In another duo-microphone embodiment, one microphone can be pointed toward the throat to pick-up the user's voice as the desired source, and another microphone can be pointed away from the mouth to pick up external noise source. The signal picked up by the microphone pointed toward the throat can be used to adaptively cancel the noise signal from the signal picked up by the microphone pointed away from the mouth.
Other noise cancellation arrangements can be used. For example, in a single microphone embodiment, one microphone is used to pick up the desired speech signal with noise. The noise spectrum is estimated and subtracted from the speech signal (containing the noise) picked up by the microphone. In this way, the desired speech signal is separated from the noise.
A further embodiment uses more than two microphones. This embodiment uses a spatial and temporal filtering method to enhance the desired speech signal from a specific direction and over an interested frequency band, and suppress signals from other directions. The desired signal obtained with this system has a high signal to noise (SNR) ratio. Alternatively, two microphones can be used to form a first-order microphone system for noise cancellation. This microphone system uses the differential property of sound field to form a fixed beam pattern in front of the user's mouth.
In one embodiment, the system of
In another embodiment, the device of
An exemplary process to collect medical information from the user (such as fire fighting personnel) and for supporting bone-conduction two way communication can be as follows:
Generally, the volume of electronics and/or transducer assembly 16 may be minimized so as to be unobtrusive and as comfortable to the user when placed in the mouth. Although the size may be varied, a volume of assembly 16 may be less than 800 cubic millimeters. This volume is, of course, illustrative and not limiting as size and volume of assembly 16 and may be varied accordingly between different users.
In one variation, with assembly 14 positioned upon the teeth, as shown in
The transmitter assembly 22, as described in further detail below, may contain a microphone assembly as well as a transmitter assembly and may be configured in any number of shapes and forms worn by the user, such as a watch, necklace, lapel, phone, belt-mounted device, etc.
With respect to microphone 30, a variety of various microphone systems may be utilized. For instance, microphone 30 may be a digital, analog, and/or directional type microphone. Such various types of microphones may be interchangeably configured to be utilized with the assembly, if so desired.
Power supply 36 may be connected to each of the components in transmitter assembly 22 to provide power thereto. The transmitter signals 24 may be in any wireless form utilizing, e.g., radio frequency, ultrasound, microwave, Blue Tooth® (BLUETOOTH SIG, INC., Bellevue, Wash.), etc. for transmission to assembly 16. Assembly 22 may also optionally include one or more input controls 28 that a user may manipulate to adjust various acoustic parameters of the electronics and/or transducer assembly 16, such as acoustic focusing, volume control, filtration, muting, frequency optimization, sound adjustments, and tone adjustments, etc.
The signals transmitted 24 by transmitter 34 may be received by electronics and/or transducer assembly 16 via receiver 38, which may be connected to an internal processor for additional processing of the received signals. The received signals may be communicated to transducer 40, which may vibrate correspondingly against a surface of the tooth to conduct the vibratory signals through the tooth and bone and subsequently to the middle ear to facilitate hearing of the user. Transducer 40 may be configured as any number of different vibratory mechanisms. For instance, in one variation, transducer 40 may be an electromagnetically actuated transducer. In other variations, transducer 40 may be in the form of a piezoelectric crystal having a range of vibratory frequencies, e.g., between 250 to 20,000 Hz.
Power supply 42 may also be included with assembly 16 to provide power to the receiver, transducer, and/or processor, if also included. Although power supply 42 may be a simple battery, replaceable or permanent, other variations may include a power supply 42 which is charged by inductance via an external charger. Additionally, power supply 42 may alternatively be charged via direct coupling to an alternating current (AC) or direct current (DC) source. Other variations may include a power supply 42 which is charged via a mechanical mechanism, such as an internal pendulum or slidable electrical inductance charger as known in the art, which is actuated via, e.g., motions of the jaw and/or movement for translating the mechanical motion into stored electrical energy for charging power supply 42.
In another variation of assembly 16, rather than utilizing an extra-buccal transmitter, hearing aid assembly 50 may be configured as an independent assembly contained entirely within the user's mouth, as shown in
The removable oral appliance 18 may be fabricated from various polymeric or a combination of polymeric and metallic materials using any variety of methods. For instance, in one variation of fabricating an oral appliance, a three-dimensional digital scanner may be used to image the dentition of the patient, particularly the tooth or teeth TH upon or about which the oral appliance is to be positioned. The scanned image may be processed via a computer to create a three-dimensional virtual or digital model 60 of the tooth or teeth TH, as shown in
Various three-dimensional scanning modalities may be utilized to create the three-dimensional digital model 60. For instance, intra-oral cameras or scanners using, e.g., laser, white light, ultrasound, mechanical three-dimensional touch scanners, magnetic resonance imaging (MRI), computed tomography (CT), other optical methods, etc., may be utilized.
Once the three-dimensional image has been captured, the image may then be manipulated via conventional software to create a direct three-dimensional print of the model. Alternatively, the image may be used to directly machine the model. Systems such as computer numerical control (CNC) systems or three-dimensional printing processes, e.g., stereolithography apparatus (SLA), selective laser sintering (SLS), and/or other similar processes utilizing three-dimensional geometry of the patient's dentition may be utilized.
In another alternative, a mold may be generated from the print to then allow for thermal forming of the appliance directly upon the created mold. And yet in other variations, the three-dimensional image may be used to create an injection mold for creating the appliance. Each of these processes are described in further detail below.
Once the scanned image has been processed to create a three-dimensional virtual or digital model 60 of the tooth or teeth TH, the housing 62 for the electronics/transducer assembly may be digitally imposed or created in the digital model 60. Alternatively, a physical model of the housing may be positioned upon the appropriate tooth or teeth TH and the dentition with the housing may be scanned to create the digital model 60.
In either case, the resulting digital model 60 may be utilized to create a three-dimensional virtual or digital model of the appliance 64 having the housing 62 integrated therewith, as shown in the partial cross-sectional view in
In another alternative method, once the three-dimensional model of the appliance 64 has been created, as shown in
In yet another alternative, once the appropriate tooth or teeth TH has been three-dimensionally scanned and the housing 62 has been included, as shown in
Another alternative is illustrated where once the three-dimensional virtual or digital model 60 has been created from the patient's dentition, as shown in
As mentioned above, although the housing for the electronics and/or transducer assembly may be digitally created on the three-dimensional digital model generated from the patient's scanned dentition, a housing replica 84 may alternatively be adhered temporarily to a patient's tooth or teeth TH prior to scanning the dentition, as shown in
Aside from digital imaging and scanning of a patient's dentition, an alternative mechanism for creating a conformable oral appliance may utilize impression molding of the appropriate dentition. One example is shown in
An impression of the dentition may also be formed after a replica of housing mold 84 has been affixed temporarily to the tooth or teeth TH, as shown in
In either case, once the impression 92, 94 has been formed, the mold 90 may be filled with a plaster to create a permanent, three-dimensional mold or model of the appropriate dentition, which may then be used to thermally form an oral appliance or which may be scanned digitally to utilize any of the forming or machining processes, as described above. Alternatively, the impression 92, 94 itself may be scanned to render a three-dimensional model of the appropriate dentition and/or housing for processing, also as above.
As illustrated in
Likewise, if mold 90 has an impression 94 already having a housing formed therein, as shown in
In the case of utilizing the mold 90 to create a physical mold or model, the resulting mold or model may alternatively be scanned to create a digital image of the dentition, as described above, rather than thermal forming directly upon the mold or model.
In another variation, the mold 90 having an impression 92 formed therein may have an electronics and/or transducer assembly 96 impressed into the mold 90, as shown in
Likewise, once an impression 94 has been formed with the housing mold included, as shown in
In yet another variation for forming or fabricating a conforming oral appliance, a dental tray 100 having a channel 102 for the user's dentition may be provided having an electronics and/or transducer housing 104 pre-formed along a lingual or buccal orientation of the dental tray 100. The example of
To form the oral appliance, tray 100 may be filled with any of the settable or curable materials 112 described above or may comprise a moisture-activated hydrogel utilizing, e.g., a dispenser 110, until the materials 112 fill any spaces or voids around assembly 106 to encapsulate assembly 106. The user may then place the tray 100 upon the appropriate portion of the dentition until the tooth or teeth TH is positioned sufficiently within tray 100, as shown in
In yet another alternative, tray 100 may comprise a preformed tray made from, e.g., ethylene vinyl acetate or polyethylene material, which may be heated or boiled to activate the tray 100. Once activated, the user may bite into tray 100 to at least partially mold or conform tray 100 to the user's dentition. Assembly 106 may be included or integrated after the tray 100 has been conformed.
The applications of the devices and methods discussed above are not limited to the treatment of hearing loss but may include any number of further treatment applications. Moreover, such devices and methods may be applied to other treatment sites within the body. Modification of the above-described assemblies and methods for carrying out the invention, combinations between different variations as practicable, and variations of aspects of the invention that are obvious to those of skill in the art are intended to be within the scope of the claims.
This application is a continuation of U.S. patent application Ser. No. 14/176,666 filed Feb. 10, 2014 (now U.S. Pat. No. 9,247,332 issuing Jan. 26, 2016), which is a continuation of U.S. patent application Ser. No. 13/615,189 filed Sep. 13, 2012 (now U.S. Pat. No. 8,649,536 issued Feb. 11, 2014), which is a continuation of U.S. patent application Ser. No. 12/175,240 filed Jul. 17, 2008 (now U.S. Pat. No. 8,295,506 issued Oct. 23, 2012), the contents of which are incorporated herein by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
2161169 | Jefferis, Jr. | Jun 1939 | A |
4478224 | Bailey | Oct 1984 | A |
6633747 | Reiss | Oct 2003 | B1 |
6849536 | Lee et al. | Feb 2005 | B2 |
8295506 | Kassayan | Oct 2012 | B2 |
8649536 | Kassayan | Feb 2014 | B2 |
9247332 | Kassayan | Jan 2016 | B2 |
20050196008 | Anjanappa | Sep 2005 | A1 |
20060270467 | Song et al. | Nov 2006 | A1 |
20070142072 | Lassally | Jun 2007 | A1 |
20070280495 | Abolfathi | Dec 2007 | A1 |
20080064993 | Abolfathi et al. | Mar 2008 | A1 |
20080144876 | Reining et al. | Jun 2008 | A1 |
20080159559 | Akagi et al. | Jul 2008 | A1 |
20090149722 | Abolfathi et al. | Jun 2009 | A1 |
20100014689 | Kassayan et al. | Jan 2010 | A1 |
20130003997 | Kassayan et al. | Jan 2013 | A1 |
Number | Date | Country |
---|---|---|
WO 2001095666 | Dec 2001 | WO |
WO 2009111566 | Sep 2009 | WO |
WO 2010009018 | Jan 2010 | WO |
Number | Date | Country | |
---|---|---|---|
20160217804 A1 | Jul 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14176666 | Feb 2014 | US |
Child | 15005860 | US | |
Parent | 13615189 | Sep 2012 | US |
Child | 14176666 | US | |
Parent | 12175240 | Jul 2008 | US |
Child | 13615189 | US |