This invention presents a device that can provide a noise cancellation solution for firefighters, first responders, and other persons, who may or may not wear a mask or other Personal Protection Equipment (PPE), in order to improve personal communications in a high-noise environment. The device comprises four modules, speech acquisition module, an Audio Signal Processing (ASP) module, a loudspeaker, and a radio interface. The speech acquisition module can be in the form of a contact microphone, an in-the-ear microphone, or both. The ASP module, which can be implemented by either digital or analog processing, contains a noise reduction unit to improve the signal-to-noise ratio without sacrificing speech intelligibility, a spectra equalization unit to equalize the energy of low- and high-frequency of speech signals, and a Voice Activity Detection (VAD) unit to detect speech. The loudspeaker and radio interface make the device a universal solution for communications with and without radios.
People need to wear a mask or other PPE when they work in dangerous areas for the sake of safety. For example, a firefighter must wear a Self-Contained Breathing Apparatus (SCBA) when battling a fire. When a mask or PPE is worn, it becomes difficult to conduct face-to-face or person-to-radio communications because speech is heavily attenuated by the mask or PPE. What is more, any communication can be severely degraded by the background noise. In an extremely noisy environment, the radio can hardly pick up any clean speech at all. The firefighter has to shout loudly in order to be heard accurately. However, it is very important and necessary for people with a mask or PPE to have very clear and effective communications in such a high-noise environment. Poor communication not only decreases the working efficiency but also can be fatal.
So far, various solutions to improve the efficiency of communications have been developed and utilized. Operational procedures, such as hand and arm signals, provide a primitive solution and are not effective for scenarios requiring hands-free communications. Commercial Noise Cancellation Devices (NCDs) that can cancel ambient noise have been developed, although these devices can only work well when communicating without radios or when communicating through radios in a Push-To-Talk (PTT) mode. As a core component of these NCDs, three different kinds of microphones have been employed to improve the efficiencies of communications in the market: in-the-mask microphone, bond-conduct microphone, and adhesive microphone.
The first option, an in-the-mask microphone integrated with the mask, is an expensive solution since the first responder needs to replace the whole SCBA. The SCBA has a potential risk of air leakage because the microphone needs to be wired out for connection to an external radio. In addition, speech becomes distorted as it passes through the SCBA. The second option is the use of a bone-conduct microphone, but such a microphone needs to have a very tight contact with the human body. This contact needs to be either directly on the skull or the throat, which makes the user uncomfortable. The installation is clearly not stable since it cannot be rigidly fixed to the human body. An adhesive microphone attached to the outside of the SCBA is the third option. It cannot be considered a complete solution, however, due to the following reasons: (1) no further active noise reduction technology has been applied. As a result, the noise level is still not low enough for comfortable listening; (2) the speech picked up by the adhesive microphone sounds different from normal speech because the speech is excited within the SCBA, so the person who listens to the speech has difficulty in identifying who is talking; (4) it does not work with those first responders who don't wear a face mask but work in a high-noise environment.
Besides the above drawbacks, no present commercial NCD has adequately addressed the Voice Operates Switch (known as VOX) mode with radios. In VOX communication mode, the radio acts as an open microphone and sends signals out only when speech is detected. With these commercial NCDs, the VOX mode with radios is not robust enough against background noise, which may cause the radio to continuously transmit unwanted noise across the network and interfere with others' abilities to use the same frequency.
To address the above problems, a solution to improve communications is highly desirable. A NCD that supports both face-to-face and person-to-radio communications in highly noisy environments and addresses the above problems is presented with this invention. This device works effectively in high-noise environments through radios in PTT and VOX mode with and without radios.
The invention presents a device that can provide a novel noise cancellation solution for first responders, especially firefighters, to effectively communicate in a high-noise environment regardless of the communication mode. The device is compatible with the first responders' existing equipment and has no impact on the first responders' abilities to perform operational tasks. System requirements of the NCD such as size, weight, and placement of the NCD components are also compatible with the existing firefighter Standard Operating Procedures (SOPs). The NCD is easy to use and affordable by most of fire departments. Maintenance fees and repair costs are low. The NCD has low power consumption to ensure sufficient operation time.
The NCD comprises speech acquisition module, an ASP module, a loudspeaker, and a radio interface.
The speech acquisition module picks up the voice from the person who wears the PPE or mask and can be in the form of a contact microphone, an in-the-ear microphone, or both. The contact microphone is installed on the outside surface of the mask and has an integrated piezoelectric transducer to detect the voice vibration from the mask. Since contact microphone picks up the reverberation signals from the mask when a person is speaking. The device can get rid of background noise and only pick up speech signals because the background noise in the open space cannot generate the same reverberation as the speech within the mask. The contact microphone is washable and disposable after being used in a polluted environment. The in-the-ear-microphone is inserted in the ear of the person who may or may not wear a mask or PPE and can pick up speech signals from the Cochlear emissions. Since the ear plug of the in-the-ear microphone can block background noise, this microphone can improve the signal-to-noise ratio significantly. The in-the-ear microphone has a replaceable earplug that varies in sizes to fit on each individual's hear canal. Unlike the contact microphone, the in-the-ear microphone can be used for communications with or without a mask because its mounting does not rely on any mask or PPE.
The purpose of the ASP module is to convert noisy speech to clean speech. The function of the ASP module can be implemented by either an analog or a digital processing. The ASP module itself includes an adaptive noise reduction unit to clean the noisy speech, a spectral equalization unit to correct the spectra distortion introduced by face mask, and a VAD unit to detect speech for the VOX function. The speech signals acquired from the above microphones can have distortion and noise, and therefore further signal processing is needed to improve the speech quality through the spectra equalization and noise reduction units.
The loudspeaker supports face-to-face communications, which are necessary since people cannot hear each other clearly when they wear masks or PPEs. The radio interface supports person-to-radio communications by enabling the device to output clean speech signals to a radio device.
The invention can be more fully understood by reading the subsequent detailed descriptions and examples with references made to the accompanying drawings, wherein:
The ASP module 103 with digital implementation includes four major chips, namely, two pre-amplifiers 203 for microphones 201 and 202, a flash memory 204, a DSP 205 with built-in Analog-to Digital (A/D) and Digital-to-Analog (D/A) converters, and a power amplifier 209 for the speaker 104. The output analog signals from the microphone 201 and microphone 202 are amplified and then imported into the DSP 205. The flash memory 204 stores the software for the DSP chip 205. Once the device starts to operate, the DSP chip 205 can read the software from the flash memory 204 into internal memory and begins to execute the codes. During the initiation processes, the software is written into the registers of the DSP chip 205. Two power regulators are used: one is the linear power regulator 206 and the other is switch power regulator 207. The regulators are used to provide stable voltage and current supply for all the components on the circuit board. A battery or rechargeable battery 208 provides the power supply for the NCD. The loudspeaker 104 is used for face-to-face communications and the radio interface 105 connects the NCD with the radio 106 for wireless communications.
The communications between the firefighters and the radio are two-way communications through the audio in 210 and audio out 211. As shown in
The NCD works as follows: after acoustic analog signals are picked up by the microphone or microphones, which can be the contact microphone, in-the-ear microphone or both, these signals are amplified by the amplifiers 203. The analog signals are then converted to a digital form by using an A/D converter. This way the analog signals are turned into a stream of numbers. However, the required output signals have to be analog signals, which require a D/A converter. The A/D and D/A converters can only change the signal format. The DSP chip 205 implements all the signal processing. As mentioned before, the ASP module includes an adaptive noise reduction unit to clean the noisy speech, a spectral equalization unit to correct the spectra distortion introduced by the face mask, and a noise-robust VAD unit to detect speech for VOX function.
Either the contact microphone or in-the-ear microphone picks up the speaker's voice on the mask or in the ear, so the spectrum of the signals is different from the spectrum of the signals transmitted in the open air. The low frequency information is boosted such that the signals sound like talking with a mask covering the mouth. A spectra equalization unit 404 equalizes the energy in low and high frequency bands. After equalization, the signals are more evenly distributed over the full bands and speech intelligibility is improved. After the signals in all sub-bands are processed, a filter bank synthesis unit 405 can combine multi-channel sub-band signals together into a single channel full-band speech signals. A VAD unit 407 can tell where the speech is. Both the noise reduction unit 403 and spectra equalization unit 404 can use the information from the VAD unit 407 to update noise statistics and suppress noise in noise section and keep speech intact in speech section. An A/D converter 401 and a D/A converter 406 switch between digital and analog signals. An in-the-ear microphone model 408 and a contact microphone model 409 are built in the invention: the in-the-ear microphone model 408 simulates the difference between a close-talk microphone and an in-the-ear microphone, while the contact microphone model 409 simulates the difference between a close-talk microphone and a contact microphone. These two models can correct the spectra distortion such that the signals after the models sound more natural than before the models. Only one model will be applied if only one type of microphones is used to pick up the audio signals in the NCD.
The noise reduction algorithms that can be applied in either noise reduction unit 403 or the set of noise reduction (NR) filters 502 include Wiener filter based noise reduction, spectral subtraction noise reduction, Cochlear transform based noise reduction, and model-based noise reduction algorithm.
The schematic diagram of the Wiener filter based noise reduction is shown in
Spectral Subtraction (SS) noise reduction algorithm is designed to reduce the degrading effects of noise acoustically added in speech signals. Similar to Wiener filter noised reduction algorithm, SS noise reduction algorithm estimates the magnitude of the frequency spectrum of the underlying clean speech by subtracting frequency spectrum magnitude of the noise from the frequency spectrum magnitude of the noisy speech. The SS algorithm estimates the current spectrum magnitude of the noisy speech by using the average measured noise magnitude when there is no speech activity. Therefore the implemented VAD can help make the VOX function more reliable in a noisy environment, since VAD can determine whether or not someone is speaking. In the first twenty-five milliseconds, it is assumed that only noise appears and the frequency spectrum of the background noise is then estimated. During the noisy speech, the noise spectrum is continuously updated when the current spectrum is below a pre-set threshold.
In spectra subtraction algorithm, the difference between real noise and estimated noise is called noise residual. Environmental noise sounds like the sum of tone generators with random frequencies. This phenomenon is known as “music noise”. To solve this problem, smooth factors are applied in both frequency and time domains to remove the “music noise”. The Wiener filter algorithm can be first applied, and then spectral subtraction algorithm is subsequently adopted. After Wiener filtering, the noise level is reduced. The noise residual after spectral subtraction algorithm is low enough to be masked by speech. Therefore, music noise is barely audible in the time domain.
In addition to environmental noise, there are some other different noises generated by the SCBA equipment, such as air-regulator inhalation noise, low-pressure alarm noise, and Personal Alert Safety System (PASS) noise, which all degrade the speech quality. The air-regulator inhalation noise does not directly corrupt speech since people do not normally speak when inhaling. However, the noise can interfere with communications using VOX mode with radio and is detracting to listeners. For those noises with known spectral patterns, the spectra model can be constructed to detect these noises. Once the noise is detected, a technique can be applied to cancel noise with the known spectral patterns. This method is known as model-based noise reduction algorithm.
The structure of model-based noise cancellation is shown in
The fourth noise reduction algorithm uses a novel developed broadband noise reduction algorithm that takes advantage of the structural correlations in speech signals as opposed to the broad frequency spread of noise signals. Cochlear transform is utilized to decompose noisy speech signals into aurally meaningful band-limited signals. This noise suppression method adaptively works on every of these sub-band signals. The re-synthesized signal output by the noise suppression algorithm is a cleaner version of the noisy speech signals with minimal speech distortion. The Cochlear transform based noise reduction algorithm has been described in detail in the U.S. patent application filed with an application number of Ser. No. 11/374,511. The diagrams of the Cochlear transform embodiments and its working principles are shown in
The noise-robust speech acquisition module and novel noise reduction algorithms can guarantee speech intelligibility even in a high-noise environment. In order to support the VOX function and make sure the radio channel is occupied only when speech exists, two VAD algorithms have been developed in this invention.
The key issue of the energy-based method is how to estimate the noise power accurately. If a wrong threshold δ is used, the difference DIST cannot tell where the speech is. In the invention, the minimum power of the sub-band noise within a finite window is used to estimate the noise floor. The algorithm is based on the observation that a short time sub-band power estimate of noisy speech signals exhibits distinct peaks and valleys, as shown in
As described above, the VAD unit has two algorithms. One is the energy-based method and the other is the change-point detection algorithm.
In the foregoing description, the present invention can be implemented in a variety of embodiments, namely with one or two different microphones, in analog or digital signal processing module, with loudspeaker or radio, and with one or a combination of noise reduction algorithms. These embodiments will be apparent to any skilled practitioner in the art.
Number | Name | Date | Kind |
---|---|---|---|
3723670 | Sebesta et al. | Mar 1973 | A |
4023209 | Frieder et al. | May 1977 | A |
4154981 | Dewberry et al. | May 1979 | A |
4374301 | Frieder, Jr. | Feb 1983 | A |
5034747 | Donahue | Jul 1991 | A |
5060308 | Bieback | Oct 1991 | A |
5136555 | Gardos | Aug 1992 | A |
5159641 | Sopko et al. | Oct 1992 | A |
5280524 | Norris | Jan 1994 | A |
5282253 | Konomi | Jan 1994 | A |
5574794 | Valley | Nov 1996 | A |
5579284 | May | Nov 1996 | A |
5586176 | Peck | Dec 1996 | A |
5889871 | Downs, Jr. | Mar 1999 | A |
5990793 | Bieback | Nov 1999 | A |
20020068616 | Tabata et al. | Jun 2002 | A1 |
20030059078 | Downs et al. | Mar 2003 | A1 |
20030068060 | Olson | Apr 2003 | A1 |
20050033571 | Huang et al. | Feb 2005 | A1 |
20060009970 | Harton et al. | Jan 2006 | A1 |
20060286933 | Harkins et al. | Dec 2006 | A1 |
20070113964 | Crawford et al. | May 2007 | A1 |
Number | Date | Country | |
---|---|---|---|
20120084084 A1 | Apr 2012 | US |