1. Field
Apparatuses and methods consistent with exemplary embodiments relate to audio sensing, and more particularly, to an audio sensing device that has a resonator array and a method of acquiring frequency information using the audio sensing device.
2. Description of Related Art
Frequency domain information of sound may be analyzed in an environment such as mobile phones, computers, home appliances, automobiles, and the like. In general, frequency domain information of an audio signal is acquired as the audio signal is input to a microphone. The audio signal may have wide band characteristics and may pass through an analog digital converter (ADC) and undergo a Fourier transformation. However, the frequency information acquisition method requires a large amount of calculation because a Fourier transformation is complicated and burdensome.
In cellular phones, computers, home appliances, cars, smart homes, and the like, an audio receiver should always be in a ready state to execute a voice command. Also, to recognize high level information, sound frequency domain information should be continuously analyzed. Furthermore, in order to separate an audio signal of a speaker from surrounding noise, frequency characteristics with respect to the noise may be used. When the surrounding noise is continuously analyzed and stored in a database, noise may be effectively removed. Analysis of the surrounding noise may be used to help to identify a place and a type of an action. To this end, frequency domain information with respect to the surrounding noise may be always monitored.
To this end, a solution having low power and a fast response speed and being capable of monitoring frequency domain information in an always-ready state may be required. In general, frequency domain information of an audio signal is acquired as an audio signal is input to a microphone having wide band characteristics passes through an analog digital converter (ADC) and undergoes a Fourier transformation. However, the frequency information acquisition method requires a large amount of calculation due to the Fourier transformation, which is burdensome. The frequency domain information being always monitored in the above method is not preferable in view of power management.
Exemplary embodiments overcome the above disadvantages and other disadvantages not described above. Also, an exemplary embodiment is not required to overcome the disadvantages described above, and an exemplary embodiment may not overcome any of the problems described above.
One or more exemplary embodiments provide an audio sensing device that has a resonator array and a method of acquiring frequency information using the audio sensing device.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented exemplary embodiments.
According to an aspect of an exemplary embodiment, there is provided an audio sensing device including a substrate having a cavity formed therein, a membrane provided on the substrate and covering the cavity, and a plurality of resonators provided on the membrane and respectively configured to sense sound frequencies of different frequency bands.
The plurality of resonators may be disposed inside the cavity and an interior of the cavity is maintained in a vacuum state. A degree of vacuum in the interior of the cavity is less than or equal to 100 Torr. The plurality of resonators are arranged on the membrane in one dimension or two dimensions. A number of the plurality of resonators may be in a range of tens to thousands.
Each of the plurality of resonators may include a first electrode provided on the membrane, and a second electrode fixedly provided on the membrane and spaced apart from the first electrode. The first electrode may be a common electrode. A first insulating layer may be provided between the membrane and the first electrode. A second insulating layer may be interposed between the first electrode and the second electrode and may be provided on one of the first electrode and the second electrode. One end or opposite ends of the second electrode may be fixed on the membrane. The first and second electrodes may include a conductive material.
Each of the plurality of resonators may include a first electrode fixedly provided on the membrane, a second electrode spaced apart from the first electrode, and a piezoelectric layer provided between the first and second electrodes. One end or opposite ends of the first electrode may be fixed on the membrane. An insulating layer may be provided between the membrane and the first electrode. The piezoelectric layer may include at least one of ZnO, SnO, PZT, ZnSnO3, polyvinylidene fluoride (PVDF), poly(vinylidene fluoride-trifluoroethylene) (P(VDF-TrFE)), AlN, and PMN-PT.
The first and second electrodes may include a conductive material. At least two of the plurality of resonators may sense frequencies of a same band. The substrate may include silicon. The membrane may include at least one of silicon, a silicon oxide, a silicon nitride, metal, and a polymer.
Sound frequency bands to be sensed may be adjusted by changing dimensions of the plurality of resonators. The membrane may be configured to receive an input audio signal of an audible frequency range or an ultrasonic frequency range.
According to an aspect of another exemplary embodiment, there is provided an audio sensing device including a membrane configured to vibrate in response to sound, and a plurality of resonators provided on the membrane and respectively configured to sense different frequency bands of the sound.
The plurality of resonators may be disposed in a vacuum state.
Each of the plurality of resonators may include a first electrode provided on the membrane, and a second electrode fixedly provided on the membrane and spaced apart from the first electrode. The first electrode may be a common electrode. A first insulating layer may be provided between the membrane and the first electrode. A second insulating layer to insulate between the first electrode and the second electrode may be provided on at least one of the first electrode and the second electrode. One end or opposite ends of the second electrode may be fixed on the membrane. The first and second electrodes may include a conductive material.
Each of the plurality of resonators may include a first electrode fixedly provided on the membrane, a second electrode spaced apart from the first electrode, and a piezoelectric layer provided between the first and second electrodes. One end or opposite ends of the first electrode may be fixed on the membrane. An insulating layer may be provided between the membrane and the first electrode. The piezoelectric layer may include at least one of ZnO, SnO, PZT, ZnSnO3, polyvinylidene fluoride (PVDF), poly(vinylidene fluoride-trifluoroethylene) (P(VDF-TrFE)), AlN, and PMN-PT.
At least two of the plurality of resonators may sense frequencies of a same band. The substrate may include silicon. The membrane may include at least one of silicon, a silicon oxide, a silicon nitride, metal, and a polymer. Sound frequency bands to be sensed may be capable of being adjusted by changing dimensions of the plurality of resonators.
The above and/or other aspects will become apparent and more readily appreciated from the following description of the exemplary embodiments, taken in conjunction with the accompanying drawings, in which:
Reference will now be made to the exemplary embodiments, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout and the thickness or size of each layer illustrated in the drawings may be exaggerated or reduced for convenience of explanation and clarity. In this regard, one or more exemplary embodiments may have different forms and should not be construed as being limited to the descriptions set forth herein.
Accordingly, the exemplary embodiments are described below, by referring to the figures, to explain aspects of the present description. In the following description, when a layer is described to exist on another layer, the layer may exist directly on the other layer or another layer may be interposed therebetween. Also, because materials forming each layer in the following embodiments are exemplary, other materials may be used. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. Expressions such as “at least one of,” when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
According to the exemplary embodiments provided herein, a plurality of resonators are provided in an audio sensing device and selectively sense sound frequencies of predetermined bands. Accordingly, frequency domain information with respect to an audio signal that is externally input may be easily acquired. According to one or more exemplary embodiments, because a Fourier transformation process that consumes a large amount of electric power is removed and such a Fourier transformation function is embodied through a resonator array of that has a mechanical structure, consumption of power may be greatly reduced.
Also, because a signal is output in direct response to an external audio signal, frequency domain information may be quickly acquired. Accordingly, the frequency domain information of an audio signal may be monitored in real time using low power and at a fast speed in an always-ready state. Furthermore, noise generated nearby may be effectively removed.
Referring to
The membrane 120 (shown in
The membrane 120 may receive an audio signal of a wide band. For example, the membrane 120 may receive an audio signal in an audible frequency range from between about 20 Hz˜about 20 kHz. As another example, the membrane 120 may receive an audio signal in an ultrasonic frequency range of about 20 kHz or higher, or an audio signal in an infrasonic frequency range of about 20 Hz or lower.
The resonators 130 are arranged on a surface of the membrane 120 and may have a predetermined shape. In the example of
The resonators 130 may sense sound frequencies that have different bandwidths. For example, the resonators 130 may have different dimensions on the membrane 120. That is, the resonators 130 may be provided on the membrane 120 such that they have different lengths, widths, and/or thicknesses. Although the number of the resonators 130 provided on the membrane 120 may be, for example, tens to several thousands, the exemplary embodiments are not limited thereto and the number of the resonators 130 may be diversely modified according to design conditions. An insulating layer may be further formed on the inner surface of the membrane 120 on which the resonators 130 are provided. The insulating layer may be used to insulate the membrane 120 and the resonators 130 when the membrane 120 includes a conductive material.
Each of the resonators 130 may be an electro-static resonator. Referring to the examples of
The first electrode 131 may be provided on the inner surface of the membrane 120 facing the cavity 110a. The first electrode 131 may be a common electrode as illustrated in
In the electro-static predetermined resonator 130 having the above structure, the second electrode 132 vibrates according to a movement of the membrane 120. In this example, an interval between the first and second electrodes 131 and 132 changes and a capacitance between the first and second electrodes 131 and 132 may vary accordingly. An electric signal may be sensed from the first and second electrodes 131 and 132 according to the change of the capacitance. As a result, the predetermined resonator 130 may sense a sound frequency in a particular range. For example, the frequency range that is capable of being sensed by the predetermined resonator 130 may be determined by the length of the second electrode 132 corresponding to the length of the predetermined resonator 130.
The audio sensing device 100 of
Referring to
In the audio sensing device 100 of
When the membrane 120 vibrates in response to the input audio signal, the resonators 130 arranged on the membrane 120 vibrates. For example, each of the second electrodes 132, vibrates at a predetermined frequency corresponding to the movement of the membrane 120. Accordingly, the resonators 130 that have different lengths from each other may sense sound frequencies of different bands. As illustrated in
Referring to
For example, the audio sensing device 100 may sense vibrations of the membrane 120 only, and audio signal information of a wide band may be additionally or independently acquired. In this example, a piezoelectric method may be used as a method of sensing vibrations of the membrane 120 only. As illustrated in
According to the audio sensing device 100 of the exemplary embodiment, because a Fourier transformation process that consumes a large amount of electric power is removed, consumption of power may be greatly reduced. Instead, such a Fourier transformation function is embodied through a resonator array of a mechanical structure allowing power consumption to be greatly reduced. Accordingly, the frequency domain information of an audio signal may be monitored by the audio sensing device 100 using low power and at a fast speed in an always-ready state. Also, because resonators capable of sensing frequencies of various bands are manufactured to be very small through a micro-electro-mechanical system (MEMS) process, the resonators may be integrated in a small area.
In the above-described exemplary embodiment, resonators 130 are arranged on the membrane 120 and have different lengths from each other. However, the audio sensing device is not limited thereto and some of the resonators 130 may have the same length. For example, each pair of resonators may have the same length, and thus, sensitivity in sending a sound frequency of a predetermined band may be improved or otherwise increased.
Also, one or more exemplary embodiments the length among the dimensions of the resonators 130 may be changed in order to embody the sensing of the sound frequencies of different bands. As another example, it is possible to change the width and/or the thickness of a resonator to achieve the sensing of sound frequencies of different bands. In other words, resonators capable of sensing sound frequencies of different bands may be embodied by changing at least one of the length, width, and thickness of each of the resonators 130 arranged on the membrane 120. Although the frequency bands that resonators 130 receive are determined by the resonant frequency and the Q value that are determined according to the dimensions of the resonators 130, the amplitude of a signal of the frequency may vary according to positions of the resonators 130 on the membrane 120.
Referring to
Referring to
Referring to
Referring to
Referring to
It should be appreciated that the arrangements of the resonators 130 in
Referring to
The resonator 230 may include first and second electrodes 231 and 232 that are spaced apart from each other, and a second insulating layer 233 that is provided on a surface of the second electrode 232 and that faces the first electrode 231. The second insulating layer 233 prevents the first electrode 231 and the second electrode 232 from electrically contacting each other. Although
Referring to
In this example, the resonator 530 includes first and second electrodes 531 and 532 that are spaced apart from each other and a piezoelectric layer 533 that is provided between the first and second electrodes 531 and 532. Opposite ends of the first electrode 531 are fixed to the inner surface of the membrane 120 and a center portion of the first electrode 531 is spaced apart from the membrane 120. The piezoelectric layer 533 includes a piezoelectric material that may generate electric energy through deformation. For example, the piezoelectric layer 533 may include ZnO, SnO, PZT, ZnSnO3, polyvinylidene fluoride (PVDF), poly(vinylidene fluoride-trifluoroethylene) (P(VDF-TrFE)), AlN, or PMN-PT. However, the exemplary embodiments are not limited thereto and the piezoelectric layer 533 may include various other piezoelectric materials.
In the resonator 530 of a piezoelectric resonator type, when the resonator 530 vibrates according to the movement of the membrane 120, the piezoelectric layer 533 provided between the first and second electrodes 531 and 532 may be deformed. In response to the piezoelectric layer 533 being deformed, an electrical signal may be detected from the first and second electrodes 531 and 532. Accordingly, the resonator 530 may selectively sense a sound frequency of a particular band. Furthermore, the frequency band that the resonator 530 may sense may be adjusted by adjusting at least one of the length, width, and thickness of the resonator 530.
Referring to
Referring to
As illustrated in
In
Referring to
The above-described frequency behaviors illustrated in
As described above, in one or more exemplary embodiments, information about an audio signal of a wide band may be additionally or independently acquired by sensing the vibrations of the membrane 120 only. The signal acquired by sensing the vibrations of the membrane 120 only may be an audio signal that restores the sound input to the membrane 120 as it is, as illustrated in
A method of acquiring frequency domain information with respect to an audio signal using the above-described audio sensing device will now be described with reference to
Referring to
A spectrogram 900 is obtained using the normalized frequency information, and thus, frequency domain information with respect to the audio signal input to the audio sensing device 100 may be acquired. Although in the above description a case in which only the resonators 130 provided on the membrane 120 selectively senses frequencies of predetermined bands is described, a process of collecting information about an audio signal of a wide band by sensing the vibrations of the membrane 120 only generated by the input audio signal may be added. For example, piezoelectric type sensing may be used as the method for sensing the vibrations of the membrane 120 only. However, the exemplary embodiments are not limited thereto and capacitive type sensing may be used as another example. Also, the information about the audio signal input to the audio sensing device 100 may be independently collected by sensing the vibrations of the membrane 120 only.
According to the above exemplary embodiments, as a plurality of resonators provided in an audio sensing device may selectively sense sound frequencies of predetermined bands, and frequency domain information with respect to an audio signal that is externally input may be easily acquired. In the above audio sensing device, because a Fourier transformation process that consumes a large amount of electric power is removed, and such a Fourier transformation function is embodied through a resonator array of a mechanical structure, consumption of power may be greatly reduced. Also, because a signal is output in a direct response to an external audio signal, frequency domain information may be quickly acquired. Accordingly, the frequency domain information of an audio signal may be monitored in real time with low power and at a fast speed in an always-ready state. Furthermore, noise generated nearby may be effectively removed. Also, because the resonators may be manufactured to be very small on the membrane through a micro-electro-mechanical system (MEMS) process, many resonators for selectively sensing frequencies of many various bands may be integrated in a small area.
The audio sensing device configured as described above according to one or more exemplary embodiments may be applied to a variety of fields. For example, the audio sensing device may be applied to the fields of voice recognition and control. In this example, as the audio sensing device recognizes a voice of a speaker, apparatuses or mobile devices in a home or in a vehicle may be operated or unlocked.
Also, the audio sensing device may be applied to a field of context awareness. In this example, the audio sensing device may analyze sound generated nearby and determine information about an environment surrounding a user. Accordingly, the user may be provided with information appropriate for the environment which may help the user effectively carry out a job.
As another example, the audio sensing device may be applied to a field of reducing noise or improving call quality. In this example, call quality may be improved or a voice recognition rate may be improved by always monitoring a state of noise generated nearby through the audio sensing device and removing the noise in advance during call or according to a voice command. In addition, the audio sensing device may be applied to a variety of fields such as a hearing aid requiring high performance and long battery life, and a field of sensing premises risk such as falling, injury, object drop, intrusion, screaming, and the like.
Number | Date | Country | Kind |
---|---|---|---|
10-2014-0105431 | Aug 2014 | KR | national |
This application is a continuation of U.S. patent application Ser. No. 14/601,753, filed on Jan. 21, 2015, which claims priority from Korean Patent Application No. 10-2014-0105431, filed on Aug. 13, 2014 in the Korean Intellectual Property Office, the disclosures of which are incorporated herein in their entireties by reference.
Number | Name | Date | Kind |
---|---|---|---|
1806871 | Bower | May 1931 | A |
4885781 | Seidel | Dec 1989 | A |
5303210 | Bernstein | Apr 1994 | A |
5870351 | Ladabaum et al. | Feb 1999 | A |
6012334 | Ando et al. | Jan 2000 | A |
6079274 | Ando et al. | Jun 2000 | A |
6223601 | Harada et al. | May 2001 | B1 |
6314057 | Solomon et al. | Nov 2001 | B1 |
6320239 | Eccardt et al. | Nov 2001 | B1 |
6328697 | Fraser | Dec 2001 | B1 |
6430109 | Khuri-Yakub et al. | Aug 2002 | B1 |
6438243 | Ikeuchi | Aug 2002 | B1 |
6585653 | Miller | Jul 2003 | B2 |
6651504 | Datskos | Nov 2003 | B1 |
7213460 | Itoh | May 2007 | B2 |
7227432 | Lutz et al. | Jun 2007 | B2 |
7230511 | Onishi et al. | Jun 2007 | B2 |
7321181 | Khuri-Yakub et al. | Jan 2008 | B2 |
7594307 | Morimura et al. | Sep 2009 | B2 |
7615834 | Khuri-Yakub et al. | Nov 2009 | B2 |
7646133 | Degertekin | Jan 2010 | B2 |
7745973 | Bayram et al. | Jun 2010 | B2 |
7944130 | Park | May 2011 | B2 |
8687466 | Kim | Apr 2014 | B2 |
8727994 | Kim et al. | May 2014 | B2 |
8858447 | Chung | Oct 2014 | B2 |
20080315331 | Wodnicki et al. | Dec 2008 | A1 |
20090140612 | Ikeuchi | Jun 2009 | A1 |
20100117485 | Martin | May 2010 | A1 |
20120145667 | Imbert et al. | Jun 2012 | A1 |
20130026655 | Lee et al. | Jan 2013 | A1 |
20130049528 | Kim | Feb 2013 | A1 |
Number | Date | Country |
---|---|---|
1595799 | Mar 2005 | CN |
1747322 | Mar 2006 | CN |
203432678 | Feb 2014 | CN |
0 903 568 | Mar 1999 | EP |
0 959 333 | Nov 1999 | EP |
0 903 568 | Dec 1999 | EP |
0 959 333 | Jan 2003 | EP |
1 909 079 | Apr 2008 | EP |
2 210 232 | Jun 1989 | GB |
2000-131135 | May 2000 | JP |
2000-201391 | Jul 2000 | JP |
4859924 | Jan 2012 | JP |
10-0691152 | Mar 2007 | KR |
10-2013-0084860 | Jul 2013 | KR |
10-2014-0028530 | Mar 2014 | KR |
10-2014-0033992 | Mar 2014 | KR |
10-2014-0033993 | Mar 2014 | KR |
10-2014-0035204 | Mar 2014 | KR |
10-2014-0068717 | Jun 2014 | KR |
2007111405 | Oct 2007 | WO |
Entry |
---|
Communication dated Nov. 20, 2015 issued by European Patent Office in counterpart European Patent Application No. 15155077.9. |
Communication dated Oct. 26, 2018, issued by the State Intellectual Property Office of P.R. China in counterpart Chinese Application No. 201510124568.9. |
Number | Date | Country | |
---|---|---|---|
20170006385 A1 | Jan 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14601753 | Jan 2015 | US |
Child | 15268141 | US |