Field of the Invention
The present invention relates to audio engineering and, more specifically but not exclusively, to microphone arrays.
Description of the Related Art
This section introduces aspects that may help facilitate a better understanding of the invention. Accordingly, the statements of this section are to be read in this light and are not to be understood as admissions about what is prior art or what is not prior art.
With the recent availability of inexpensive, small, surface-mount MEMS (microelectromechanical systems) and electret microphone devices, it is now possible to build microphone arrays having large numbers of microphone devices in ways that would have been nearly impossible just a short time ago. One interesting aspect of using surface-mount technology is that microphone devices can be mounted like any other semiconductor or passive component to a printed circuit board (PCB). Surface mounting microphone devices allows one to place a large number of microphone devices in a fast and inexpensive way. Placing the microphone devices directly on the PCB also allows one to interconnect and combine the microphone devices directly in either the analog or digital domain on the same PCB on which the microphone devices are mounted. Conventional, rigid PCB technology, however, limits the array geometry to planar configurations for the array manifold.
Problems in the prior art are addressed in accordance with the principles of the present invention by mounting microphone devices on flexible PCBs that are now used in miniaturized product design and as interconnects in complex multi-board systems, to allow more-general microphone array geometries. For example, mounting inexpensive, small, surface-mount MEMS or electret microphone devices in certain configurations on flexible PCBs can be used to realize high-quality, professional-grade, directional microphone arrays.
In one embodiment, the present invention is a microphone array comprising a flexible printed circuit board (PCB) and a plurality of microphone devices mounted onto the flexible PCB.
Other aspects, features, and advantages of the present invention will become more fully apparent from the following detailed description, the appended claims, and the accompanying drawings in which like reference numerals identify similar or identical elements.
Flexible PCB technology using layers of copper traces and insulating films have become a standard way for designers to connect other subsystems needing a large number of connections in tight spaces. Miniaturized devices use this technology to pack the entire volume of the device as much as possible.
Flexible PCBs have layers of copper wedged in between layers of insulating film. The insulating layers are commonly made from polyimide films, such as (but not limited to) Kapton® polyimide films from DuPont of Wilmington, Del. Flexible PCBs can currently be made with up to about six layers, with the bending stiffness increasing as the number of layers increases.
Flexible PCBs can be populated with components using standard pick-and-place PCB-manufacturing equipment. Solder connection of the components to the boards is also done in a similar manner as for conventional, rigid PCBs. Flexible PCBs can be entirely flexible or can contain both flexible and rigid regions, where the rigid regions can be made of standard, rigid PCB materials with connections to the flexible portions of the overall PCB. Standard via connections and holes are possible with flexible PCBs.
The combination of physically small, surface-mountable microphone devices on flexible PCBs enables the building of microphone arrays containing multiple microphone elements that can have geometries that are interesting for beamforming. One can build relatively large arrays of microphone devices that are stable in position and connected in unique ways.
As audio communication devices find their way more and more into mobile applications, the ability to operate in the presence of high levels of background noise becomes more and more significant. Standard, single-channel, noise-suppression algorithms can be effective in combating undesired background noise, but these algorithms notoriously “fall off a cliff” in terms of signal quality as the signal-to-noise ratio (SNR) falls below about 5 dB. One proven effective way to further improve noise rejection and immunity is to use beamforming with multiple microphone devices. Beamforming is a linear process where noise rejection is accomplished by combining the signals from multiple microphone devices to attain a directional spatial response aimed at the desired source or desired spatially separated sources. Steering of the beamformer can be either mechanical or electrical.
As the size of microphone devices becomes smaller, the physical thermal-noise limit becomes more significant in terms of the dominant self noise of the microphone devices. One way to effectively deal with the loss in SNR for smaller devices is to combine them by summing many microphone devices to form a new microphone signal. Since thermal noise is independent between the microphone devices, the net gain in SNR by summing the signals is approximately 10*log(N), where N is the number of devices uniformly summed. One can also sum the devices with general weighting and sacrifice some SNR gain for spatial control of the composite microphone array. For instance, one could amplitude weight the device signals with a smooth aperture weighting to control sidelobe-level response at frequencies at and above the frequency where the wavelength becomes smaller than the size of the composite microphone array. Spatial smoothing by summing the signals from smaller microphone devices can be useful in beamforming systems where the average spacing of the microphone devices becomes larger than one half of the acoustic wavelength.
As used in this specification, the term “microphone device” refers to an individual transducer that converts acoustic vibrations into electrical signals, such as a single MEMS or electret microphone. The terms “microphone array” and “microphone” refer to an entire system of microphone devices whose electrical signals are combined to generate a single, electrical, array output signal. The term “microphone element” refers to a subset or cluster of two or more of the microphone devices in a microphone array that have a common geometric attribute in the array. For example, in microphone array 100, the 12 microphone devices 104 in each of the six microphone elements 106(1)-106(6) have substantially the same longitudinal distance from one end (e.g., end 108) of cylindrical microphone array 100.
Depending on the implementation, the process of rolling up flexible PCB 102 can be performed using a cylindrical object that might remain within the interior of microphone array 100 or be removed after flexible PCB 102 has achieved the desired, rolled-up shape. Depending on the implementation, each microphone device 104 can be surface mounted onto flexible PCB 102 as a top-ported device in which the device's aperture faces away from the surface of the PCB or as a bottom-ported device in which the device's aperture faces down into an opening in the PCB.
Note that, in an alternative embodiment, flexible PCB 102 can be rolled up in the opposite direction such that microphone elements 106 are on the exterior surface of the resulting cylinder. In another alternative embodiment, flexible PCB 102 can be rolled up at an angle such that the rows of devices form (interior or exterior) spiral stripes as on a barber-shop pole. Such a spiral construction could provide a better mechanical configuration in that it may be easier to spiral around a cylindrical object rather than just wrapping the rectangular, flexible PCB around one dimension of the array.
In the rolled-up state of
The distances between the different elements 106 in
In general, the 12 electrical signals from the 12 microphone devices 104 in each microphone element 106 are combined (e.g., summed) to form an element output signal. The six different element output signals are then combined (e.g., as a weighted sum) to form the array output signal. Depending on the particular application, the weight applied to one or more of the element output signals may be zero to remove those one or more elements from contributing to the resulting array output signal.
Summing (passively or digitally) the 12 microphone devices 104 in each element 106 yields a gain in signal-to-noise ratio (SNR) of approximately 11 dB. For example, if each device 104 has an equivalent self noise (ENL) of 25 dBA, then the ENL of the corresponding microphone element 106 would be 14 dBA. A microphone element having an ENL of less than 20 dBA is considered to be a low-noise element. Even better SNR can be achieved by employing more than 12 microphone devices for each element. However, since the SNR gain is proportional to the logarithm of the number of summed devices, the cost of adding more devices tends to grow more rapidly than the improvement in SNR. Low self-noise microphone devices can be chosen to control the number of devices in each element.
In an alternative scheme, the different microphone devices 104 in each element 106 can be segmented in the angular domain to form different sub-elements. For example, the three devices 104 in quadrant I of
In alternative schemes, different sub-elements within an element can overlap, where the output from a given microphone device contributes to two (or more) different (e.g., adjacent) sub-elements.
In general, summing multiple device output signals to form sub-element and/or element output signals can be effective in combating the problem of spatial aliasing by lowering the response to signals arriving from the end-fire direction where spatial aliasing first appears.
The spiral configuration of
As designers and users demand more spatial directivity in small packages, higher spatial directivity can be attained by using superdirectional beamforming. Superdirectional beamforming is based on attaining higher differential orders of the scalar pressure field. Spatial derivatives of plane-wave fields have responses that are high-pass functions with a slope proportional to the order of the differential. Signals processed through a superdirectional beamformer subtract, and the SNR on output can be much less than the input SNR. A standard measure of the loss in SNR in beamforming is the White-Noise-Gain (WNG). Negative WNG indicates that there is a loss in SNR. Positive WNG indicates that the beamformer output SNR is higher than a single microphone input SNR. Positive WNG is typical in classical delay-sum beamformers, which generally employ an additive combination of the array elements. Thus, a designer utilizing superdirectional beamforming should use the lowest-ENL microphone devices that can be obtained within cost constraints. Combining smaller, inexpensive microphone devices using a cluster-element construction is one cost-effective way for a designer to optimize the performance of the overall design and meet design specifications.
One can also use microphone array 200 of
As described previously, flexible PCB 202 of microphone array 200 is perforated to form a number of openings 208. There may be some advantages to “open” the flexible PCB by placing such cutouts or perforations in as many places as possible while maintaining structural integrity and circuit connectivity. By opening up the flexible PCB, one can make the system more acoustically transparent, which might help in limiting the potential negative impact of package size and the commensurate issues of scattering and diffraction.
In
In the field of general linear acoustics, the far-field beampattern and the aperture weighting function of a beamformer are directly related by the Fourier Transform. The beampattern of the overall microphone array can be controlled by controlling the actual density (by physical design) or the effective density (by weighted summing) of the microphone devices. For instance, one could space the devices 204 in each row of
One could have further flexibility by forming separate sub-element outputs corresponding to different radial positions (e.g., “rings”) of the spiral configuration of
Yet another possible embodiment involves widening the dynamic range of microphone array 200 by using different dynamic-range microphone devices 204 within each microphone element 206. A sub-element of each element 206 can then be populated by a number of microphone devices 204 that have much-stiffer compliance characteristics resulting in a lower sensitivity but an ability to operate at much-higher sound-pressure levels. One can dynamically switch over to an overall array formed from just these sub-elements as the sound-pressure level increases above the linear operating range of the rest of the microphone devices and not use these sub-elements at lower sound-pressure level signals. Although the inherent SNR of the higher-sound-pressure-level microphone devices is worse, transitioning over to these lower-SNR devices would not be audible, since masking in human hearing would prevent one from perceiving the higher noise due to the higher signal level. The transition between these two types of microphone arrays can be done continuously over a wide range in sound level. One could also expand on this idea by building more sub-elements that have different maximum sound-pressure levels and dynamically switching between these sub-elements to maintain desired linearity over a desired wide dynamic range.
Another possible configuration similar to the dynamic-range-increase concept is to use two or more sub-elements of microphone devices with different low-frequency cutoff frequencies. Acoustic pressure-sensing microphone devices use an atmospheric leak to the rear volume of the device to mitigate the problem of sensitivity change with atmospheric pressure changes. The resulting high-pass response is controlled by the size of the leak and the size of the back volume. Thus, by adjusting the leak size, one can control the high-pass cutoff frequency of the microphone device. Current MEMS microphone devices can control the size of this leak and therefore accurately control the high-pass cutoff frequency. Wind noise contains very large acoustic-pressure fluctuations at low frequencies. As a result, microphones (and especially differential directional microphones) are susceptible to both low-frequency electrical and acoustic overload in wind. One way to combat the overload is to use microphone devices that naturally have a mechanical high-pass response so that the high level of low-frequency wind excitation is acoustically short-circuited by the atmospheric leak. The advantage of having a larger vent leak is that the mechanical motion of the microphone diaphragm can be greatly reduced and therefore can significantly reduce wind-induced overload in the microphone device. A disadvantage of having a permanent, higher-frequency, high-pass cutoff is that, for no air flow, desired acoustic low frequencies are attenuated. By combining two or more microphone devices with different cutoffs, one could dynamically transition to using the best set of microphone devices for the current conditions, e.g., wide-band when there is no wind or more high-passed when the wide-band microphone devices are overloaded by wind and air flow over the devices.
Although
Although microphone arrays have been discussed that have microphone devices mounted on only one side of the flexible PCB, in alternative embodiments, devices can be mounted on both sides of the flexible PCB. If one adds the output signals from devices on both PCB sides, then the vibration induced and acoustic coupling due to the acoustic radiation from the vibration of the PCB will subtract (due to the 180-degree flip in phase), but the desired acoustic-pressure signal will sum. Thus, by this technique, one could remove undesired vibration signals from the microphone output, even for extremely complex vibration of the PCB.
The geometry shown in
Microphone devices can be even more densely configured by mounting devices in a staggered manner (similar to that represented in
Although
As described previously, the output signals from different subsets of microphone devices can be combined (e.g., summed in analog or digital) to form element output signals corresponding to different microphone elements, and the element output signals can then be combined (e.g., by weighted summation) into a single, composite, array output signal for the overall microphone array. Such summing and/or weighted summation can be performed using summing op-amp circuits (not shown) that are also mounted onto the flexible PCB. In addition, analog-to-digital (A/D) converters can be placed close to the microphone devices to improve EMI performance of the microphone array. Passive or digital combining of the device output signals allows one to route only the resulting element output signals for further (either on-board or off-board) processing. Digitizing near the devices allows one to place the digital, element output signals onto a time-division multiplexed (TDM) bus. Some common A/D codecs allow “daisy-chaining” of the codecs which would allow a single, digital serial bus to contain all of the composite element output signals. The codecs could be distributed on the flexible PCB near the devices while sharing the common serial bus. Other types of electronic devices, such as (without limitation) ASICs, FPGAs, and/or DSPs can also be mounted onto the flexible PCB to process signals generated by the different microphone devices, sub-elements, and/or elements.
Relatively inexpensive, digital, surface-mount microphone devices are becoming available. First-generation devices use a pulse-density modulated (PDM) data stream running at a few megahertz capable of sharing two channels of audio in the serial interface. Interestingly, a PDM serial bit-stream can also be used to perform the element summation of the microphone devices in the digital bit domain. The resulting digital, element output signal is then fed as a single PDM stream or an Integrated Interchip Sound (I2S) output TDM stream to other devices for further processing. Processing in the PDM domain could potentially lower the individual cost of the surface-mount microphone devices.
Downsampling (decimating) the PDM digital stream is trivial for some input codecs since the PDM signal is a standard operation for the front-end of modern delta-sigma converters. Since the bit-serial data stream is at a relatively high rate, downsampling the data stream can be handled by FPGA processing, which converts the high bit-rate serial stream into a lower bit-rate serial stream for a standard DSP chip. DSP chipsets used for audio signal processing use a more-flexible I2S serial interface that supports multiple simultaneous channels of digital audio. Manufacturers of digital surface-mount microphone devices are now beginning to design devices with I2S output, thereby making microphone arrays with more than two microphone devices more simple to build. External chips would be used to frame the multichannel digital stream for DSP serial input. Future microphone-interface designs may allow “daisy chaining” of the digital stream to enable lower-cost microphone-array applications. Although the digital data rate used to transmit all device output signals is higher than the composite analog element output signals described earlier, having individual output signals from each microphone device would enable more-dynamic and more-flexible grouping of the microphone devices into elements and sub-elements.
Polyhedral Arrays Formed using Flexible PCBs
The microphone arrays of
Although not shown in the figures, flexible PCB 402 of
In this way, 3D microphone array 400 can be used to implement a spherical Eigenmike® microphone array, such as those described in U.S. Pat. No. 7,587,054 (Elko et al.), the teachings of which are incorporated herein by reference. Every triangular face can be further subdivided into sub-sections so that smaller clusters of microphone devices can be combined to allow more flexibility in combining clusters to achieve spatial low-pass filtering and combat spatial-aliasing effects at high frequencies. Smaller cluster combinations allow control of the spatial response at frequencies using filter-sum beamforming where the impact of spatial aliasing precludes the use of Eigenbeam-forming.
Note that flexible PCBs corresponding to planar segmentations of a Pentakis dodecahedron different from that shown in
Building a complete microphone array from one flexible PCB enables all electrical connections to be made on a single PCB. There may, however, be advantages in providing microphone sub-arrays that can be connected to form larger, more-complex microphone array assemblies. One way to visualize these smaller sub-arrays is to think of them as pieces of a two- or even three-dimensional puzzle. Depending on the implementation, the sub-arrays could all have the same shape or different sub-arrays could have different shapes. Providing different sub-arrays with different shapes would enable even more-complex structures to be built. In any case, the sub-arrays would be constructed as modules that physically interlock with one another like pieces of a puzzle.
Depending on the implementation, the different sub-arrays 500 could have electrical contacts at their edges that would allow electrical signals to flow between interconnected sub-arrays whose electrical contacts are mated with one another. In one implementation, the electrical contacts are at the edges of the rigid, circular PCB sections 504 and at corresponding locations at the edges of the cut-out portions 508. In this way, common electrical signals, such as power and ground, and even locally generated signals could flow between the interconnected sub-arrays.
Analogous to
In addition to the roughly square and triangular shapes represented in
Although this interlocking has been described in the context of sub-arrays having multiple rigid PCB sections interconnected by flexible PCB regions, where a rigid PCB section and a corresponding flexible PCB region of one sub-array fits within a cut-out portion of another sub-array, interlocking can also be implemented in other contexts. For example, interlocking could involve one or both sub-arrays being entirely flexible. Interlocking could also involve one of the sub-arrays being entirely rigid, as long as the other sub-array is at least partially flexible.
Instead of different sub-arrays having interlocking members, as in
Although this overlapping has been described in the context of sub-arrays having multiple rigid PCB sections interconnected by flexible PCB regions, where a rigid PCB section of one sub-array overlaps with a rigid PCB section of another sub-array, overlapping can also be implemented in other contexts. For example, one or both of the overlapping portions could be or could include one or more of the flexible PCB regions. Moreover, overlapping could involve one or both sub-arrays being entirely flexible. Overlapping could also involve one of the sub-arrays being entirely rigid, as long as the other sub-array is at least partially flexible.
Note that, in alternative embodiments, the first signal-combining stage 704 and/or the second signal-combining stage 706 may be omitted. Note further that, depending on the implementation, zero, one, or more of the initial signal-combining stages may be performed by devices (e.g., summing op-amp circuits) mounted on the flexible PCB, while the rest of the signal-combining stages (if any) are performed by one or more processors located external to the flexible PCB. Note further still that, depending on the implementation, the signal combination performed by one or more of the signal-combining stages may be weighted or unweighted signal differencing, instead of summation.
Acoustic Advantages to using Flexible PCBs for Microphone Arrays
Although the basic microphone array structure is based on surface-mounted microphone devices on a flexible PCB, other types of electronic devices can also be incorporated on the flexible PCB, such as (without limitation) gyroscopes, accelerometers, cameras, vibration sensors, pressure sensors, capacitive sensors, temperature sensors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), complex programmable logic devices (CPLDs), digital signal processors (DSPs), and advanced RISC (reduced instruction set computer) machines (ARMs). For example, one could mount commonly available, small, single-axis or multi-axis accelerometers and/or gyroscopes. One could also add capacitive and/or pressure-sensitive sensors to the flexible PCB to detect how the device is being held and/or determine the distribution of force over the surface. Having small accelerometers that can be placed extremely close to the acoustic-sensing microphone devices on the flexible PCB would be advantageous since the sampling distance can be made very small.
Also, by using vibration, gyroscoping, and pressure and capacitive sensors, a user can dynamically change the operation of the microphone array by either vibration, orientation, or touch, where it would also be possible to use all of these sensors in parallel. Providing human “gesture” recognition as part of the microphone array, by using auxiliary sensors on the same flexible PCB, could open up many new modalities for microphone control such as near-field effect removal or enhancement, dynamic control of equalization, compression, effects processing, beampattern control, and similar modification of the microphones acoustic and electrical response. It might also be advantageous to detect undesired vibration and adaptively subtract out the undesired, coupled acoustic response due to the vibration. By allowing multiple mechanical sensing devices, it might also be possible to isolate specific types of undesired vibration energy that get into the acoustic or electrical response of the microphone.
With a large array of microphone devices distributed over a reasonable area, it is possible that the acoustic signals from clusters of devices can be used to determine how the array is being held. One can use this physical information to effect a modification on how the microphone operates. The general idea is to use acoustic information from the clusters of microphone devices to control the post-processing chain (like equalization, gain, proximity control, directivity control, or a preprogrammed change in operation, etc.). For example, it would be possible to turn the microphone array into a flute or some other musical instrument where touch is determined by many microphone devices that are used, along with acoustic excitation, for control and modification of dynamic signal generation.
As used in this specification, the terms “printed circuit board” and “PCB” are intended to refer generally to any structure used to mechanically support and electrically connect electronic components using conductive pathways, tracks, or signal traces etched from (e.g., copper) sheets laminated onto a non-conductive substrate. Synonyms for printed circuit boards include printed wiring boards and etched wiring boards.
For purposes of this description, the terms “couple,” “coupling,” “coupled,” “connect,” “connecting,” or “connected” refer to any manner known in the art or later developed in which energy is allowed to be transferred between two or more elements, and the interposition of one or more additional elements is contemplated, although not required. Conversely, the terms “directly coupled,” “directly connected,” etc., imply the absence of such additional elements.
It should be appreciated by those of ordinary skill in the art that any block diagrams herein represent conceptual views of illustrative circuitry embodying the principles of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudo code, and the like represent various processes which may be substantially represented in computer readable medium and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
Unless explicitly stated otherwise, each numerical value and range should be interpreted as being approximate as if the word “about” or “approximately” preceded the value of the value or range.
It will be further understood that various changes in the details, materials, and arrangements of the parts which have been described and illustrated in order to explain the nature of this invention may be made by those skilled in the art without departing from the scope of the invention as expressed in the following claims.
The use of figure numbers and/or figure reference labels in the claims is intended to identify one or more possible embodiments of the claimed subject matter in order to facilitate the interpretation of the claims. Such use is not to be construed as necessarily limiting the scope of those claims to the embodiments shown in the corresponding figures.
It should be understood that the steps of the exemplary methods set forth herein are not necessarily required to be performed in the order described, and the order of the steps of such methods should be understood to be merely exemplary. Likewise, additional steps may be included in such methods, and certain steps may be omitted or combined, in methods consistent with various embodiments of the present invention.
Although the elements in the following method claims, if any, are recited in a particular sequence with corresponding labeling, unless the claim recitations otherwise imply a particular sequence for implementing some or all of those elements, those elements are not necessarily intended to be limited to being implemented in that particular sequence.
Reference herein to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments necessarily mutually exclusive of other embodiments. The same applies to the term “implementation.”
The embodiments covered by the claims in this application are limited to embodiments that (1) are enabled by this specification and (2) correspond to statutory subject matter. Non-enabled embodiments and embodiments that correspond to non-statutory subject matter are explicitly disclaimed even if they fall within the scope of the claims.
This application is a continuation of U.S. application Ser. No. 13/516,842, filed on Jun. 18, 2012 as attorney docket no. 1053.012 and based on PCT application serial no. PCT/US10/61445, filed on Dec. 21, 2010 as attorney docket no. 1053.012PCT, which claims the benefit of the filing dates of U.S. provisional application No. 61/289,033, filed on Dec. 22, 2009 as attorney docket no. 1053.012PROV1, and U.S. provisional application No. 61/299,019, filed on Jan. 28, 2010 as attorney docket no. 1053.012PROV2, the teachings of both of which are incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
61299019 | Jan 2010 | US | |
61289033 | Dec 2009 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13516842 | Jun 2012 | US |
Child | 15059329 | US |