MULTI-DIMENSIONAL ARRAY MICROPHONE

Abstract
Embodiments include an array microphone, comprising: a plurality of microphone boards arranged in a linear pattern along a first axis and comprising a plurality of microphone elements configured to cover a plurality of frequency bands, each microphone board comprising: a first linear array comprising a first microphone element of the plurality of microphone elements and one or more second microphone elements of the plurality of microphone elements, the first microphone element located on the first axis and the one or more second microphone elements located on a second axis orthogonal to the first axis, and a second linear array comprising the first microphone element and one or more third microphone elements of the plurality of microphone elements, the one or more third microphone elements located on a third axis orthogonal to the first axis and to the second axis.
Description
TECHNICAL FIELD

This application generally relates to an array microphone. In particular, this application relates to a multi-dimensional array microphone configured to provide improved frequency-dependent directivity.


BACKGROUND

Audio environments, such as conference rooms, boardrooms, and other meeting rooms, video conferencing settings, and the like, can involve the use of one or more microphones to capture sound from various audio sources active in the environment. The audio sources may include in-room human speakers, for example. The captured sound may be disseminated to a local audience in the environment through speakers (for sound reinforcement) and/or to others located remotely (such as via a telecast, webcast, or the like). For example, persons in a conference room may be conducting a conference call with persons at a remote location.


In general, microphones and other audio capturing devices, such as, e.g., conferencing devices, are available in a variety of sizes, form factors, mounting options, and wiring options to suit the needs of particular environments. Moreover, the microphones can be designed to produce different polar response patterns, including, for example, omnidirectional, cardioid, subcardioid, supercardioid, hypercardioid, and bidirectional. The types of conferencing devices, their operational characteristics (e.g., lobe direction, gain, polar pattern, etc.), and their placement in a particular audio environment may depend on a number of factors, including, for example, the locations of the audio sources, locations of listeners, the desire to exclude unwanted noises, physical space requirements, aesthetics, room layout, and/or other considerations. As an example, in some environments, a conferencing device may be placed on a table or lectern to be near the audio sources and/or listeners. In other environments, a conferencing device may be mounted overhead or on a wall to capture the sound from, or project sound towards, the entire room, for example.


Micro-Electrical-Mechanical-System (“MEMS”) microphones, or microphones that have a MEMS element as the core transducer, have become increasingly popular due to their smaller package size, thus enabling the audio device to have a smaller, thinner profile overall (e.g., compared to traditional microphones like dynamic, crystal, condenser/capacitor, boundary, button, etc.); high performance characteristics (e.g., high signal-to-noise ratio (“SNR”), low power consumption, good sensitivity, etc.); lower cost (e.g., compared to electret or condenser microphone cartridges); and general ease of assembly. While a conventional MEMS microphone, by itself, has an inherently omnidirectional polar pattern (i.e. the microphone is equally sensitive to sounds coming from any and all directions, regardless of the microphone's orientation), placing MEMS microphones in an array configuration, and applying appropriate beamforming techniques (e.g., signal processing), can produce a directional response, or a beam pattern that is more sensitive to sound coming from one or more specific directions than sound coming from other directions.


SUMMARY

The techniques of this disclosure provide systems and methods designed to, among other things, (1) provide an array microphone with a three-dimensional structure and microphone layout that has improved directivity transverse to the axis of the array, (2) steerable control of the array's direction of greatest sensitivity to any point at any azimuth and elevation around a sphere surrounding the center of the array, using appropriate beamforming techniques, thus providing increased ability to direct the array to where it is most effective at collecting sound, as well as generation of nulls, and (3) high performance acoustic characteristics suitable for conferencing environments, stage, sports, and other entertainment environments, including selective coverage of the stage or audience and/or isolation of ambience from game audio, and live sound reinforcement.


For example, one embodiment includes an array microphone comprising a plurality of microphone boards arranged in a linear pattern along a first axis and comprising a plurality of microphone elements configured to cover a plurality of frequency bands, each microphone board comprising: a first linear array comprising a first microphone element of the plurality of microphone elements and one or more second microphone elements of the plurality of microphone elements, the first microphone element located on the first axis and the one or more second microphone elements located on a second axis orthogonal to the first axis, and a second linear array comprising the first microphone element and one or more third microphone elements of the plurality of microphone elements, the one or more third microphone elements located on a third axis orthogonal to the first axis and to the second axis. According to various aspects, the linear pattern can be configured to place the microphone boards in a harmonically-nested configuration for covering the plurality of frequency bands.


Another example embodiment provides an array microphone comprising a plurality of microphone boards arranged in a first linear pattern along a first axis of the array microphone, the plurality of microphone boards comprising a plurality of microphone elements configured to cover a plurality of frequency bands, each microphone board comprising: a first microphone element of the plurality of microphone elements located on the first axis; one or more second microphone elements of the plurality of microphone elements located on a second axis of the microphone board, the second axis being orthogonal to the first axis; and one or more third microphone elements of the plurality of microphone elements located on a third axis of the microphone board, the third axis being orthogonal to the first axis and to the second axis, wherein the first microphone elements of the plurality of microphone boards are configured to form the first linear pattern along the first axis, and for each microphone board, the first microphone element and the one or more second microphone elements are configured to form a second linear pattern along the second axis of the corresponding microphone board, and the first microphone element and the one or more third microphone elements are configured to form the second linear pattern along the third axis of the corresponding microphone board.


Another example embodiment provides a microphone system, comprising: an array microphone comprising a plurality of microphone elements arranged on a plurality of microphone boards, the array microphone configured to provide audio coverage for a plurality of frequency bands; and one or more audio processors in communication with the array microphone and comprising one or more beamformers, the one or more audio processors being configured to, using the one or more beamformers: steer an audio pick-up lobe of the array microphone towards an audio source detected at a first point; and generate an audio output based on audio signals generated by the audio source and captured using the audio pick-up lobe, wherein the one or more beamformers are configured for steering the audio pick-up lobe towards any one of a plurality of points located on a sphere surrounding a center of the array microphone, the plurality of points comprising the first point. According to some aspects, the plurality of points are located at different azimuths and elevations around the sphere. According to some aspects, the plurality of points cover a solid angle of four times pi steradians. According to some aspects, the audio pick-up lobe comprises a direction of highest sensitivity for the array microphone.


These and other embodiments, and various permutations and aspects, will become apparent and be more fully understood from the following detailed description and accompanying drawings, which set forth illustrative embodiments that are indicative of the various ways in which the principles of the invention may be employed.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a schematic diagram of an exemplary array microphone placed in a horizontal orientation, in accordance with one or more embodiments.



FIG. 2 is a side view of the array microphone of FIG. 1, in accordance with one or more embodiments.



FIG. 3A is a top view of the array microphone of FIG. 1, in accordance with one or more embodiments.



FIG. 3B is partial close-up view of a primary array included in the array microphone of FIG. 3A, in accordance with one or more embodiments.



FIG. 4 is a schematic diagram of the array microphone of FIG. 1 placed in a vertical orientation, in accordance with one or more embodiments.



FIG. 5A is a schematic diagram of an exemplary microphone board placed in a vertical orientation, in accordance with one or more embodiments.



FIG. 5B is a schematic diagram of the microphone board of FIG. 5A placed in a horizontal orientation, in accordance with one or more embodiments.



FIG. 6 is a schematic diagram of an exemplary microphone board oriented relative to XYZ axes, in accordance with one or more embodiments.



FIG. 7 is a schematic diagram of a first plane of the array microphone of FIG. 1, in accordance with one or more embodiments.



FIG. 8 is a schematic diagram of a first plane of another exemplary array microphone, in accordance with one or more embodiments.



FIG. 9 is a block diagram of an exemplary audio system comprising an array microphone, in accordance with one or more embodiments.



FIG. 10 is a block diagram of the array microphone and beamformer included in the audio system of FIG. 9, in accordance with embodiments.



FIG. 11 is a block diagram of an exemplary sum and difference beamformer included in the beamformer of FIG. 10, in accordance with embodiments.



FIG. 12 is a block diagram of an exemplary pattern-forming beamformer included in the beamformer of FIG. 10, in accordance with embodiments.





DETAILED DESCRIPTION

In general, array microphones are comprised of multiple microphone elements aligned in a specific pattern or geometry (e.g., linear, circular, etc.) and configured to operate as a single microphone device. For example, a linear array microphone is comprised of microphone elements situated relatively close together along a single axis. Array microphones can have different configurations and frequency responses depending on the placement of the microphone elements relative to each other and the direction of arrival for sound waves. The directionality of array microphones can also provide steerable coverage, or pick up patterns that focus on desired audio sources and reject unwanted sounds, such as room noise, and this steerability can enable pick up of multiple audio sources with a single array or device. For example, a broadside linear array comprised of a line of MEMS microphones arranged perpendicular to the preferred direction of sound arrival can achieve a desired pickup pattern using a delay and sum beamformer to combine the signals from the various microphone elements accordingly. In some broadside arrays, the microphone elements are placed in nested pairs about a central point and may be spaced apart from each by certain predetermined distances in order to cover a variety of frequencies.


Systems and methods are provided herein for a multi-dimensional array microphone that has added directivity for most, if not all, frequencies in all dimensions. In particular, the array microphone comprises a first plurality of microphone elements arranged in a linear pattern along a first axis, a second plurality of differential and complementary microphone elements arranged along a second perpendicular axis, and a third plurality of differential and complementary microphone elements arranged along a third, mutually perpendicular axis. The linear pattern can be configured to place the first plurality of microphone elements in a harmonically-nested configuration for covering a plurality of frequency bands. The second and third pluralities of microphone elements can be configured to form second and third linear patterns, respectively, that are mirror images of each other. This geometry provides not only array control perpendicular to the first axis (or the axis of the array microphone) but also, control around the axis of the array, such that the direction of maximum or greatest microphone sensitivity can be pointed towards any location at any azimuth and elevation within a sphere surrounding the center of the array, or covering a solid angle of 4*pi steradians, using appropriate beamforming techniques. For example, in embodiments, microphone elements along two or more axes can be combined to generate any first-order pattern (e.g., cardioid, toroidal, etc.) steered to any direction about the defined sphere in order to capture a desired sound source, or generate a null for rejecting an unwanted sound source.


Moreover, the multi-dimensional form factor of the array microphone is provided by arranging the microphone elements on a plurality of microphone boards (e.g., made of printed circuit board (PCB) substrate or the like) that are structurally independent but electrically linked together and configured to minimize the impacts of the array structure on the incident acoustic field. For example, in embodiments, each board is aligned with the first axis at a central point for supporting a respective one of the first plurality of microphones and has a predefined shape that extends out from that point and is configured to support the second plurality of microphones along the second axis and support the third plurality of microphones along the third axis. The multi-dimensional structure is further configured to minimize the total number of microphone elements used and the amount of PCB substrate used, so as to reduce the diffraction and geometric shading that would otherwise be present in a three-dimensional array, all while improving the directivity and flexibility of the array.



FIGS. 1 through 3B illustrate an exemplary array microphone 100 for detecting sounds from one or more audio sources at various frequencies, such as speech spoken by human speakers, in accordance with embodiments. The array microphone 100 may be utilized in a conferencing environment, such as, for example, a conference room, a boardroom, or other meeting room, in an entertainment environment, such as, for example, a stage, a sports arena, or other live performance venue, or any other environment where the audio sources may include one or more human speakers or talkers. Other sounds may be present in the environment which may be undesirable, such as ambient noises and/or noises from ventilation systems, other persons (e.g., audience members, non-participants of the conference call, etc.), audio/visual equipment, electronic devices, etc. In a conferencing situation, the audio sources may be seated in chairs at a table, although other configurations and placements of the audio sources are contemplated and possible, including, for example, audio sources that move about the room. Similarly, in a live performance situation, the audio sources may be located on one or more stages or other performance areas, at designated positions and/or may move about the stage or between stages.


The array microphone 100 comprises a plurality of microphone elements 102 (also referred to herein as “transducers” and “cartridges”) capable of forming multiple pickup patterns in order to optimally or consistently detect and capture sound from the audio sources. The polar patterns that can be formed by the array microphone 100 may depend on the placement of the microphone elements 102 within the array 100, as well as the type of beamformer(s) used to process the audio signals generated by the microphone elements 102. For example, a sum and differential beamformer may be used to form a cardioid, subcardioid, supercardioid, hypercardioid, bidirectional, and/or toroidal polar pattern directed to a desired sound source. Additional polar patterns may be created by combining the original polar patterns, and the combined pattern can be steered to any angle along the plane of, for example, the table on which the array microphone 100 rests, the wall on which the array microphone 100 is mounted, or other plane that is perpendicular to the axis of the array microphone 100. In some embodiments, a combination of beamforming techniques can be used to steer the direction of highest sensitivity to any direction at any azimuth and elevation around a sphere that surrounds the center of the array, or to cover a solid angle of 4*pi steradians. Other beamforming techniques may be utilized to combine the outputs of the microphone elements 102, so that the overall array microphone 100 achieves a desired frequency response, including, for example, lower noise characteristics, higher microphone sensitivity, and coverage of discrete frequency bands, as described in more detail herein. More description of the beamforming techniques used with the array microphone 100 is provided below with reference to FIGS. 10 through 12.


In preferred embodiments, each of the microphone elements 102 may be a MEMS (micro-electrical mechanical system) transducer with an inherent omnidirectional polar pattern. In some embodiments, the microphone elements 102 may be any type of omnidirectional microphone. In other embodiments, the microphone elements 102 may have other polar patterns and/or may be condenser microphones, dynamic microphones, piezoelectric microphones, or other types of traditional microphones. In still other embodiments, the arrangement and/or processing techniques described herein can be applied to other types of arrays comprised of omnidirectional transducers or sensors where directionality is desired (such as, e.g., sonar arrays, radio frequency applications, seismic devices, etc.). Also, although FIG. 1 shows a specific number of microphone elements 102, other amounts of microphone elements (e.g., more or fewer) are possible and contemplated.


Each of the microphone elements 102 can detect sound and convert the sound into an audio signal. In some cases, the audio signal can be a digital audio output (e.g., MEMS transducers). For other types of microphones, the audio signal may be an analog audio output, and components of the array microphone 100, such as analog to digital converters, processors, and/or other components, may process the analog audio signals to ultimately generate one or more digital audio output signals. The digital audio output signals may conform to the Dante standard for transmitting audio over Ethernet, in some embodiments, or may conform to another standard. In certain embodiments, one or more pickup patterns may be formed by a processor of the array microphone 100 from the audio signals of the microphone elements 102, and the processor may generate a digital audio output signal corresponding to each of the pickup patterns. In other embodiments, the microphone elements 102 may output analog audio signals and other components and devices (e.g., processors, mixers, recorders, amplifiers, etc.) external to the array microphone 100 that may process the analog audio signals.


As shown in FIG. 1, the array microphone 100 comprises a plurality of microphone boards 104 configured to comprise or support the plurality of microphone elements 102. The plurality of microphone boards 104 (also referred to as “unit cells”) may be enclosed in a housing 106, which is only partially shown in each of FIGS. 1 through 3 for ease of illustration, as will be appreciated. The microphone elements 102 may be mechanically and/or electrically coupled to the microphone boards 104. The microphone boards 104 (also referred to as “supports”) may be independent structures that are mechanically attached to the housing 106 and electrically coupled to each other and/or one or more processors or other electronic devices for receiving and processing audio signals captured by the microphone elements 102 (see, e.g., system 300 of FIG. 9). The microphone boards 104 may be made of a printed circuit board (“PCB”), a PCB substrate, or other suitable substrate or material. The housing 106 may be made of aluminum, plastic, or any other suitable material. While the illustrated embodiment shows the housing 106 as having a generally rectangular shape, in other embodiments the housing may have any other suitable shape or design. In some embodiments, two or more microphone boards 104 may be combined (e.g., side by side) to form a single unit, for example, in order to decrease the total number of boards 104.


The plurality of microphone boards 104 can be configured to position the microphone elements 102 in three-dimensional space so that they collectively form a multi-dimensional array configured to cover a plurality of frequency bands (e.g., 20 hertz (Hz)≤f≤20 kilohertz (kHz)). In particular, each microphone board 104 may have a matching or uniform shape comprised of multiple sides or surfaces for positioning the microphone elements 102 in different dimensions, as well as a bottom or back side for positioning the overall board 104 in an upright manner. For example, in the illustrated embodiment, the microphone boards 104 have a generally triangular shape with three sides meeting to form three corners. A first side 108 of each board 104 is attached to a mounting surface 106a of the housing 106, while the other two sides 110 and 112 are freestanding and substantially perpendicular to the mounting surface 106a. As shown, the microphone elements 102 may be included on the freestanding sides 110 and 112 of the microphone boards 104, while the first side 108 (also referred to herein as a “plain side”) may have no microphone elements 102 thereon. This arrangement ensures that the microphone elements 102 are positioned in free space and, for example, away from any circuitry near the mounting surface 106a or other part of the housing 106. In other embodiments, the microphone boards 104 may be configured to form any other shape capable of implementing the techniques described herein.


According to embodiments, the array microphone 100 can produce a substantially consistent frequency response across a variety of settings or orientations, including, for example, whether mounted on a wall or other vertical surface, placed on a table, desktop, lectern, or other horizontal surface, or attached to a ceiling. That is, regardless of the array orientation, the audio pick-up lobes of the array microphone 100 can be directed towards a desired sound source with increased rear rejection and steering control, or isolated forward acceptance, thus improving the array's ability to reject unwanted sound sources and reflections in the room and provide a high signal to noise ratio (SNR) in any dimension.


To illustrate, FIGS. 1 through 3B show the array microphone 100 arranged in a horizontal orientation, or where the mounting surface 106a of the housing 106 is placed flat on a horizontal surface (not shown), while FIG. 4 shows the array microphone 100 arranged in a vertical orientation, or where the mounting surface 106a is placed flat against a vertical surface. As shown in FIGS. 5A and 5B, a given sound source 113 may impact the array microphone 100 at different angles, or have different directions of arrival relative to the array, depending on whether the boards 104 are oriented vertically or horizontally. For example, when the array microphone 100 is placed in the horizontal orientation, as in FIG. 5B, the sound source 113 may be directed towards one side 112 of the microphone boards 104, and when the array microphone 100 is placed in the vertical orientation, as in FIG. 5A, the sound source 113 may be directed towards a center 114 of the microphone boards 104, or perpendicular to a first axis 115 of the array (also referred to herein as the “axis of the array” and shown in FIG. 3A). In embodiments, the array microphone 100 can be configured, using the microphone placement and beamforming techniques described herein, to steer a main lobe or sound beam to any location within a plane 116 that is perpendicular to the axis 115 of the array. In some embodiments, additional beamforming techniques may be used to steer the main lobe to any direction at any azimuth and elevation around a sphere surrounding the center of the array, thus allowing the array microphone 100 to optimally capture the sound source 113 while in any orientation. The array microphone 100 can also use similar techniques to isolate or reject sound sources (e.g., unwanted talkers or other noise sources) coming from other directions within the plane 116, or the defined sphere, as described herein.


According to embodiments, dividing the microphone elements 102 across multiple microphone boards 104 that are structurally and physically separate allows for a more efficient use of the copper lines or wires, and minimizes or reduces an impact of the overall array structure on an incident acoustic field. Minimizing the structural footprint of the array microphone 100 also reduces the diffraction, resonance, and geometric shading, or shadowing effects, that would otherwise be present in a three-dimensional array structure, as will be appreciated. In embodiments, the microphone boards 104, themselves, are also configured to have minimal interactions with the incident acoustic field by reducing the structural footprint of each board 104. For example, as shown, each microphone board 104 has a cut-out or open center 117 to minimize the amount of PCB substrate, or other material, used to create the structure of the board 104. In some embodiments, the open center 117 may be configured (e.g., sized and shaped) to be as large as possible while still leaving enough room on the board 104 for placement and/or attachment of the microphone elements 102 and to maintain a structural integrity of the board 104. Similarly, a thickness of each microphone board 104 may be selected to further minimize interactions with the incident acoustic field while also maintaining the structural integrity and stability of the board 104.


In embodiments, the microphone boards 104 can be linearly arranged along a length of the array microphone 100, or its housing 106, and perpendicular to a preferred or expected direction of arrival for incoming sound waves, so as to form a linear pattern along the first axis 115 (or common axis) of the array microphone 100. For example, as shown in FIG. 3A, the linear pattern may be formed by aligning the center 117 of each board 104 with the first axis 115 and arranging the boards 104 substantially parallel to each other, or to an axis 119 that is orthogonal to the first axis 115 and parallel to the mounting surface 106a of the housing 106. As illustrated, the linear pattern is configured such that the plurality of microphone boards 104 comprises a central microphone board 104a, a first group of microphone boards 104b arranged on one side of the central microphone board 104a in a first pattern, and a second group of microphone boards 104c arranged on an opposite side of the central microphone board 104a in a second pattern that is a mirror image of the first pattern.


According to embodiments, the linear pattern formed by the microphone boards 104 along the first axis 115 can be configured to place the microphone boards 104 in a harmonically-nested configuration for covering a desired plurality of frequency bands, using one or more beamformers or other audio processing techniques. For example, the linear pattern formed by the microphone boards 104 can be configured to operate in different octaves (e.g., 600-1200 Hertz (Hz), 1200-2400 Hz, 2400-4800 Hz, etc.) within the covered plurality of frequency bands, so that the overall beam pattern for the array microphone 100 remains essentially constant from octave to octave. In some embodiments, the linear pattern may be implemented using a sub-band-based scaled aperture (SSA) approach that uses a different array aperture for each octave, so that progressively lower frequency octaves are processed by progressively wider linear arrays. In order to enhance spatial resolution, the aperture of the linear array formed by the microphone boards 104 may be doubled when moving from a higher octave to the next lower one (e.g., as shown in FIG. 7 and described in more detail below).


As best seen in FIG. 3A, each microphone board 104 comprises a select number of the plurality of microphone elements 102, with the central microphone board 104a comprising a largest number of microphone elements 102 (e.g., nine) and the other microphone boards 104b and 104c comprising a fewer number of microphone elements 102 (e.g., three or five). In embodiments, each microphone board 104 is configured to contain all of the microphone elements 102 that are necessary to build a functional array at the given location of the board 104 along the first axis 115. Thus, the exact number of microphone elements 102 included on each microphone board 104 may vary depending on a number of factors, such as, for example, a placement of the board 104 within the linear pattern formed by the plurality of microphone boards 104, a linear aperture of the overall array microphone 100, the plurality of frequency bands covered by the array microphone 100, a size and/or type of the microphone elements 102, a size and/or shape of the microphone boards 104, and/or a spacing between adjacent microphone boards 104, as described in more detail below. In embodiments, because the total number of microphone elements 102 that may be included on any given microphone board 104 will be nine or less, the audio signals captured by each microphone board 104 can be multiplexed into a TDM16 stream in all cases, or can be split into a TDM16 stream for the central microphone board 104a (which has the maximum number of microphone elements 102) and TDM8 streams for the rest of the microphone boards 104b and 104c. This can help minimize the use of copper wire or lines in each microphone board 104 and/or between the boards 104.


As also shown in FIG. 3A, each of the plurality of microphone boards 104 comprises a first microphone element 102a that is disposed on the first axis 115, or otherwise at or near the center 114 of the microphone board 104. As further shown by the close-up view in FIG. 3B, because of this placement at the center 114, the first microphone elements 102a may be linearly arranged along the first axis 115 to form the same linear pattern as the microphone boards 104. In various embodiments, the first microphone elements 102a may be configured to collectively form a primary array 118 that helps generate consistent behaviors during steering, while maximizing reuse of the microphone elements 102a and minimizing total microphone count within the primary array 118. For example, as shown in FIG. 3B, the primary array 118 may be comprised of eleven first microphone elements 102a arranged to form four harmonically-nested sub-arrays, each sub-array comprising a select five of the first microphone elements 102a (as further described below with respect to FIG. 7).


Referring additionally to FIG. 6, an exemplary microphone board 104 is shown oriented relative to XYZ axes, for ease of explanation. In particular, as shown, the center 114 of the board 104 aligns with a center (0, 0, 0) of the XYZ axes, and the axis of the array (e.g., first axis 115) aligns with the X-axis. In order to orient the rest of the board 104 to the XYZ axes, the microphone board 104 may be rotated about the first axis 115 so that the two sides 110 and 112 are aligned with the Z and Y axes, respectively. It should be appreciated that during use, the microphone board 104 may be oriented at different angles relative to the center of the XYZ axes depending on the orientation of the array microphone 100, for example, as shown in FIGS. 5A and 5B. Moreover, while FIG. 6 specifically shows the central microphone board 104a, similar principles may be used for placement of microphone elements 102 on one or more of the other microphone boards 104b and 104c.


According to embodiments, each microphone board 104 comprises a first linear array 120 disposed along a second axis 121 (e.g., the Y axis) that is orthogonal to the first axis 115 (e.g., the X axis) and a second linear array 122 disposed along a third axis 123 (e.g., the Z axis) that is orthogonal to both the first axis 115 and the second axis 121, as shown in FIG. 6. On each board 104, the first linear array 120 comprises the first microphone element 102a, which is disposed on the first axis 115 and at the center 114 of the board 104, and one or more second microphone elements 102b of the plurality of microphone elements 102, the second microphone elements 102b being disposed on the second axis 121 that is orthogonal to the first axis 115. Similarly, the second linear array 122 on each board 104 comprises the same first microphone element 102a and one or more third microphone elements 102c of the plurality of microphone elements 102, the third microphone elements 102c being disposed on the third axis 123 that is orthogonal to both the first axis 115 and the second axis 121. In embodiments, the first microphone elements 102a may be reused in each of the secondary arrays 120 and 122 and to create the primary array 118, so that the total number of microphone elements 102 included in the array microphone 100 is reduced, thus increasing efficiency and performance of the array while also reducing costs and complexity, as will be appreciated.


The secondary arrays 120 and 122 can be configured to form differential arrays along the second axis 121 and the third axis 123, respectively, based on harmonic nesting techniques, as described in more detail with respect to FIG. 7. As shown in FIG. 6, the first linear array 120 and the second linear array 122 may be disposed substantially perpendicular to each other and to the primary array 118 formed along the first axis 115. In addition, on each microphone board 104, the second linear array 122 along the third axis 123 may be configured as a mirror image of the first linear array 120 along the second axis 121. For example, as shown in FIG. 6, the first microphone element 102a is located a distance d from a first one of the second microphone elements 102b along the second axis 121. Likewise, the first microphone element 102a is located the same distance d from a first one of the third microphone elements 102c along the third axis 123. A similar correspondence may be present for each of the other microphone elements 102b and 102c, as well as in each of the other microphone boards 104b and 104c, for example, as seen in FIG. 3A when comparing the microphone elements 102 located above the first axis 115 to the microphone elements 102 located below the first axis 115. In embodiments, on each microphone board 104, a distance along the second axis 121 between the first microphone element 102a and each of the one or more second microphone elements 102b may be configured based on respective octaves of the plurality of frequency bands, and a distance along the third axis 123 between the first microphone element 102a and each of the one or more third microphone elements 102c may be respectively configured based on the same octaves. Thus, the array microphone 100 can be configured to provide respective differential arrays situated along the orthogonal axes 121 and 123 of each microphone board 104.


In embodiments, using one or more beamforming techniques described herein, each of the differential arrays formed on the microphone boards 104 may be configured to generate a first-order polar pattern that is oriented along a line defined by the microphone elements 102 in that array (e.g., along the second axis 121 or the third axis 123), and is directable in either the positive or negative direction. In addition, the resulting first-order polar patterns, from all or many of the microphone boards 104, can be combined to steer an overall audio pick-up lobe of the array microphone 100 towards any direction within the plane 116 (or the YZ plane in FIG. 6) that is transverse to the axis of the array (or the first axis 115), using one or more beamforming techniques described herein, thus providing the array microphone 100 with improved directivity. The primary array 118 can also be combined with one or more of the secondary arrays 120 and 122 to steer the overall audio pick-up lobe to any direction at any azimuth and elevation around a sphere surrounding the center of the array, e.g., the central microphone element 132, such that the array microphone 100 can cover a solid angle of, for example, 4*pi steradians.


In embodiments, the microphone elements 102 are arranged across the microphone boards 104 to collectively form a harmonically nested linear array, using one or more beamforming techniques. For example, the plurality of microphone elements 102 may be configured to form, across the plurality of microphone boards 104, a first sub-array for covering a first octave of the covered plurality of frequency bands and a second sub-array for covering a second octave of the plurality of frequency bands, the first sub-array being nested within the second sub-array, for example, as shown in FIG. 7. In such cases, the first microphone elements 102a in the first sub-array may be separated by a first distance along the first axis 115, and the first microphone elements 102a in the second sub-array may be separated by a second distance along the first axis 115 that is twice the first distance, such that the first sub-array and the second sub-array are harmonically nested, as also shown in FIG. 7.


Referring back to FIG. 3A, since each microphone board 104 includes a respective one of the first microphone elements 102a, a spacing or distance between each set of adjacent microphone boards 104 along the first axis 115 may also be determined based on harmonic nesting principles. This also means the first linear arrays 120 on the sides 112 of the boards 104 may be harmonically nested relative to each other, and the second linear arrays 122 on the sides 110 of the boards 104 may be harmonically nested relative to each other as well. In some embodiments, the first linear arrays 120 can be combined, or aggregated, to form a first harmonically nested linear array directed parallel to the second axis 121 of any given microphone board 104, and the second linear arrays 122 can be combined to form a second harmonically nested linear array directed parallel to the third axis 123 of any given microphone board 104. These first and second harmonically nested linear arrays may then be combined to form the primary harmonically nested linear array of the array microphone 100, which can be steered to any direction within the plane 116 that is transverse to the first axis 115, or the axis of the array. The resulting first-order polar pattern can be further steered to a specific angle relative to the axis of the array, at any azimuth or elevation within a sphere centered on the array microphone 100, by aggregating the first and second linear arrays 120 and 122 with the primary array 118, which may be processed using a traditional linear array beamformer (e.g., delay and sum, differential, MVDR, etc.), as described herein. As will be understood, arranging the microphone elements 102 in harmonically nested sub-arrays (or nests) may be more efficient and economical because one or more of the microphone elements 102 can be reused as part of multiple sub-arrays (or nests), thus reducing the total number of microphone elements 102 required to cover the octaves of interest for the array microphone 100.


Referring additionally to FIG. 7, shown is an exemplary harmonically-nested microphone arrangement on a first plane 101 (or portion) of the array microphone 100 of FIG. 1, in accordance with embodiments. As shown in the top view of FIG. 3A, the first plane 101 may be positioned on one side of the array microphone 100, for example, relative to a plane (not shown) that comprises the first axis 115 and extends perpendicular to the axis 119, or otherwise bisects the array microphone 100, while a second plane 103 of the array microphone 100 may be positioned on the opposite side or half of the array microphone 100 (e.g., relative to the bisecting plane). In FIG. 7, the first plane 101 is shown situated on an XY plane of the XYZ axes shown in FIG. 6, for ease of explanation. For example, the first plane 101 may be positioned on the XY plane by orienting all of the microphone boards 104 in the array microphone 100 so that the center 114 of each board 104 is disposed along the X axis of the XY plane (e.g., the first axis 115 shown in FIG. 6) and the side 112 of each board 104 aligns with the Y axis of the XY plane (e.g., the second axis 121 shown in FIG. 6).


In the illustrated example, the second plane 103 of the array microphone 100, though not shown, may be situated on a XZ plane of the XYZ axes because the second plane 103 is comprised of the board sides 110 that are aligned with the Z axis of the XZ plane (e.g., the third axis 123 shown in FIG. 6). In embodiments, the second plane 103 of the array microphone 100 may be a mirror image of the first plane 101, since the second linear array 122 disposed on the side 110 of each microphone board 104 is a mirror image of the first linear array 120 disposed on the side 112 of the same board 104. Accordingly, for the sake of brevity, the following description of FIG. 7 will primarily refer to the microphone arrangement disposed on the first plane 101. However, it should be appreciated that the second plane 103 has the same or similar characteristics as the first plane 101 and that similar techniques may be used to form a harmonically-nested microphone arrangement on the second plane 103 of the array microphone 100.


The harmonically-nested arrangement of the microphone elements 102a and 102b on the first plane 101 of the array microphone 100 will now be described with reference to FIGS. 3B and 7. As shown in FIG. 3B, the first microphone elements 102a may include a first group of elements 124 that are spaced apart from each other by a first distance, D1, to form a first sub-array (or nest) that is configured to cover a first, or Nth, frequency octave. As also shown in FIG. 3B, the first microphone elements 102a further include a second group of elements 126 that are configured to form a second sub-array for covering a second, or next lower, frequency octave (e.g., (N-1)th octave) by spacing the elements 126 apart by a second distance that is twice the first distance, D1. Similarly, FIG. 3B also shows that the first microphone elements 102a include a third group of elements 128 configured to form a third sub-array for covering a third, still lower, octave (e.g., (N-2)th octave) by spacing the elements 128 apart by a third distance that is twice the second distance, or four times the first distance, D1. As also shown in FIG. 3B, the first microphone elements 102a further include a fourth group of elements 130 configured to form a fourth sub-array for covering a fourth, still lower, octave (e.g., (N-3)th octave) by spacing the elements 130 apart by a fourth distance that is twice the third distance, or eight times the first distance, D1. In other words, the distance or spacing between the first microphone elements 102a may be halved for each octave's worth of frequencies, or increased by a factor of 2 for each decreasing octave. As a result, the microphone elements 124 for covering the highest, or Nth, octave are closest together, or form the smallest aperture size, and the microphone elements 130 for covering the lowest octave (e.g., (N-3)th octave), and below, are furthest apart, or form the largest aperture size.


In a preferred embodiment, harmonic nesting techniques are used to select the distances between adjacent first microphone elements 102a in the primary array 118, such that the linear pattern formed by the first, second, third, and fourth sub-arrays are harmonically nested, as shown in FIG. 3B. This arrangement may be more efficient and economical because one or more of the first microphone elements 102a can be reused as part of multiple sub-arrays, thus reducing the total number of microphone elements 102a required to cover the octaves of interest for the array microphone 100. In particular, because the second and third sub-arrays are placed at different double multiples (e.g., 2 and 4, respectively) of the distance D1 between the first microphone elements 102a in the first sub-array, the first sub-array can be nested within the second and third sub-arrays, and the second sub-array can be nested within the third sub-array, as also shown in FIG. 7. As a result, some of the first microphone elements 102a can be reused for multiple nests. For example, as shown in FIGS. 3B and 7, a central element 132 of the plurality of first microphone elements 102a may be reused for each of the first, second, third, and fourth sub-arrays. As another example, at least three of the elements 124 in the first sub-array also form part of the second sub-array, and at least three of the elements 126 from the second sub-array also form part of the third sub-array.


Various considerations may be used to determine the smallest distance value, D1, between the first microphone elements 102a along the first axis 115 and thus, the distance between adjacent microphone boards 104. In some embodiments, the distance between adjacent microphone boards 104 along the first axis 115 may be configured based on a frequency value included in the covered plurality of frequency bands. In such cases, the distance, D1, between the first microphone elements 102a may be selected based on the frequency bands that are to be spatially sampled in the array microphone 100. In some embodiments, the distance between adjacent microphone boards 104 along the first axis 115 may be configured based on a linear aperture size of the array microphone 100. In such cases, the distance, D1, between the first microphone elements 102a may be selected based on the desired linear array aperture size, as well as a total number of the first microphone elements 102a being used to form the linear array pattern (or primary array 118), thus enabling the array microphone 100 to have a scalable geometry that can be reconfigured to fit the design needs of a particular application. Other design considerations may also determine the D1 value, including, for example, desired locations for the frequency nulls, a desired amount of electrical delay, spatial sampling density, criteria for avoiding spatial aliasing, and processing overhead. In one example embodiment, the D1 distance is approximately 150 millimeters (mm) along the axis of the array.


As depicted in FIG. 7, the first plane 101 further comprises the second microphone elements 102b (also referred to herein as “additional microphone elements”) that are arranged orthogonal to the first microphone elements 102a, or along the second axis 121 of the respective microphone board 104, to create differential arrays for added directivity at the various frequencies or octaves of interest. In particular, on each microphone board 104, the second microphone elements 102b are added to duplicate the first microphone element 102a included thereon in terms of placement relative to the first axis 115, but are disposed on the second axis 121 that is orthogonal to the corresponding first microphone element 102a and perpendicular to the first axis 115, such as, e.g., the Y axis shown in FIGS. 6 and 7 (also referred to herein as an “orthogonal axis”).


In embodiments, on each microphone board 104, each of the second microphone elements 102b and the first microphone element 102a being duplicated thereby jointly form a microphone set, or differential pair, that is configured to operate in a frequency octave covered by the duplicated first microphone element 102a. For example, in each microphone set, a spacing or distance between the first microphone element 102a and the corresponding second microphone element 102b along the orthogonal axis 121 may be selected based on the frequency octave covered by that set. Moreover, the first and second microphone elements 102a and 102b of each microphone set may be treated or handled as a single microphone unit of the array microphone 100 by acoustically combining the two microphone elements 102a and 102b to create a new pickup pattern for that microphone set (e.g., using appropriate beamforming techniques).


Also in embodiments, microphone sets from different microphone boards 104 may be grouped together as sub-arrays to produce one or more combined outputs for the array microphone 100. As an example, all of the microphone sets configured to cover the first octave (e.g., N) can be combined or aggregated, across multiple microphone boards 104, to create a sub-array for operating in that octave (e.g., using appropriate beamforming techniques), for example, as shown by Sub-array 1 in FIG. 7. As also shown in FIG. 7, the first plane 101 of the array microphone 100 may include four groups of microphone sets 134, 136, 138, and 140, and the microphone sets in each group 134, 136, 138, and 140 may be combined to create the octave-specific Sub-arrays 1, 2, 3, and 4, respectively. These sub-arrays (also referred to as “differential sub-arrays”) may be further aggregated to create an overall output for the array microphone 100 that has an essentially constant beamwidth, for example.


More specifically, the first group of microphone sets 134 comprises the elements 124 from the first microphone elements 102a that are disposed along the first axis 115 to form the first sub-array for covering the first, or Nth, octave. The first group of microphone sets 134 further comprises the second microphone elements 102b that are added to duplicate the first sub-array along the second axes of the corresponding microphone boards 104. In each microphone set 134, the second microphone element 102b is disposed a first distance, D2, from the corresponding first microphone element 102a. Similarly, the second group of microphone sets 136 comprises the elements 126 from the first microphone elements 102a that are disposed along the first axis 115 to form the second sub-array for covering the second, or (N-1)th, octave. The second group of microphone sets 136 further comprises the second microphone elements 102b that are added to duplicate the second sub-array along the second axes 121 of the corresponding microphone boards 104. In each microphone set 136, the second microphone element 102b is disposed a second distance that is twice the first distance, D2, from the corresponding first microphone element 102a. Likewise, the third group of microphone sets 138 comprises the elements 128 from the first microphone elements 102a that are disposed along the first axis 115 to form the third sub-array for covering the third, or (N-2)th, octave. The third group of microphone sets 138 further comprises the second microphone elements 102b that are added to duplicate the third sub-array along the second axes 121 of the corresponding microphone boards 104. In each microphone set 138, the second microphone element 102b is disposed a third distance that is four times the first distance, D2, from the corresponding first microphone element 102a. And lastly, the fourth group of microphone sets 140 comprises the elements 130 from the first microphone elements 102a that are disposed along the first axis 115 to form the fourth sub-array for covering the fourth, or (N-3)th, octave. The fourth group of microphone sets 140 further comprises the second microphone elements 102b that are added to duplicate the fourth sub-array along the second axes 121 of the corresponding microphone boards 104. In each microphone set 140, the second microphone element 102b is disposed a fourth distance that is about 6.67 times the first distance, D2, from the corresponding first microphone element 102a.


Thus, like the distances between adjacent first microphone elements 102a along the first axis 115, the distance between the microphone elements in a given differential pair are halved with each octave's worth of frequencies, or increased by double multiples (i.e. a factor of 2) with each decreasing octave, except for the very highest frequencies. In embodiments, the distance D2 between the first microphone element 102a and the second microphone element 102b in each of the first plurality of microphone sets 134 may be equal to a half wavelength of a desired frequency from the octave covered by the sets 134 (i.e. the Nth octave), for example, to create nulls at the desired frequency. The distance D2 may also be selected to optimize cardioid formation when combining the first microphone element 102a and the second microphone element 102b of a given microphone set to produce a combined output, as described below. In one example embodiment, the D2 distance is approximately 7.5 millimeters (mm) along the corresponding second axis 121.


As shown in FIG. 7, a number of the microphone boards 104 have two or more microphone sets that are co-located along the orthogonal axis 121 because they share the same first microphone element 102a. This arrangement is due, at least in part, to the harmonic nesting of the first microphone elements 102a along the first axis 115 and the coverage of multiple octaves by several of the first microphone elements 102a. More specifically, each first microphone element 102a that is configured to cover a number of frequency octaves may be duplicated by an equal number of second microphone elements 102b disposed at appropriate (e.g., frequency-dependent) distances along the same orthogonal axis 121 of the corresponding microphone board 104, thus creating the co-located microphone sets. In other words, the total number of second microphone elements 102b that may be located on the same orthogonal axis 121 (or in the first linear array 120) depends on the number of octaves covered by the first microphone element 102a in that linear array 120. As an example, in FIG. 7, the central microphone element 132 is included in all four sub-arrays and therefore, is used to cover all four octaves (e.g., N, N-1, N-2, and N-3). Accordingly, as shown in FIG. 7, the central microphone element 132 is paired with four different second microphone elements 102b in order to provide coverage for each of the four octaves. Conversely, as also shown in FIG. 7, each of the first microphone elements 102a disposed on the far sides of the first plane 101 is paired with only one of the second microphone elements 102b because those first microphone elements 102a are only used to cover one octave (e.g., N-3) and thus, are only included in one of the sub-arrays (e.g., Sub-array 4).


In embodiments, the plurality of microphone sets formed by the microphone elements 102 on each of the first plane 101 and the second plane 103 are arranged orthogonal to the first axis 115 (or along the second orthogonal axis 121 and the third orthogonal axis 123, respectively, as shown in FIG. 6) in order to maintain the linear array pattern created by the first microphone elements 102a along the first axis 115. For example, the first microphone elements 102a may constitute the primary array 118 of the array microphone 100 (e.g., as shown in FIG. 3B), and the second and third microphone elements 102b and 102c may be disposed in the array microphone 100 to form multiple secondary or differential arrays (e.g., the first and second linear arrays 120 and 122 shown in FIG. 6) that are arranged orthogonal to the primary array 118 along two different dimensions or axes. This multi-dimensional arrangement of the microphone elements 102 allows the array microphone 100 to have a relatively thin form factor while providing directionality anywhere within the plane 116 (or the YZ plane in FIG. 6), or anywhere within a sphere centered on the array, using appropriate beamforming techniques. In some cases, an overall length of the array microphone 100 may be largely determined by the dimensions of the primary array 118, or more specifically, the linear aperture size formed by the first microphone elements 102a and other physical characteristics of the first microphone elements 102a, as well as the amount of space (e.g., D1 or a multiple thereof) between adjacent first microphone elements 102a along the first axis 115.


Other dimensions of the array microphone 100 (e.g., an overall depth or a height/width along the axis 119) may be determined by the number of differential pairings included on the orthogonal axes 121 and 123 of the microphone boards 104 and the spacing between adjacent microphone elements along each orthogonal axis (e.g., as shown in FIG. 6). The exact number of differential pairings included in the array 100 may depend on the total number of octaves to be covered by the array microphone 100, which in turn may determine the distances between each layer, as described herein. In some cases, the number of differential pairings, or covered octaves, may be determined by physical limitations on a device housing for the array microphone 100 (e.g., a maximum depth or height of the housing 106). In the illustrated embodiments, the overall height and depth of the array microphone 100 may be determined by the size and shape of the microphone boards 104, a length or linear aperture size formed by each of the first and second linear arrays 120 and 122, the amount of space (e.g., D2 or a multiple thereof) between adjacent second microphone elements 102b along the second axis 121 and adjacent third microphone elements 102c along the third axis 123, and/or other physical characteristics of the microphone elements 102b and 102c. While the illustrated embodiments show four layers of differential pairs configured to provide added directivity for four different octaves (e.g., N, N-1, N-2, N-3), other embodiments may include more layers to cover more octaves, thus increasing the height and depth of the array 100, or fewer layers to cover fewer octaves, thus decreasing the array height and depth.


To illustrate, FIG. 8 depicts a first plane 201, or portion, of another exemplary array microphone 200 that has a smaller aperture size but is otherwise configured to be substantially similar to the array microphone 100, in accordance with embodiments. As an example, the array microphone 200 may have a linear aperture size that is about half the size of the array microphone 100. In embodiments, the array microphone 200 may include fewer microphone boards 204 than the array microphone 100 (e.g., nine instead of eleven) in order to accommodate the smaller linear aperture size, using scalable geometry techniques described herein. For example, the microphone boards 204, and the microphone elements 202 included thereon, may be harmonically-nested like the microphone elements 102, by subdividing the linear aperture size into four harmonically nested sub-arrays of five microphone each. However, the smallest distance value, D1*, between first microphone elements 202a disposed along a common axis 215 of the array microphone 200 may be smaller than the distance value, D1, used for the array microphone 100. Moreover, because there are fewer microphone boards 204 overall, the fourth sub-array may be configured to completely overlap with the third sub-array, or be positioned on the same microphone boards 104, as shown in FIG. 8. In various embodiments, the array microphone 200 can maintain low frequency directionality with minimal performance loss (e.g., due to self-noise, etc.) despite the overlapping sub-arrays.



FIG. 9 illustrates an exemplary audio system 300, in accordance with embodiments. The audio system 300 comprises an array microphone 302 similar to the array microphone 100 (or array microphone 200), a beamformer 304, and an output generation unit 306. The array microphone 302 may include the microphone boards 104 of the array microphone 100 shown in FIG. 1, and the microphone elements 102 included on each board 104, or other microphone designed in accordance with the techniques described herein. The beamformer 304 may be in communication with the array microphone 302 and may include one or more components to facilitate processing of audio signals received from the array microphone 302. The output generation unit 306 may be in communication with the beamformer 304 and may be used to process the output signals received from the beamformer 304 for output generation via, for example, loudspeaker, telecast, etc.


Various components of the audio system 300 may be implemented using software executable by one or more computers, such as a computing device with a processor and memory, and/or by hardware (e.g., discrete logic circuits, application specific integrated circuits (ASIC), programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.). For example, some or all components of the beamformer 304 may be implemented using discrete circuitry devices and/or using one or more processors (e.g., audio processor and/or digital signal processor) (not shown) executing program code stored in a memory (not shown), the program code being configured to carry out one or more processes or operations described herein. Thus, in embodiments, the audio system 300 may include one or more processors, memory devices, computing devices, and/or other hardware components not shown in FIG. 9. In a preferred embodiment, the system 300 includes at least two separate processors, one for consolidating and formatting the microphone elements and another for implementing DSP functionality.


The beamformer 304 may be used to apply appropriate beamforming techniques to the audio signals captured by the microphone elements of the array microphone 302 to create a desired pickup pattern, such as, e.g., a first-order polar-pattern (e.g., cardioid, super-cardioid, hypercardioid, etc.), and/or to steer the pattern to a desired angle, relative to the axis of the array, to obtain additional directionality. For example, in some embodiments, the beamformer 304 may be configured to combine audio signals captured by each microphone element disposed on a first or primary axis of the array microphone 302 to form a primary array output; combine the audio signals captured by the microphone elements one the first axis with those captured by the differential microphone elements correspondingly disposed on different orthogonal axes of the array microphone 302 to form outputs for each differential pair; for each orthogonal plane of the array microphone 302, combine the differential pair outputs for that plane to form octave-specific sub-array outputs; combine the sub-array outputs for each orthogonal plane to create a linear array output with a first-order polar pattern (such as, e.g., a cardioid pickup pattern) directed along an axis in that plane; combine the linear array outputs for the two orthogonal planes to generate a directional output steered to any direction or angle within a plane that is perpendicular to the first axis of the array; and combine one or more of the linear array outputs with the primary array output to generate a directional output steered to any direction or angle about a sphere centered around a center of the array. The beamformer 304 may be configured to use any appropriate beamforming algorithm to combine the received audio signals and generate the steered output, including, for example, delay and sum techniques, weight and sum techniques, sum and difference techniques, filter and sum techniques, minimum variance distortionless response (“MVDR”) techniques, first-order differential techniques, or any combination thereof.



FIG. 10 shows the array microphone 302 and the beamformer 304 of the audio system 300 in more detail. For ease of explanation, the array microphone 302 will be described with reference to the XYZ axes, or assuming that the array microphone 302 has been situated in alignment with the XYZ axes, for example, by aligning the centers 114 of the microphone boards 104 with the X axis and aligning the sides 112 and 110 of the boards 104 with the Y and Z axes, respectively (e.g., as shown in FIGS. 6 and 7). The Y axes may coincide with a first plane (e.g., first plane 101) of the array microphone 302 that is orthogonal to the first axis, while the Z axes may coincide with a second plane (e.g., second plane 103) of the array microphone 302 that is orthogonal to both the first axis and the first plane.


As shown, the array microphone 302 comprises a plurality of first microphone elements 302a disposed along a primary or first axis that is aligned with the X axis, such that the coordinates for each first microphone element 302a have a zero value along both the Y and Z axes (e.g., similar to the first microphone elements 102a disposed on the first axis 115 shown in FIG. 3B). In addition, the array microphone 302 comprises a plurality of second microphone elements 302b disposed on second axes that are aligned with the Y axes of the microphone boards, such that the coordinates for each second microphone element 302b have a zero value along both the X and Z axes of its respective microphone board (e.g., similar to the second microphone elements 102b disposed on the Y axis in FIG. 6). As shown, the array microphone 302 also comprises a plurality of third microphone elements 302c disposed on third axes that are aligned with the Z axes of the microphone boards, such that the coordinates for each third microphone element 302c have a zero value along both the X and Y axes of its respective microphone board (e.g., similar to the third microphone elements 102c disposed on the Z axis in FIG. 6). In embodiments, the second microphone elements 302b may be arranged to form a mirror image of the third microphone elements 302c, so that the Y values for the second microphone elements 302b on a given microphone board have the same numeric value as the Z values for the third microphone elements 302c correspondingly arranged on the same microphone board (e.g., as shown in FIG. 3A).


According to embodiments, the beamformer 304 may comprise a plurality of individual beamformers, or beamforming components, configured to combine the audio signals received from the array microphone 302 and generate a steered output that is directed towards a desired audio source (e.g., sound source 113 in FIGS. 5A and 5B) and/or generates nulls in selected locations. In some embodiments, the various beamforming components may be in communication with each other, for example, in order to provide the output of one beamforming component as the input to another beamforming component. In some embodiments, though not shown, the beamformer 304 includes multiple instances of a given beamforming component, for example, in order to tailor that component to the specific characteristics of the microphone elements, or sub-arrays, coupled thereto (e.g., microphone separation distance, covered frequency octave, etc.). Other beamforming techniques or combinations thereof may also be performed by the beamformer 304 to provide a desired output.


As shown, the beamformer 304 comprises a primary beamforming component 308 configured to receive the audio signals captured by the first microphone elements 302a and combine those signals to generate primary sub-array outputs for the primary array formed along the X axis (e.g., primary array 118 of FIG. 3B). The primary beamforming component 308 (or “primary beamformer”) can be configured to generate an octave-specific output for each of the harmonically-nested sub-arrays formed by the primary array. The primary beamformer 308 can also be configured to combine the primary sub-array outputs to generate a primary array output that has a first-order polar pattern directed along an axis of the array. For example, the primary array output may be directed in either direction along the axis 119 in FIG. 3A. As will be appreciated, the polar pattern of the primary array output may be omnidirectional in the YZ plane. In embodiments, the primary beamformer 308 may be configured to generate these primary sub-array outputs using one or more beamforming algorithms, such as, e.g., delay and sum techniques, filter and sum techniques, delay and difference techniques, magnitude shading techniques, and minimum variance distortionless response (“MVDR”) techniques.


The beamformer 304 also comprises two differential pair beamforming components 310 and 312, one for each orthogonal axis of the microphone boards included in the array microphone 302. More specifically, a first differential pair beamforming component 310 (or “first differential beamformer”) can be configured to combine the audio signals captured by each differential pair included on the Y axis of each microphone board. Similarly, a second differential pair beamforming component 312 (or “first differential beamformer”) may be configured to combine the audio signals captured by each differential pair included on the Z axis of each microphone board. Each differential beamformer 310 and 312 may generate one or more differential pair outputs for each microphone board depending on the number of differential pairs included thereon. For example, for the central microphone board 104a shown in FIG. 3A, a total of four differential outputs may be generated by each of the differential beamformers 310 and 312, corresponding to the four differential pairs formed along each of the Y and Z axes. Conversely, each of the other microphone boards 104b and 104c may have one to three differential pair outputs per axis.


According to embodiments, the first differential beamformer 310 can be further configured to combine the Y axis differential pair outputs generated across the plurality of microphone boards to create an octave-specific output for each of the harmonically-nested sub-arrays formed by the boards within the first orthogonal plane. Similarly, the second differential beamformer 312 can be further configured to combine the Z axis differential pair outputs generated across the plurality of microphone boards to create an octave-specific output for each of the harmonically-nested sub-arrays formed by the boards within the second orthogonal plane. That is, each sub-array output generated by the differential beamformers 310 and 312 may be configured to cover a specific octave of the covered frequency bands. In embodiments, the differential beamformers 310 and 312 may be configured to generate these differential sub-array outputs using one or more beamforming algorithms, such as, e.g., delay and sum techniques, filter and sum techniques, delay and difference techniques, magnitude shading techniques, and minimum variance distortionless response (“MVDR”) techniques.


The beamformer 304 further comprises two directional beamformers 314 and 316 configured to combine the primary sub-array outputs generated by the primary beamformer 308 with corresponding differential sub-array outputs generated by each of the differential beamformers 310 and 312 to create a linear array output for each orthogonal plane of the array microphone 302. In particular, a first directional beamformer 314 can be configured to combine the primary sub-array outputs with corresponding Y axis differential sub-array outputs provided by the first differential beamformer 310. For example, each primary sub-array output may be combined with the Y axis sub-array output that corresponds to the same octave. Similarly, a second directional beamformer 316 can be configured to combine the primary sub-array outputs with corresponding Z axis differential sub-array outputs provided by the second differential beamformer 312. For example, each primary sub-array output may be combined with the Z axis sub-array output that corresponds to the same octave. The linear array output generated by the first directional beamformer 314 may have a first-order polar pattern directed along a Y axis of the first orthogonal plane (e.g., the XY plane), while the linear array output generated by the second directional beamformer 316 may have a first-order polar pattern directed along a Z axis of the second orthogonal plane (e.g., the XZ plane). In embodiments, the directional beamformers 314 and 316 can be configured to use any appropriate beamforming algorithm for pattern formation and/or to create the various sub-array outputs, including, for example, sum and difference techniques (e.g., as shown in FIG. 11), first-order differential combining techniques (e.g., as shown in FIG. 12), or any combination thereof.


As shown, the beamformer 304 also comprises a steering beamforming component 318 configured to combine the linear array outputs received from the first and second directional beamformers 314 and 316 to generate a steered output. In embodiments, the steering beamforming component 318 (or “steering beamformer”) can be configured to provide additional control of the array output around the axis of the array, or transverse to the array axis. For example, due to the multi-dimensional placement and harmonic nesting of the microphone elements 302a, 302b, and 302c, the steering beamformer 318 can be configured to create a directional output that can have any first-order pattern (e.g., cardioid, toroid, etc.) and can be steered to any direction within a plane (e.g., the YZ plane) that is perpendicular to the first axis. The steering beamformer 318 also receives the primary array output from the primary beamformer 308 and can be configured to combine the primary array output with the directional outputs from the beamformers 314 and 316 to generate a directional output steered to any angle relative to the axis of the array (e.g., the X axis), or to any direction at any azimuth or elevation about a sphere centered around the center of the array. The steering beamformer 318 may include a combiner or the like for combining together the various outputs to generate a steered directional output for the overall array microphone 302. In embodiments, the steering beamformer 318 may be configured to use any appropriate beamforming algorithm to combine the two directional outputs, including, for example, weight and sum (or magnitude and summation) techniques, filter and sum techniques, and differential techniques.


Thus, the beamformer 304 can be configured to apply array processing techniques (e.g., beamformers 308, 310, and 312), coupled with secondary beamforming processing techniques (e.g., beamformers 314 and 316), and a tertiary beamforming step of magnitude and summation techniques to provide greater control of the array, or the audio pick-up lobe with highest sensitivity. In embodiments, the beamformer 304 may be agnostic to the order in which its components operate due to the linear independence of the three beamforming steps. For example, because the microphone elements within the array microphone 302 are disposed on different axes, the audio signals captured by those elements can be processed along any one of the axes in any order. Thus, while FIG. 10 shows the components of the beamformer 304 arranged in a specific order, in other embodiments, one or more components of the beamformer 304 may be positioned differently or performed in a different order. For example, in some embodiments, the differential beamformers 310 and 312 and the primary beamformer 308 may be performed at the end, e.g., after operation of the directional beamformers 314 and 316 and the steering beamformer 318.



FIG. 11 illustrates an exemplary sum and difference beamformer 400 that may be used to implement all or part of any one of the beamformers 310, 312, 314, and 316 in FIG. 10, in accordance with embodiments. In general, the beamformer 400 can be configured to combine first and second audio inputs 402 using appropriate sum and difference beamforming techniques to generate a combined audio output signal that has a directional polar pattern.


In some embodiments, the audio inputs 402 may be the audio signals captured by the differential pairs located on each microphone board of the array microphone 302, and the beamformer 400 may be used to combine each differential pair to form cardioid elements with narrowed lobes (or sound pick-up patterns), for example, as compared to the full omnidirectional polar pattern of the individual microphone elements of the array microphone 302. For example, the first audio input 402 may include the audio signals captured by the first microphone element 302a on each microphone board and the second audio input 402 may include the audio signals captured by one of the second microphone elements 302b arranged on the first orthogonal axis of the same microphone board, or one of the third microphone elements 302c arranged on the second orthogonal axis of the same microphone board.


In other embodiments, the audio inputs 402 may include sub-array outputs received from the primary beamformer 308 and one of the differential beamformers 310 and 312 to cover the same covered octave. In such cases, the beamformer 400 may be configured to use sum and difference beamforming techniques to combine the sub-array outputs to form a directional output that is specific to the frequency octave covered by the inputs 402 and constitutes a first-order pattern within the corresponding orthogonal plane of the array microphone 302. For example, the first audio input 402 may include one of the primary sub-array outputs received from the primary beamformer 308, and the second audio input 402 may include a differential sub-array output corresponding to the same octave as the first audio input 402 and received from one of the differential beamformers 310 and 312. The exact beamforming technique used to combine the sub-array signals may vary depending on how the corresponding sub-array is formed, or how the microphone elements are arranged within that sub-array (e.g., linear array, orthogonal array, broadside array, endfire array, etc.). For example, audio signals received from microphone elements arranged in a linear or broadside array may be summed together to generate the sub-array signal. Other techniques may be used for other types of sub-arrays.


As shown in FIG. 4, the first and second audio inputs 402 are provided to a summation component 404 of the beamformer 400, as well as a difference component 406 of the same. The summation component 404 may be configured to calculate a sum of the first and second audio signals (e.g., Input 1+Input 2) to generate a combined or summed output for the pair of audio inputs 402. The difference component 406 may be configured to subtract the second audio signal from the first audio signal (e.g., Input 1−Input 2) to generate a differential signal or output for the first and second audio inputs 402. As an example, the summation component 404 may include one or more adders or other summation elements, and the difference component 406 may include one or more invert-and-sum elements.


As also shown, beamformer 400 further includes a correction component 408 for correcting the differential output generated by the difference component 406. The correction component 408 may be configured to correct the differential output for a gradient response caused by the difference calculation. For example, the gradient response may give a 6 dB per octave slope to the frequency response of the audio inputs 402. In order to generate a first-order polar pattern (e.g., cardioid) for the pair of audio inputs 402 over a broad frequency range, the differential output must be corrected so that it has the same magnitude as the summation output. In a preferred embodiment, the correction component 408 applies a correction value of (c*d)/(j*ω) to the difference output to obtain a corrected difference output for the two audio inputs 402 (e.g., (Mic 1−Mic 2)*((c*d)/(j*ω))), where c equals the speed of sound in air at 20 degrees Celsius, d equals the distance between the first and second microphones (e.g., D2 or a multiple thereof), and ω equals the angular frequency. In some cases, a second magnitude correction may be performed to match the sensitivity of the difference component to that of the summation component.


The beamformer 400 also includes a combiner 410 configured to combine, or sum, together the summed output generated by the summation component 404 and the corrected difference output generated by the correction component 408. The combiner 410 thus generates a combined output signal with directional polar pattern (e.g., cardioid) for the pair of audio inputs 402, as shown in FIG. 4.



FIG. 12 illustrates an exemplary pattern-forming beamformer 500 that may be used to implement all or part of any of the beamformers 308, 310, 312, 314, and 316 shown in FIG. 10, in accordance with embodiments. The beamformer 500 may be configured to combine outputs from the harmonically-nested microphone elements 302a, 302b, and 302c to form cardioid outputs, or other directional outputs with a first-order polar pattern. For example, the beamformer 500 may receive outputs from respective nests or sub-arrays formed along one or more axes of the array microphone 302. In some embodiments, the beamformer 500 may be included in each of the beamformers 314 and 316 and used to combine sub-array outputs received from the primary beamformer 308 and the corresponding differential beamformer 310 or 312, so as to create a first-order directional output for each orthogonal plane of the array microphone 302.


In embodiments, the beamformer 500 can be configured to use cross-over filtering techniques to create the first-order polar patterns. As shown, the beamformer 500 comprises a plurality of filters 502, 504, 506, and 508 and each filter is configured to receive audio signals from a different set of microphone elements. In particular, a very high pass filter 502 is configured to receive audio signals from microphone elements, or sub-arrays, that are configured to cover very high frequencies (e.g., greater than about 4 kHz). A high frequency bandpass filter 504 is configured to receive audio signals from microphone elements, or sub-arrays, that are configured to cover high frequencies (e.g., about 2 kHz to about 4 kHz). A mid frequency bandpass filter 506 is configured to receive audio signals from microphone elements, or sub-arrays, that are configured to cover middle or mid-range frequencies (e.g., about 1 kHz to about 2 kHz). And a low pass filter 508 is configured to receive audio signals from microphone elements, or sub-arrays, that are configured to cover low frequencies (e.g., less than about 1 kHz). The cut-off frequencies for the filters 502, 504, 506, and 508 may be selected based on the specific frequency response characteristics of the corresponding set of microphone elements, including, for example, location of frequency nulls, a desired frequency response for the microphone array, etc.


In various embodiments, the filters 502, 504, 506, and 508 may be analog or digital filters (e.g., digital finite impulse response (FIR) filters on a digital signal processor (DSP), or the like). While FIG. 12 shows four filters, in other embodiments, the beamformer 500 may include more or fewer filters. In still other embodiments, the beamformer 500 may be configured to include a different combination of filters, such as, e.g., multiple bandpass filters, or any other combination.


As shown, the filtered outputs of the filters 502, 504, 506, and 508 may be provided to a summation element 510 of the beamformer 500. The summation element 510 may be configured to combine or sum the filtered outputs to generate a combined output signal that may represent a cardioid output for the input microphone elements or other first-order polar pattern.


Thus, the techniques described herein provide an array microphone with improved directivity transverse to the axis of the array, thus providing a larger level of control with regards to where the array is most effective at collecting sound, and a geometry that is designed to allow for minimal diffraction and resonance. For example, the structure of the array microphone is broken up into separate unit cells (or microphone boards) in order to use a minimum amount of interfering material (e.g., PCB substrate) while still placing the microphone elements in a multi-dimensional formation. Moreover, due to the microphone arrangement and overall geometry of the array microphone, the main lobe, or beam with greatest sensitivity, can be placed in any direction within a plane that is perpendicular to the axis of the array. In some cases, the array microphone described herein can be used to simultaneously generate a plurality of individual audio channels, each tailored to capture a particular talker or audio source, while removing room noise, other talker noise, and other unwanted sounds. For example, the array microphone can be used for stage or live music reinforcement to provide selective coverage of the stage or audience, or in live sports environments to isolate ambience from game audio. Thus, the array microphone can provide not only improved directivity with wideband audio application (e.g., 20 Hz≤f≤20 kHz), but also improved signal to noise ratio (SNR) and acoustic echo cancellation (AEC) properties. The techniques described herein also provide an array microphone with greater flexibility, e.g., compared to existing linear arrays, that allows for expanded functionality. For example, the pattern formation techniques described herein may enable the array microphone to be used as a mid-side stereo array, or for mid-side stereo generation that is highly directional and could improve spatialization in simple two-channel recordings (e.g., with the addition of elevation information). As another example, the array geometry described herein may allow for first-order ambisonic collection, with only minor alteration to the signal flow. In some cases, the techniques described herein can be used for integrated or UC devices to minimize coupling between transmit and receive acoustic systems.


Referring back to FIG. 9, in various embodiments, the audio system 300 may also include various components that are not shown in FIG. 9, such as, for example, one or more loudspeakers, display screens, computing devices, and/or cameras. In addition, one or more of the components in the system 300 may include one or more digital signal processors or other processing components, controllers, wireless receivers, wireless transceivers, etc., though not shown or mentioned above. It should be understood that the components shown in FIG. 9 are merely exemplary, and that any number, type, and placement of the various components in the system 300 are contemplated and possible.


One or more components of the audio system 300 may be in wired or wireless communication with one or more other components of the system 300. For example, the array microphone 302 may transmit the plurality of audio signals to the beamformer 304, the output generation unit 306, a separate audio processor (not shown), or a computing device comprising one or more of the same, using a wired or wireless connection. In some embodiments, one or more components of the audio system 300 may communicate with one or more other components of the system 300 via a suitable application programming interface (API). For example, one or more APIs may enable components of the audio processor to transmit audio and/or data signals between themselves.


In some embodiments, one or more components of the audio system 300 may be combined into, or reside in, a single unit or device. For example, all of the components of the audio system 300 may be included in the same device, such as the microphone 302, or a computing device that includes the microphone 302. As another example, the output generation unit 306 may be included in, or combined with, the beamformer 304 and/or with the microphone 302. In some embodiments, the audio system 300 may take the form of a cloud based system or other distributed system, such that the components of the system 300 may or may not be physically located in proximity to each other.


The components of the audio system 300 may be implemented in hardware (e.g., discrete logic circuits, application specific integrated circuits (ASIC), programmable gate arrays (PGA), field programmable gate arrays (FPGA), digital signal processors (DSP), microprocessor, etc.), using software executable by one or more servers or computers, or other computing device having a processor and memory (e.g., a personal computer (PC), a laptop, a tablet, a mobile device, a smart device, thin client, etc.), or through a combination of both hardware and software. For example, some or all components of the microphone 302, the beamformer 304, and/or the output generation unit 306 may be implemented using discrete circuitry devices and/or using one or more processors (e.g., audio processor and/or digital signal processor) executing program code stored in a memory (not shown), the program code being configured to carry out one or more processes or operations described herein. Thus, in embodiments, one or more of the components of the audio system 300 may include one or more processors, memory devices, computing devices, and/or other hardware components not shown in the figures.


All or portions of the processes described herein may be performed by one or more processing devices or processors (e.g., analog to digital converters, encryption chips, etc.) that are within or external to the audio system 300 of FIG. 9. In addition, one or more other types of components (e.g., memory, input and/or output devices, transmitters, receivers, buffers, drivers, discrete components, logic circuits, etc.) may also be used in conjunction with the processors and/or other processing components to perform any, some, or all of the steps of any methods or processes described herein. As an example, in some embodiments, each of the methods described herein may be carried out by a processor executing software stored in a memory. The software may include, for example, program code or computer program modules comprising software instructions executable by the processor. In some embodiments, the program code may be a computer program stored on a non-transitory computer readable medium that is executable by a processor of the relevant device.


Any of the processors described herein may include a general purpose processor (e.g., a microprocessor) and/or a special purpose processor (e.g., an audio processor, a digital signal processor, etc.). In some examples, the processor(s) described herein may be any suitable processing device or set of processing devices such as, but not limited to, a microprocessor, a microcontroller-based platform, an integrated circuit, one or more field programmable gate arrays (FPGAs), and/or one or more application-specific integrated circuits (ASICs).


Any of the memories or memory devices described herein may be volatile memory (e.g., RAM including non-volatile RAM, magnetic RAM, ferroelectric RAM, etc.), non-volatile memory (e.g., disk memory, FLASH memory, EPROMs, EEPROMs, memristor-based non-volatile solid-state memory, etc.), unalterable memory (e.g., EPROMs), read-only memory, and/or high-capacity storage devices (e.g., hard drives, solid state drives, etc.). In some examples, the memory described herein includes multiple kinds of memory, particularly volatile memory and non-volatile memory.


Moreover, any of the memories described herein may be computer readable media on which one or more sets of instructions can be embedded. The instructions may reside completely, or at least partially, within any one or more of the memory, the computer readable medium, and/or within one or more processors during execution of the instructions. In some embodiments, the memory described herein may include one or more data storage devices configured for implementation of a persistent storage for data that needs to be stored and recalled by the end user. In such cases, the data storage device(s) may save data in flash memory or other memory devices. In some embodiments, the data storage device(s) can be implemented using, for example, SQLite data base, UnQLite, Berkeley DB, BangDB, or the like.


Any of the computing devices described herein can be any generic computing device comprising at least one processor and a memory device. In some embodiments, the computing device may be a standalone computing device included in the audio system 300, or may reside in another component of the audio system 300, such as, e.g., the microphone 302, the beamformer 304, or the output generation unit 306. In such embodiments, the computing device may be physically located in and/or dedicated to the given environment or room, such as, e.g., the same environment in which the microphone 302 is located. In other embodiments, the computing device may not be physically located in proximity to the microphone 302 but may reside in an external network, such as a cloud computing network, or may be otherwise distributed in a cloud-based environment. Moreover, in some embodiments, the computing device may be implemented with firmware or completely software-based as part of a network, which may be accessed or otherwise communicated with via another device, including other computing devices, such as, e.g., desktops, laptops, mobile devices, tablets, smart devices, etc. Thus, the term “computing device” should be understood to include distributed systems and devices (such as those based on the cloud), as well as software, firmware, and other components configured to carry out one or more of the functions described herein. Further, one or more features of the computing device may be physically remote and may be communicatively coupled to the computing device.


In some embodiments, any of the computing devices described herein may include one or more components configured to facilitate a conference call, meeting, classroom, or other event and/or process audio signals associated therewith to improve an audio quality of the event. For example, in various embodiments, any computing device described herein may comprise a digital signal processor (“DSP”) configured to process the audio signals received from the various microphones or other audio sources using, for example, automatic mixing, matrix mixing, delay, compressor, parametric equalizer (“PEQ”) functionalities, acoustic echo cancellation, and more. In other embodiments, the DSP may be a standalone device operatively coupled or connected to the computing device using a wired or wireless connection. One exemplary embodiment of the DSP, when implemented in hardware, is the P300 IntelliMix Audio Conferencing Processor from SHURE, the user manual for which is incorporated by reference in its entirety herein. As further explained in the P300 manual, this audio conferencing processor includes algorithms optimized for audio/video conferencing applications and for providing a high quality audio experience, including eight channels of acoustic echo cancellation, noise reduction and automatic gain control. Another exemplary embodiment of the DSP, when implemented in software, is the IntelliMix Room from SHURE, the user guide for which is incorporated by reference in its entirety herein. As further explained in the IntelliMix Room user guide, this DSP software is configured to optimize the performance of networked microphones with audio and video conferencing software and is designed to run on the same computer as the conferencing software. In other embodiments, other types of audio processors, digital signal processors, and/or DSP software components may be used to carry out one or more of audio processing techniques described herein, as will be appreciated.


Moreover, any of the computing devices described herein may also comprise various other software modules or applications (not shown) configured to facilitate and/or control the conferencing event, such as, for example, internal or proprietary conferencing software and/or third-party conferencing software (e.g., Microsoft Skype, Microsoft Teams, Bluejeans, Cisco WebEx, GoToMeeting, Zoom, Join.me, etc.). Such software applications may be stored in the memory of the computing device and/or may be stored on a remote server (e.g., on premises or as part of a cloud computing network) and accessed by the computing device via a network connection. Some software applications may be configured as a distributed cloud-based software with one or more portions of the application residing in the computing device and one or more other portions residing in a cloud computing network. One or more of the software applications may reside in an external network, such as a cloud computing network. In some embodiments, access to one or more of the software applications may be via a web-portal architecture, or otherwise provided as Software as a Service (SaaS).


In general, a computer program product in accordance with embodiments described herein includes a computer usable storage medium (e.g., standard random access memory (RAM), an optical disc, a universal serial bus (USB) drive, or the like) having computer-readable program code embodied therein, wherein the computer-readable program code is adapted to be executed by a processor (e.g., working in connection with an operating system) to implement the methods described herein. In this regard, the program code may be implemented in any desired language, and may be implemented as machine code, assembly code, byte code, interpretable source code or the like (e.g., via C, C++, Java, ActionScript, Python, Objective-C, JavaScript, CSS, XML, and/or others). In some embodiments, the program code may be a computer program stored on a non-transitory computer readable medium that is executable by a processor of the relevant device.


The terms “non-transitory computer-readable medium” and “computer-readable medium” include a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. Further, the terms “non-transitory computer-readable medium” and “computer-readable medium” include any tangible medium that is capable of storing, encoding, or carrying a set of instructions for execution by a processor or that cause a system to perform any one or more of the methods or operations disclosed herein. As used herein, the term “computer readable medium” is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals.


Any process descriptions or blocks in the figures should be understood as representing modules, segments, or portions of code that include one or more executable instructions for implementing specific logical functions or steps in the process, and alternate implementations are included within the scope of the embodiments described herein, in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those having ordinary skill in the art.


It should be noted that in the description and drawings, like or substantially similar elements may be labeled with the same reference numerals. However, sometimes these elements may be labeled with differing numbers, such as, for example, in cases where such labeling facilitates a more clear description. In addition, system components can be variously arranged, as is known in the art. Also, the drawings set forth herein are not necessarily drawn to scale, and in some instances, proportions may be exaggerated to more clearly depict certain features and/or related elements may be omitted to emphasize and clearly illustrate the novel features described herein. Such labeling and drawing practices do not necessarily implicate an underlying substantive purpose. The above description is intended to be taken as a whole and interpreted in accordance with the principles taught herein and understood to one of ordinary skill in the art.


In this disclosure, the use of the disjunctive is intended to include the conjunctive. The use of definite or indefinite articles is not intended to indicate cardinality. In particular, a reference to “the” object or “a” and “an” object is intended to also denote one of a possible plurality of such objects.


This disclosure describes, illustrates, and exemplifies one or more particular embodiments of the invention in accordance with its principles. The disclosure is intended to explain how to fashion and use various embodiments in accordance with the technology rather than to limit the true, intended, and fair scope and spirit thereof. That is, the foregoing description is not intended to be exhaustive or to be limited to the precise forms disclosed herein, but rather to explain and teach the principles of the invention in such a way as to enable one of ordinary skill in the art to understand these principles and, with that understanding, be able to apply them to practice not only the embodiments described herein, but also other embodiments that may come to mind in accordance with these principles. The embodiment(s) provided herein were chosen and described to provide the best illustration of the principle of the described technology and its practical application, and to enable one of ordinary skill in the art to utilize the technology in various embodiments and with various modifications as are suited to the particular use contemplated. All such modifications and variations are within the scope of the embodiments as determined by the appended claims, as may be amended during the pendency of this application for patent, and all equivalents thereof, when interpreted in accordance with the breadth to which they are fairly, legally, and equitably entitled.

Claims
  • 1. An array microphone, comprising: a plurality of microphone boards arranged in a linear pattern along a first axis and comprising a plurality of microphone elements configured to cover a plurality of frequency bands, each microphone board comprising: a first linear array comprising a first microphone element of the plurality of microphone elements and one or more second microphone elements of the plurality of microphone elements, the first microphone element located on the first axis and the one or more second microphone elements located on a second axis orthogonal to the first axis, anda second linear array comprising the first microphone element and one or more third microphone elements of the plurality of microphone elements, the one or more third microphone elements located on a third axis orthogonal to the first axis and to the second axis.
  • 2. The array microphone of claim 1, wherein the linear pattern is configured to place the microphone boards in a harmonically-nested configuration for covering the plurality of frequency bands.
  • 3. The array microphone of claim 1, wherein the microphone boards are arranged substantially parallel to each other to form the linear pattern.
  • 4. The array microphone of claim 1, wherein the linear pattern is configured such that the plurality of microphone boards comprises a central microphone board, a first group of microphone boards arranged on one side of the central microphone board in a first pattern, and a second group of microphone boards arranged on an opposite side of the central microphone board in a second pattern that is a mirror image of the first pattern.
  • 5. The array microphone of claim 1, wherein a distance between adjacent microphone boards along the first axis is configured based on a linear aperture size of the array microphone.
  • 6. The array microphone of claim 1, wherein a distance between adjacent microphone boards along the first axis is configured based on a frequency value included in the plurality of frequency bands.
  • 7. The array microphone of claim 1, wherein for each microphone board, the second linear array is a mirror image of the first linear array.
  • 8. The array microphone of claim 1, wherein on each microphone board, a distance along the second axis between the first microphone element and each of the one or more second microphone elements is configured based on respective octaves of the plurality of frequency bands, and a distance along the third axis between the first microphone element and each of the one or more third microphone elements is respectively configured based on the same octaves.
  • 9. The array microphone of claim 1, wherein the plurality of microphone elements are configured to form, across the plurality of microphone boards, a first sub-array for covering a first octave of the plurality of frequency bands and a second sub-array for covering a second octave of the plurality of frequency bands, the first sub-array being nested within the second sub-array.
  • 10. The array microphone of claim 9, wherein the first microphone elements in the first sub-array are separated by a first distance along the first axis, and the first microphone elements in the second sub-array are separated by a second distance along the first axis that is twice the first distance, such that the first sub-array and the second sub-array are harmonically nested.
  • 11. The array microphone of claim 1, wherein each microphone board is a printed circuit board configured to form a triangular shape.
  • 12. The array microphone of claim 1, further comprising a housing configured to enclose the plurality of microphone boards.
  • 13. The array microphone of claim 1, wherein each of the plurality of microphone elements is a micro-electrical-mechanical-system (MEMS) microphone.
  • 14. An array microphone, comprising: a plurality of microphone boards arranged in a first linear pattern along a first axis of the array microphone, the plurality of microphone boards comprising a plurality of microphone elements configured to cover a plurality of frequency bands, each microphone board comprising: a first microphone element of the plurality of microphone elements located on the first axis;one or more second microphone elements of the plurality of microphone elements located on a second axis of the microphone board, the second axis being orthogonal to the first axis; andone or more third microphone elements of the plurality of microphone elements located on a third axis of the microphone board, the third axis being orthogonal to the first axis and to the second axis,wherein the first microphone elements of the plurality of microphone boards are configured to form the first linear pattern along the first axis, andfor each microphone board, the first microphone element and the one or more second microphone elements are configured to form a second linear pattern along the second axis of the corresponding microphone board, and the first microphone element and the one or more third microphone elements are configured to form the second linear pattern along the third axis of the corresponding microphone board.
  • 15. The array microphone of claim 14, wherein the first linear pattern is configured to place the microphone boards in a harmonically-nested configuration for covering the plurality of frequency bands.
  • 16. A microphone system, comprising: an array microphone comprising a plurality of microphone elements arranged on a plurality of microphone boards, the array microphone configured to provide audio coverage for a plurality of frequency bands; andone or more audio processors in communication with the array microphone and comprising one or more beamformers, the one or more audio processors being configured to, using the one or more beamformers: steer an audio pick-up lobe of the array microphone towards an audio source detected at a first point; andgenerate an audio output based on audio signals generated by the audio source and captured using the audio pick-up lobe,wherein the one or more beamformers are configured for steering the audio pick-up lobe towards any one of a plurality of points located on a sphere surrounding a center of the array microphone, the plurality of points comprising the first point.
  • 17. The microphone system of claim 16, wherein the plurality of points are located at different azimuths and elevations around the sphere.
  • 18. The microphone system of claim 16, wherein the plurality of points cover a solid angle of four times pi steradians.
  • 19. The microphone of claim 16, wherein the audio pick-up lobe comprises a direction of highest sensitivity for the array microphone.
  • 20. The microphone system of claim 16, wherein the plurality of microphone boards are arranged in a first linear pattern along a first axis, and each microphone board comprises: a first linear array comprised of a first subset of the plurality of microphone elements, the first subset configured to form a second linear pattern along a second axis of the corresponding microphone board; anda second linear array comprised of a second subset of the plurality of microphone elements, the second subset configured to form a mirror image of the first linear array along a third axis of the corresponding microphone board,wherein the second axis is orthogonal to the first axis, and the third axis is orthogonal to the first axis and the second axis.
CROSS-REFERENCE

This application claims priority to U.S. Provisional Pat. App. No. 63/501,998, filed on May 12, 2023, the contents of which are incorporated herein in their entirety.

Provisional Applications (1)
Number Date Country
63501998 May 2023 US