This application generally relates to an array microphone incorporating a loudspeaker. In particular, this application relates to an array microphone incorporating a variety of technologies to allow improved performance of both the microphone array and the loudspeaker.
Conferencing environments, such as conference rooms, boardrooms, video conferencing applications, and the like, can involve the use of microphones for capturing sound from various audio sources active in such environments. Such audio sources may include humans speaking, for example. The captured sound may be disseminated to a local audience in the environment through amplified speakers (for sound reinforcement), and/or to others remote from the environment (such as via a telecast and/or a webcast). The types of microphones and their placement in a particular environment may depend on the locations of the audio sources, physical space requirements, aesthetics, room layout, and/or other considerations. For example, in some environments, the microphones may be placed on a table or lectern near the audio sources. In other environments, the microphones may be mounted overhead to capture the sound from the entire room, for example. Accordingly, microphones are available in a variety of sizes, form factors, mounting options, and wiring options to suit the needs of particular environments.
Traditional microphones typically have fixed polar patterns and few manually selectable settings. To capture sound in a conferencing environment, many traditional microphones can be used at once to capture the audio sources within the environment. However, traditional microphones tend to capture unwanted audio as well, such as room noise, echoes, and other undesirable audio elements. The capturing of these unwanted noises is exacerbated by the use of many microphones.
Array microphones having multiple microphone elements can provide benefits such as steerable coverage or pick up patterns (having one or more lobes), which allow the microphones to focus on the desired audio sources and reject unwanted sounds such as room noise. The ability to steer audio pick up patterns provides the benefit of being able to be less precise in microphone placement, and in this way, array microphones are more forgiving. Moreover, array microphones provide the ability to pick up multiple audio sources with one array microphone or unit, again due to the ability to steer the pickup patterns.
However, the position of lobes of a pickup pattern of an array microphone may not be optimal in certain environments and situations. For example, an audio source that is initially detected by a lobe may move and change locations. In this situation, the lobe may not pick up the audio source as well at its new location.
In teleconferencing applications, loudspeakers are used to allow participants to hear the audio from the far end and microphones transmit the participants' speech to the far end. However, the microphones might pick up the sound from the loudspeaker and rebroadcast it to the far end, causing the far-end users to hear an echo of their own voices. Technologies such as acoustic echo cancelation (AEC) are known in the art to reduce the perceived echo. However, the performance of these technologies can be improved by using techniques to limit the extent to which the microphones pick up the loudspeaker output before AEC processing.
In some conference room applications, the loudspeaker may be installed as a separate component, but it would be convenient to include at least one loudspeaker within the same housing as the array microphone. However, including a loudspeaker within an array microphone may potentially increase the extent to which the microphone array picks up the output of the loudspeaker. In addition, including a loudspeaker within an array microphone would potentially cause distortion of the microphone signal and/or loudspeaker output caused by the loudspeaker output energizing components of the array microphone and causing them to vibrate. Accordingly, there is an opportunity for an array microphone that addresses these concerns while incorporating a loudspeaker.
A communications device is described that may include a system housing, a microphone array, a loudspeaker, and a loudspeaker housing. The loudspeaker housing is configured to minimize acoustic coupling between the loudspeaker and the microphone array, and at least a portion of the loudspeaker housing is positioned outside of the system housing. The loudspeaker housing may include a plurality of loudspeaker housing mounts. The loudspeaker housing may include first and second halves which may have a gasket positioned between them. The gasket between the first half and the second half of the loudspeaker housing may be configured to dampen vibrations.
The loudspeaker housing mounts may include a first threaded end, a second threaded end, and an elastomeric center connecting the first and second threaded ends. The elastomeric center may be configured to dampen vibrations. The threaded ends may include an anti-rotation shoulder configured to prevent rotation of the loudspeaker housing mount when the anti-rotation shoulder is engaged within a corresponding hole. The anti-rotation shoulder may have a square cross-section and the corresponding hole may have a matching square opening.
The system housing may also include a sound-permeable screen, a fabric backing adjacent to the sound-permeable screen, and a fabric retainer. The fabric retainer may be positioned between the loudspeaker housing and the fabric backing. The fabric retainer may be elastically deformed between the loudspeaker housing and the fabric backing, causing the fabric backing to be held against the sound-permeable screen.
The communications device may include a frame with a plurality of slots configured to secure the sound-permeable screen and the sound-permeable screen may have edges that are secured within the plurality of slots. The edges may include raised dimples that form an interference fit with the slots when the sound-permeable screen is secured within the slots.
The communications device may also include a Power over Ethernet (PoE) power supply and a loudspeaker amplifier. The amplifier may include a power limitation circuit that may be configured to prevent an average PoE power drawn by the communications device from exceeding a PoE power budget. The amplifier may also be configured to provide temporary peak power to the loudspeaker in excess of the PoE power budget without drawing power in excess of the PoE limit from the PoE power supply. The temporary peak power may be provided by a peak supply capacitor.
The microphone array may be a beamforming microphone array. The microphone array may include concentric rings of microphones. The communications device may also include a digital signal processor within the housing, wherein a designated amount of required signal processing is performed in the digital signal processor. The designated amount may be 100%.
To facilitate an understanding of the principals and features of the disclosed technology, illustrative embodiments are explained below. The components described hereinafter as making up various elements of the disclosed technology are intended to be illustrative and not restrictive. Many suitable components that would perform the same or similar functions as components described herein are intended to be embraced within the scope of the disclosed electronic devices and methods. Such other components not described herein may include, but are not limited to, for example, components developed after development of the disclosed technology. Referring now to the Figures, in which like reference numerals represent like parts, various embodiments of the computing devices and methods will be disclosed in detail.
In one example, the system housing 124 may be compatible with mounting in a standard drop ceiling. A drop ceiling is a secondary ceiling, hung below the main (structural) ceiling. It may also be referred to as a drop ceiling grid, T-bar ceiling, false ceiling, suspended ceiling, grid ceiling, drop in ceiling, drop out ceiling, or ceiling tiles, as will be understood by those skilled in the art. In a further example, the system housing 124 may have a square shape. In a further example, the square system housing 124 may be 24 inches×24 inches, 600 mm×600 mm, or 630 mm×630 mm for mounting in a drop ceiling grid. In another example, the system housing 124 may have a flange 134 configured to support the communications device 100 in the drop ceiling grid. In a further example, the flange 134 may be configured to position the communications device 100 such that a portion of communications device 100 extends a fixed amount into the room below the drop ceiling grid.
In another example, some portions of the communications device 100 could be circular. For example, the system housing 124 may be circular instead of square. If the system housing 124 is circular, it may include provisions for mounting from a pole (e.g., a VESA pole) or via a suspension cable or cables in a balanced manner. In addition, as discussed below, the microphone array could be circular, including a circular array of microphone elements and/or a circular substrate. Similarly, the loudspeaker 250 could have a circular profile shape. Also, a plurality of loudspeakers could be employed in a circular array.
The microphones may be any suitable type of transducer that can detect the sound from an audio source and convert the sound to an electrical audio signal. In a preferred embodiment, the microphones are micro-electrical mechanical system (MEMS) microphones. In other embodiments, the microphones may be condenser microphones, balanced armature microphones, electret microphones, dynamic microphones, and/or other types of microphones.
The microphones can be coupled to, or included on, a substrate. In the case of MEMS microphones, the substrate may be one or more printed circuit boards (also referred to herein as “microphone PCB”). For example, the microphones may be surface mounted to the microphone PCB and included in a single plane. In other embodiments, for example, where the microphones are condenser microphones, the substrate may be made of carbon-fiber, or other suitable material.
In embodiments, the microphones can be arranged in concentric, circular rings of varying sizes, so as to avoid undesired pickup patterns (e.g., due to grating lobes) and accommodate a wide range of audio frequencies. As used herein, the term “ring” may include any type of circular configuration (e.g., perfect circle, near-perfect circle, less than perfect circle, etc.), as well as any type of oval configuration or other oblong loop. As explained in U.S. Pat. No. 9,565,493, the rings can be positioned at various radial distances from a central microphone, or a central point of the substrate, to form a nested configuration that can handle progressively lower audio frequencies, with the outermost ring being configured to better operate at the lowest frequencies in a predetermined operating range. Using harmonic nesting techniques, the concentric rings can be used to cover specific frequency bands within a range of operating frequencies.
In embodiments, each ring contains a different subset of the remaining microphones, and each subset of microphones can be positioned at predetermined intervals along a circumference of the corresponding ring. The predetermined interval or spacing between neighboring microphones within a given ring can depend on a size or diameter of the ring, a number of microphones included in the subset assigned to that ring, and/or a desired sensitivity or overall sound pressure for the microphones in the ring. Increasing the number of microphones and a microphone density of the rings (e.g., due to nesting of the rings) can help remove grating lobes and thereby, produce an improved beamwidth with a near constant frequency response across all frequencies within the preset range.
In the illustrated example, the loudspeaker housing 200 is positioned in a corner of the system housing 124, and thus does not interfere with the circular microphone array 114. However, in another example, the loudspeaker housing 200 may be positioned such that the loudspeaker 250 protrudes through the microphone array 114. In such an example, the loudspeaker 250 may be positioned in the space between two microphone elements of the microphone array 114. The microphone array 114 may incorporate a through-hole to accommodate the loudspeaker 250 and/or loudspeaker housing 200.
The communications device 100 may be powered by Power over Ethernet plus (PoE+). PoE+ is a protocol that allows a communications device to be powered over the same cables used for Ethernet communication, e.g., “Cat 6” cables. Power over Ethernet (PoE) protocols limit the amount of power that a device can draw, based on the classification of the PoE devices. PoE+ is a class of device under PoE protocols, which allocate a maximum power draw for each PoE+ device. Similar PoE protocols include IEEE 802.3bt (PoE++ or 4PPoE). However, a loudspeaker may, under some circumstances, draw more power or cause the communications device 100 to draw more power than is allowed under these protocols. Accordingly, the communications device 100 may include a loudspeaker amplifier that has a power limitation circuit to prevent the communications device 100 from drawing more power than is allowed by the PoE or PoE+ protocol.
The current-limited power is supplied to the loudspeaker amplifier 512. The loudspeaker amplifier 512 may be an integrated circuit or may be formed from discrete components. In one example, the loudspeaker amplifier 512 may be a Class D amplifier.
In another example, the output of the loudspeaker 250 may be limited by a control circuit in the DSP 106, limiting the amplitude of the input signal to the loudspeaker amplifier 512. In another example, the communications device 100 may limit the power of the loudspeaker 250 using both the analog current-limitation circuit 500 and the control circuit in the DSP 106. In another example, the communications device 100 may be able to differentiate between types of PoE power supplies or sources to which it might be connected. For example, the communications device 100 may be able to identify if it is connected to a “normal” PoE power supply or source, or to a PoE+ power supply or source. If the PoE power supply or source is incapable of providing enough power for both the microphone functions (e.g., the DSP 106) and the loudspeaker functions, the communications device 100 may disable the loudspeaker functions to prevent overloading the PoE power supply or source.
Additional Digital Signal Processing
As explained above, incorporating a loudspeaker within the same system housing as an array microphone can distort the microphone signal and make echo cancelation more challenging. In addition to the physical techniques described above, advanced digital signal processing techniques can be used to improve performance of the microphone array when co-housed with a loudspeaker.
In one example, the lobes of the microphone array can be configured to have an adjustable beamwidth that allows the audio component to effectively track, and capture audio from, human speakers as they move within the environment, as explained in U.S. Pat. No. 9,565,493, which is incorporated herein by reference. In some cases, the microphone array system and/or the control device may include a user control that allows manual beamwidth adjustment. For example, the user control may be a knob, slider, or other manual control that can be adjusted between three settings: normal beamwidth, wide beamwidth, and narrow beamwidth. In other cases, the beamwidth control can be configured using software running on the audio component and/or the control device.
In a further example, the microphone may employ methods that enable more precise control of lobes and nulls of an array microphone are provided. Optimized beamformer coefficients can be generated to result in beamformed signals associated with one or more lobes steered towards one or more desired sound locations and one or more nulls steered towards one or more undesired sound location, e.g., the loudspeaker 250. The performance of the AEC can thus be improved and enhanced. Additional details regarding methods enabling more precise control of lobes and nulls of the array microphone are described in U.S. Provisional Patent Application No. 63/266,555, filed Jan. 7, 2022 and U.S. patent application Ser. No. 18/151,042 filed Jan. 6, 2023, both titled “Audio Beamforming with Nulling Control System and Methods,” which are incorporated by reference herein.
In a further example, multiple microphones or microphone arrays, some of which may include internal loudspeakers, may be used in conjunction with each other. Examples may include an audio system that includes a plurality of microphones disposed in an environment, where the plurality of microphones is configured to detect one or more audio sources, and generate location data indicating a location of each audio source relative to each of the microphones. These audio sources may include loudspeakers, including loudspeakers incorporated within microphone arrays. These microphones may be, but are not limited to, beamforming microphone arrays. In another example, the location data may also be used to communicate the locations of the microphones relative to each other. A processor connected to the microphones may receive the location data from the microphones, and define audio pickup regions in the environment based on the location data. The microphones may then be configured to deploy beamformed lobes in one or more of the audio pickup regions. Additional details regarding methods using multiple array microphones together are described in U.S. Provisional Patent Application No. 63/266,553, filed Jan. 7, 2022 and U.S. patent application Ser. No. 18/151,346 filed Jan. 6, 2023, both titled “System and Method for Automatic Setup of Audio Coverage Area,” which are incorporated by reference herein.
In a further example, AEC performance can be improved by using a non-linear processor (NLP) to assist in suppressing far end single talk leakage, as is known in the art. NLP can be improved by generating a continuous rather than binary mask value that can be used as the gain of a non-linear processor, as described in U.S. Provisional Patent Application No. 63/260,750 filed Aug. 31, 2021 and U.S. patent application Ser. No. 17/823,295 filed Aug. 30, 2022, both titled “Mask Non-Linear Processor For Acoustic Echo Cancellation”, which are incorporated by reference herein. Communication between the loudspeaker 250 and the non-linear processor can be utilized to adjust the threshold of the non-linear processor when the loudspeaker 250 is active to assist in suppressing far end single talk leakage. These techniques can improve the removal of residual echo and therefore enhance the overall performance of the acoustic echo cancellation system when the loudspeaker 250 is located in the same system housing 124 as the microphone array 114.
In a further example, the communications device may utilize a hybrid audio beamforming system that includes a time domain beamformer for processing upper frequency band signals of an audio signal using a time domain beamforming technique, and a frequency domain beamformer for processing groups of lower frequency band signals of the audio signal using frequency domain beamforming techniques. Additional details regarding methods using a hybrid audio beamforming system are described in U.S. Provisional Patent Application No. 63/142,711 filed Jan. 28, 2021 and U.S. patent application Ser. No. 17/586,213 filed Jan. 27, 2022, both titled “Hybrid Audio Beamforming System,” which are incorporated by reference herein.
The design and functionality described in this application is intended to be exemplary in nature and is not intended to limit the instant disclosure in any way. Those having ordinary skill in the art will appreciate that the teachings of the disclosure may be implemented in a variety of suitable forms, including those forms disclosed herein and additional forms known to those having ordinary skill in the art. For example, one skilled in the art will recognize that executable instructions may be stored on a non-transient, computer-readable storage medium, such that when executed by one or more processors, causes the one or more processors to implement the method described above.
It must also be noted that, as used in the specification and the appended claims, the singular forms “a,” “an” and “the” include plural referents unless the context clearly dictates otherwise. By “comprising” or “containing” or “including” is meant that at least the named compound, element, particle, or method step is present in the composition or article or method, but does not exclude the presence of other compounds, materials, particles, method steps, even if the other such compounds, material, particles, method steps have the same function as what is named.
It is also to be understood that the mention of one or more method steps does not preclude the presence of additional method steps or intervening method steps between those steps expressly identified. Similarly, it is also to be understood that the mention of one or more components in a device or system does not preclude the presence of additional components or intervening components between those components expressly identified.
Certain embodiments of this technology are described above with reference to block and flow diagrams of computing devices and methods and/or computer program products according to example embodiments of the disclosure. It will be understood that one or more blocks of the block diagrams and flow diagrams, and combinations of blocks in the block diagrams and flow diagrams, respectively, can be implemented by computer-executable program instructions. Likewise, some blocks of the block diagrams and flow diagrams may not necessarily need to be performed in the order presented, or may not necessarily need to be performed at all, according to some embodiments of the disclosure.
These computer-executable program instructions may be loaded onto a general-purpose computer, a special-purpose computer, a processor, or other programmable data processing apparatus to produce a particular machine, such that the instructions that execute on the computer, processor, or other programmable data processing apparatus create means for implementing one or more functions specified in the flow diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means that implement one or more functions specified in the flow diagram block or blocks.
As an example, embodiments of this disclosure may provide for a computer program product, comprising a computer-usable medium having a computer-readable program code or program instructions embodied therein, said computer-readable program code adapted to be executed to implement one or more functions specified in the flow diagram block or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational elements or steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions that execute on the computer or other programmable apparatus provide elements or steps for implementing the functions specified in the flow diagram block or blocks.
Accordingly, blocks of the block diagrams and flow diagrams support combinations of means for performing the specified functions, combinations of elements or steps for performing the specified functions, and program instruction means for performing the specified functions. It will also be understood that each block of the block diagrams and flow diagrams, and combinations of blocks in the block diagrams and flow diagrams, can be implemented by special-purpose, hardware-based computer systems that perform the specified functions, elements or steps, or combinations of special-purpose hardware and computer instructions.
While certain embodiments of this disclosure have been described in connection with what is presently considered to be the most practical and various embodiments, it is to be understood that this disclosure is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
This written description uses examples to disclose certain embodiments of the technology and also to enable any person skilled in the art to practice certain embodiments of this technology, including making and using any apparatuses or systems and performing any incorporated methods. The patentable scope of certain embodiments of the technology is defined in the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.
This application claims the benefit of U.S. Provisional Patent Application No. 63/298,169 filed on Jan. 10, 2022 and is fully incorporated by reference in its entirety herein. This application is related to U.S. Pat. No. 9,565,493 filed Apr. 30, 2015 and issued Feb. 7, 2017, entitled “Array Microphone System and Method of Assembling The Same.” This application is also related to U.S. Provisional Patent Application No. 63/266,555 filed Jan. 7, 2022 and U.S. patent application Ser. No. 18/151,042 filed Jan. 6, 2023, both entitled “Audio Beamforming With Nulling Control System And Methods.” This application is also related to U.S. Provisional Patent Application No. 63/266,553 filed Jan. 7, 2022 and U.S. patent application Ser. No. 18/151,346 filed Jan. 6, 2023, both entitled “System And Method for Automatic Setup of Audio Coverage Area.” This application is also related to U.S. Provisional Patent Application No. 63/260,750 filed Aug. 31, 2021 and U.S. patent application Ser. No. 17/823,295 filed Aug. 30, 2022, both entitled “Mask Non-Linear Processor For Acoustic Echo Cancellation.” This application is also related to U.S. Provisional Patent Application No. 63/142,711 filed Jan. 28, 2021 and U.S. patent application Ser. No. 17/586,213 filed Jan. 27, 2022, both entitled “Hybrid Audio Beamforming System.” The foregoing patents and patent applications are hereby incorporated by reference into this application in their entireties.
Number | Date | Country | |
---|---|---|---|
63298169 | Jan 2022 | US |