Patent Application
20180124513
This disclosure generally relates to personal acoustic systems such as headphones used in gaming and virtual reality (VR) applications.
Headphones are typically worn by a user in, on, or over the ears. This may occlude outside sounds from reaching the ears of a person using such headphones.
In one aspect, this document features an apparatus that includes an open headphone, a subwoofer, and a controller. The open headphone includes an electroacoustic transducer, and a support structure for supporting the electroacoustic transducer proximate to a user's ear in an acoustically open configuration. The subwoofer is configured to output low-frequency audio, and the controller includes one or more processing devices. The controller is configured to generate one or more control signals to control the audio output from one or both of the electroacoustic transducer and the subwoofer, and control one or both of the electroacoustic transducer and the subwoofer using the generated control signals.
In another aspect, this document features an apparatus that includes an open headphone and a controller. The open headphone includes an electroacoustic transducer, and a support structure for supporting the electroacoustic transducer in an acoustically open configuration. The controller includes one or more processing devices, and is configured to establish a connection with a subwoofer configured to output low-frequency audio. The controller is also configured to generate one or more control signals for controlling the audio output from one or both of the electroacoustic transducer and the subwoofer, and provide the one or more control signals for controlling one or both of the electroacoustic transducer and the subwoofer.
In another aspect, this document features a method that includes establishing, by a controller having one or more processing devices, a first connection to an open headphone that includes an electroacoustic transducer. The method also includes establishing, by the controller, a second connection with a subwoofer configured to output low-frequency audio, and generating one or more control signals for controlling the audio output from one or both of the electroacoustic transducer and the subwoofer in accordance with a target frequency response. The method further includes providing the one or more control signals for controlling one or both of the electroacoustic transducer and the subwoofer.
Implementations of the above aspects can include one or more of the following features.
The one or more control signals can be generated in accordance with a target frequency response of the apparatus. The controller can be configured to determine, in accordance with the target frequency response, a cross-over frequency for distributing audio output between the electroacoustic transducer and the subwoofer, and generate the one or more control signals based on the cross-over frequency. The one or more control signals can include a gain control signal for the acoustic transducer and/or the subwoofer. The controller can be configured to detect an onset of an overdrive condition of the acoustic transducer, and adjust the output of the acoustic transducer responsive to detecting the overdrive condition to mitigate the overdrive condition. The low-frequency audio output by the subwoofer can be in a frequency range of 0-200 Hz. The low-frequency audio output by the subwoofer can include unlocalizable bass. The open headphone can be configured to be connected to a virtual reality (VR) system.
Various implementations described herein may provide one or more of the following advantages. Gaming and virtual reality experiences may be significantly enhanced by using an open headphone system in conjunction with a low-frequency driver such as a subwoofer. For example, on one hand, substituting an in-ear, on-ear, or over-the-ear headphone with an open headphone allows for increased situational awareness and un-occluded ears. This, in turn, may be leveraged to deliver impactful bass through a sub-woofer, which may enhance the overall acoustic experience. Tailoring the output of the open headphones and/or the subwoofer in accordance with a target frequency response may allow for delivering an acoustic experience that balances the benefits of three-dimensional (3D) binaural audio with impactful bass.
Two or more of the features described in this disclosure, including those described in this summary section, may be combined to form implementations not specifically described herein.
The details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, objects, and advantages will be apparent from the description and drawings, and from the claims.
Headphones are widely used as personal acoustic devices. Commercially available headphones typically fall into the categories of in-ear headphones, on-ear headphones, or over-the-ear headphones. Each of these categories of headphones may provide an immersive acoustic experience by substantially occluding any ambient noise from entering the ears of the user. Such occlusion, however, may isolate users from ambient sounds to an extent where the user is not aware of his/her surroundings. Further, the electroacoustic transducers of such headphones are typically incapable of producing high-impact “chest-thumping” bass that may be desirable, for, example, during watching movies, playing action-packed audio-visual games, or experiencing VR shows. In some cases, a separate low-frequency driver such as a subwoofer may be used to supplement the audio of the headphones with bass-rich content. However, if the ears of the user are occluded by a headphone, the effectiveness of the subwoofer may be significantly limited.
This document describes technology that uses an open-headphone together with a low frequency driver such as a subwoofer to produce an acoustic experience that may achieve a desirable trade-off between near-field audio and rich bass. Open-headphones include electroacoustic transducers (which may also be referred to as acoustic transducers) that are disposed proximate to a user's ears in a way that does not occlude the user's ears. The technology described herein leverages such non-occluding property of open-headphones to deliver bass-rich acoustic experiences that also use an appropriately tuned low-frequency driver such as a subwoofer. This may significantly improve user experience in gaming and virtual reality (VR) applications, where the near-field audio from the open headphones is supplemented by impactful “chest-thumping” bass delivered by the subwoofer. A controller can be used to tailor the outputs of the open-headphones and subwoofer in accordance with a target frequency response such that directional audio from the open-headphones may be balanced with unlocalizable bass produced by the subwoofer.
In the example of
Other configurations of open-headphones are also possible. For example, some open headphones may include one or more acoustic transducers disposed on a support structure such as a neck-pad or shoulder-pad, which when worn by the user, places the acoustic transducers sufficiently proximate to the user's ears. Examples of such neck-pad type support structures are described in U.S. application Ser. No. 14/857,287, filed on Sep. 17, 2015. In another example, the acoustic transducers 111 of the open-headphones may be supported proximate to the user's ears by a support structure that sits over the user's head. In another example, the acoustic transducers can be suspended from another wearable device (e.g., the band of a VR headset 120) using a corresponding support structure. Other open-headphones that place acoustic transducers 111 proximate or adjacent to a user's ears without occluding at least a portion of the ears are also possible.
The proximity of the acoustic transducers 111 to the user's ears may vary from one open-headphone to another, and can depend, for example, the type of acoustic transducer and/or the specific application. For example, acoustic transducers that are highly directional may be positioned at a larger distance from the ears than acoustic transducers that are less directional. In some implementations, the proximity may also depend on the loudness of the corresponding transducers. In some implementations, the proximity may depend on other qualities or functionalities of the acoustic transducers. In general, the proximity of the acoustic transducers 111 can be configured for a given set of open-headphones to provide a target acoustic experience that balances a loudness of the transducers against an occlusion property. For example, a transducer can be placed closer to an ear for more loudness at the cost of increased occlusion of ambient sounds.
In some implementations, open-headphones can include one or more microphones that are used to sense noise in an environment near the headphones. Microphone signals are then used by a processor to operate an electroacoustic transducer of the headphones to reduce noise that is heard by a headphone user. In such ANR systems, the user is able to hear the audio even in noisy environments. In some implementations, the ANR has an equivalent effect of turning the audio volume up and can make the headphone suitable in noisy environments, e.g., environments where the noise is higher than 70 dBA. Such ANR systems, as well as other examples of open-headphones are described in U.S. patent application Ser. No. 15/223,634, filed on Aug. 28, 2016, the entire content of which is incorporated herein by reference. In some implementations, the ANR system may have to be configured such that the ANR does not significantly reduce low frequency content generated using a subwoofer.
In some implementations, the open headphones 110, 112 can be used in conjunction with a VR headset 120 and/or other VR accessories. VR technology can be used to generate realistic images, sounds and other sensations (temperature, haptic feedback etc.) that simulate a user's physical presence in a three-dimensional (3D) real or pseudo-real environment. In some implementations, VR technology may also enable the user to interact with various features or items that are depicted, for example, on a screen of the VR headset 120. Other VR accessories can be used to simulate sensory experiences, which can include, for example, sight, touch, hearing, and/or smell. While
In some implementations, an effective VR experience may benefit from the generation of bass-rich audio content that is beyond the capability of headphones. For example, if the user is experiencing an action-packed VR show that involves body-vibrating and high-adrenaline audio, the acoustic transducers of a headphone may prove to be inadequate in delivering such an immersive experience. In some implementations, the audio experience may be significantly improved by delivering bass-rich audio content through a subwoofer (or other low-frequency drivers) that supplements the audio delivered through the open headphones. Because the open-headphones do not occlude the ears, the user would be able to hear both the near-field audio generated by the headphones 110, 112, as well as the bass-rich content generated by the subwoofer. This in turn may improve the overall VR experience for the user by delivering more realistic and immersive acoustics.
In some implementations, the controller 215 can be used for implementing one or more tuning processes and adjust the open headphone 205 and/or the subwoofer 210 accordingly. The controller 215 can include one or more processing devices, and can be configured to generate control signals for adjusting the open headphone 205 and/or the subwoofer 210. The controller 215 can be connected to the open headphone 205 and the subwoofer 210 via wired or wireless connections. For example, the controller 215 may be connected to the open headphone 205 and the subwoofer 210 over a Wi-Fi® or Bluetooth® connection. In some implementations, the controller 215 can be disposed in a stand-alone unit that can be connected to the open-headphone and the subwoofer, e.g., via one or more wired/wireless connection ports provided on the unit. In some implementations, the controller can be disposed within another device such as the open-headphone 205, a VR headset (e.g., the VR headset 120 shown in
The controller 215 can include one or more processing devices such as microprocessors, microcontrollers, or digital signal processors (DSP), which can be configured to implement various tuning processes. In some implementations, the controller 215 can be configured to determine a cross-over frequency between the open headphone 205 and the subwoofer 210. The selection of cross-over frequency can significantly affect the user experience. For example, if the open headphone is tuned to play frequencies that are too low (e.g., 60-70 Hz or lower), inherent limitations of the corresponding acoustic transducers may prevent the corresponding acoustic output from being loud enough, which in some cases may lead to spectrally unbalanced audio. Such a situation may also entail the capabilities of the subwoofer (which is equipped to generate powerful low frequency audio, e.g., in the 0-200 Hz range) being used in a sub-optimal way. On the other hand, if the cross-over frequency is too high, the subwoofer 210 may handle at least a portion of the mid-frequency range, which in turn may cause an undesired localization of the corresponding audio. In some implementations, the controller 215 can be configured to determine the cross-over frequency according to achieve a target frequency response for the system. For example, for a given combination of open-headphone and subwoofer, the controller 215 can be configured to determine (or access stored information on) a cross-over frequency that makes the subwoofer virtually invisible (e.g., the acoustic output of the subwoofer is unlocalizable) and a desired frequency response is achieved by the overall system. In some implementations, the cross-over frequency may be determined offline (e.g., during a system tuning process), and made available to the controller 215.
In some implementations, in order to keep up with the high power output of the subwoofer 210, the electroacoustic transducers of the open headphone 205 has to be driven much harder, for example, than that of a regular headphone. Unless such overdrive of the transducer is corrected, this may result in unpleasant distortions, and in some cases, even transducer damage. In some implementations, the controller 215 is configured to implement limiter processes that aim to prevent such transducer overdrive. In some implementations, this can include applying a limiting gain for the audio output using the open headphone 205 and/or the subwoofer 210. In some implementations, the limiting gain can be selected dynamically, for example, based on a target distortion performance threshold that may vary with frequency. As such, various limiter processes may be implemented by the controller to obtain a target frequency response performance from the combination of open headphone 205 and subwoofer 210. Examples of such limiter processes and systems are described in U.S. Pat. No. 8,351,621, and U.S. patent application Ser. No. 14/918,145, filed on Oct. 20, 2015, the entire contents of which are incorporated herein by reference.
Operations of the process 400 also includes establishing a second connection with a subwoofer configured to output low-frequency audio (420). In some implementations, the second connection may be established in a way that is substantially similar to the way in which the first connection is established. For example, both the open headphone and the subwoofer may be Bluetooth® enabled, and just like the first connection, the second connection can be established using a Bluetooth® pairing process. In some implementations, the second connection can be established in a way that is different from the way the first connection is established. For example, the second connection can be established via a wired connection whereas the first connection is a wireless connection.
Operations of the process 400 further includes generating one or more control signals for controlling the audio output from one or both of the electroacoustic transducer and the subwoofer (430). This can be done, for example, in accordance with a target frequency response as illustrated above. Generation of such control signals can include, for example, determining, in accordance with the target frequency response, a cross-over frequency for distributing audio output between the electroacoustic transducer of the open headphone and the subwoofer, and generating the one or more control signals in accordance with the determined cross-over frequency. For example, the control signals can include gain control signals that adjust the gain of the electroacoustic transducer (or the subwoofer) at frequencies higher and lower than the crossover frequency. In some implementations, the crossover frequency may be represented by a range. In some implementations, the one or more control signals can be configured to adjust the electroacoustic transducer in accordance with a limiter process. This can include, for example, detecting an onset of an overdrive condition in the acoustic transducer, and adjusting the output of the acoustic transducer responsive to detecting the overdrive condition to mitigate the overdrive condition.
Operations of the process 400 also includes providing the one or more control signals for controlling one or both of the electroacoustic transducer and the subwoofer (440). This can include, for example, transmitting the one or more control signals to the transducer (or the subwoofer) to cause changes to one or more operating parameters of the corresponding device. For example, gain control signals can be provided to one or both of the devices such that the corresponding outputs are adjusted in accordance with a target frequency response for the overall system.
The functionality described herein, or portions thereof, and its various modifications (hereinafter “the functions”) can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media or storage device, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.
A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a network.
Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). In some implementations, at least a portion of the functions may also be executed on a floating point or fixed point digital signal processor (DSP) such as the Super Harvard Architecture Single-Chip Computer (SHARC) developed by Analog Devices Inc., or an Advanced RISC Machine (ARM) processor.
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.
Other embodiments and applications not specifically described herein are also within the scope of the following claims. For example, while the above description primarily refers to VR applications and open headphones, the technology may be used for other applications (non-VR gaming, movie-watching etc.), and/or in conjunction with other devices such as on-ear, in-ear, or over-the-ear headphones. Elements may be left out of the structures described herein without adversely affecting their operation. Furthermore, various separate elements may be combined into one or more individual elements to perform the functions described herein.
