As electronic and mobile devices proliferate, the use of headsets has increased. Headsets are often worn by people while listening to music, playing video games, or conducting telephone conversations. For example, it is not uncommon to see a person walking on the street or riding public transportation while wearing large headphones to listen to music or conduct a telephone call. While performing these activities, the headset user desires to be isolated from their environment so they can focus on the activity they are currently engaged in. Thus, headsets are often designed to block ambient noise in the surrounding environment from being heard. While this can be desirable to the user, it can pose safety or undesirable situations for the headset user and/or for other people trying to attract the attention of the intensive user.
In the prior art, certain headsets have typically tried to address this problem by providing an open architecture in the headset design to allow ambient sound to enter the receive channel or certain automatic noise reduction (ANR) headsets port in the external sound to the receive (Rx) channel as a manually selectable user feature. However, these solutions either defeat the user's desire to be isolated from their environment or the user selectable feature isn't turned on when the external stimulus is trying to contact an occupied unaware user.
As a result, improved methods and apparatuses for addressing desirable ambient sound in headsets are needed.
The present invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements.
Methods and apparatuses for ambient sound enablement in head worn devices are disclosed. The following description is presented to enable any person skilled in the art to make and use the invention. Descriptions of specific embodiments and applications are provided only as examples and various modifications will be readily apparent to those skilled in the art. The general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Thus, the present invention is to be accorded the widest scope encompassing numerous alternatives, modifications and equivalents consistent with the principles and features disclosed herein.
Block diagrams of example systems are illustrated and described for purposes of explanation. The functionality that is described as being performed by a single system component may be performed by multiple components. Similarly, a single component may be configured to perform functionality that is described as being performed by multiple components. For purpose of clarity, details relating to technical material that is known in the technical fields related to the invention have not been described in detail so as not to unnecessarily obscure the present invention. It is to be understood that various example of the invention, although different, are not necessarily mutually exclusive. Thus, a particular feature, characteristic, or structure described in one example embodiment may be included within other embodiments.
In one example, a headset includes a processor, a speaker arranged to output audible sound to a headset wearer ear, and an ambient microphone arranged to detect ambient sound and output an ambient sound signal. The headset further includes a memory storing an application executable by the processor configured to process the ambient sound signal and selectively output the ambient sound signal at the speaker.
In one example, a method for operating a headset includes receiving an ambient sound signal from an ambient microphone arranged to detect ambient sound external to a headset, and identifying a pre-determined interrupt condition from the ambient sound signal. The method further includes outputting the ambient sound signal at a headset speaker responsive to identifying the pre-determined interrupt condition.
In one example, one or more non-transitory computer-readable storage media have computer-executable instructions stored thereon which, when executed by one or more computers, cause the one more computers to perform operations including receiving an ambient sound signal from an ambient microphone arranged to detect ambient sound external to a headset. The operations include identifying a pre-determined output interrupt condition from the ambient sound signal, and outputting the ambient sound signal at a headset speaker responsive to identifying the pre-determined interrupt condition.
In one example, a processing circuit performs operations including receiving an ambient sound signal from an ambient microphone arranged to detect ambient sound external to a headset. The processing circuit identifies a pre-determined output interrupt condition from the ambient sound signal. The processing circuit further outputs the ambient sound signal at a headset speaker responsive to identifying the pre-determined interrupt condition.
In one example, an external facing microphone is incorporated on the earcup or insert design of a headset that is programmed to open the receive (Rx) channel when a particular noise is sensed/recognized. In a further implementation, the headset system also opens the Rx channel if the ambient noise level exceeded a predetermined level as a safety feature to inform the intensive user that a possible danger could exist. Advantageously, this functionality operates as an aid for people to more easily contact intensive headset users while engaged and/or as a headset safety feature. In one usage scenario, the headset system would recognize the headset users' name if the parent was summoning the child and open the Rx channel to external conversation.
In the example shown in
Ambient sound interrupt system 6 processes receive signal Rx2 to determine whether to open the receive channel to the speaker(s) 8 and enable (i.e., output) the ambient sound 12 at the speaker(s) 8. In one implementation, ambient sound interrupt system 6 processes receive signal Rx2 to recognize a speech in the ambient sound 12 and selectively output the ambient sound 12 at the speaker(s) 8 when the speech includes a pre-determined interrupt word or interrupt phrase. In one implementation, ambient sound interrupt system 6 processes receive signal Rx2 to determine the ambient sound signal level and selectively output the ambient sound 12 at the speakers(s) 8 when the ambient sound signal level is greater than a pre-determined threshold level. In one implementation, ambient sound interrupt system 6 processes receive signal Rx2 to identify a pre-determined interrupt sound pattern and output the ambient sound 12 at the speaker(s) 8 responsive to an identification of the pre-determined interrupt sound pattern.
In one implementation, ambient sound interrupt system 6 pauses or mutes a current receive audio signal output Rx1 at the speaker(s) 8 prior to an output of the ambient sound 12 at the speaker(s) 8. In a further implementation, ambient sound interrupt system 6 outputs the ambient sound 12 at the speaker(s) 8 in combination with a current receive audio signal Rx1 being output at the speaker(s) 8 using a signal mixer. In various examples, ambient sound 12 detected by the microphone 2 is output at the speaker(s) 8 for a pre-determined amount of time after an interrupt condition is detected, as long as a conversation is detected, or as long as an interrupt condition is detected.
Speech recognition module 22 (also sometimes referred to in the art as “voice recognition”) is operable to recognize words 28 or phrases 30 in receive signal Rx2.
Sound pattern recognition module 20 is operable to recognize sound patterns 32 in receive signal Rx2.
In one example, ambient sound interrupt system 6 is implemented on a headset. In a further example, ambient sound interrupt system 6 may be implemented on a variety of mobile devices. Ambient sound interrupt system 6 may be a distributed system. Components of ambient sound interrupt system 6 may be implemented on a single host device or across several devices, including cloud based implementations. Example devices include headsets, mobile phones, personal computers, and network servers.
In one example, a headset 42 includes a microphone 2, microphone 1010, speaker(s) 1008, a memory 1004, and a network interface 1006 operable to receive a receive audio signal to be output at the speaker and transmit a transmit audio signal (e.g., to a call participant). Headset 42 includes a digital-to-analog converter (D/A) coupled to speaker(s) 1008 and an analog-to-digital converter (A/D) coupled to microphone 1010. In one example, the network interface 1006 is a wireless transceiver or a wired network interface. In one implementation, speaker(s) 1008 include a first speaker worn on the user left ear to output a left channel of a stereo signal and a second speaker worn on the user right ear to output a right channel of the stereo signal.
Headset 42 includes an ambient microphone 2 dedicated to and optimized to detect ambient sound, which may include background noise, sounds, user voices, etc. For example, microphone 2 is placed on the headset 42 in a position so that detection of a headset wearer voice is minimized while detection of ambient sound is maximized.
Memory 1004 represents an article that is computer readable. For example, memory 1004 may be any one or more of the following: random access memory (RAM), read only memory (ROM), flash memory, or any other type of article that includes a medium readable by processor 1002. Memory 1004 can store computer readable instructions for performing the execution of the various method embodiments of the present invention. In one example, the processor executable computer readable instructions are configured to perform a process such as that shown in
Network interface 1006 allows device 1000 to communicate with other devices. Network interface 1006 may include a wired connection or a wireless connection. Network interface 1006 may include, but is not limited to, a wireless transceiver, an integrated network interface, a radio frequency transmitter/receiver, a USB connection, or other interfaces for connecting headset 42 to a telecommunications network such as a Bluetooth network, cellular network, the PSTN, or an IP network.
In one example operation, the headset 42 includes a processor 1002 configured to process the ambient sound signal and selectively output the ambient sound signal at the speaker(s) 1008. In one example, the processor 1002 is configured to process the ambient sound signal by recognizing a speech in the ambient sound signal and configured to selectively output the ambient sound signal at the speaker(s) 1008 when the speech includes a pre-determined interrupt word or interrupt phrase, such as a headset wearer name. The processor 1002 may also be configured process the ambient sound signal to identify a pre-determined interrupt sound pattern and output the ambient sound signal at the speaker(s) 1008 responsive to an identification of the pre-determined interrupt sound pattern. In a further example, the processor 1002 is configured to process the ambient sound signal by determining an ambient sound signal level and configured to selectively output the ambient sound signal at the speaker(s) 1008 when the ambient sound signal level is greater than a pre-determined threshold level. Where the processor 1002 determines that the ambient sound should be output at speaker(s) 1008, the processor is configured to pause or mute a current receive audio signal output at the speaker prior to an output of the ambient sound signal at the speaker(s) 1008, or alternatively output the ambient sound signal at the speaker(s) 1008 in combination with a current receive audio signal output at the speaker(s) 1008. In a further example, the processor 1002 is configured to only pause, reduce or mute the volume of the current receive audio signal output at the speaker when the processor 1002 identifies a pre-determined interrupt condition, and the processor 1002 does not output the ambient sound signal at the headset speaker (i.e., does not open the receive channel to the headset speaker).
In a further example, headset 42 does not include microphone 2, but only microphone 1010. In this example, microphone 1010 is operable as the ambient microphone performing functions of an ambient microphone described herein. Microphone 1010 is also operable to detect a headset wearer's voice, such as when headset used for voice communications. When not used to receive a headset user's voice, microphone 1010 is optimized to detect ambient sound, which may include background noise, sounds, user voices, etc.
At block 1404, the ambient sound data is processed to identify a speech or sound pattern. In one example, identifying the speech includes recognizing a pre-determined interrupt word or interrupt phrase in the ambient sound data. At decision block 1406, it is determined whether an interrupt word, phrase, or sound pattern is detected. If no at decision block 1406, the process returns to block 1402.
If yes at decision block 1406, at block 1408, ambient sound detected by the microphone is output at the headset speaker. In various examples, ambient sound detected by the microphone is output at the headset speaker for a pre-determined amount of time, as long as a conversation is detected, or as long as an interrupt condition is detected. Prior to outputting the ambient sound (i.e., interrupting the user), a receive audio signal currently being output at the headset speaker may be paused or muted. In a further example, the ambient sound is combined with the current receive audio signal and both are simultaneously output at the headset speaker.
At block 1504, the ambient sound data is processed to determine the ambient sound level. At decision block 1506, it is determined whether the ambient sound level is greater than a predetermined threshold level. For example, the predetermined threshold level may be in the range of 80-90 dB. If no, the process returns to block 1502.
If yes at decision block 1506, at block 1508, ambient sound detected by the microphone is output at the headset speaker. In various examples, ambient sound detected by the microphone is output at the headset speaker for a pre-determined amount of time, as long as a conversation is detected, or as long as an interrupt condition is detected. Prior to outputting the ambient sound (i.e., interrupting the user), a receive audio signal currently being output at the headset speaker may be paused or muted. In a further example, the ambient sound is combined with the current receive audio signal and both are output at the headset speaker.
At block 1604, the ambient sound signal is processed to identify a pre-determined interrupt condition. In one example, identifying the pre-determined interrupt condition includes recognizing a pre-determined interrupt word or interrupt phrase in the ambient sound signal. In one example, identifying the pre-determined interrupt condition includes determining whether an ambient sound signal level is greater than a predetermined threshold level. In one example, identifying the pre-determined interrupt condition includes identifying a pre-determined interrupt sound pattern in the ambient sound signal.
At decision block 1606, it is determined whether an interrupt condition has been identified. If no at decision block 1606, the process returns to block 1602. If yes at decision block 1606, at block 1608, the ambient sound signal is output at the headset speaker. In various examples, the ambient sound signal is output at the headset speaker for a pre-determined amount of time after the interrupt condition is identified, as long as a conversation is detected, or as long as an interrupt condition is detected. Prior to outputting the ambient sound signal (i.e., interrupting the user), a receive audio signal currently being output at the headset speaker may be paused or muted. In a further example, the ambient sound signal is combined with the current receive audio signal and both are simultaneously output at the headset speaker.
While the exemplary embodiments of the present invention are described and illustrated herein, it will be appreciated that they are merely illustrative and that modifications can be made to these embodiments without departing from the spirit and scope of the invention. Acts described herein may be computer readable and executable instructions that can be implemented by one or more processors and stored on a computer readable memory or articles. The computer readable and executable instructions may include, for example, application programs, program modules, routines and subroutines, a thread of execution, and the like. In some instances, not all acts may be required to be implemented in a methodology described herein.
Terms such as “component”, “module”, “circuit”, and “system” are intended to encompass software, hardware, or a combination of software and hardware. For example, a system or component may be a process, a process executing on a processor, or a processor. Furthermore, a functionality, component or system may be localized on a single device or distributed across several devices. The described subject matter may be implemented as an apparatus, a method, or article of manufacture using standard programming or engineering techniques to produce software, firmware, hardware, or any combination thereof to control one or more computing devices.
Thus, the scope of the invention is intended to be defined only in terms of the following claims as may be amended, with each claim being expressly incorporated into this Description of Specific Embodiments as an embodiment of the invention.