Patent Application
20140146976
This relates to electronic devices and, more particularly, to electronic devices with accessories such as earphones.
Accessories such as earphones are often used with media players, cellular telephones, and other electronic devices. Some accessories have microphones that are used to form part of a noise cancellation circuit. When noise cancellation functions are active, the impact of ambient noise on audio playback can be reduced. Microphones can also be used to implement voice microphone noise cancellation.
There can be difficulties associated with noise cancelling earphones. For example, a user who is using earphones to listen to audio while noise cancellation circuitry in the earphones is active may occasionally need to remove the earphones. When doing so, the user may not be able to manually turn off noise cancellation features. Actively running noise cancellation operations in an accessory when a user is not using the accessory increases power consumption and decreases the battery life of the accessory.
It would therefore be desirable to be able to provide improved ways in which to control operation of an electronic device coupled to an accessory such as noise cancelling earphones.
An electronic device may be coupled to an accessory such as a pair of earphones having noise cancellation features. The noise cancellation features may be used to reduce the impact of ambient noise on the audio content that is played through the earphones.
The earphones may have ear presence sensor structures that determine whether or not speakers in the earphones are present at the ears of the user. Information from the ear presence sensor structures may be used to control the operation of the noise cancellation features. In one suitable embodiment, noise cancellation features may be implemented using noise cancellation circuitry in the earphones. With this type of configuration, control circuitry in the earphones may adjust the noise cancellation circuitry in response to information from the ear presence sensor structures. For example, control circuitry in the earphones may automatically deactivate noise cancellation circuitry when information from the ear presence sensor structures indicates that the earphones have been removed from a user's ears. When information from the ear presence sensor structures indicates that the earphones have been placed in or on the user's ears, the control circuitry in the earphones may, if desired, automatically activate the noise cancellation circuitry.
In another suitable embodiment, noise cancellation features may be implemented using noise cancellation circuitry in the electronic device. With this type of configuration, information from ear presence sensor structures may be conveyed to control circuitry in the electronic device. The control circuitry may adjust the noise cancellation circuitry in response to information received from the ear presence sensor structures. For example, control circuitry in the electronic device may automatically deactivate noise cancellation circuitry when information from the ear presence sensor structures indicates that the earphones have been removed from a user's ears. When information from the ear presence sensor structures indicates that the earphones have been placed in or on the user's ears, the control circuitry in the earphones may, if desired, automatically activate the noise cancellation circuitry.
Controlling the operation of noise cancellation circuitry based on whether or not the earphones are present at the user's ears may reduce the power consumption of a battery in the earphones or in the electronic device.
The ear presence sensor structures may include switch-based sensors, accelerometer-based sensors, light-based sensors, or other suitable types of sensors.
Further features of the invention, its nature and various advantages will be more apparent from the accompanying drawings and the following detailed description of the preferred embodiments.
Electronic device accessories such as earphones may be provided with noise cancellation features. When noise cancellation features are activated, the impact of ambient noise on audio content that is played through the earphones can be reduced. Noise cancellation features may also be used to perform voice microphone noise cancellation.
Noise cancellation features may be implemented using one or more noise cancellation microphones. For example, a voice microphone in the accessory may have an associated noise cancellation microphone that picks up ambient noise in the vicinity of the voice microphone.
Earphone speaker housings in an accessory may also have noise cancellation microphones. For example, each earphone speaker housing in a headset may have an external noise cancellation microphone on an outer surface of the earphone speaker housing. In addition to the external noise cancellation microphone or instead of the external noise cancellation microphone, each earphone speaker housing may have an internal noise cancellation microphone on an interior surface of the earphone speaker housing (e.g., adjacent to the ear).
In accessories with more speakers, more noise cancellation microphones may be used. For example, additional noise cancellation microphones can be provided in earbuds that contain multiple drivers or in surround sound accessories. A surround sound accessory might, for example, have five or six speakers (or more) and might have a noise cancellation microphone that is adjacent to each respective speaker.
Accessories such as earphones having noise cancellation features may be provided with the ability to sense the presence of external objects. For example, an earphone accessory may be provided with sensor structures such as ear presence sensor structures that can determine whether or not the earphones (i.e., the earphone speakers) are located in or on the ears of a user.
Information gathered by the sensor structures may be used to control the operation of noise cancellation features in the earphones. For example, control circuitry in the accessory or in the electronic device may automatically activate or deactivate noise cancellation features based on whether or not the earphones are located in or on the ears of a user. Controlling noise cancellation features in a pair of earphones coupled to an electronic device based on whether or not the user is wearing the earphones may reduce power consumption and extend the battery life of the earphones and/or of the electronic device.
Electronic device 10 may include a display such as display 14. Display 14 may be a touch screen that incorporates a layer of conductive capacitive touch sensor electrodes or other touch sensor components or may be a display that is not touch-sensitive. Display 14 may include an array of display pixels formed from liquid crystal display (LCD) components, an array of electrophoretic display pixels, an array of plasma display pixels, an array of organic light-emitting diode display pixels, an array of electrowetting display pixels, or display pixels based on other display technologies. Configurations in which display 14 includes display layers that form liquid crystal display (LCD) pixels may sometimes be described herein as an example. This is, however, merely illustrative. Display 14 may include display pixels formed using any suitable type of display technology.
Display 14 may be protected using a display cover layer such as a layer of transparent glass or clear plastic. Openings may be formed in the display cover layer. For example, an opening may be formed in the display cover layer to accommodate a button such as button 16 and an opening such as opening 18 may be used to form a speaker port.
Device 10 may have a housing such as housing 12. Housing 12, which may sometimes be referred to as an enclosure or case, may be formed of plastic, glass, ceramics, fiber composites, metal (e.g., stainless steel, aluminum, etc.), other suitable materials, or a combination of any two or more of these materials.
Housing 12 may be formed using a unibody configuration in which some or all of housing 12 is machined or molded as a single structure or may be formed using multiple structures (e.g., an internal frame structure, one or more structures that form exterior housing surfaces, etc.). The periphery of housing 12 may, if desired, include walls. One or more openings may be formed in housing 12 to accommodate connector ports, buttons, and other components. For example, an opening may be formed in the wall of housing 12 to accommodate audio connector 24 and other connectors (e.g., digital data port connectors, etc.). Audio connector 24 may be a female audio connector (sometimes referred to as an audio jack) that has two pins (contacts), three pins, four pins, or more than four pins (as examples). Audio connector 24 may mate with male audio connector 22 (sometimes referred to as an audio plug) in accessory 20.
Accessory 20 may be a pair of earphones (e.g., earbuds or earphones with other types of speakers), other audio equipment (e.g., an audio device with a single earbud unit), or other electronic equipment that communicates with electronic device 10. The use of a pair of earphones in system 8 is sometimes described herein as an example. This is, however, merely illustrative. Accessory 10 may be implemented using any suitable electronic equipment.
It should be understood that the term “earphones” may refer to any suitable type of audio headset (e.g., headphones, over-the-ear headphones, earbuds, earbud-type headphones with ear hooks, in-ear headphones that extend partially into the ear canal, etc.).
As shown in
The circuitry of controller 30 may communicate with the circuitry of device 10 using the wires or other conductive paths in cable 26 (e.g., using digital and/or analog communications signals). The paths in cable 26 may also be coupled to speaker drivers in earphones 28, so that audio signals from device 10 may be played through the speakers in earbuds 28. Electronic device 10 may regulate the volume of sound produced by earbuds 28 by controlling the audio signal strength used in driving the speakers in earbuds 28.
In one suitable embodiment, sensor signals from sensor structures in earbuds 28 may be conveyed to device 10 using the conductive paths of cable 26. With this type of configuration, electronic device 10 may process the sensor signals and take suitable action based on a determination of whether or not earphones 20 are located in or on a user's ears.
A schematic diagram showing illustrative components that may be used in device 10 and accessory 20 of system 8 is shown in
Input-output circuitry 34 may include components for receiving input from external equipment and for supplying output. For example, input-output circuitry 34 may include user interface components for providing a user of device 10 with output and for gathering input from a user. As shown in
Input-output devices 38 may include buttons such as sliding switches, push buttons, menu buttons, buttons based on dome switches, keys on a keypad or keyboard, or other switch-based structures. Input-output devices 38 may also include status indicator lights, vibrators, display touch sensors, speakers, microphones, camera sensors, ambient light sensors, proximity sensors, and other input-output structures.
Electronic device 10 may be coupled to components in accessory 20 using cables such as cable 26 of accessory 20. Accessory 20 may include speakers such as a pair of speaker drivers 40 (e.g., a left speaker and a right speaker). If desired, accessory 20 may include more than one driver per earbud. For example, each earbud in accessory 20 may have a tweeter, a midrange driver, and a bass driver (as an example). Speaker drivers 40 may be mounted in earbuds or other earphone housings. The use of left and right earbuds to house respective left and right speaker drivers 40 is sometimes described herein as an example.
Accessory 20 may include control circuitry such as control circuitry 45. Control circuitry 45 may, for example, include storage and processing circuits formed from one or more integrated circuits or other circuitry. Circuitry 45 in accessory 20 may include noise cancellation circuitry and other audio processing circuitry 48, if desired.
Cables such as cable 26 may form a communications path that can be used in conveying signals between device 10 and accessory 20. The communications path may be used to transmit audio from circuitry 32 to speaker drivers 40 during playback operations.
The communications path may also be used to convey noise signals. Noise cancellation may, for example, be performed using the processing circuitry of device 10 (e.g., using noise cancellation circuitry 46). In this type of arrangement, noise signals gathered by one or more microphones in earphones 20 may be routed to circuitry 46. Circuitry 46 may then route audio signals from which noise has been cancelled to headset 20. If desired, noise cancellation operations may be performed locally in headset 20. With this type of arrangement, noise cancellation circuitry 48 in headset 20 can receive audio playback signals from device 10 and can receive noise signals from noise cancellation microphones in earphones 20. Circuitry 48 can then cancel noise from the played back audio.
If desired, accessory 20 may include user input devices 42 such as buttons (see, e.g., the buttons associated with button controller 30 of
To determine whether or not the earbuds in which speaker drivers 40 are located in or on the ears of a user, accessory 20 may be provided with ear presence sensor structures 44. Ear presence sensor structures 44 may be configured to detect whether or not the speakers of earphones 20 are present at the ears of a user. Ear presence sensors may be formed from force sensors, from switches or other mechanical sensors, from capacitive sensors, from resistance-based sensors, from light-based sensors, from accelerometer-based sensors, and from acoustic-based sensors such as ultrasonic acoustic-based sensors (as examples). Control circuitry 45 in accessory 20 and/or control circuitry 32 of electronic device 10 may use information from ear presence sensor structures 44 in determining which actions should be automatically taken by device 10 and/or by accessory 20.
A schematic diagram of device 10 and accessory 20 in a configuration in which noise cancellation circuitry is located in device 10 is shown in
Noise cancellation techniques can also be implemented for microphones. For example, microphones 50 may include a voice microphone and a corresponding noise cancellation microphone. The voice microphone may be used to gather a user's voice signals during telephone calls or to record audio clips, while the corresponding noise cancellation microphone may be used to gather ambient noise signals associated with the voice microphone. Ambient noise signals gathered by the noise cancellation microphone may be used to reduce noise in the voice signals gathered by the voice microphone.
Noise cancellation operations may be performed using analog circuitry or using digital processing techniques. Noise cancellation operations may be performed locally in accessory 20 or may be performed remotely in device 10. In the example of
As shown in
Audio processing circuitry 46 may be powered by a power source such as battery 47. If desired, accessory 20 may also include a power source such as battery 57. This is, however, merely illustrative. The use of a battery such as battery 57 in accessory 20 is optional and is only shown as an illustrative example.
Audio processing circuitry 46 may include a digital signal processor that may be used to perform digital signal processing on digitized audio signals. For example, if operating accessory 20 in a noise cancellation mode, noise signals from microphones 50, which may reflect the amount of ambient noise in the vicinity of speaker drivers 40 and/or the amount of ambient noise in the vicinity of a voice microphone) may be conveyed to audio processing circuitry 46 in device 10. Using the processing capabilities of an audio digital signal processor in circuitry 46, the noise signals can be digitally removed from digital audio voice signals and from digital speakers signals.
This is, however, merely illustrative. If desired, circuitry 46 may perform noise cancellation operations using analog noise cancellation circuitry. With this type of configuration, noise signals gathered by microphones 50 may be conveyed to circuitry 46 in device 10. Audio processing circuitry 46 may produce an anti-noise signal and may convey the anti-noise signal to speaker drivers 40 along with the audio signal that is to be heard by the user. The anti-noise signal may be identical to the noise signal except that it is shifted by 180 degrees with respect to the noise signal. The anti-noise signal may be superimposed onto the noise signal such that destructive interference occurs and the two signals mutually cancel.
Noise cancellation circuitry of the type shown in
If desired, audio signal processing operations for implementing noise cancellation functions may be performed locally in accessory 20. As shown in
Circuitry 48 may be used to locally implement noise cancellation functions. In a typical local noise cancellation arrangement using digital processing techniques, analog microphone signals (noise signals) from microphones 50 are digitized using analog-to-digital circuitry 56. Processing circuitry 48 may receive audio signals (e.g., played back music) from device 10 in digital form. Audio processing circuitry 48 may then use digital processing techniques to remove noise from the played back audio. The resulting audio signal may be converted to analog for speakers 40 using digital-to-analog converter circuitry 58.
This is, however, merely illustrative. If desired, circuitry 48 may perform noise cancellation operations using analog noise cancellation circuitry. With this type of configuration, noise signals gathered by microphones 50 may be conveyed to circuitry 48 in accessory 20. Audio processing circuitry 48 may produce an anti-noise signal and may convey the anti-noise signal to speaker drivers 40. The anti-noise signal may be identical to the noise signal except that it is shifted by 180 degrees with respect to the noise signal. The anti-noise signal may be superimposed onto the noise signal such that destructive interference occurs and the two signals mutually cancel.
Noise cancellation circuitry of the type shown in
An illustrative earbud speaker housing with an ear presence sensor is shown in
Conductive structures such as conductive mesh structures 68 and 70 may be mounted in housing 66. As shown in
Mesh electrodes 68 and 70 (e.g., metal screen structures) or other conductive structures in earbud 28 may be used as first and second terminals in a resistive (resistance-based) sensor. Control circuitry in housing 66 may be used to apply a voltage across the first and second terminals while measuring how much current flows as a result. The control circuitry may use information on the voltage and current signals that are established between electrodes 68 and 70 to determine whether or not earbud 28 has been placed in the ear of a user. In the absence of the user's ear, the resistance between electrodes 68 and 70 will be relatively high. When, however, earbud 28 has been placed into a user's ear, contact between electrodes 68 and 70 and the flesh of the ear will give rise to a lower resistance path between electrodes 68 and 70.
To determine whether or not earbud 28 has been placed within the user's ear, control circuitry 45 of earbud (and/or control circuitry 32 of
In configurations where noise cancellation functions are performed remotely in device 10, control circuitry 32 in device 10 may analyze sensor signals from ear presence sensors in earphones 20 and may automatically activate and deactivate noise cancellation circuitry in device 10 based on the sensor signals. Configurations in which noise cancellation is performed and controlled locally in earphones 20 and in which sensor signals from ear presence sensors are analyzed by control circuitry 45 in earphones 20 are sometimes described herein as an example.
In addition to or instead of using mesh 68 and 70 to measure the resistance of the user's ear, mesh electrodes 68 and 70 may be used as capacitive sensor electrodes (e.g., to make mutual capacitance measurements or to make self capacitance measurements). Different capacitance values may be detected in the presence and absence of the user's ear in the vicinity of electrodes 68 and 70. This allows circuitry 45 to use the capacitance measurements to determine whether or not earbud 28 is in, on, or out of the user's ear.
If desired, earbud 28 may include a sealing member such as compressible sealing member 72. Sealing member 72 may be used to form a seal between a user's ear and earbud 28 that helps block ambient noise while also forming an enclosed cavity adjacent to the ear canal. In addition to or instead of using mesh 68 and 70 to detect the presence of a user's ear, an ear presence sensor such as ear presence sensor 74 may be embedded in or formed on sealing member 72.
As an example, ear presence sensor 74 may be a switch-based sensor such as a switch or button that is actuated when a user's ear is present or absent. Switch 74 may be mounted on an exterior surface of earbud housing 66 or may be embedded or formed on sealing member 72. Switch 74 may be configured to move inwards (e.g., towards the interior of housing 66) and to move outwards (e.g., towards the exterior of housing 66). When earbud 28 is inserted into a user's ear, switch 74 may be compressed inward. When earbud 28 is out of the user's ear, switch 74 may move outwards to regain its original uncompressed state. Circuitry 45 may use information from switch structures such as switch structure 74 to determine whether or not earbud 28 has been placed in a user's ear. If desired, a switch-based ear presence sensor of this type may be implemented without requiring electrical power.
As additional examples, sensor structure 74 may be an accelerometer-based sensor, an orientation sensor, or other sensor that may be used in gathering earphone movement information and/or determining the location or orientation of earbud 28. Changes in orientation and/or changes in acceleration may be used to determine whether or not earphones 20 are in or on a user's ears. For example, when movement is detected by sensor 74, circuitry 45 can conclude that earphones 20 are not in the user's ears. When movement is not detected by sensor 74 for a predetermined period of time, circuitry 45 can conclude that earphones 20 are not in the user's ears.
If desired, ear presence sensor 74 may be a pressure or force sensor configured to measure a pressure or force against sealing member 72. In force-based sensor schemes, the resistance of a compressible foam may be measured or a strain gauge output can be monitored. When force is present, circuitry 45 can conclude that earphones 20 have been inserted into or mounted on a user's ears, whereas when force is not present, circuitry 45 can conclude that earphones 20 are not being worn by the user. Force indicative of a user's ear pressing against earphones 20 may also be monitored using piezo-electric force sensors or other force sensors.
These examples are, however, merely illustrative. In general, any suitable type of sensor may be used to detect the presence and/or absence of a user's ear in the vicinity of earbud 28.
As shown in
As shown in
Ear presence sensor structures 82 and 84 may be accelerometer-based sensors, pressure or force sensors, capacitive sensors, acoustic-based sensors, switch-based sensors (e.g., sensors formed form mechanical switches that are actuated when a user's ear or head is present or absent), or any other suitable type of sensor configured to detect the presence and/or absence of a user's ear or head.
A cross-sectional side view of an illustrative earbud with a speaker driver and an associated ear presence sensor is shown in
When external object 80 is sufficiently close to earbud 28, the presence of external object 80 may be detected. For example, control circuitry 45 may measure the resistance between mesh electrodes 68 and 70 using conductive paths 82 or may use capacitance measurements in monitoring for the presence of object 80. The measured resistance (or capacitance) may then be used to determine whether earbud 28 is in the user's ear or is out of the user's ear. Control circuitry 45 may also use sensors such as sensor 44 of
Sensor 44 may be a light-based sensor. For example, transmitter 44T may be a light-emitting diode or laser that emits light 84 (e.g., infrared light, visible light, etc.) and receiver 44R may be a light detector (e.g., a photodiode or phototransistor) that measures the amount of light 84 that is reflected as reflected light 86 from external object 80. When the amount of light that is reflected from external object 80 is high, circuitry 45 can conclude that earbud 28 is in the user's ear. When the amount of light that is reflected from external object 80 is low, circuitry 45 can conclude that earbud 28 is out of the user's ear.
If desired, sensor 44 may be a sensor that emits and receives acoustic signals. For example, transmitter 44T may be an ultrasonic signal transducer that transmits ultrasonic signals 84. Receiver 44R may be an ultrasonic signal receiver that measures the amount of corresponding ultrasonic signal 84 that is reflected as reflected signal 86 from external object 80. When the amount of ultrasonic signal that is reflected from external object 80 is low, circuitry 45 can conclude that earbud 28 is not in the user's ear. When the amount of ultrasonic signal that is reflected from external object 80 is high, circuitry 45 can conclude that earbud 28 is currently in the user's ear.
In configurations where noise cancellation operations are performed locally in accessory 20, circuitry 45 in accessory 20 may use information from sensor structures 44 to control noise cancellation circuitry 48. For example, when information from sensor structures 44 indicates that earphones 20 have been removed from a user's ears, control circuitry 45 may automatically deactivate noise cancellation circuitry 48. When information from sensor structures 44 indicates that earphones 20 have been placed in or on a user's ears, control circuitry 45 may automatically deactivate noise cancellation circuitry 48, thereby conserving the battery life of earphones 20.
In configurations where noise cancellation operations are performed remotely in device 10, circuitry 32 (
A flow chart of illustrative steps involved in using system 8 is shown in
Examples of operations that may be performed by system 8 during step 92 include audio-based operations such as playing media content (e.g., media content stored on device 10 or media content provided by an online service), providing a user with audio associated with a telephone call, providing audio associated with a video chat session to the user, or otherwise presenting audio content through earphones 20. Audio may be played in stereo so that left and right earbuds receive corresponding left and right channels of audio, may be played using a multi-channel surround sound scheme, or may be played using a monophonic (mono) sound scheme in which both the left and right channels of audio are identical. During the audio-based operations of step 92, noise cancellation circuitry 48 (or noise cancellation circuitry 46 in device 10) may be active to reduce the impact of ambient noise on the audio content played through earphones 20. Configurations where noise cancellation circuitry 48 in earphones 20 is used to perform noise cancellation operations is sometimes described herein as an example. It should be understood, however, that the steps of
During the monitoring operation of step 100, circuitry 45 can use user detection sensors 44 to determine whether or not earphones 20 are in or on the user's ears.
If, during the operations of step 100, it is determined that earphones 20 have been removed from the user's ears, circuitry 45 may take suitable action at step 102. For example, circuitry 45 may deactivate noise cancellation circuitry 48 in response to information from sensor structures 44 indicating that earphones 20 have been removed from the user's ears. If desired, circuitry 32 in device 10 may adjust the audio content being played based on the information gathered by sensor structures 44. For example, circuitry 32 may pause or stop the audio content being played, may adjust the playback volume (audio signal drive strength), may switch from a stereo playback scheme to a monophonic playback scheme, or may take other suitable actions based on information from sensor structures 44.
After taking suitable actions at step 102, device 10 can be operated in an earphones-off mode (step 104). For example, earphones 20 may operate with noise cancellation circuitry deactivated (i.e., turned off). This may include continuing to play audio content without performing noise cancellation operations, operating with paused or stopped audio playback, etc.
During the operations of step 104, ear presence sensor structures 44 may be used to monitor for the presence of earphones 20 in or on the ears of the user.
If, during the operations of step 104, sensor structures 44 determine that earphones 20 have been placed in or on the user's ears, appropriate action may be taken at step 106. Suitable actions that may be taken by system 8 in response to earphones 20 being placed in or on the user's ears include activating noise cancellation circuitry 48, resuming media playback, and/or restoring a previous volume level of the media playback (as examples). Operations may then proceed to step 100, where system 8 may operate in an earphones-on mode while circuitry 45 monitors sensor structures 44 to determine when earphones 20 are removed from the user's ears.
The foregoing is merely illustrative of the principles of this invention and various modifications can be made by those skilled in the art without departing from the scope and spirit of the invention. The foregoing embodiments may be implemented individually or in any combination.
