The present application relates generally to earbud control and, more particularly, to systems and methods for earbud control using proximity detection.
Users of electronics are often concerned with extending and saving the battery life of their devices. In some cases, users may turn off their device to save battery life. Other common solutions to extending and saving battery life include providing devices with a sleep mode or hibernation mode to conserve battery. However, especially for earpiece-based audio devices, the known methods of battery conservation are typically limited to conscious user input and control.
Systems and methods for providing earbud control using proximity detection are provided. In various embodiments, insertion or removal of an earbud from an ear canal may be determined using proximity detection. An example method includes transmitting ultrasonic signals and receiving reflected ultrasonic signals. The example method further includes determining, based at least partially on the reflected ultrasonic signals, a distance of an earbud to an ear canal. If the distance of the earbud to the ear canal is above a first predetermined threshold value, the example method may proceed with activating a low-power mode of operation. For example, when it is determined that the earbud is removed from the ear canal, the earbud is automatically switched to a low-power mode of operation. When it is determined that the earbud is inserted into the ear canal, the earbud is automatically switched to a full power mode of operation.
In certain embodiments, if the distance of the earbud to the ear canal is below the first predetermined threshold value, the example method modifies a functionality of the earbud which may include determining a quality of a seal between the earbud and the ear canal. If the quality of the seal is good (e.g., above a predetermined threshold), the earbud may send the user a positive feedback, otherwise, the earbud may send the user a negative feedback and may then suggest a correction to the seal.
The present technology provides systems and methods for earbud control based on proximity detection, which can overcome or substantially alleviate problems associated with power consumption and seal quality. Embodiments of the present technology may be practiced on any earpiece-based audio device that is configured to receive and/or provide audio such as, but not limited to, cellular phones, MP3 players, phone handsets and headsets. While some embodiments of the present technology are described in reference to operation of a cellular phone or mobile device, the present technology may be practiced on any audio device.
In various embodiments, the earbud includes controls for power conservation. When a user removes an earbud from his or her ear, or is otherwise not wearing the earbud, power consumption of the earbud should be minimized. According to an example embodiment, a method for controlling an earbud includes transmitting ultrasonic signals, receiving reflected ultrasonic signals, and determining, based at least partially on the reflected ultrasonic signals, a distance of an earbud to an ear canal. If the distance of the earbud to the ear canal is above a first predetermined threshold value, a low-power mode of operation is activated. In further embodiments, if the distance of the earbud to the ear canal is below the first predetermined threshold value, a functionality of the earbud is adapted. The modifying the functionality of the earbud may include activating a full power mode of operation.
In some embodiments, the modifying the functionality of the earbud includes determining a quality of a seal, provided by the ear bud, in the ear canal. If the quality of the seal is above a second predetermined threshold value, the user is provided with a positive feedback. If the quality of the seal is below the second predetermined threshold value, the user is provided with a negative feedback. The positive feedback and the negative feedback may be audible feedback. For example, the positive feedback includes a first tone and the negative feedback includes a second tone. In other embodiments, the negative feedback includes a verbal instruction, which, for example, is an instruction to re-insert the earbud into the ear canal.
Referring now to
In various embodiments, the microphones 106 and 108 are either analog or digital. In either case, the outputs from the microphones are converted into synchronized pulse code modulation (PCM) format at a suitable sampling frequency and connected to the input port of the DSP 112. The signals xin and xex denote signals representing sounds captured by internal microphone 106 and external microphone 108, respectively. In certain embodiments, internal microphone 106 is a proximity detection module, for example a dual microelectromechanical system (MEMS) microphone, as shown and described in
The DSP 112 performs appropriate signal processing tasks to improve the quality of microphone signals xin and xex. The output of DSP 112, referred to as the send-out signal (sout), is transmitted to the desired destination, for example, to a network or host device 116 (see signal identified as sout uplink), through a wireless or wired interface 114.
If a two-way voice communication is needed, a signal is received by the network or host device 116 from a suitable source (e.g., via the radio or wired interface 114). This is referred to as the receive-in signal (rin) (identified as rin downlink at the network or host device 116). The receive-in signal can be coupled via the radio or wired interface 114 to the DSP 112 for processing. The resulting signal, referred to as the receive-out signal (rout), is converted into an analog signal through a digital-to-analog convertor (DAC) 110 and then connected to a loudspeaker 118 in order to be presented to the user. In some embodiments, the loudspeaker 118 is located in the same ear canal 104 as the internal microphone 106. In other embodiments, the loudspeaker 118 is located in the ear canal opposite the ear canal 104. In example of
In additional embodiments,
In various embodiments, ITE module(s) 202 include internal microphone(s) 106 and loudspeaker (s) 118 (shown in
In some embodiments, each of the BTE modules 204 and 206 includes at least one external microphone 108 (shown in
In some embodiments, the seal of the ITE module(s) 202 is good enough to isolate acoustics waves coming from outside acoustic environment 102. However, when speaking or singing, a user can hear the user's own voice reflected by ITE module(s) 202 back into the corresponding ear canal. The sound of the voice of the user is distorted since, while traveling through the user's skull, the high frequencies of the voice are substantially attenuated and thus have a much narrower effective bandwidth compared to voice conducted through air. As a result, the user can hear mostly the low frequencies of the voice. The user's voice cannot be heard by the user outside of the earpieces since the ITE module(s) 202 isolate external sound waves, particularly when a quality of a seal of the earpiece and the ear canal is good.
In various embodiments, the proximity determination module 310 is operable to determine a distance between an earbud and the user's ear canal.
A non-limiting example for proximity detection utilizing a dual-purpose ultrasonic MEMS microphone or transducer is shown and described in
Other exemplary embodiments utilizing a dual-purpose ultrasonic MEMS microphone having a proximity determination module 310 may also use an infrared sensor, or other suitable sensor for determining a distance parameter between the earbud and an object.
In certain embodiments, the proximity determination module 310 is configured to transmit ultrasonic signals, receive reflected ultrasonic signals, and calculate the distance to the object or portion of the user's head. In one example, the proximity determination module 310 calculates the distance with a pseudo noise correlation sequence by observing a correlation factor of a pseudo random signal. The pseudo noise correlation sequence is particularly robust in an environment with ambient interference. In other examples, the proximity determination module 310 calculates the distance by measuring a time-of-flight or amplitude of the reflected ultrasonic signals.
In some embodiments, the power on/off control module 320 is provided to switch the earbud from a full (normal) power mode of operation to a low power mode of operation, to conserve battery life when the user is not using the earbud. In certain embodiments, the power control module 320 switches the earbud on and off.
In further embodiments, the seal quality determination module 330 is operable to receive at least internal microphone signal xin and external microphone signal xex and determine the quality of seal of an ear canal. For example, the quality of seal can be determined based on a difference between signal xin and signal xex. If signal xin includes components similar to components of signal xex, it indicates that outside noise is heard inside the earbud, reflective of a bad seal quality. The components may include noise components, voice components, power present in frequency bands, or other suitable components of signal xin and signal xex. The difference between signals may also represent a cross-correlation between the internal microphone signal xin and the external microphone signal xex. An example system suitable for determining seal quality is discussed in more detail in U.S. patent application Ser. No. 14/985,187, entitled “Audio Monitoring and Adaptation Using Headset Microphones Inside User's Ear Canal,” filed on Dec. 30, 2015, and U.S. patent application Ser. No. 14/985,057, entitled “Occlusion Reduction and Active Noise Reduction Based on Seal Quality,” filed on Dec. 30, 2015, the disclosures of which are incorporated herein by reference for all purposes.
In various embodiments, the first MEMS transducer 422 is configured to transmit ultrasonic signals. The first MEMS transducer 422 (or the second MEMS transducer 423) is configured to detect the reflection of the ultrasonic signals. The second MEMS transducer also receives audible acoustic signals and converts the audible acoustic signals to electrical signals.
The MEMS transducers 422 and 423, and the ASIC 400 may be incorporated into a MEMS microphone 401. In these regards, the ASIC 400 and MEMS transducers 422 and 423 may be disposed on a base and covered by a lid or cover. The lid, cover, or base may have a port allowing sound and reflected sound to enter the microphone, and allow ultrasonic signals to exit the MEMS microphone 401.
The proximity detection block or module 409 may be any combination of hardware and/or software configured to perform proximity detection. Ultrasonic signals are transmitted, reflected ultrasonic signals are received from an object of interest, and the proximity (e.g., distance) is calculated to the object of interest.
In some embodiments, the proximity detection core 412 makes a time-of-flight measurement. The proximity detection core 412 calculates the time-of-flight from the time the ultrasonic signal is transmitted until the time the reflected ultrasonic signal is received. In another embodiment, the proximity detection core 412 determines proximity by measuring an amplitude of the reflected ultrasonic signal, or otherwise measuring a signal amplitude parameter. In a further embodiment, the proximity detection core 412 compares the reflected signal to a pseudo random signal, for example by a cross-correlation or sliding inner product, and calculates a correlative factor to determine proximity.
In certain embodiments, the MEMS microphone 401 arrangement in
In certain embodiments, example method 500 includes additional, optional steps if the distance is below the first predetermined threshold value. For example, in block 510, a quality of a seal of an ear canal is determined. Seal quality is detected after determining that the user has inserted the earbud into his or her ear canal. As a result, power is saved by performing seal quality detection when a good seal is preferable (e.g., when the earbud is in use). In some embodiments, the quality of the seal can be determined based on a difference between signal xex captured by the external microphone 108 and signal xin captured by the internal microphone 106. If signal xin includes components similar to components of signal xex, it indicates that outside noise is captured by the internal microphone (e.g., in the ITE module) inside the ear canal. The components may include noise components, voice components, power present in frequency bands, or other suitable components to determine the quality of the seal. The difference between signals may also represent a cross-correlation between the internal microphone signal xin and the external microphone signal xex.
In decision block 512, a determination is made based on the quality of the seal of the ear canal. If the quality of the seal is above a predetermined threshold value, example method 500, in this example, proceeds with providing the user a positive feedback 514. Alternatively, if the quality of the seal is below a predetermined threshold value, then example method 500, in this example, proceeds with providing the user a negative feedback 516. In some embodiments, the positive and negative feedback are audible feedback, and includes having a first and a second tone, respectively. In other embodiments, the negative feedback includes a verbal warning or instruction directing the user to re-adjust or re-insert the earbud into their ear canal.
In block 606, based at least partially on the reflected ultrasonic signals, a distance of an earbud to an ear canal is determined. For example, the proximity detection module makes a time-of-flight measurement by calculating duration between the time the ultrasonic signal is transmitted and the time the reflected ultrasonic signal is received. In another example, the proximity detection module determines the first distance parameter by measuring the amplitude of the reflected ultrasonic signal.
In block 608, the method 600 proceeds with determining if the distance of the earbud to the ear canal is below a first predetermined threshold value. If the distance is above the first predetermined threshold, a low-power mode is activated 610. Alternatively, if the distance is below the first predetermined threshold value, a full power mode is activated 612. Optionally, a functionality of the earbud may be modified in block 614. For example, block 614 may perform steps 510-516 as shown in
The components shown in
Mass data storage 730, which can be implemented with a magnetic disk drive, solid state drive, or an optical disk drive, is a non-volatile storage device for storing data and instructions for use by processor unit(s) 710. Mass data storage 730 stores the system software for implementing embodiments of the present disclosure for purposes of loading that software into main memory 720.
Portable storage device 740 operates in conjunction with a portable non-volatile storage medium, such as a flash drive, floppy disk, compact disk, digital video disc, or Universal Serial Bus (USB) storage device, to input and output data and code to and from the computer system 700 of
User input devices 760 can provide a portion of a user interface. User input devices 760 may include one or more microphones, an alphanumeric keypad, such as a keyboard, for inputting alphanumeric and other information, or a pointing device, such as a mouse, a trackball, stylus, or cursor direction keys. User input devices 760 can also include a touchscreen. Additionally, the computer system 700 as shown in
Graphics display system 770 include a liquid crystal display (LCD) or other suitable display device. Graphics display system 770 is configurable to receive textual and graphical information and processes the information for output to the display device.
Peripheral devices 780 may include any type of computer support device to add additional functionality to the computer system.
The components provided in the computer system 700 of
The processing for various embodiments may be implemented in software that is cloud-based. In some embodiments, the computer system 700 is implemented as a cloud-based computing environment, such as a virtual machine operating within a computing cloud. In other embodiments, the computer system 700 may itself include a cloud-based computing environment, where the functionalities of the computer system 700 are executed in a distributed fashion. Thus, the computer system 700, when configured as a computing cloud, may include pluralities of computing devices in various forms, as will be described in greater detail below.
In general, a cloud-based computing environment is a resource that typically combines the computational power of a large grouping of processors (such as within web servers) and/or that combines the storage capacity of a large grouping of computer memories or storage devices. Systems that provide cloud-based resources may be utilized exclusively by their owners or such systems may be accessible to outside users who deploy applications within the computing infrastructure to obtain the benefit of large computational or storage resources.
The cloud may be formed, for example, by a network of web servers that comprise a plurality of computing devices, such as the computer system 700, with each server (or at least a plurality thereof) providing processor and/or storage resources. These servers may manage workloads provided by multiple users (e.g., cloud resource customers or other users). Typically, each user places workload demands upon the cloud that vary in real-time, sometimes dramatically. The nature and extent of these variations typically depends on the type of business associated with the user.
The present technology is described above with reference to example embodiments. Therefore, other variations upon the example embodiments are intended to be covered by the present disclosure.