The disclosure relates generally to electronic devices, and more particularly to the control of such devices based on proximity sensing.
Some personal electronic devices such as smart phones with touch-sensitive displays also comprise ambient light and proximity sensors that are useful in the control and operation of such devices. However, ambient light and proximity sensing is typically done using dedicated sensors and associated circuitry which can result in increased part count, cost, size and complexity of such personal electronic devices.
Improvement is therefore desirable.
Reference is now made to the accompanying drawings, in which:
Aspects of various embodiments of the disclosure are described through reference to the drawings.
The disclosure describes devices, components and methods relating to electronic devices.
In various aspects, for example, the disclosure describes electronic devices comprising image sensors configured to capture digital images in the visible light spectrum and also detect electromagnetic energy in the infrared frequency range (IR energy). The detection of the IR energy by the image sensors may be used to control at least one function of such electronic devices such as, for example, the activation of one or more displays which may or may not be touch-sensitive.
Thus, in one aspect, the disclosure describes an electronic device. The electronic device may comprise: a housing; a processor coupled to a memory and housed within the housing; an infrared source coupled to the processor and configured to emit electromagnetic energy in the infrared frequency range (IR energy) for reflection against an object in proximity to the housing; and an image sensor coupled to the processor and configured to: detect images in the visible light spectrum; detect the reflected IR energy; and generate a signal for controlling a function of the electronic device based on the reflected IR energy detected.
In another aspect, the disclosure describes an apparatus for sensing proximity of an object to an electronic device. The apparatus may comprise: an infrared source configured to emit electromagnetic energy in the infrared frequency range (IR energy) for reflection by an object in proximity to the electronic device; and an image sensor configured to: capture digital images in the visible light spectrum; detect the reflected IR energy; and generate a signal useful in controlling a function of the electronic device based on the reflected IR energy detected.
In a further aspect, the disclosure describes a method in an electronic device for sensing proximity of an object to the electronic device using electromagnetic energy in the infrared frequency range (IR energy) and an image sensor configured to receive images in the visible light spectrum. The method may comprise: emitting IR energy for reflection against an object in proximity to the electronic device; and using the image sensor, detecting the reflected IR energy and generating a signal for controlling a function of the electronic device based on the reflected IR energy detected.
For example, in various embodiments the image sensor may be further configured to detect an ambient lighting condition and generate one or more signals useful in controlling the backlighting of at least one display on the electronic device.
Further details of these and other aspects of the subject matter of this application will be apparent from the drawings and the description included below.
Electronic device 10 may include housing 12 for containing various components/circuitry described further below. For example, electronic device 10 may include one or more displays 14, hereinafter referred to in the singular. Display 14 may include one or more areas in which a graphic user interface (GUI) can be displayed. At least a portion of display 14 may be touch-sensitive to permit electronic device 10 to receive user input via interaction with the GUI shown on display 14. The GUI may, for example, include information such as text, characters, symbols, images, icons, and other items rendered on display 14 where interaction with the GUI may be used to perform various functions/tasks with electronic device 10. For example, display 14 may include a capacitive touch-sensitive display including a capacitive touch-sensitive overlay or may include any other suitable touch-sensitive display, such as a resistive, infrared, surface acoustic wave (SAW) touch-sensitive display, optical imaging, dispersive signal technology and acoustic pulse recognition.
Electronic device 10 may include telephone capabilities and accordingly may include one or more speakers 16, one or more microphones 18 and associated circuitry permitting wireless communication via cellular network for example. Electronic device 10 may also include camera assembly or assemblies 20, hereinafter referred to in the singular, configured for one or both of still image and video image capture in the visible light (VL) spectrum. Electronic device 10 may also include other components/circuitry for performing other functions/tasks.
Touch-sensitive display 14 may also be susceptible to inadvertent actuations when electronic device 10 is disposed in a user's pocket. Accordingly, object 22 may include a user's head, face, leg or any other part of a user's body or clothing that could potentially cause inadvertent actuations of touch-sensitive display 14. Alternatively, object 22 may include something other than a user's body such as, for example, any surface against which electronic device 10 may be resting and which could potentially cause inadvertent actuation of touch-sensitive display 14. The disabling of touch-sensitive display 14 may include placing the touch-sensitive display 14 in a state where electronic device 10 no longer accepts inputs via at least a portion of touch-sensitive display 14.
One or more light separators 35 may be disposed between IR source 30 and sensor 32 depending on the configuration and relative placement of IR source 30 and sensor 32. Light separator 35 may be configured to substantially prevent IR energy 24 from bouncing off of lens 22 and being re-directed towards sensor 32. Light separator 35 may comprise one or more materials substantially impermeable to IR energy 24 and may, for example, include a suitable barrier extending between structure 34 and lens 22.
While
IR source 30 may include one or more suitable emitters of IR energy. For example, IR source 30 may include one or more light emitting diodes (LEDs) that can emit IR energy in a particular direction. For example IR source 30 may be configured to emit IR energy in an outward direction from housing 12 and image sensor 32 may be configured to capture digital images in the visible light spectrum by detecting light arriving along substantially the same path but travelling in an inward direction from housing 12. Display 14 may also be facing substantially the same outward direction from housing 12 as shown in
Image sensor 32 may be further configured to detect an ambient light condition around electronic device 10. Accordingly, VL pixels 36 shown in
Battery 40 may serve as a power source for at least some of the electrical circuitry including processor 42, memory 44, camera assembly 20 and other components of electronic device 10 via bus 48. Battery 40 may include one or more rechargeable batteries.
Processor 42 may include one or more microprocessors or other suitably programmed or programmable logic circuits controlling at least some of the functionality of electronic device 10 including some of the functionality of camera assembly 20 and other components. As shown in
Memory 44 may comprise any storage means (e.g. devices) suitable for retrievably storing machine-readable instructions executable by processor 42. The machine-readable instructions may include software/data 50. Memory 38 may be non-volatile. For example, memory 38 may include random access memory (RAM), read only memory (ROM), persistent (i.e. non-volatile) memory which may be flash erasable programmable read only memory (EPROM) memory (“flash memory”) or any other suitable electromagnetic or optical media suitable for storing electronic data signals in volatile or non-volatile, non-transient form. Memory 38 may contain machine-readable instructions for execution by processor 42 that may cause processor 42 to control one or more functions of electronic device based on the reflected IR energy detected by the image sensor 32.
Communication functions, including data and voice communications, may be performed through communication subsystem 46. Communication subsystem 46 may receive messages from and send messages to wireless network 52. Wireless network 52 may, for example, include any suitable type of wireless network 52 such as a cellular network or a wireless local area network.
Electronic device 10 may also include other user input devices such as a keyboard, control buttons such as a power toggle (on/off) button (not shown), a camera button (not shown) for enabling a camera mode, an image-capture button (not shown) for enabling an image capture sequence. Such user-input devices may be provided on touch-sensitive display 14 instead of, or in addition to, physical interface components.
Exceeding the predetermined value(s) may be representative of object 22 being in proximity to (e.g. in contact with) electronic device 10. The predetermined value(s) may be selected to be representative of object 22 being either in contact with or within a sufficiently small distance from electronic device 10 to cause a risk of inadvertent interaction with touch-sensitive display 14. For example, object 22 may be a head/face of a user in proximity to electronic device 10 when the user is participating in a telephone call and the user's ear is pressed against or is within a relatively small distance from speaker 16. In a case where electronic device 10 may be disposed in a user's pocket, object 22 may be a leg of the user or a portion of an article of clothing that is in contact with the electronic device 10. In any event, the predetermined values to be exceeded should be indicative of a risk of inadvertent interaction with touch-sensitive display 14 and should be selected such that normal interaction of a user's finger or hand with touch-sensitive display 14 does not cause touch-sensitive display 14 to become disabled.
Conditioned on the amount of reflected IR energy 26 detected by image sensor 32 exceeding the predetermined value (i.e. indicating a risk of inadvertent interaction with touch-sensitive display 14), touch-sensitive display 14 may be disabled. If touch-sensitive display 14 was already disabled then it may be kept in a disabled mode. Conditioned upon the amount of reflected IR energy 26 detected by image sensor 32 being less than the predetermined value (i.e. not indicating a risk of inadvertent interaction with touch-sensitive display 14), touch-sensitive display 14 may be enabled. If touch-sensitive display 14 was already enabled then it may be kept in a enabled mode. It is understood that there may be other conditions monitored within electronic device 10 that may control the activation of touch-sensitive display 14 and that the enabling or disabling of touch-sensitive display 14 in method 700 may or may not necessarily override the enabling or disabling of touch-sensitive display 14 independently controlled based on the other conditions.
Disablement of touch-sensitive display 14 may include partial or complete disablement. For example, partial disablement of touch-sensitive display 14 could include placing at least a portion of display 14 in a state where inputs via touch-sensitive display 14 are no longer accepted by electronic device 10 but display 14 can still show information. Complete disablement of touch-sensitive display 14 could include placing at least a portion of display 14 in a state where inputs via touch-sensitive display 14 are no longer accepted by electronic device 10 and information is no longer shown on display 14.
In accordance with method 800, machine-readable instructions stored in memory 44, when executed by processor 42 may cause: IR source 30 to emit IR energy 24 for reflection against object 22 which may be in proximity to electronic device 10 (see block 802); image sensor 32 to detect the reflected IR energy 26 (see block 804) and based on the reflected IR energy 26 detected by image sensor 32, control the activation of display 14 (see block 806). At block 804, the detection of reflected IR energy 26 using image sensor 32 may also include the image sensor 32 generating one or more signals representative of an amount of IR energy 26 detected. Such signals may be useful in controlling the activation of at least a portion of display 14.
Conditioned upon display 14 being enabled (see block 808), the machine-readable instructions, when executed by processor 42 may cause image sensor 32 to detect an ambient light condition (see block 810); and based on the ambient light condition detected, control backlighting of display 14 (see block 812). At block 810, the detection of an ambient condition using image sensor 32 may also include the image sensor 32 generating one or more signals representative of the ambient light condition detected. Such signals may be useful in controlling the backlighting (e.g. brightness) of display 14.
The disabling of display 14 in response to a sufficiently large amount of reflected IR energy 26 being detected by image sensor 32 may comprise placing display 14 in a state where inputs are no longer accepted by touching display 14 (i.e. partial disablement). In such state, display 14 may still be permitted to display information. Accordingly, the determination of whether display 14 is enabled at 808 may not be used since adjustment of backlighting display 14 could still be done even though inputs may no longer be accepted via touch-sensitive display 14. Alternatively, the disabling of display 14 could include the complete shut-down of display 14 such that inputs via touch-sensitive display 14 are no longer accepted by electronic device 10 and information is no longer shown on display 14 (i.e. complete disablement). In a case of complete disablement of display 14, it may not be necessary to adjust backlighting of display 14. Adjustment of the backlighting of display 14 may include increasing the brightness of display 14 in brighter ambient lighting conditions and decreasing the brightness of display 14 in darker ambient lighting conditions.
The above description is meant to be exemplary only, and one skilled in the relevant arts will recognize that changes may be made to the embodiments described without departing from the scope of the invention disclosed. For example, the blocks and/or operations in the flowcharts and drawings described herein are for purposes of example only. There may be many variations to these blocks and/or operations without departing from the teachings of the present disclosure. For instance, the blocks may be performed in a differing order, or blocks may be added, deleted, or modified. The present disclosure may be embodied in other specific forms without departing from the subject matter of the claims. The present disclosure is also intended to cover and embrace all suitable changes in technology. Modifications which fall within the scope of the present invention will be apparent to those skilled in the art, in light of a review of this disclosure, and such modifications are intended to fall within the appended claims.