Device having light intensity measurement in presence of shadows

Information

  • Patent Grant
  • 9194741
  • Patent Number
    9,194,741
  • Date Filed
    Friday, September 6, 2013
    11 years ago
  • Date Issued
    Tuesday, November 24, 2015
    8 years ago
Abstract
A device and method for detecting lighting conditions to enable brightness control of a display are disclosed. The device includes a display and a first photodiode array to detect light in a visible spectrum and a non-visible spectrum that is incident on the first photodiode array. The device also includes a second photodiode array to detect light in the non-visible spectrum that is incident on the second photodiode array, and a processor to determine the lighting conditions based on a first output of the first photodiode array and a second output of the second photodiode array. The processor adjusts the first output used to determine the lighting conditions based on detecting that the first photodiode array includes a shadowed region, and controls the brightness of the display based on the lighting conditions.
Description
BACKGROUND

In various applications, the accurate detection of lighting conditions may be helpful. For example, most computation and communication devices such as smart phones, laptop computers, tablets, and the like, include a display. Exemplary displays may be comprised of a liquid crystal display (LCD) or organic light-emitting diodes (OLED). Because these devices may be used in different lighting conditions, the display brightness must be adjusted based on detected lighting conditions. If the display is to dim in bright conditions, it may be unreadable. Conversely, if the display is too bright for the ambient conditions, it may be uncomfortable to view. Thus, by determining the lighting conditions, the display brightness may be adjusted so as to allow a good user experience while minimizing power usage.


In an exemplary device, ambient light sensors comprise arrays of photodiodes that detect visible and infrared light (IR), and photodiodes that detect only IR light. These are utilized to determine the incident light intensity (illuminance) so that the brightness of the display can be properly adjusted. Since the ambient light sensors are typically disposed within the device, it is possible for certain incident angles of light to introduce errors into the illuminance determination due to shadowing. This effect is most pronounced when the device is used in the sun, or in dark rooms with incandescent lighting, and can cause the brightness control software to make the display too dark.





BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of this disclosure, reference is now made to the following brief description, taken in connection with the accompanying drawings and detailed description, wherein like reference numerals represent like parts.



FIG. 1 is a block diagram of a cross-sectional view of a device;



FIG. 2 is a process flow diagram of a method of detecting the lighting conditions according to an exemplary embodiment of the disclosure;



FIG. 3 is a block diagram of a sensor of the device of FIG. 1 according to an exemplary embodiment; and



FIG. 4 is a block diagram of an exemplary device configured to perform detection of lighting conditions according to embodiments discussed herein.





DETAILED DESCRIPTION

It should be understood at the outset that although illustrative implementations of one or more embodiments of the present disclosure are provided below, the disclosed systems and/or methods may be implemented using any number of techniques, whether currently known or in existence. The disclosure should in no way be limited to the illustrative implementations, drawings, and techniques illustrated below, including the exemplary designs and implementations illustrated and described herein, but may be modified within the scope of the appended claims along with their full scope of equivalents.


As noted above, detection of lighting conditions may be used in various applications. For example, the brightness, contrast, or both of a device display must be adjusted as lighting conditions under which the display is being viewed change. Otherwise, for example, the display will be too dim to be clearly visible or too bright to be seen comfortably. Brightness control may be achieved differently depending on the display technology used. For example, brightness-setting methods include backlighting of LCD panels with light sources behind the display and direct control of pixel intensity of OLED panels. The two related aspects of adjusting the display brightness are detecting the current lighting conditions and adjusting the display accordingly. When the detection is inaccurate for any reason, the adjustment may be compromised. For example, if the display is dimmed too much in bright lighting conditions or made too bright in dark conditions, the user experience of the user of the device suffers. Embodiments of the system and method described herein address a source of inaccuracy in detecting the current lighting conditions.



FIG. 1 is a block diagram of a cross-sectional view of a device 100. While the view shown in FIG. 1 focuses on an aspect of the device 100, the device 100 may include other components (see, e.g., FIG. 4). The device 100 may be a tablet, laptop computer, smart phone, music player, storage device, and the like. The device 100 includes a housing 140. A sensor 110 within the housing 140 under a window 120 includes a first photodiode array 115 and a second photodiode array 117. The sensor 110 is an ambient light sensor that senses the available light conditions in which the device 100 is operating. Each of the first photodiode array 115 and the second photodiode array 117 detects light that is incident on the first photodiode array 115 and the second photodiode array 117, respectively, and outputs a photodiode light intensity measurement. This measurement may be a voltage or current that is proportional to the detected incident light. The measurement may also be a digital code based on converting the voltage or current using one or more analog-to-digital converters. The analog-to-digital conversion may be achieved within the sensor 110 directly or outside of the sensor within the device 100. The measurement may further be a count of photon arrival occurrences. The detected light is within a specific spectrum for each of the first photodiode array 115 and the second photodiode array 117. In the embodiment detailed herein, the first photodiode array 115 detects incident light in the visible spectrum and also in the infrared (IR) spectrum, and the second photodiode array 117 detects incident light in the IR spectrum only. In alternate embodiments, the first photodiode array 115 may detect incident light in the visible spectrum and another non-visible spectrum other than the IR spectrum, and the second photodiode array 117 may detect incident light in the other non-visible spectrum as well. As detailed with reference to FIG. 2, the non-visible spectrum detected by the first photodiode array 115 must be the same non-visible spectrum detected by the second photodiode array 117 in order to accurately detect the lighting conditions.



FIG. 1 depicts incident light rays 130 at an angle that results in a shadowed region 135 of the first photodiode array 115. That is, due to the angle of incident light rays 130 and the placement of the first photodiode array 115 within the housing 140, a portion of the first photodiode array 115 (in the shadowed region 135) does not receive any of the incident light rays 130 and, therefore, does not contribute to the output current or voltage. This leads to a lower output response from the first photodiode array 115 (an output that is not proportional to the true lighting condition) than if the shadowed region 135 did not exist (e.g., when the light rays 130 have a different angle of incidence). The effect of the shadowed region 135 on the accurate detection of lighting conditions is detailed with reference to FIG. 2.



FIG. 2 is a process flow diagram of a method 200 of detecting the lighting conditions according to an exemplary embodiment of the disclosure. At block 210, computing illuminance includes an IR subtraction method which involves subtracting an output of the second photodiode array 117 (which detects incident light in the IR spectrum only) from an output of the first photodiode array 115 (which detects incident light in the visible and IR spectrums). The two output values are weighted so that, ideally, the IR spectrum contribution is subtracted out and only the visible spectrum contribution remains (voltage or current) for conversion to a photometric unit (lux) indicating lumens per square meter or, alternatively, a radiometric unit (irradiance) indicating watts per square meter. In the ideal case in which no shadowed region 135 of the first photodiode array 115 is present, the calculated illuminance indicating current lighting conditions may be used to adjust brightness, contrast, or both of a display of a computation or communication device, for example. The computation of illuminance (I) is given by:

I=K1*output1−K2*output2  [EQ 1]


K1 and K2 are weighting factors and output1 and output2 are the photodiode light intensity measurements from the first photodiode array 115 and the second photodiode array 117, respectively. The weighting factors K1 and K2 may be based on the device 100 and additionally or alternately on the ratio of output2 (the output of the IR-only second photodiode array 117) to output1 (the output of the visible and IR first photodiode array 115). The values of K1 and K2 may be determined by a calibration process, for example. The values of K1 and K2 are calibrated to account for the difference between the first photodiode array 115 and the second photodiode array 117 such that the IR portion of the first photodiode array 115 output is subtracted out by subtracting the second photodiode array 117 output. As noted above, the photodiode light intensity measurement from the first photodiode array 115 and the second photodiode array 117 may be in the form of a current, a voltage, a digital code, or a photon count, for example. Thus, the values of K1 and K2 may reflect a conversion in addition to the weighting. That is, for example, when the photodiode light intensity measurement is provided as a voltage, K1 and K2 may have a unit of lux per voltage so that the illuminance (I) resulting from EQ. 1 is in units of lux.


As EQ. 1 makes clear, when the shadowed region 135 prevents output1 from being as high a value as it should be (were it not for the shadowing effect caused by the angle of incidence of the light rays 130), the illuminance determined by EQ. 1 may be artificially low or even a negative value (depending on the size of the shadowed region 135 and the value of factors K1 and K2). If the angle of incidence of the light rays 130 were different than the angle shown in FIG. 1, such that the shadowed region 135 were on the second photodiode array 117 rather than on the first photodiode array 115, then the IR-only detected incident light (output2 in EQ. 1) would be lower than it should be. While this condition would prevent all of the IR contribution from being subtracted out based on EQ. 1 (because the IR level detected by the first photodiode array 115 would be greater than the IR level detected by the second photodiode array 117), a negative value would not result for the illuminance (as shown by EQ. 1). The focus of the method described with reference to FIG. 2 is on the shadowed region 135 being on the first photodiode array 115 rather than on the second photodiode array 117.


At block 220, determining whether shadowing is detected may be done in one of several ways. When the illuminance computed at block 210 (using EQ. 1) is zero or a negative value, shadowing may be assumed. The ratio of the converted second photodiode array 117 output (in lux, for example) to the computed illuminance (at block 210) may also be used to determine shadowing. The ratio is calculated as:









ratio
=


output





2

I





[

EQ
.




2

]








When this ratio is greater than a threshold ratio (because the first photodiode array 115 output and, thus, the illuminance calculation is artificially low due to the shadowed region 135), shadowing may be indicated. The threshold ratio may be selected based on the device as well as output2. Additionally, shadowing may be indicated when the second photodiode array 117 output (converted to lux, for example) exceeds an IR signal threshold. The IR signal threshold may be checked if the threshold ratio is exceeded. When shadowing is not detected, the illuminance computed at block 210 is provided as the illuminance value, at block 250, that may be used to adjust the display brightness, for example. In addition, the illuminance computed at block 210 is provided at block 225 as the last-known good illuminance. This value is used at block 240, as described below, the next time that a shadowed region 135 is detected on the first photodiode array 115. When shadowing is detected, an artificial illuminance is computed at block 230.


At block 230, computing the artificial illuminance includes using EQ. 1 again with an artificial output1 value. That is, first the artificial output1 is determined as:










artificial_output





1

=


output





2

artificial_ratio





[

EQ
.




3

]








The artificial ratio may be determined through calibration, for example. EQ. 1 is then used again to determine an artificial illuminance using artificial output1 and output2. When K1 and K2 are not based only on the device, K1 and K2 may be re-selected to determine the artificial illuminance (using EQ. 1) based on the artificial ratio.


At block 240, determining the illuminance value to be provided (block 250) is based on the artificial illuminance and includes using either a linear or a non-linear combination of the last-known good illuminance value (computed at block 210 and stored at block 225) and the artificial illuminance (determined at block 230). According to one embodiment, the illuminance value that is provided at block 250 may be determined at block 240 as the maximum of the last-known good illuminance value or the artificial illuminance value.



FIG. 3 is a block diagram of the sensor 110 of the device 100 of FIG. 1 according to an exemplary embodiment. The sensor 110 is arranged below a window 120 and includes the first photodiode array 115 and the second photodiode array 117 as shown in FIG. 1. The sensor 110 may also include one or more processors 310 and one or more memory devices 320. The processor 310 (e.g., application specific integrated circuit (ASIC), microprocessor) may execute instructions stored in the memory device 320 to compute illuminance and the other values (e.g., ratio, artificial output1) discussed above. The memory device 320 may also include the threshold values, artificial ratio values, and K1 and K2 values discussed above. In alternate embodiments, the processing described above to determine the illuminance value to be provided for adjustment of the display in the window 305, for example, may be done by one or more processors (e.g., 401, FIG. 4) and memory devices (e.g., 402, FIG. 4) of the device 100 that also perform other device functions.



FIG. 4 is a block diagram of an exemplary device 100 configured to perform detection of lighting conditions according to embodiments discussed above with reference to FIG. 2. While various components of the device 100 are depicted, alternate embodiments of the device 100 may include a subset of the components shown or include additional components not shown in FIG. 4. The device 100 includes a general purpose digital signal processor or DSP 401 and a memory 402. The DSP 401 and memory 402 may provide, in part or in whole, the functionality of the processor 310 and memory device 320 of the sensor 110 discussed above. As shown, the device 100 may further include an antenna and front-end unit 403, a radio frequency (RF) transceiver 404, an analog baseband processing unit 405, a microphone 406, an earpiece speaker 407, a headset port 408, a bus 409, such as a system bus or an input/output (I/O) interface bus, a removable memory card 410, a universal serial bus (USB) port 411, an alert 412, a keypad 413, a short range wireless communication sub-system 414, a liquid crystal display (LCD) 415, which may include a touch sensitive surface, an LCD controller 416, a charge-coupled device (CCD) camera 417, a camera controller 418, and a global positioning system (GPS) sensor 419, and a power management module 420 operably coupled to a power storage unit, such as a battery 426. In various embodiments, the device 100 may include another kind of display that does not provide a touch sensitive screen. In one embodiment, the DSP 401 communicates directly with the memory 402 without passing through the input/output interface (“Bus”) 409.


In various embodiments, the DSP 401 or some other form of controller or central processing unit (CPU) operates to control the various components of the device 100 in accordance with embedded software or firmware stored in memory 402 or stored in memory contained within the DSP 401 itself. In addition to the embedded software or firmware, the DSP 401 may execute other applications stored in the memory 402 or made available via information media such as portable data storage media like the removable memory card 410 or via wired or wireless network communications. The application software may comprise a compiled set of machine-readable instructions that configure the DSP 401 to provide the desired functionality, or the application software may be high-level software instructions to be processed by an interpreter or compiler to indirectly configure the DSP 401.


The antenna and front-end unit 403 may be provided to convert between wireless signals and electrical signals, enabling the device 100 to send and receive information from a cellular network or some other available wireless communications network or from a peer device 100. In an embodiment, the antenna and front-end unit 403 may include multiple antennas to support beam forming and/or multiple input multiple output (MIMO) operations. As is known to those skilled in the art, MIMO operations may provide spatial diversity, which can be used to overcome difficult channel conditions or to increase channel throughput. Likewise, the antenna and front-end unit 403 may include antenna tuning or impedance matching components, RF power amplifiers, or low noise amplifiers.


In various embodiments, the RF transceiver 404 facilitates frequency shifting, converting received RF signals to baseband and converting baseband transmit signals to RF. In some descriptions a radio transceiver or RF transceiver may be understood to include other signal processing functionality such as modulation/demodulation, coding/decoding, interleaving/deinterleaving, spreading/despreading, inverse fast Fourier transforming (IFFT)/fast Fourier transforming (FFT), cyclic prefix appending/removal, and other signal processing functions. For the purposes of clarity, the description here separates the description of this signal processing from the RF and/or radio stage and conceptually allocates that signal processing to the analog baseband processing unit 405 or the DSP 401 or other central processing unit. In some embodiments, the RF Transceiver 404, portions of the antenna and front-end unit 403, and the analog base band processing unit 405 may be combined in one or more processing units and/or application specific integrated circuits (ASICs).


Note that, in this diagram, the radio access technology (RAT) RAT1 and RAT2 transceivers 421, 422, the IXRF 423, the IRSL 424 and Multi-RAT subsystem 425 are operably coupled to the RF transceiver 404 and analog baseband processing unit 405 and then also coupled to the antenna and front-end unit 403 via the RF transceiver 404. As there may be multiple RAT transceivers, there will typically be multiple antennas or front ends 403 or RF transceivers 404, one for each RAT or band of operation.


The analog baseband processing unit 405 may provide various analog processing of inputs and outputs for the RF transceivers 404 and the speech interfaces (406, 407, 408). For example, the analog baseband processing unit 405 receives inputs from the microphone 406 and the headset 408 and provides outputs to the earpiece 407 and the headset 408. To that end, the analog baseband processing unit 405 may have ports for connecting to the built-in microphone 406 and the earpiece speaker 407 that enable the device 100 to be used as a cell phone. The analog baseband processing unit 405 may further include a port for connecting to a headset or other hands-free microphone and speaker configuration. The analog baseband processing unit 405 may provide digital-to-analog conversion in one signal direction and analog-to-digital conversion in the opposing signal direction. In various embodiments, at least some of the functionality of the analog baseband processing unit 405 may be provided by digital processing components, for example by the DSP 401 or by other central processing units.


The DSP 401 may perform modulation/demodulation, coding/decoding, interleaving/deinterleaving, spreading/despreading, inverse fast Fourier transforming (IFFT)/fast Fourier transforming (FFT), cyclic prefix appending/removal, and other signal processing functions associated with wireless communications. In an embodiment, for example in a code division multiple access (CDMA) technology application, for a transmitter function the DSP 401 may perform modulation, coding, interleaving, and spreading, and for a receiver function the DSP 401 may perform despreading, deinterleaving, decoding, and demodulation. In another embodiment, for example in an orthogonal frequency division multiplex access (OFDMA) technology application, for the transmitter function the DSP 401 may perform modulation, coding, interleaving, inverse fast Fourier transforming, and cyclic prefix appending, and for a receiver function the DSP 401 may perform cyclic prefix removal, fast Fourier transforming, deinterleaving, decoding, and demodulation. In other wireless technology applications, yet other signal processing functions and combinations of signal processing functions may be performed by the DSP 401.


The DSP 401 may communicate with a wireless network via the analog baseband processing unit 405. In some embodiments, the communication may provide Internet connectivity, enabling a user to gain access to content on the Internet and to send and receive e-mail or text messages. The input/output interface (“Bus”) 409 interconnects the DSP 401 and various memories and interfaces. The memory 402 and the removable memory card 410 may provide software and data to configure the operation of the DSP 401. Among the interfaces may be the USB interface 411 and the short range wireless communication sub-system 414. The USB interface 411 may be used to charge the device 100 and may also enable the device 100 to function as a peripheral device to exchange information with a personal computer or other computer system. The short range wireless communication sub-system 414 may include an infrared port, a Bluetooth interface, an IEEE 802.11 compliant wireless interface, or any other short range wireless communication sub-system, which may enable the device to communicate wirelessly with other nearby client nodes and access nodes. The short-range wireless communication sub-system 414 may also include suitable RF Transceiver, Antenna and Front End subsystems.


The input/output interface (“Bus”) 409 may further connect the DSP 401 to the alert 412 that, when triggered, causes the device 100 to provide a notice to the user, for example, by ringing, playing a melody, or vibrating. The alert 412 may serve as a mechanism for alerting the user to any of various events such as an incoming call, a new text message, and an appointment reminder by silently vibrating, or by playing a specific pre-assigned melody for a particular caller.


The keypad 413 couples to the DSP 401 via the I/O interface (“Bus”) 409 to provide one mechanism for the user to make selections, enter information, and otherwise provide input to the device 100. The keypad 413 may be a full or reduced alphanumeric keyboard such as QWERTY, DVORAK, AZERTY and sequential types, or a traditional numeric keypad with alphabet letters associated with a telephone keypad. The input keys may likewise include a track wheel, track pad, an exit or escape key, a trackball, and other navigational or functional keys, which may be inwardly depressed to provide further input function. Another input mechanism may be the LCD 415, which may include touch screen capability and also display text and/or graphics to the user. The display controller 416 couples the DSP 401 to the display 415. In alternate embodiments, the display 415 may be, for example, an LED or an OLED built-in display in the device 100.


The camera 417 (e.g., CMOS camera), if equipped, enables the device 100 to make digital pictures. The DSP 401 communicates with the camera 417 via the camera controller 418. In another embodiment, a camera implemented as a Charge Coupled Device (CCD) camera may be employed. The GPS sensor 419 is coupled to the DSP 401 to decode global positioning system signals or other navigational signals, thereby enabling the device 100 to determine its position. The GPS sensor 419 may be coupled to an antenna and front end (not shown) suitable for its band of operation. Various other peripherals may also be included to provide additional functions, such as radio and television reception.


In various embodiments, device 100 comprises a first Radio Access Technology (RAT) transceiver 421 and a second RAT transceiver 422. As shown in FIG. 4, the RAT transceivers ‘1’ 421 and ‘2’ 422 are in turn coupled to a multi-RAT communications subsystem 425 by an Inter-RAT Supervisory Layer Module 424. In turn, the multi-RAT communications subsystem 425 is operably coupled to the Bus 409. Optionally, the respective radio protocol layers of the first Radio Access Technology (RAT) transceiver 421 and the second RAT transceiver 422 are operably coupled to one another through an Inter-RAT eXchange Function (IRXF) Module 423.


While several embodiments have been provided in the present disclosure, it should be understood that the disclosed systems and methods may be embodied in many other specific forms without departing from the spirit or scope of the present disclosure. The present examples are to be considered as illustrative and not restrictive, and the intention is not to be limited to the details given herein. For example, the various elements or components may be combined or integrated in another system or certain features may be omitted, or not implemented.


Also, techniques, systems, subsystems and methods described and illustrated in the various embodiments as discrete or separate may be combined or integrated with other systems, modules, techniques, or methods without departing from the scope of the present disclosure. Other items shown or discussed as coupled or directly coupled or communicating with each other may be indirectly coupled or communicating through some interface, device, or intermediate component, whether electrically, mechanically, or otherwise. Other examples of changes, substitutions, and alterations are ascertainable by one skilled in the art and could be made without departing from the spirit and scope disclosed herein.

Claims
  • 1. An electronic device, comprising: a display;a first photodiode array configured to detect light in a visible spectrum and a non-visible spectrum that is incident on the first photodiode array;a second photodiode array configured to detect light in the non-visible spectrum that is incident on the second photodiode array; anda processor configured to determine lighting conditions and to control brightness of the display based on a first output of the first photodiode array and a second output of the second photodiode array, the processor adjusting the first output used to determine the lighting conditions based on detecting that the first photodiode array includes a shadowed region.
  • 2. The device according to claim 1, wherein the first output is proportional to the light in the visible spectrum and the non-visible spectrum that is incident on the first photodiode array and the second output is proportional to the light in the non-visible spectrum that is incident on the second photodiode array.
  • 3. The device according to claim 1, wherein the processor determines a difference between the first output and the second output, the difference being based on a subtraction of the second output from the first output.
  • 4. The device according to claim 3, wherein the difference is the subtraction of the second output, multiplied by a second factor, from the first output, multiplied by a first factor, the first factor and the second factor being determined based on a calibration.
  • 5. The device according to claim 3, wherein the processor detects that the first photodiode array includes the shadowed region based on the difference being zero or a negative value.
  • 6. The device according to claim 3, wherein the processor determines an illuminance in lumens per square meter (lux) based on the difference between the first output and the second output and outputs the illuminance as the lighting conditions unless the processor detects that the first photodiode array includes the shadowed region.
  • 7. The device according to claim 6, wherein the processor detects that the first photo diode array includes the shadowed region based on a ratio of the second output to the illuminance exceeding a ratio threshold.
  • 8. The device according to claim 7, wherein the processor detects that the first photodiode array includes the shadowed region based additionally on the second output exceeding an output threshold.
  • 9. The device according to claim 1, wherein the processor adjusts the first output used to determine the lighting conditions to be a ratio of the second output to an artificial ratio, the artificial ratio being determined based on a calibration.
  • 10. A non-transitory computer readable medium storing instructions which, when processed by a processor, cause the processor to execute a method of detecting lighting conditions, the method comprising: receiving a first output from a first photodiode array that is proportional to light in a visible spectrum and a non-visible spectrum that is incident on the first photodiode array;receiving a second output from a second photodiode array that is proportional to light in the non-visible spectrum that is incident on the second photodiode array;determining the lighting conditions based on the first output and the second output; andadjusting the first output used to determine the lighting conditions based on detecting that the first photodiode array includes a shadowed region.
  • 11. A method of detecting lighting conditions, the method comprising: detecting, using a first photodiode array, light in a visible spectrum and a non-visible spectrum that is incident on the first photodiode array;detecting, using a second photodiode array, light in the non-visible spectrum that is incident on the second photodiode array;determining, using a processor, the lighting conditions based on a first output of the first photodiode array and a second output of the second photodiode array; andadjusting, using the processor, the first output used to determine the lighting conditions based on detecting that the first photodiode array includes a shadowed region.
  • 12. The method according to claim 11, wherein the first output is proportional to the light in the visible spectrum and the non-visible spectrum that is incident on the first photodiode array and the second output is proportional to the light in the non-visible spectrum that is incident on the second photodiode array.
  • 13. The method according to claim 11, further comprising the processor determining a difference between the first output and the second output, the difference being based on a subtraction of the second output from the first output.
  • 14. The method according to claim 13, wherein the processor determines the difference as the subtraction of the second output, multiplied by a second factor, from the first output, multiplied by a first factor, the first factor and the second factor being determined based on a factor calibration process.
  • 15. The method according to claim 13, further comprising the processor detecting that the first photodiode array includes the shadowed region based on the difference being zero or a negative value.
  • 16. The method according to claim 13, further comprising the processor determining an illuminance in lumens per square meter (lux) based on the difference between the first output and the second output and outputting the illuminance as the lighting conditions unless the processor detects that the first photodiode array includes the shadowed region.
  • 17. The method according to claim 16, further comprising the processor detecting that the first photo diode array includes the shadowed region based on a ratio of the second output to the illuminance exceeding a ratio threshold.
  • 18. The method according to claim 17, further comprising the processor detecting that the first photodiode array includes the shadowed region based additionally on the second output exceeding an output threshold.
  • 19. The method according to claim 11, wherein the processor adjusting the first output includes the processor setting the first output as a ratio of the second output to an artificial ratio.
  • 20. The method according to claim 19, further comprising determining the artificial ratio based on a ratio calibration process.
US Referenced Citations (140)
Number Name Date Kind
5252951 Tannenbaum et al. Oct 1993 A
5554912 Thayer et al. Sep 1996 A
5594469 Freeman et al. Jan 1997 A
6693612 Matsumoto et al. Feb 2004 B1
7618323 Rothschild et al. Nov 2009 B2
7620316 Boillot Nov 2009 B2
8035614 Bell et al. Oct 2011 B2
8363157 Han Jan 2013 B1
8964062 Neglur Feb 2015 B1
9063574 Ivanchenko Jun 2015 B1
20020093491 Gillespie et al. Jul 2002 A1
20030112228 Gillespie et al. Jun 2003 A1
20030156100 Gettemy Aug 2003 A1
20040178997 Gillespie et al. Sep 2004 A1
20040190776 Higaki et al. Sep 2004 A1
20060013440 Cohen et al. Jan 2006 A1
20060092142 Gillespie et al. May 2006 A1
20060139185 Bonnat et al. Jun 2006 A1
20060187214 Gillespie et al. Aug 2006 A1
20060279548 Geaghan Dec 2006 A1
20070075965 Huppi et al. Apr 2007 A1
20070120996 Boillot May 2007 A1
20070130547 Boillot Jun 2007 A1
20070259716 Mattice et al. Nov 2007 A1
20070259717 Mattice et al. Nov 2007 A1
20080005703 Radivojevic et al. Jan 2008 A1
20080041640 Gillespie et al. Feb 2008 A1
20080042994 Gillespie et al. Feb 2008 A1
20080048997 Gillespie et al. Feb 2008 A1
20080122803 Izadi et al. May 2008 A1
20080134102 Movold et al. Jun 2008 A1
20080165145 Herz et al. Jul 2008 A1
20080165160 Kocienda et al. Jul 2008 A1
20080168402 Blumenberg Jul 2008 A1
20080266083 Midholt et al. Oct 2008 A1
20090031258 Arrasvuori et al. Jan 2009 A1
20090051648 Shamaie et al. Feb 2009 A1
20090058830 Herz et al. Mar 2009 A1
20090074248 Cohen et al. Mar 2009 A1
20090077504 Bell et al. Mar 2009 A1
20090100383 Sunday et al. Apr 2009 A1
20090139778 Butler et al. Jun 2009 A1
20090189858 Lev et al. Jul 2009 A1
20090195497 Fitzgerald et al. Aug 2009 A1
20100027843 Wilson Feb 2010 A1
20100060611 Nie Mar 2010 A1
20100090947 Underkoffler et al. Apr 2010 A1
20100150399 Svajda et al. Jun 2010 A1
20100153996 Migos et al. Jun 2010 A1
20100156676 Mooring et al. Jun 2010 A1
20100177060 Han Jul 2010 A1
20100188328 Dodge et al. Jul 2010 A1
20100192105 Kim et al. Jul 2010 A1
20100244751 Van Endert Sep 2010 A1
20100245289 Svajda Sep 2010 A1
20100253241 Van Endert Oct 2010 A1
20100277073 Van Endert Nov 2010 A1
20100313050 Harrat et al. Dec 2010 A1
20100325575 Platzer et al. Dec 2010 A1
20110010626 Fino et al. Jan 2011 A1
20110029913 Boillot et al. Feb 2011 A1
20110096009 Kurokawa et al. Apr 2011 A1
20110140610 Van Endert Jun 2011 A1
20110157016 Chang Jun 2011 A1
20110163947 Shaw et al. Jul 2011 A1
20110167391 Momeyer et al. Jul 2011 A1
20110180709 Craddock et al. Jul 2011 A1
20110182519 Craddock et al. Jul 2011 A1
20110185309 Challinor et al. Jul 2011 A1
20110187640 Jacobsen et al. Aug 2011 A1
20110211073 Foster Sep 2011 A1
20110215733 Van Endert Sep 2011 A1
20110221666 Newton et al. Sep 2011 A1
20110221669 Shams et al. Sep 2011 A1
20110248151 Holcombe et al. Oct 2011 A1
20110248961 Svajda et al. Oct 2011 A1
20110254864 Tsuchikawa et al. Oct 2011 A1
20110291988 Bamji et al. Dec 2011 A1
20110296353 Ahmed et al. Dec 2011 A1
20110298754 Bove et al. Dec 2011 A1
20110306304 Forutanpour et al. Dec 2011 A1
20110310005 Chen et al. Dec 2011 A1
20110314429 Blumenberg Dec 2011 A1
20110314430 Blumenberg Dec 2011 A1
20120007821 Zaliva Jan 2012 A1
20120007833 Liu et al. Jan 2012 A1
20120013529 McGibney et al. Jan 2012 A1
20120013539 Hogan et al. Jan 2012 A1
20120013540 Hogan Jan 2012 A1
20120023443 Blumenberg Jan 2012 A1
20120023460 Blumenberg Jan 2012 A1
20120023461 Blumenberg Jan 2012 A1
20120023509 Blumenberg Jan 2012 A1
20120050007 Forutanpour et al. Mar 2012 A1
20120056804 Radivojevic et al. Mar 2012 A1
20120089948 Lim et al. Apr 2012 A1
20120133580 Kirby et al. May 2012 A1
20120162636 Sy Jun 2012 A1
20120176303 Miyake Jul 2012 A1
20120176401 Hayward et al. Jul 2012 A1
20120200486 Meinel et al. Aug 2012 A1
20120206339 Dahl Aug 2012 A1
20120242584 Tuli Sep 2012 A1
20120242852 Hayward et al. Sep 2012 A1
20120245886 Zhang et al. Sep 2012 A1
20120280107 Skurnik et al. Nov 2012 A1
20120280900 Wang et al. Nov 2012 A1
20120280904 Skurnik et al. Nov 2012 A1
20120280905 Vonog et al. Nov 2012 A1
20120281129 Wang et al. Nov 2012 A1
20120282974 Green et al. Nov 2012 A1
20120287044 Bell et al. Nov 2012 A1
20120293404 Federico et al. Nov 2012 A1
20120306815 Su et al. Dec 2012 A1
20120312956 Chang et al. Dec 2012 A1
20120317511 Bell Dec 2012 A1
20130002538 Mooring et al. Jan 2013 A1
20130002601 McCracken Jan 2013 A1
20130004016 Karakotsios et al. Jan 2013 A1
20130009896 Zaliva Jan 2013 A1
20130022214 Dickins et al. Jan 2013 A1
20130033418 Bevilacqua et al. Feb 2013 A1
20130034265 Nakasu et al. Feb 2013 A1
20130053007 Cosman et al. Feb 2013 A1
20130067419 Eltoft Mar 2013 A1
20130083252 Boyes Apr 2013 A1
20130091561 Bruso et al. Apr 2013 A1
20130093727 Eriksson et al. Apr 2013 A1
20130100036 Papakipos et al. Apr 2013 A1
20130102366 Teng et al. Apr 2013 A1
20130145535 Parsons et al. Jun 2013 A1
20130167221 Vukoszavlyev et al. Jun 2013 A1
20130182246 Tanase Jul 2013 A1
20130328761 Boulanger et al. Dec 2013 A1
20130328842 Barnhoefer et al. Dec 2013 A1
20140118257 Baldwin May 2014 A1
20140237432 Geurts et al. Aug 2014 A1
20140253427 Gruhlke et al. Sep 2014 A1
20140306877 Katz et al. Oct 2014 A1
20150009290 Mankowski et al. Jan 2015 A1
Foreign Referenced Citations (3)
Number Date Country
0538705 Apr 1993 EP
2226710 Sep 2010 EP
2012140593 Oct 2012 WO
Non-Patent Literature Citations (56)
Entry
Pyreos, “Low Power Gester Sensor Enabling Touchless Control for Mobile Devices” [online]; retrieved Jun. 6, 2013; retrieved from http://www.pyreos.com/images/downloads/Applications/Touchless%20Gesture%20Control/Gesture%20Sensor%20FAQs.pdf pp. 1-2.
Silicon Labs, “Touchless Gesturing Brings New Innovation to Electronic Product Designs” [online]; retrieved Jun. 27, 2013; retrieved from http://www.silabs.com/Support%20Documents/TechnicalDocs/TouchlessSensorIC-WP.pdf pp. 1-4.
Taos, “Light-to-Digital Converter” The Lumenology Company, Taos132, Mar. 2012, pp. 1-24.
Mankowski, Peter, et al.; U.S. Appl. No. 13/932,470, filed Jul. 1, 2013; Title: Gesture Detection Using Ambient Light Sensors.
Mankowski, Peter, et al.; U.S. Appl. No. 13/932,235, filed Jul. 1, 2013; Title: Performance Control of Ambient Light Sensors.
Mankowski, Peter; U.S. Appl. No. 13/932,243, filed Jul. 1, 2013; Title: Password by Touch-Less Gesture.
Mankowski, Peter; U.S. Appl. No. 13/932,250, filed Jul. 1, 2013; Title: Touch-Less User Interface Using Ambient Light Sensors.
Mankowski, Peter, et al.; U.S. Appl. No. 13/932,487, filed Jul. 1, 2013; Title: Gesture Detection Using Ambient Light Sensors.
Mankowski, Peter, U.S. Appl. No. 13/932,260, filed Jul. 1, 2013; Title: Camera Control Using Ambient Light Sensors.
Mankowski, Peter, et al., U.S. Appl. No. 13/932,271, filed Jul. 1, 2013; Title: Display Navigation Using Tough-Less Gestures.
Mankowski, Peter; U.S. Appl. No. 13/932,280, filed Jul. 1, 2013; Title: Alarm Operation by Touch-Less Gesture.
Mankowski, Peter, et al.; U.S. Appl. No. 13/937,444, filed Jul. 9, 2013; Title: Operating a Device Using Touchless and Touchscreen Gestures.
Cheng, Heng-Tze, et al.; “Contactless Gesture Recognition System Using Proximity Sensors”; Carnegie Mellon University; http://repository.cmu.edu/silicon—valley/17/; 2010; 2 pages.
Pyreos; “Pioneering Low Power Gesture Sensor Enabling Touchless Control for Mobile Devices”; http://www.pyreos.com/images/downloads/Applications/Touchless%20Gesture%20Control/Gesture%20Sensor%20FAQs.pdf; Jun. 27, 2013; 2 pages.
Silicon Laboratories, Inc.; “Touchless Gesturing Brings New Innovation to Electronic Product Designs”; http://www.silabs.com/Support%20Documents/TechnicalDocs/TouchlessSensorIC-WP.pdf; Jun. 27, 2013; 4 pages.
Taos, Inc.; “Light-To-Digital Converter”; TSL2572; The Lumenology Company; Mar. 2012; 24 pages.
Liao, Chunyuan, et al.; “PACER: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone”; CHI 2010: Displays Where You Least Expet Them; Atlanta, GA, USA; Apr. 10-15, 2010; 10 pages.
Holenarsipur, Prashanth, et al.; “Ambient-Light Sensing Optimizes Visibility and Battery Life of Portable Displays”; Maxim; Application Note 5051; Jun. 20, 2011; 7 pages.
Office Action dated Dec. 15, 2014; U.S. Appl. No. 13/932,243, filed Jul. 1, 2013; 29 pages.
Office Action dated Sep. 3, 2014; U.S. Appl. No. 13/932,260, filed Jul. 1, 2013; 48 pages.
Office Action dated Nov. 20, 2014; U.S. Appl. No. 13/932,271, filed Jul. 1, 2013; 35 pages.
Office Action dated Oct. 29, 2014; U.S. Appl. No. 13/937,444, filed Jul. 9, 2013; 28 pages.
European Extended Search Report; Application No. 13174561.4; Jan. 3, 2014; 8 pages.
European Extended Search Report; Application No. 13174565.5; Dec. 6, 2013; 7 pages.
European Extended Search Report; Application No. 13174557.2; Dec. 13, 2013; 7 pages.
European Extended Search Report; Application No. 13174558.0; Jan. 3, 2014; 10 pages.
European Extended Search Report; Application No. 13174576.2; Jan. 3, 2014; 12 pages.
European Extended Search Report; Application No. 13174577.0; Dec. 13, 2013; 8 pages.
European Extended Search Report; Application No. 13174560.6; Jan. 3, 2014; 10 pages.
European Extended Search Report; Application No. 13174575.4; Jan. 3, 2014; 9 pages.
European Extended Search Report; Application No. 13175807.0; Jan. 15, 2014; 7 pages.
European Extended Search Report; Application No. 14183709.6; Jan. 26, 2015; 7 pages.
Mankowski, Peter, et al.; U.S. Appl. No. 13/949,748, filed Jul. 24, 2013; Title: Backlight for Touchless Gesture Detection.
Mankowski, Peter, et al.; U.S. Appl. No. 13/949,727, filed Jul. 24, 2013; Title: Backlight for Touchless Gesture Detection.
EE Times; “Ambient Light Sensors Adjust LCD Brightness to Save Battery Power”; http://www.eetimes.com/document.asp?doc—id=1302779&print=yes; Dec. 26, 2006; 2 pages.
Rohm Semiconductor; “Ambient Light Sensor (ALS) Applications in Portable Electronics”; http://www.rohm.com/documents/11303/41217/CNA09016—wp.pdf; Jul. 24, 2013; 9 pages.
European Extended Search Report; Application No. 14178207.8; Dec. 23, 2014; 6 pages.
Office Action dated Jun. 2, 2015; U.S. Appl. No. 13/932,487, filed Jul. 1, 2013; 47 pages.
Final Office Action dated Mar. 4, 2015; U.S. Appl. No. 13/932,260, filed Jul. 1, 2013; 55 pages.
Final Office Action dated Mar. 31, 2015; U.S. Appl. No. 13/937,444, filed Jul. 9, 2013; 20 pages.
Office Action dated May 14, 2015; U.S. Appl. No. 13/949,748, filed Jul. 24, 2013; 50 pages.
Office Action dated Apr. 14, 2015; U.S. Appl. No. 13/949,727, filed Jul. 24, 2013; 44 pages.
Office Action dated Jun. 30, 2015; U.S. Appl. No. 13/932,470, filed Jul. 1, 2013; 51 pages.
Office Action dated Jun. 18, 2015; U.S. Appl. No. 13/932,235, filed Jul. 1, 2013; 41 pages.
Final Office Action dated Jun. 5, 2015; U.S. Appl. No. 13/932,243 filed Jul. 1, 2013; 10 pages.
Office Action dated Jun. 11, 2015; U.S. Appl. No. 13/932,250, filed Jul. 1, 2013; 53 pages.
Office Action dated Jul. 27, 2015; U.S. Appl. No. 13/932,260, filed Jul. 1, 2013; 70 pages.
Final Office Action dated Jun. 18, 2015; U.S. Appl. No. 13/932,271, filed Jul. 1, 2013; 34 pages.
Office Action dated Jun. 29, 2015; U.S. Appl. No. 13/932,280, filed Jul. 1, 2013; 45 pages.
Advisory Action dated Jun. 8, 2015; U.S. Appl. No. 13/937,444, filed Jul. 9, 2013; 6 pages.
Final Office Action dated Aug. 21, 2015; U.S. Appl. No. 13/949,727, filed Jul. 24, 2013; 17 pages.
Final Office Action dated Sep. 8, 2015; U.S. Appl. No. 13/932,243, filed Jul. 1, 2013; 14 pages.
Notice of Allowance dated Sep. 29, 2015; U.S. Appl. No. 13/932,487, filed Jul. 1, 2013; 16 pages.
Advisory Action dated Sep. 10, 2015; U.S. Appl. No. 13/932,271, filed Jul. 1, 2013; 3 pages.
Office Action dated Oct. 9, 2015; U.S. Appl. No. 13/932,280, filed Jul. 1, 2013; 13 pages.
Office Action dated Sep. 18, 2015; U.S. Appl. No. 13/937,444, filed Jul. 9, 2013; 18 pages.
Related Publications (1)
Number Date Country
20150069921 A1 Mar 2015 US