This application is related to U.S. patent application Ser. No. 14/557,036, filed on Dec. 1, 2014, which is assigned to the same assignee as the current application, and all of which are incorporated by reference in its entirety as if fully set forth herein.
Electronic displays facilitate the reproduction of data on a lighted platform. Driving circuitry is employed to manipulate lighted elements to render the information being displayed. The viewer may gaze upon the display and view the lighted elements to process and consume the information.
However, because light is employed to convey the electronic information, the viewing experience is affected by the environment in which the electronic display is implemented in. For example, if the electronic display is an awkward or inconvenient location, viewing the electronic display may be ultimately frustrated.
Further, the environment around the electronic display may be dynamic and changing. For example, if the electronic display is implemented in an area that interacts with outside or external light providing sources, the electronic display's ability to convey information via the lighted elements may be obstructed or modified.
A measure of unit for determining the intensity of light being transmitted or propagated in a specific direction is known as luminance. Various units may be employed to measure luminance, such as a candela per square meter. One of ordinary skill in the art may appreciate that several units or types of measurements may be employed for luminance measurement.
For example, if an electronic display is implemented in a vehicle, the electronic display may interact with the outside lighting environment. Thus, several factors may be present with the exterior lighting to affect the display's ability to provide a clear display in an optimal fashion. For example, the exterior lighting may be affected by the cloud cover, the weather, the road (e.g. if the vehicle is in a tunnel), the time of day, or the like.
Thus, an electronic display may be aided greatly by an ability to be cognizant of the exterior lighting conditions. Based on the knowledge of the exterior lighting conditions, the electronic display may adjust the display luminance accordingly.
One such example of a system for adjusting display luminance is shown in
As shown in
The aspects shown in
The various affects shown in
In order to understand how to adjust display luminance, the Silverstein relationship is provided (as explained in several references submitted). The equation described below describes a relationship between the detect DBL and the luminance to be employed in a display.
ESL=BO(DBL)C
With cathode ray tubes (CRT) display technologies, phosphor reflectance does not change as a function of phosphor light emission. A liquid crystal display (LCD) presents a different challenge due to the “on” and “off” state each LCD cell experiences. Thus, variations of the Silverstein relationship may be calculated for LCD displays. However, by employing the DBL relationship above, the display visibility may be greatly improved.
In addition, various other factors employing the Silverstein methodology may be employed. For example, the gain correction factor (GF) may be calculated, which employs a forward looking light sensor.
However, the existing logarithmic sensors to compensate for light adaptation effects may be incompatible with the Silverstein methodology (which is designed an optimized for linear light sensing). Thus, employing a logarithmic light sensor in a display adjustment system may ultimately be frustrated.
The detailed description refers to the following drawings, in which like numerals refer to like items, and in which:
A system for adjusting an electronic display is provided herein. The system includes a forward looking light sensor receiver to logarithmically receive a first light information from a forward looking light sensor; an ambient light sensor receiver to logarithmically receive a second light information from an ambient light sensor; and an adjuster to adjust a luminance of the electronic display based on a combination of the first light information and the second light information.
The invention is described more fully hereinafter with references to the accompanying drawings, in which exemplary embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure is thorough, and will fully convey the scope of the invention to those skilled in the art. It will be understood that for the purposes of this disclosure, “at least one of each” will be interpreted to mean any combination of the enumerated elements following the respective language, including combination of multiples of the enumerated elements. For example, “at least one of X, Y, and Z” will be construed to mean X only, Y only, Z only, or any combination of two or more items X, Y, and Z (e.g. XYZ, XZ, YZ, X). Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals are understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated for clarity, illustration, and convenience.
Electronic displays employ lighting to convey information to a viewer. As explained in the Background section, the lighting is often interfered with due to environmental conditions, such as ambient light or weather conditions. In these situations, the viewing experience may be affected by the environmental conditions, and thus, be perturbed.
Various techniques have been disclosed that allow the lighting to be adjusted. However, these techniques are either limited by the ranges or the dynamic abilities they provide.
In one such implementation, ambient light is detected, and the display is modified or adjusted accordingly. With these sensors, which may be situated on the electronic display, the light affecting the electronic display is employed to modify or adjust the display.
However, this light does not encompass all the external lighting that may be affecting a viewing on an electronic display. For example, the viewer's eye may be affected by the lighting condition experienced via external lighting sources (i.e. the sun, etc). In these situations, the solar lighting may cause the viewer's pupil to process and view the electronic display in a different manner.
As illustrated in the Background section and in other techniques, an approximation employing a linear forward looking light sensor has been proposed. This methodology does not work effectively because of the limitation in range associated with linear light sensing. The linear forward looking light sensor services a range that does not adequately cover the amount of detection necessary to successfully implement a technology to adjust the electronic display.
Disclosed herein are methods, systems, and devices for adjusting an electronic display based on light sensing. The aspects disclosed herein allow for the employment of logarithmic light sensing on a forward looking light sensor and an ambient light sensor to effectively adjust an electronic display system. The various methodologies and components discussed herein facilitate a system rendering or driving an electronic display to adjust light levels in a manner that allows for a dynamic response to environmental concerns with the implementation of a display system.
For example, if the electronic display is implemented in a vehicle, a forward looking light sensor, an ambient light sensor, and system for integrating data from both sensors may allow a viewer of the electronic display system to achieve a better and safer driving system.
The aspects disclosed herein employ a vehicle display system for explanatory purposes. However, one of ordinary skill in the art may implement the aspects disclosed herein in other contexts that employ both a forward looking light sensor and an ambient light sensor.
The forward looking light sensor and the ambient light sensor, in the implementations described below are logarithmic. The employment of a logarithmic light sensor allows for a dynamic range to be represented.
The logarithmic forward looking sensor interfacer 410 is configured to receive data or sensing information from a logarithmic forward looking sensor 480. The sensor 480 may be installed in a fashion to replicate an image or area being viewed upon by a person viewing through a forward surface (for example, a windshield in a vehicle). For example, if the display 450 is implemented in a vehicle, the sensor 480 may be oriented to view the light coming through a windshield.
The display 450 may be any sort of electronic display attached to driving circuitry. The display 450 renders images and information via lighted elements. The amount of lighting may be configured by an adjustment and according to the aspects disclosed herein.
The display 450 may include multiple sensors, such as logarithmic ambient light sensors 460 and 470. The sensors 460 and 470 may be configured to interface with ambient light sensor interfacer 430.
The various sensors (sensor 460, 470, and 480) are each configured to monitor the light associated with the environment each one is situated in. The sensing may occur in real-time, or periodic intervals. The sensing may be configured to be enabled/disabled by user operation, or by an external signal from an electronic system in communication with the display 450.
The adjuster 420, based on the information received via the interfacers 410 and 430, adjusts the lighting associated with the display 450. The adjustment may be according to the concepts disclosed herein, and will be described in greater detail below.
Referring to
The digital conversion is represented by the following equation:
The above-identified equations (the terms, definition of the constants, and the derivation) are found in references submitted along with this application, and thus, a full explanation is omitted for brevity.
The output of the A/D blocks may be employed to drive the adjuster 420 (and thus, adjust the lighting of the display 450). However, the values may be employed as described below to adjust the display 450 in another way.
The following relationship describes the Lsel value. The Lsel value is the desired display luminance, and may be determined by populating a lookup table based on various constant step ratios R. If the constant step ratio is used, ND value, and the NDB value may employed to determine the Lsel value. ND is used and derived by the A/D output, and NDB may be obtained by a user offset or bias. This definition is described in the references disclosed, and is listed as:
The logarithmic expression of the above-described relationship is defined by the following:
For the ease of analysis, the base 10 version of the above relationship may be calculated by the following expressions:
For each Lsel calculated, a lookup table may be referred to find a corresponding constant figure. For the purposes of the adjuster 420 shown above, the constants are known as (ND).
It will be described further below how the above described relationship is incorporated by the analysis performed by the data obtained from sensors 460, 470, and 480.
Specifically, for the sensor 480, the following relationships described below produce a value that may be employed to augment the adjustment described herein. Sensor 480 may include circuits 481 and 482 similar to circuits 461 and 462, respectively.
The sensor 480 produces a voltage, which may be defined by the following relationships:
The voltage generated above in the previous equation may undergo an A/D conversion, with the following relationship (as shown by element 520):
The equation may be transformed even more by the following:
FFVI=KFLLSiFLLS
Where KFFLS is a constant, thereby rendering the following relationship for the A/D conversion:
Manipulating the relationship produces the following:
Taking a logarithm of the relationship produces:
In order to manipulate the equation further, a NH factor may be employed. The NH factor may be determined by the A/D count above, and defined the following relationship:
Which may be substituted in the previous relationship, producing the following:
The above relationship is multiplied by 1.125 to produces the relationship shown in element 524:
The above relationship produces a 1.125 log10(FFVI) factor that is input into element 530.
Element 530 sums the contribution from the various sensors (460-480), to produce the following relationship to produce a gain factor (GF):
The above relationship indicates another advantage of employing logarithmic sensors since only addition and subtraction is employed in element 530. The method to perform the gain factor (GF) multiplication by element 517 may be performed by a processor. However a less computationally intense method is to construct a lookup table.
In element 531, a branching statement is employed to determine whether the GF is above a certain threshold (for example, 1). If the GF (as calculated by element 530) is greater than 1, the adjuster 420 proceeds to element 517. If the GF is greater than 1, then the LSEL value determined by sensors 460 and 470 is multiplied by the GF in element 517.
The output of 517 is fed back to the display 450, and the display 450 is adjusted accordingly by the multiplied value.
If no (in element 531), the GF is set to 1, and adjuster 420 proceeds to element 517. In this situation, the display 450 is not adjusted. In one example, the GF multiplication performed in element 517 may be performed by a processor. However, in another example, a lookup table might be employed.
In order to determine a constant to employ with a lookup table, the following set of equations may be incorporated with the adjuster 420. Element 514 is a summation block that produces an Nd+Nbd value. That value is employed to calculate the value produced in element 518. It may be additionally propagated to element 515 to satisfy the following relationship:
Where NS is the Nd+Nbd value.
In order to determine a step number (which is then cross-referenced to a lookup table 600, as shown in
The above equations are combined to determine the following:
The above equation may be simplified, therefore producing the following:
Further manipulation of the above equation produces:
Subtraction of the exponent terms results in:
Producing the natural log, provides the following:
A luminance ratio, RD, describing the display luminance ratio for each N step may be defined by the following:
Substituting the equations above, produces:
The previous equations indicate that the step level of the sensors 460 and 470 are not important, and that the difference ΔN=(NGF−NS) needs to be added.
This relationship is shown in greater detail in
Another difference is that element 524 is different in
Instead of relying on an index number ND, elements 810, 820, and 830 are introduced. Also, elements 518 and 524 are changed to eliminate the table index parameters NH and ND. The following set of expressions and formulas explain how the index numbers are replaced.
The display ambient light sensor output is calculated in a similar way as describe in
The above equation is then transformed to produce the following.
Which leads to the following derivation:
Allowing for the solving of iALS:
The relationship between the Display Background Luminance (DBL) and the photocurrent iALS is defined by the following where B is reflectance factor based on viewer geometry:
Solving for DBL provides the following:
After which, ESL may be solved for (block 810):
In element 830, the amount calculated by element 810 is multiplied by RD(NBD)—corresponding to the user bias. This figure may be referred to as LSEL, and may undergo another transformation in element 850.
In the expression above, the last term requires an exponential term to be determined. If constants K1 and K2 are defined, element 830 may be simplified as below:
LSEL=RDN
Element 518, which is employed to calculate the gain factor is also modified as below (to element 840).
Once the output of element 518 is produced (and propagated to element 840), the gain factor and the subsequent modifications to the luminance may be performed in a similar fashion as that shown in
Specifically, a view of the vehicle from a driver/passenger looking outside of a front window is depicted. The other elements of the vehicle are not shown or described for exemplary purposes. The vehicle includes a display 450, which may be any electronic display 450 know one of ordinary skill in the art. Display 450's luminance may be adjustable by the various parameters described herein.
As shown in
Light source 930 represents the light being emanated from within the vehicle, such as an ambient light source. Light source 930 produces a light ray 931. Light ray 931 may be representative of a light being shone onto a display 450's screen. A light bulb is shown to graphically represent this light, however, the light may be produced for all sorts of light effects that propagate onto a display 450. For example, the light may come from external sources (i.e. the sun or moon), light from multiple light sources, or the like.
The system 400 employs the techniques described up above to sense the light rays 921 and 931, and subsequently alter the display 450. By employing two sets of logarithmic light sensors, the display 450 may adjust to various light conditions in a robust and dynamic manner.
It will be apparent to those skilled in the art that various modifications and variation can be made in the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Number | Name | Date | Kind |
---|---|---|---|
5883605 | Knapp | Mar 1999 | A |
6479810 | Weindorf | Nov 2002 | B1 |
6483245 | Weindorf et al. | Nov 2002 | B1 |
6507286 | Weindorf et al. | Jan 2003 | B2 |
6762741 | Weindorf | Jul 2004 | B2 |
8358074 | Biondo | Jan 2013 | B2 |
20020101166 | Weindorf | Aug 2002 | A1 |
20020118182 | Weindorf | Aug 2002 | A1 |
20040201483 | Stam | Oct 2004 | A1 |
20120327051 | Davies | Dec 2012 | A1 |
Number | Date | Country |
---|---|---|
2013167466 | Nov 2013 | WO |
2013167466 | Nov 2013 | WO |
Entry |
---|
Silverstein et al., “The Development and Evaluation of Color Systems for Airborne Applications-Fundamental Visual, Perceptual, and Display Systems Considerations,” SAE International, Oct. 14, 1985, pp. 301-305, Paper Q No. 851774. |
“Standard Metrology for Vehicular Displays” SAE International , Jul. 2002, Revised Apr. 2007, pp. 1-27, J1757-1, Available online at www.cie.co.at. |
“Road vehicles- Ergonomic aspects of transport information and control systems- Specifications and test procedures for in-vehicle visual presentation” International Standard, Feb. 15, 2009 (second edition), pp. 1-18, ISO 15008 (Ref. No. ISO 15008:2009(E)), Switzerland. |
“Ergonomic requirements for work with visual displays based on flat-panels- Part 2: Ergonomics requirements for flat panel displays,” International Standard, Dec. 1, 2001(first edition), pp. 1-148. ISO 13406-2 (Ref. No. ISO 13406-2:2001(E)), Switzerland. |
Silverstein et al., “The Development and Evaluation of Color Systems for Airborne Applications-Fundamental Visual, Perceptual, and Display Systems Considerations,” SAE International, Oct. 14, 1985, pp. 241-365, Paper No. 851774. |
IDMS Download Page,' The Society for Information Display (SID), Mar. 31, 2015, pp. 1-3, available online at http://www.sid.org/Publications/ICDM/oldIDMSLicenseamp;Download.aspx. |
Number | Date | Country | |
---|---|---|---|
20160157324 A1 | Jun 2016 | US |