Patent Application
20080218501
The present invention relates to the field of electronic display devices. More particularly, the present invention relates to a system and method for making adjustments to compensate for environmental changes when engaging in image display activities.
Electronic systems and circuits have made a significant contribution towards the advancement of modern society and are utilized in a number of applications to achieve advantageous results. Numerous electronic technologies such as digital computers, calculators, audio devices, video equipment, and telephone systems have facilitated increased productivity and reduced costs in analyzing and communicating data in most areas of business, science, education and entertainment. Frequently, these electronic technologies are utilized to convey information. Displaying information in a visual presentation is usually a convenient and effective method of conveying the information. However, poor image quality and a number of interfering environmental conditions can adversely effect or impede information presentation and user comprehension.
Typically, the primary function of a display screen is to provide a clear and readily viewable presentation to a user. However, there are numerous environmental conditions that can have a significant impact on the perceptibility of the presentation. One of the most important factors affecting a users ability to easily perceive the shapes or images of a presentation is appropriate illumination of the display screen. For example, ambient light can often have significant impacts on the clarity of a display screen presentation.
The amount of ambient light that illuminates a display can determine the perceptibility of an image presented on a display. Ambient light is often insufficient to provide adequate illumination of a display screen, for example at night or in dark locations. Relative changes in the ambient lighting conditions can also impact ability to perceive a display image. For example, changing ambient lighting conditions associated with lights being turned on, off or dimmed often impact a users view. Changes in lighting provided by natural sources can also have detrimental affects such as changes in sun light when the sun rises to an apex and then sets, window shades are opened or closed or a cloud passes by temporarily reducing the sun light. The change in ambient illumination can be the result of the display orientation changing with respect to the source of the ambient light. Traditional displays do not typically take such real time ambient light changes into consideration when displaying an image.
Some conventional displays attempt to statically address reduced ambient lighting conditions. Traditional attempts at providing adequate illumination usually include self contained lighting provisions (e.g., a back-light) that provide a constant light level during device operation. Conventional display systems typically focus on achieving a predetermined particular illumination without regard for environmental conditions. For example, a back-light system is set to provide a particular output of illumination regardless of whether the ambient lighting is sufficiently bright or not. However, back-light systems often consume a relatively large portion of the power consumed by a system.
As the components required to build display devices have reduced in size, new categories of mobile devices have emerged. Even though some of these devices are very small, they typically provide diverse functionality and their capabilities are constantly increasing. Numerous hand held devices (e.g., cellular phones, lap top and palm top computer systems, etc.) are becoming more prolific and are utilized by a widespread section of society. Display capabilities of handheld devices are becoming increasingly meaningful and due to the relatively small size of the display in a handheld device it is important for the presentation to be clear and well illuminated. Typically, the mobility and compactness of the devices typically limits the power supply and it is important to effectively utilize the resulting limited light emissions.
The illumination uniformity of an image display also often has a significant impact on the perceptibility of a presentation. Ambient lighting conditions can alter the perceived uniformity of a display. For example, a shadow may be cast on a portion of a display causing that portion of the display to appear darker relative to other portions. Traditional computer display illumination techniques often provide back-lighting from a single source spread across the display without concern for environmental conditions. While the backlight illumination may get distributed evenly throughout a display, some areas of a display screen often appear significantly lighter or darker than other areas due to environmental conditions that impact one portion of the screen differently than another.
The present invention is a dynamic and adaptive system and method that provide illumination adjustments to an image display presentation corresponding to ambient lighting conditions around the display. By adjusting the presentation (e.g., adjusting back-lighting and/or pixel data) the present invention provides an improved image quality as the ambient lighting conditions change (e.g., moving the device) and also facilitates power conservation (e.g., by reducing back-lighting when not required). The improved image quality facilitates a users ability to easily perceive the shapes or images of a presentation. In one embodiment the present invention includes a feedback “mechanism” that directs automatic adjustments to an image presentation based upon changes in the ambient light. The adjustments can be made to the back-lighting and/or the pixel data. In one exemplary implementation, a vertex map or alternatively a brightness map is overlaid on the display image to compensate for changes in ambient light conditions.
The invention is applicable to a variety of display or presentation devices. It is also readily adaptable for utilization with an assortment of sensors capable of monitoring the ambient light environment of the display device (e.g., a digital camera). The ambient lighting can also be monitored from a variety of orientations. The sensor can be directed away from the display (e.g., towards the user) or the sensor can be directed towards the display (e.g., from an angle comparable to the users view). In one exemplary implementation, a graphics control system utilizes real time ambient light sampling input to calibrate the image presentation automatically. Ambient light measurements can be averaged over a period of time and/or space. For example, ambient light can be sampled or measured at a predetermined rate (e.g., 30, 60, etc. frames a second) and/or from a variety of multi spot locations. In one embodiment, adjustments in illumination are made based upon an average of those measurements or readings. The present invention is able to calibrate the adjustments to make a rapid yet smooth transition in the presentation.
The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. The drawings referred to in this specification should be understood as not being drawn to scale except if specifically noted.
Reference will now be made in detail to the preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. While the invention will be described in conjunction with the preferred embodiments, it will be understood that they are not intended to limit the invention to these embodiments. On the contrary, the invention is intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope of the invention as defined by the appended claims. Furthermore, in the following detailed description of the present invention, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be obvious to one ordinarily skilled in the art that the present invention may be practiced without these specific details. In other instances, well known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the current invention.
Some portions of the detailed descriptions which follow are presented in terms of procedures, logic blocks, processing, and other symbolic representations of operations on data bits within a computer memory. These descriptions and representations are the means generally used by those skilled in data processing arts to effectively convey the substance of their work to others skilled in the art. A procedure, logic block, process, etc., is here, and generally, conceived to be a self-consistent sequence of steps or instructions leading to a desired result. The steps include physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical, magnetic, optical, or quantum signals capable of being stored, transferred, combined, compared, and otherwise manipulated in a computer system. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
It should be borne in mind, however, that all of these and similar terms are associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussions, it is appreciated that throughout the present application, discussions utilizing terms such as “processing”, “computing”, “calculating”, “determining”, “displaying” or the like, refer to the action and processes of a computer system, or similar processing device (e.g., an electrical, optical, or quantum, computing device), that manipulates and transforms data represented as physical (e.g., electronic) quantities. The terms refer to actions and processes of the processing devices that manipulate or transform physical quantities within a computer system's component (e.g., registers, memories, other such information storage, transmission or display devices, etc.) into other data similarly represented as physical quantities within other components.
The present invention is directed towards adjusting illumination of a display image in response to varying ambient environmental lighting conditions. In one embodiment, a digital camera senses the ambient light around a display screen and a control component adjusts the display illumination. For example, a digital camera and/or multiple digital cameras can sense the ambient light in multiple regions of space (e.g., around a display screen) and an illumination adjustment can be made to correspond to a measurement from each individual region of space or an average of the measurements from the different regions. In one exemplary implementation, illumination from a back-light is adjusted and in an alternate implementation the illumination characteristics of a pixel are adjusted. The illumination is increased for relatively dark ambient lighting conditions and reduced for relatively light ambient lighting conditions. Thus, appropriate illumination for viewing the image is provided in a manner that facilitates increased user perceptibility of a presentation during changing ambient light conditions. The present invention also facilitates increased power conservation when ambient light conditions permit (e.g., are bright enough to view a screen with reduced assistance from back lighting).
Ambient light sensing component 110 can have a variety of implementations. In one embodiment, ambient light sensing component 110 is a digital camera sensing component. For example, a digital camera sensing component can include a filter (e.g., an intelligent filter) that monitors the ambient light quality the cameras senses. In one exemplary implementation, a digital camera sensing component measures ambient light illumination of the image provided from a source other than the presentation system. The illumination is the result of photons from the other source striking or hitting the presentation (e.g., the surface an image is presented on) and the ambient light sensing component can sense the changes in the photons. For example, the ambient light sensor can sense changes in ambient illumination caused by a variety of conditions including the amount and/or the actual direction of the ambient light photons that affect the environmental illumination of the presentation.
In one embodiment, an ambient light sensing component can sense the photogenic levels in multiple regions of space (e.g., around a display screen). For example, ambient light sensing component 110 can include multiple “spot” sensors (e.g., one in each of the four corners of a display) that sense different areas around a display (e.g., that correspond to different portions or sub-regions of the display).
It is appreciated that the present invention is readily adaptable for varying orientations of ambient light sensing component 110. In one embodiment of the present invention, ambient light sensing component 110 can face out into the environment away form the display. For example, towards an anticipated user's viewing angle or vantage point with respect to the display. In another embodiment, ambient light sensing component 110 is directed towards the display. For example, a digital camera sensing component can face the display from a user's vantage point or from the orientation of another component associated with the display. In one exemplary implementation, an ambient light sensing component 110 is mounted in the keyboard of a lap top computer and oriented to face the screen. An ambient light sensing component can be configured to capture ambient light illumination measurements from the display face.
In one embodiment of the present invention, control component 120 adjusts the illumination of the image in response to changing lighting conditions. Control component 120 increases the display illumination for relatively dark ambient lighting conditions (e.g., increases the intensity of the back-light). Control component 120 decreases the display illumination for relatively light ambient lighting conditions (e.g. decreases the intensity of the back-light). The adjustment of the illumination can be based upon an average of ambient light measurements over different spatial regions and/or over a period of time. In an alternate embodiment, adjustments in the illumination of different portions of a display (e.g., sub-areas of the display) can be made to correspond with corresponding spatial region ambient light measurements. In one exemplary implementation, control component 120 provides illumination adjustment instructions to a back-light component 135. In an alternate implementation, control component 120 provides illumination adjustment instructions to a pixel generation component (not shown) and the illumination characteristics or values of the pixels are altered. In one embodiment of the present invention, control component 120 provides a feedback type adjustment of the display illumination.
In one embodiment, the present invention is incorporated in a computer system.
The components of computer system 200 cooperatively operate to provide a variety of functions, including processing of graphics information associated with an image and control of display illumination in response to changing ambient light conditions. Communications bus 290 communicates information, central processor 201 processes information and engages in display illumination control operations, main memory 202 stores information and instructions for the central processor 201. Removable data storage device 204 also stores information and instructions (e.g., functioning as a large information reservoir). For example, memories 202 and 204 store information that correlates image presentation adjustments to ambient light conditions, and processor 201 processes the information (e.g., compares information from the memories to input from digital camera 225) and issues instructions defining illumination adjustments. Digital camera 225 senses the ambient light conditions (e.g., around display device 209) and provides ambient light information to the system. Input device 206 provides a mechanism for inputting information and/or for pointing to or highlighting information on display 220. Signal communication port 208 provides a communication interface to exterior devices (e.g., an interface with a network). Display device 209 displays information in accordance with data stored in graphics buffers 215 and 217. Graphics processor 211 processes graphics commands from central processor 201 and provides the resulting data to graphics buffers 215 and 217 for storage and retrieval by display monitor 220.
Computer system 200 implements environmental responsive illumination adjustment measures during graphics operations. Central processor 201 receives input from digital camera 225 on the ambient illumination levels around display 220. In one embodiment, the memories of computer system 200 include graphics software control instructions that utilize real time ambient light measurements (e.g., provided by real time sampling techniques) and graphics software control instructions that direct corresponding image illumination optimization in real time. Central processor 201 utilizes the instructions from the memories and the input from digital camera 225 to develop and issue commands directed towards increasing or decreasing the illumination generated by a back-light in display 220 based upon the relative ambient light illumination measurements. In an alternate embodiment central processor 201 issues instructions to graphics subsystem 210 to increase or decrease the intensity of pixels in accordance with changing ambient light conditions. In yet another embodiment, graphics subsystem 210 (e.g., graphics processor 211) receives input from digital camera 225 and directs illumination adjustments.
The components of display presentation adjustment system 300 cooperatively operate to provide image presentations that adjust to compensate for changes in ambient lighting conditions. In one exemplary implementation, an image presentation is generated by impinging high-energy electrons on a picture element or “pixel” (e.g., pixels 371 through 394) of a phosphor screen and the phosphor converts the electron energy into visible light utilized to convey images to observers. Ambient light sensing components 311 through 334 sense ambient light that penetrates through the face of display array 310. The light sensing components convey information about the ambient light to control component 120. Control component 120 then directs adjustments to the pixel intensity of pixels 371 through 394 based upon the measured ambient light. In one embodiment, control component 120 directs a pixel intensity value generator (e.g., a graphics processor 211) to increase or decrease the pixel intensity values to compensate for ambient light measurements of relative darkness or lightness. Display device 300 can provide significant granularity in illumination adjustment. In one exemplary implementation, each pixel “above” (e.g., pixel 322) a light sensing component (e.g., ambient light sensing component 372) is adjusted based upon the input from that particular ambient light sensing component. In an alternate embodiment, several pixels are adjusted based upon input from a particular ambient light sensing component.
It is appreciated that the present invention is readily adaptable for use with a variety of display devices, including a cathode ray tube (CRT) display, a field emission display (FED), a vacuum fluorescent display (VFD), a plasma display panel (PDP), and/or an organic luminescent display (OEPLD). The image information is presented on the display screen in accordance with a fundamental “raster” display process or “pattern” that usually starts at the top of the display and goes across the display from left to right on each row and then drops to the row below until it reaches the bottom. Information on the brightness level for each primary color (e.g., red, blue and green) in a pixel is provided for each pixel included in the display. Pixels are arranged in a matrix of rows and columns in which each pixel has a unique identifier (e.g., row and column indicator). The display “illuminates” each pixel in accordance with illumination data assigned to a corresponding pixel identifier. The illumination data is adjusted to compensate for changes in ambient illumination.
The speed at which changes in ambient lighting occur impact the speed at which the compensating adjustments are made. For example, image presentation system 100, presentation adjustment system 300 or display presentation method 400 can be included in a portable device moving in a vehicle (e.g., a laptop computer, a heads-up display, etc.) and a shadow can be cast by something outside the vehicle (e.g., a building, a tree, another vehicle, etc.). The present invention facilitates adjustments in the presentation illumination to compensate for changes in ambient light conditions or shadow regions associated with respective positions changes of the vehicle and the other object (e.g., a building).
In step 410, an ambient light condition is measured (e.g., utilizing a digital camera). Ambient light measurements can be averaged over a period of time and/or from multiple measurement spots. For example, ambient light can be sampled or measured at a predetermined rate (e.g., 30, 60, etc. frames a second) or from different locations (e.g., four corners of a display). The measurements can be taken from a variety of orientations. The digital camera can be directed away from the display (e.g., towards the user) or the sensor can be directed towards the display (e.g., from an angle comparable to the users view).
In step 420, the ambient light condition is analyzed. In one embodiment of the present invention, the ambient light measurements are compared to a predetermined value (e.g., an optimal viewing illumination). If the measurements are lower than the predetermined value the analysis provides an indication to increase illumination intensity and if the measurements are higher than the predetermined value the analysis provides an indication to decrease the illumination. In one exemplary implementation, the ambient light condition is analyzed over a period of time and an average value is derived.
In step 430, an adjustment is made to a presentation based upon the analysis of the ambient light condition. For example, the illumination provided by a back-light is increased if the ambient light analysis indicates there is insufficient ambient light for optimal viewing. The adjustment can be made based upon an average of those readings (e.g., an average of ambient light measurements over time and/or space). In one exemplary implementation, the adjustment is made to pixel data and/or back-lighting of a display device. In one exemplary implementation, control directions are issued to a pixel intensity value generator (e.g., graphics processor 211) to increase or decrease the pixel intensity values (e.g., stored in a graphics buffer) to compensate for ambient light measurements of relative darkness or lightness. For example, essentially overlaying an intensity adjusting vertex map on the display image.
It is appreciated that a sensor for obtaining ambient lighting measurements for utilization by the present invention can have a variety of different configurations.
It is appreciated that the present invention systems and methods can be implemented in a variety of devices. For example the present invention systems and methods can be implemented in computer systems, game consoles, graphics systems, laptops, televisions (TVs), personal digital assistants (PDAs), projectors, cell phones, digital video cameras, personal video players, arcade systems, display or presentation devices in a vehicle (e.g., a car, plane, etc.), and headsup display devices.
Thus, the present invention provides a flexible and efficient system and method for adjusting the illumination of an image display with compensation for ambient lighting conditions. By adjusting the presentation (e.g., adjusting back-lighting and/or pixel data), the present invention provides an improved image quality as the ambient lighting conditions change and also facilitates power conservation (e.g., by reducing back-lighting when not required). The present invention facilitates a higher quality visual experience in which a user more readily see an image in an environment with changing ambient lighting conditions.
The foregoing descriptions of specific embodiments of the present invention have been presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed, and obviously many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the Claims appended hereto and their equivalents.
This Application claims the benefit and priority of and is a Divisional of U.S. patent application Ser. No. 10/448,823, entitled “A Display Illumination System and Method” (Attorney Docket No. NVID-P000633), filed on May 30, 2003, which is incorporated herein by this reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10448823 | May 2003 | US |
| Child | 12005960 | US |
