Patent Application
20110267365
The present disclosure relates generally to methods and systems for displaying images on electronic visual displays, and more particularly, to processing or correcting images to be displayed on such displays.
Signs are frequently used for displaying information to viewers. Such signs include, for example, billboards or other types of large outdoor displays, including electronic visual displays. Electronic visual displays or signs are typically very large, often measuring several hundred square feet in size. Electronic signs or displays have become a common form of advertising. For example, such displays are frequently found in sports stadiums, arenas, public forums, and/or other public venues for advertising diverse types of information. These displays are often designed to catch a viewer's attention and create a memorable impression very quickly.
The following disclosure describes image processing systems and associated methods for processing images to be shown on visual display signs, such as large electronic visual displays. As described in greater detail below, an image processing method and/or system configured in accordance with one aspect of the disclosure is configured to process or modify an image to account for variations in an electronic display sign. The processed image, rather than the electronic sign, contains any correction or calibration information necessary to display the image on the electronic sign according to a desired or target appearance. Since the image itself contains any correction or calibration information, there is no need to calibrate or otherwise adjust the sign. There is also no need for the sign to have built-in correction capability or to use specialized video processing equipment to perform the correction.
For example, a method in accordance with one embodiment of the disclosure for processing an image to be shown on a sign includes determining an actual display value for one or more portions of the sign. In certain embodiments the image can be a static image. In other embodiments, however, the image can be a video stream comprised of a series of images. In certain embodiments, the actual display value can be a measured color value or luminance value of the one or more portions of the display. The method further includes comparing the actual display value with a desired display value for the one or more portions of the sign, and determining a correction factor for the one or more portions of the sign. The correction factor can be based at least in part on the comparison between the actual display values and the desired display values. The method further includes processing or adjusting the image with the correction factors for the corresponding portions of the sign. After processing the image to account for variations in the sign, the method can further include transmitting the image to the sign and showing the image on the sign. Accordingly, and as described in detail below, the image can be shown on the sign according to the desired display values without modifying or calibrating the actual display values of the corresponding portions of the sign, even though the sign is not performing any image correction.
Certain details are set forth in the following description and in
Many of the details, dimensions, angles, and other features shown in the Figures are merely illustrative of particular embodiments of the disclosure. Accordingly, other embodiments can have other details, dimensions, angles, and features without departing from the spirit or scope of the present disclosure. In addition, those of ordinary skill in the art will appreciate that further embodiments of the disclosure can be practiced without several of the details described below.
In the embodiment illustrated in
One of ordinary skill in the art will understand that although the system 100 illustrated in
According to another aspect of the illustrated embodiment, the imaging device 106 can also include a lens 210. In one embodiment, for example, the lens 210 can be a reflecting telescope that is operably coupled to the camera 208 to provide sufficiently high resolution for long distance imaging of the sign 102. In other embodiments, however, the lens 210 can include other suitable configurations for viewing and/or capturing display information from the sign 102. A suitable imaging device 208 and lens 210 are disclosed in U.S. patent application Ser. No. 10/455,146, entitled “Method and Apparatus for On-Site Calibration of Visual Displays,” filed Jun. 4, 2003, and U.S. patent application Ser. No. 10/653,559, entitled “Method and Apparatus for On-Site Calibration of Visual Displays,” filed Sep. 2, 2003, each of which is incorporated herein by reference in its entirety.
The imaging device 106 can accordingly be positioned at a distance L from the sign 102. The distance L can vary depending on the size of the sign 102, and can include relatively large distances. In one embodiment, for example, the imaging device 106 can be positioned at a distance L that is generally similar to a typical viewing distance of the sign 102. In a sports stadium, for example, the imaging device 106 can be positioned in a seating area facing toward the sign 102. In other embodiments, however, the distance L can be less that a typical viewing distance and direction, and the imaging system 106 can be configured to account for any viewing distance and/or direction differences. Moreover, in other embodiments, the distance L can be between approximately 100 and 300 meters. In still further embodiments, the distance L can be approximately 200 meters. In yet other embodiments, the distance L can have other values.
The computing device 104 is configured to receive, manage, store, and/or process the display data collected by the imaging device 106 for the purpose of adjusting the appearance of images that will be displayed on the sign 102. In other embodiments, however, display data associated with the sign 102, including correction factors and related data, can be processed by a computer that is separate form the imaging device 106. A typical sign 102, such as an XGA-resolution visual display for example, can have over two million subpixels that provide display data for the computing device 104 to manage and process. As such, the computing device 104 includes the necessary hardware and corresponding software components for managing and processing the display data. More specifically, the computing device 104 configured in accordance with an embodiment of the disclosure can include a processor 220, a memory 222, input/output devices 224, one or more sensors 226 in addition to sensors of the imaging device 106, and/or any other suitable subsystems and/or components 228 (displays, speakers, communication modules, etc.). The memory 222 can be configured to store the display data from the sign 102. Moreover, the memory 222 can also be configured to include computer readable media including instructions or software stored thereon that, when executed by the processor 220 or computing device 104, cause the processor 220 or computing device 104 to process an image as described herein. Moreover, the processor 220 can be configured for performing or otherwise controlling calculations, analysis, and any other functions associated with the methods described herein.
In certain embodiments, the memory 222 can include software to control the imaging device 106 as well as measurement software to find portions of the sign 102 (e.g., subpixels of the sign 102) and image or otherwise extract the display data (e.g., brightness data, color data, etc.). One example of suitable software for controlling the imaging device 106 and/or acquiring the display data is the VisionCAL software, which is commercially available from the assignee of the present disclosure, Radiant Imaging, of Redmond, Wash. In other embodiments, other suitable software can be implemented with the system 100. Moreover, the memory 222 can also store one or more databases used to store the display data from the sign 102, as well as calculated correction factors for the display data. In one embodiment, for example, the database can be a Microsoft Access® database designed by the assignee of the present disclosure. In other embodiments, the display data can be stored in other types of databases or data files.
In addition to color and/or luminance, the subpixels 332 may have other visual properties that can be measured and analyzed in accordance with embodiments of the present disclosure. Moreover, although the imaging area 103 is described above with reference to pixels 330 and subpixels 332, other embodiments of the disclosure can be used with signs having different types of light emitting elements or components.
The method 450 includes determining an actual display value corresponding to one or more portions of the sign (block 452). The determination of these actual display values are intended to refer to measurements or acquisitions of the actual display properties or characteristics of imaging areas of the sign. Referring to
The actual display values may differ from desired or target display values of the sign. For example, there is typically significant variation in color or luminance of each sub-pixel of the display, especially if the sub-pixels are light emitting diodes (LEDs). Moreover, over time the visual properties of the sign 102 may degrade or otherwise vary from a desired or target display value. Accordingly, the method 450 illustrated in
The determination of the correction values is based, at least in part, on the comparison between the actual display values and the target display values. More specifically, each correction factor can compensate for the difference between the actual display values and the corresponding target display value. For example, if the actual display value is less bright than the corresponding target display value, the correction factor can include the amount of brightness that would be required for the actual display value of the sign to be generally equal to the target display value. Moreover, the correction factor can correlate to the corresponding type of display value. For example, the correction value can be expressed in terms of color or brightness correction values, or in terms of other visual display property correction values. Suitable methods and systems for determining correction values or correction factors are disclosed in U.S. patent application Ser. Nos. 10/455,146 and 10/653,559 referenced above.
The method 450 further includes processing an image to be shown on the sign according to the correction factor for each corresponding actual display value (block 458). The image processing can be conducted independently from the calculation of the correction values (e.g., with a separate computer). Images processed according to the embodiments of the present disclosure can be in any type of file format including, for example, JPEG, TIFF, etc. Processing the image can include applying the data set of correction factors to the image so that the image will be shown on the display according to the target display values (e.g., color, luminance, etc.) without modifying or otherwise calibrating the corresponding actual display values of the subpixels, and/or without the sign itself applying any correction to the image to display the image according to the target values. More specifically, processing the image with the one or more correction factors can include applying the correction factor to one or more pixels of the image that will be displayed by the corresponding light emitting elements of the display. Processing the image in this manner can include applying the correction map to the image such that the appearance of the image will be displayed on the sign according to the target display values. As such, the image itself, rather than the sign, can contain the correction factor for each corresponding light emitting element of the sign (e.g., each subpixel of the sign) to account for the variation of actual display properties of the sign.
After processing the image, the method 450 can further include sending the image to the sign. The sign can therefore display the processed image according to desired or target display properties without calibrating or adjusting the display sign itself. In other embodiments, however, the correction factors or correction factor data set or map can be stored for processing different images to be shown on the sign. Moreover, the correction factor data set or map can be sent to a third party, such as the display owner, to enable the third party to process and display more than one image.
One advantage of the image processing system and associated methods described herein is that processing images in accordance with the present disclosure eliminates the need to calibrate or otherwise modify a display to achieve desired display properties. Many existing displays or signs do not have any built-in calibration equipment or hardware. Calibrating or otherwise adjusting the display properties of such signs typically requires additional hardware and/or replacement of some or all of the sign itself. In contrast, embodiments of the present disclosure alter the image sent to the sign rather than modifying the sign itself, and thereby eliminate the need to add calibration hardware to existing signs. In addition, embodiments of the present disclosure are also expected to be reliable and robust since these embodiments do not require the separate calibration hardware associated with the display sign. Furthermore, once a user obtains the correction factors for a particular display sign, the user can process an unlimited number of images or a video stream to be shown on the sign without requiring further calibration.
From the foregoing, it will be appreciated that specific embodiments of the disclosure have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the various embodiments of the disclosure. Further, while various advantages associated with certain embodiments of the disclosure have been described above in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the disclosure. Accordingly, the disclosure is not limited, except as by the appended claims.
