Augmented reality avionics displays, such as head-up and helmet mounted displays, require safety monitors. A horizontally or vertically flipped or frozen display image is very hazardous, especially where the image fills a substantial portion of the pilot's field-of-view. Row/column driver monitors or light emitting diode (LED)/photodiode pairs in display corners can identify such faults in liquid crystal displays but not in monolithic displays such as microLED.
For active-matrix liquid-crystal displays, row/column driver monitors ensure the appropriate data is provided to the display crystals. Liquid-crystal on silicon displays have used LED/photodiode pairs in unused portions of an oversized display. Light is reflected off the display corners which are driven black then white at a low rate. The photodiode receives light if the corner is white; if the commanded state of the corner and the photodiode signal agree, the display is considered operational. Such approaches are not operative for microLED displays due to the displays small size, high dimming range, and monolithic design.
In one aspect, embodiments of the inventive concepts disclosed herein are directed to a system and method for monitoring the status of a pixelated display. One or more pixel locations or clusters of pixels are dithered; a monitor determines if the specified pixels or clusters of pixels demonstrate dithering. Detection of the expected dithering indicates a functional display while failure to detect the dithering indicates a failed display.
In a further aspect, brightness levels are monitored to detect a failure in brightness leveling. Brightness is monitored at the same locations.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and should not restrict the scope of the claims. The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments of the inventive concepts disclosed herein and together with the general description, serve to explain the principles.
The numerous advantages of the embodiments of the inventive concepts disclosed herein may be better understood by those skilled in the art by reference to the accompanying figures in which:
Before explaining at least one embodiment of the inventive concepts disclosed herein in detail, it is to be understood that the inventive concepts are not limited in their application to the details of construction and the arrangement of the components or steps or methodologies set forth in the following description or illustrated in the drawings. In the following detailed description of embodiments of the instant inventive concepts, numerous specific details are set forth in order to provide a more thorough understanding of the inventive concepts. However, it will be apparent to one of ordinary skill in the art having the benefit of the instant disclosure that the inventive concepts disclosed herein may be practiced without these specific details. In other instances, well-known features may not be described in detail to avoid unnecessarily complicating the instant disclosure. The inventive concepts disclosed herein are capable of other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
As used herein a letter following a reference numeral is intended to reference an embodiment of the feature or element that may be similar, but not necessarily identical, to a previously described element or feature bearing the same reference numeral (e.g., 1, 1a, 1b). Such shorthand notations are used for purposes of convenience only, and should not be construed to limit the inventive concepts disclosed herein in any way unless expressly stated to the contrary.
Further, unless expressly stated to the contrary, “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by anyone of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
In addition, use of the “a” or “an” are employed to describe elements and components of embodiments of the instant inventive concepts. This is done merely for convenience and to give a general sense of the inventive concepts, and “a” and “an” are intended to include one or at least one and the singular also includes the plural unless it is obvious that it is meant otherwise.
Finally, as used herein any reference to “one embodiment,” or “some embodiments” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the inventive concepts disclosed herein. The appearances of the phrase “in some embodiments” in various places in the specification are not necessarily all referring to the same embodiment, and embodiments of the inventive concepts disclosed may include one or more of the features expressly described or inherently present herein, or any combination of sub-combination of two or more such features, along with any other features which may not necessarily be expressly described or inherently present in the instant disclosure.
Broadly, embodiments of the inventive concepts disclosed herein are directed to a system and method for monitoring the status of a pixelated display. One or more pixel locations or clusters of pixels are dithered; a monitor determines if the specified pixels or clusters of pixels demonstrate dithering. Detection of the expected dithering indicates a functional display while failure to detect the dithering indicates a failed display.
Referring to
The comparator 102 may monitor the row counter 104 for the known, predefined values in the corresponding pixel location 120, 122, 124, 126; when the value of the row counter 104 and the value from the image register 114 are determined to be equal via the comparator 102, data values are latched to one of the grayscale registers 106, 108, 110, 112. The grayscale registers 106, 108, 110, 112 are then analyzed to identify dithering between frames. If dithering is identified at the pixel locations 120, 122, 124, 126, the display 100 is known to be properly oriented and properly refreshing. If dithering is not detected at one or more of the pixel locations 120, 122, 124, 126, the display may be faulty. Faulty orientation may include the image on the display 100 being flipped either horizontally or vertically, or the image being misaligned on the display 100 (for example by shifting pixels an image register) such that the dithered pixels do not correspond to the monitored pixel locations 120, 122, 124, 126.
For example, a pixel at a pixel location 120, 122, 124, 126 is set to grayscale ‘240’. The image register 114 is configured for a grayscale value of ‘240’. The comparator 102 waits for the value of the row counter 104 to reach ‘240’. When the row counter 104 reaches ‘240,’ the comparator 102 shuts off the LED driver transistor 118, causing the ‘240’ value in the row counter 104 to latch in grayscale register 106. Prior latched values in the grayscale registers 106, 108, 110, 112 may be shifted such that a first register 106 holds the most recent latched value, a second register 108 holds the most recent prior value, etc. The process is repeated for multiple frames. Those grayscale registers 106, 108, 110, 112 may be analyzed to identify dithering grayscale values between ‘240’ and ‘241’ every other frame.
It may be appreciated that, because the system is designed to identify a vertically or horizontally flipped image, the pixel locations 120, 122, 124, 126 may be offset from each other along one or more axes such that pixel locations 120, 122, 124, 126 do not align if flipped. Alternatively, or in addition, individual pixel locations 120, 122, 124, 126 may be supplied with dithered grayscale values at different times and/or over different sets of frames. Furthermore, it may be appreciated that in some applications, images are not rendered to edge of the display 100, therefore the pixel locations 120, 122, 124, 126 may be inset from the edge of the display 100 some number of pixels to ensure the pixel locations 120, 122, 124, 126 fall within the rendered area.
In at least one embodiment, the system may also monitor display brightness. A separate pulse-width counter 128 may feed pulse-width values to a separate set of pulse-width registers 130, 132, 134, 136. Unexpected brightness changes as represented by pulse-width may be identified via analysis of the pulse-width registers 130, 132, 134, 136. Alternatively, or in addition, a ratio of grayscale values to pulse-width values may be analyzed for unexpected changes between frames; for example, a ratio of grayscale values in a first grayscale register 106 to pulse-width values in a first pulse-width register 130 is compared to a ratio of grayscale values in a second grayscale register 108 to pulse-width values in a second pulse-width register 132. In at least one embodiment, the pulse-width counter 128 may be driven via a clock frequency rather than a row count.
In at least one embodiment, the pixel locations 120, 122, 124, 126 may each correspond to a set of sub-pixels that operate in concert to form a single image pixel. The processes described herein may be applied to image pixels or individual sub-pixels within the pixel locations 120, 122, 124, 126.
Referring to
The display system receives 202, 204 grayscale values and pulse-width values corresponding to pixels in the image stream. While a system of LED drive transistors applies the grayscale and pulse-width values to pixels in the display, a row counter monitors 206 the row of pixels currently being driven and records grayscale values and/or pulse-width values corresponding to the pixels in the specific locations in registers. A monitoring processor/controller identifies 208 values in the one or more registers corresponding to the specific locations and analyzes 210 the identified values between frames via measured pixel on-time and/or current monitoring.
In at least one embodiment, when the LED in a pixel is enabled, the row counter increments. Once the row counter is equal to the value in a grayscale register, the LED in the pixel is disabled and the row counter value is latched into a grayscale monitor register. In at least one embodiment, the monitoring processor/controller may also increment a pulse-width counter and latch the pulse-width value to a corresponding monitor register. In at least one embodiment, four frames worth of the grayscale and pulse-width values are retained, offering four frames of history for each monitored pixel. Grayscale and pulse-width registered values allow for brightness of the pixel to be inferred and for the pixel grayscale to be monitored by the processor/controller. Either or both of these registered values may be used to verify whether the specific pixels are appropriately dithering up and down in grayscale or luminance.
When the display system is operating properly, the analysis 210 indicates grayscale manipulation at the specific locations, such as dithering between frames. When the display system is suffering an orientation fault (shifted pixels, vertical or horizontal flipping, etc.) or when the display system is frozen, the grayscale manipulation will not be identified.
In at least one embodiment, when a fault is detected, a fault message may be sent to an avionics system. Alternatively, or in addition, when a fault is detected the display may be deactivated or deemphasized (such as by reducing brightness) to prevent the faulted display from distracting the pilot.
In at least one embodiment, the monitoring processor/controller may analyze 212 pulse-width values or a ratio of grayscale values to pulse-width values over time at the specific locations. Unexpected changes to the pulse-width values or the ratio between frames may indicate a brightness fault in the display system.
Embodiments of the present disclosure facilitate microLED technology for avionics displays by offering a critical safety monitor.
It is believed that the inventive concepts disclosed herein and many of their attendant advantages will be understood by the foregoing description of embodiments of the inventive concepts disclosed, and it will be apparent that various changes may be made in the form, construction, and arrangement of the components thereof without departing from the broad scope of the inventive concepts disclosed herein or without sacrificing all of their material advantages; and individual features from various embodiments may be combined to arrive at other embodiments. The form herein before described being merely an explanatory embodiment thereof, it is the intention of the following claims to encompass and include such changes. Furthermore, any of the features disclosed in relation to any of the individual embodiments may be incorporated into any other embodiment.
The present application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional App. No. 63/026,579 (filed May 18, 2020), which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
63026579 | May 2020 | US |