SIGNAL GENERATION APPARATUS, SIGNAL GENERATION PROGRAM, SIGNAL GENERATION METHOD, AND IMAGE DISPLAY APPARATUS

Abstract

[Object]

Description

TECHNICAL FIELD

The present disclosure relates to a signal generation apparatus, a signal generation program, a signal generation method, and an image display apparatus.

BACKGROUND ART

In recent years, for acquiring high luminance in color image display apparatuses, white sub-pixels for displaying a white color, for example, are added in addition to three types of sub-pixels, that is, red sub-pixels for displaying a red color, green sub-pixels for displaying a green color, and blue sub-pixels for displaying a blue color.

In the color image display apparatus including white sub-pixels, while bright display is possible in the case of an achromatic color or colors in the vicinity thereof, display becomes relatively dark in the case of displaying colors of high chroma. In other words, a displayable color range becomes narrower as brightness increases.

In contrast, for video signals acquired by a camera or the like, a maximum value is normally set irrespective of the chroma. Therefore, when an image is to be displayed on the color image display apparatus including white sub-pixels based on such video signals, the part that should be displayed brightly with high chroma is displayed with chroma and brightness that are relatively lowered.

For improving such a display state, for example, Japanese Patent Application Laid-open No. 2009-520241 (Patent Document 1) discloses a technique of uniformly decreasing chroma of video signals to compensate for lowering of brightness.

Patent Document 1: Japanese Patent Application Laid-open No. 2009-520241

SUMMARY OF INVENTION

Problem to be Solved by the Invention

In the technique disclosed in Patent Document 1, since chroma of an image is lowered also when an image having low brightness is displayed, the color range of an image to be displayed is narrowed. Moreover, a phenomenon that the compensation for the lowering of brightness is insufficient when displaying an image of high brightness occurs.

Therefore, the present disclosure aims at providing a signal generation apparatus, a signal generation program, a signal generation method, and an image display apparatus that are capable of displaying a high-chroma image when displaying a low-brightness image and sufficiently compensating for lowering of brightness when displaying a high-brightness image.

Means for Solving the Problem

To attain the object described above, according to the present disclosure, there is provided a signal generation apparatus that generates, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix,

the signal generation apparatus carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

Further, to attain the object described above, according to the present disclosure, there is provided a signal generation program that is executed in a signal generation apparatus that generates, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix,

the signal generation program causing the signal generation apparatus to execute the step of

carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

Further, to attain the object described above, according to the present disclosure, there is provided a signal generation method for generating, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix,

the signal generation method including

carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

Further, to attain the object described above, according to the present disclosure, there is provided an image display apparatus, including:

an image display section in which a first sub-pixel for displaying a first primary color, a second sub-pixel for displaying a second primary color, a third sub-pixel for displaying a third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix; and

a signal generation section configured to generate a signal for driving the image display section based on a first input image signal for displaying the first primary color, a second input image signal for displaying the second primary color, and a third input image signal for displaying the third primary color, that are supplied in correspondence with pixels of an image to be displayed,

in which the signal generation section carries out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generates signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

Effect of the Invention

According to the image display apparatus, the image display apparatus drive method, the signal generation apparatus, the signal generation program, and the signal generation method according to the present disclosure, an image is displayed while white sub-pixels are used effectively. As a result, a high-chroma image can be displayed when displaying a low-brightness image, and the lowering of brightness can sufficiently be compensated for when displaying a high-brightness image.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a schematic diagram of an image display apparatus according to a first embodiment.

FIG. 2 is a schematic block diagram for describing a structure of a color space conversion section.

FIG. 3A is a schematic diagram for describing an HSV color space of an input video signal. FIG. 3B is a schematic diagram for describing an HSV color space displayable by an image display section.

FIG. 4 is a schematic diagram for describing that brightness is raised by decreasing chroma.

FIG. 5 is a schematic diagram for describing an operation of a LUT included in a chroma decrease amount calculation section.

FIG. 6 is a schematic diagram for describing a difference between a case where a chroma decrease is performed fixedly and a case where the chroma decrease is performed dynamically.

FIG. 7 is a schematic diagram for describing operations at a time of generating signals for driving a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel in a case where a first input image signal, a second input image signal, and a third input image signal corresponding to pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section and a case where the signals are signals for performing display not exceeding the reproduction range.

FIG. 8 is a schematic block diagram for describing another structural example of the color space conversion section.

MODES FOR CARRYING OUT THE INVENTION

Hereinafter, the present disclosure will be described based on an embodiment while referring to the drawings. The present disclosure is not limited to the embodiment, and various numerical values and materials of the embodiment are mere examples. In the following descriptions, the same elements or elements having the same function are denoted by the same symbols, and overlapping descriptions will be omitted. It should be noted that the descriptions will be given in the following order.

1. Overall descriptions on signal generation apparatus, signal generation program, signal generation method, and image display apparatus according to present disclosure

2. First embodiment, others

(Overall Descriptions on Signal Generation Apparatus, Signal Generation Program, Signal Generation Method, and Image Display Apparatus According to Present Disclosure)

A signal generation apparatus according to the present disclosure, a signal generation apparatus in which a signal generation program according to the present disclosure is executed, and a signal generation apparatus used in an image display apparatus according to the present disclosure (hereinafter, may simply be referred to as signal generation apparatus of present disclosure) may include:

a color space conversion section configured to calculate a position in a color space based on values of the first input image signal, the second input image signal, and the third input image signal;

a chroma decrease amount calculation section configured to calculate a chroma decrease amount based on the calculated position in the color space;

a chroma control section configured to output the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed based on the calculated chroma decrease amount; and

a multi-primary color signal generation section configured to generate the signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed.

The system of the image display section used in the present disclosure (hereinafter, may simply be referred to as image display section of present disclosure) is not particularly limited. For example, the image display section may be suited for display of moving images or suited for display of still images. The image display section may adopt a self-luminous system like an electroluminescence display apparatus or a transmission-type system or a reflection-type system like a liquid crystal display apparatus, for example.

As values of pixels of the image display section, several values expressing image display resolutions can be exemplified in addition to VGA (640, 480), S-VGA (800, 600), XGA (1024, 768), APRC (1152, 900), S-XGA (1280, 1024), U-XGA (1600, 1200), HD-TV (1920, 1080), and Q-XGA (2048, 1536), the examples including (1920, 1035), (720, 480), and (1280, 960). However, the resolutions are not limited to those values.

In the signal generation apparatus according to the present disclosure that has the favorable structure described above,

the first primary color, the second primary color, and the third primary color may be red, green, and blue, respectively, and

the color space conversion section may calculate the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSV color signals. In this case, the chroma decrease amount calculation section may calculate the chroma decrease amount based on a V value and an S value in the HSV color signals of the color space conversion section.

Alternatively, in the signal generation apparatus according to the present disclosure that has the favorable structure described above,

the first primary color, the second primary color, and the third primary color may be red, green, and blue, respectively, and

the color space conversion section may calculate the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSL color signals. In this case, the chroma decrease amount calculation section may calculate the chroma decrease amount based on an L value and an S value in the HSL color signals of the color space conversion section.

In the signal generation apparatus according to the present disclosure that has the various favorable structures described above, the chroma control section may output the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed by performing predetermined arithmetic operation processing on the values of the first input image signal, the second input image signal, and the third input image signal based on the calculated chroma decrease amount.

In the image display section according to the present disclosure, the fourth color may be white. It should be noted that the fourth color is not limited thereto and may be, for example, yellow, cyan, or magenta.

The signal generation section and signal generation apparatus used in the present disclosure may be constituted of, for example, an arithmetic operation circuit and a storage apparatus that can be structured using well-known circuit elements and the like. The signal generation section and the signal generation apparatus may be operated based on physical wire connections of hardware or may be operated based on programs.

The signal generation processing may involve processing input video signals in real time. It should be noted that according to circumstances, the signal generation processing may involve non-real-time processing. For example, it is also possible to successively process data of input video signals stored in storage means, store processed signal data in the storage means, and read out the processed signal data based on a user request.

For example, the chroma decrease amount calculation section may reference a lookup table (LUT) based on the L and S values in the HSL signals of the color space conversion section, or carry out arithmetic operation processing using a function that uses the L and S values as arguments.

Various conditions indicated in the specification are satisfied when the conditions are practically established, in addition to the case where the conditions are strictly established. For example, “red” only needs to be recognized as substantially red, and “green” only needs to be recognized as substantially green. The same holds true for “blue” and “white”. Various variances caused during design and manufacturing are allowable.

First Embodiment

A first embodiment relates to the signal generation apparatus, the signal generation program, the signal generation method, and the image display apparatus according to the present disclosure.

FIG. 1 is a schematic diagram of the image display apparatus according to the first embodiment.

The image display apparatus 1 of the first embodiment includes an image display section 20 in which a first sub-pixel for displaying a first primary color, a second sub-pixel for displaying a second primary color, a third sub-pixel for displaying a third primary color, and a fourth sub-pixel 22 for displaying a fourth color are arranged in a 2D matrix, and a signal generation section (signal generation apparatus) 10 that generates a signal for driving the image display section 20.

The image display section 20 is constituted of a self-luminescence display panel including a current-drive-type light-emitting section, such as an organic electroluminescence panel.

In the first embodiment, the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively, and the fourth color is white. The first sub-pixel of the image display section 20 for displaying the first primary color, the second sub-pixel thereof for displaying the second primary color, the third sub-pixel thereof for displaying the third primary color, and the fourth sub-pixel thereof for displaying the fourth color are denoted by codes 22_R, 22_G, 22_B, and 22_W, respectively. The pixel 22 of the image display section 20 is constituted of a set of the first sub-pixel 22_R, the second sub-pixel 22_G, the third sub-pixel 22_B, and the fourth sub-pixel 22_W. A display area in which the pixels 22 are arranged in a matrix is denoted by a code 21.

For convenience of descriptions, it is assumed that the white-color chromaticity (x, y) obtained by the first sub-pixel 22_R, the second sub-pixel 22_G, and the third sub-pixel 22_B is the same as the white-color chromaticity (x, y) obtained by the fourth sub-pixel 22_W. It is also assumed that the white-color luminance L_rgb obtained by the first sub-pixel 22_R, the second sub-pixel 22_G, and the third sub-pixel 22_B and the white-color luminance L_w of the fourth sub-pixel 22_W are in a relationship expressed by L_w=a*L_rgb where the code “a” is a predetermined coefficient.

Further, in the image display section 20, it is assumed that white display is performed using the fourth sub-pixel 22_W alone, and a designed maximum light amount of the fourth sub-pixel 22_W is twice the maximum light amount of white display at a time the first sub-pixel 22_R, the second sub-pixel 22_G, and the third sub-pixel 22_B are all emitting light most brightly in terms of design. In other words, the relationship of L_w=2*L_rgb is established.

Input image signals are supplied to the signal generation section 10 from an external apparatus in correspondence with pixels of an image to be displayed. For convenience of descriptions, the input image signals input from the external apparatus are each a 9-bit RGB-type linear signal, for example. Signals output from the signal generation section 10 are each an 8-bit linear signal, for example. It should be noted that in a case where the image display section 20 and the like have predetermined gamma characteristics, a correction only needs to be performed as appropriate considering the nonlinearity.

The signal generation section 10 carries out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels of the image to be displayed are signals for performing display exceeding a reproduction range of colors displayable in the image display section 20, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generates signals for driving the first sub-pixel 22_R, the second sub-pixel 22_G, the third sub-pixel 22_B, and the fourth sub-pixel 22_W based on those signals. The signal generation section 10 operates based on the signal generation program stored in the storage means (not shown).

The first input image signal for red-color display, the second input image signal for green-color display, and the third input image signal for blue-color display are denoted by codes R_in, G_in, and B_in, respectively. The signals R_in, G_in, and B_in take values between 0 to 511 according to luminance of an image to be displayed. Here, the value “0” indicates minimum luminance, and the value “511” indicates maximum luminance. Moreover, in the descriptions below, the first input image signal R_in, the second input image signal G_in, and the third input image signal B_in may collectively be referred to as input image signals R_in, G_in, and B_in in some cases.

The structure of the signal generation section 10 will be described. The signal generation section 10 includes:

a color space conversion section 11 configured to calculate a position in a color space based on values of the first input image signal R_in, the second input image signal G_in, and the third input image signal B_in;

a chroma decrease amount calculation section 12 configured to calculate a chroma decrease amount based on the calculated position in the color space;

a chroma control section 13 configured to output the first input image signal R_in′, the second input image signal G_in′, and the third input image signal B_in′ whose chroma have been changed based on the calculated chroma decrease amount; and

a multi-primary color signal generation section 14 configured to generate the signals for driving the first sub-pixel 22_R, the second sub-pixel 22_G, the third sub-pixel 22_B, and the fourth sub-pixel 22_W based on the first input image signal R_in′, the second input image signal G_in′, and the third input image signal B_in′ whose chroma have been changed.

A general outline of the operations of the signal generation section 10 will be described. The input image signals R_in, G_in, and B_in of the RGB system are input to the color space conversion section 11 and the chroma control section 13. The color space conversion section 11 converts the RGB space of the input image signals R_in, G_in, and B_in into an HSV space. The chroma decrease amount calculation section 12 calculates a chroma decrease gain according to S and V values obtained from the input image signals R_in, G_in, and B_in.

The chroma control section 13 carries out an arithmetic operation for lowering chroma of the input image signals R_in, G_in, and B_in using the chroma decrease gain. The video signals having the chroma decreased as described above are input to the multi-primary color signal generation section 14. The multi-primary color signal generation section 14 carries out processing of converting RGB space signals into multi-primary color space signals.

It should be noted that a structure in which the color space conversion section 11 converts the RGB space of the input image signals R_in, G_in, and B_in into an HSL space and the chroma decrease amount calculation section 12 calculates the chroma decrease gain according to S and L values of the input image signals R_in, G_in, and B_in is also possible.

Hereinafter, the structure and operations of the signal generation section 10 will be described in detail.

FIG. 2 is a schematic block diagram for describing the structure of the color space conversion section.

The color space conversion section 11 calculates a position in the color space by converting the first input image signal R_in, the second input image signal G_in, and the third input image signal B_in into HSV color signals.

The color space conversion section 11 is constituted of a maximum value calculation section 111, a minimum value calculation section 112, and an S value calculation section 113. The input image signals R_in, G_in, and B_in are input to the maximum value calculation section 111 and the minimum value calculation section 112 so that the maximum value calculation section 111 calculates maximum values MAX=max(R_in, G_in, B_in) thereof and the minimum value calculation section 112 calculates minimum values MIN=min(R_in, G_in, B_in) thereof. The function max( ) is a function that imparts a maximum value of an argument, and the function min( ) is a function that imparts a minimum value of the argument.

The maximum value calculation section 111 calculates the maximum value MAX as the V value. Further, the S value calculation section 113 calculates the S value as in the following expression (1) based on the maximum value MAX and the minimum value MIN.

$\begin{array}{cc}S=\frac{\mathrm{MAX}-\mathrm{MIN}}{\mathrm{MAX}}& \left(1\right)\end{array}$

The chroma decrease amount calculation section 12 calculates a chroma decrease amount based on the V and S values of the HSV color signals of the color space conversion section 11. Specifically, the chroma decrease amount calculation section 12 calculates the chroma decrease gain to be multiplied by the S value. The chroma decrease gain is calculated by referencing a predetermined lookup table.

Referring to FIGS. 3 to 5, the structure of the lookup table used for calculating the chroma decrease gain will be described.

FIG. 3A is a schematic diagram for describing an HSV color space of an input video signal. FIG. 3B is a schematic diagram for describing an HSV color space displayable by the image display section.

The input video signals R_in, G_in, and B_in take values between 0 to 511 according to luminance of an image to be displayed. Therefore, the HSV color space of the input video signals is cylindrical as shown in FIG. 3A.

On the other hand, as described above, in the image display section 20, white display is performed using the fourth sub-pixel 22_W alone, and a designed maximum light amount of the fourth sub-pixel 22_W is twice the maximum light amount of white display at a time the first sub-pixel 22_R, the second sub-pixel 22_G, and the third sub-pixel 22_B are all emitting light most brightly in terms of design. Therefore, bright display is possible by using the fourth sub-pixel 22_W regarding a low-chroma image. However, an operation of the fourth sub-pixel 22_W cannot avoid being suppressed as the chroma of an image increases. As a result, the HSV color space displayable by the image display section 20 has a cylindrical shape in the lower half and roughly a truncated cone shape in the upper half.

As is apparent from comparing FIGS. 3A and 3B, the space shown in FIG. 3B is narrower than that shown in FIG. 3A. When the position in the HSV space based on the input video signals R_in, G_in, and B_in is not included in the space shown in FIG. 3B, that signal is a signal for performing display exceeding a reproduction range of colors displayable in the image display section 20.

The S and V values based on the input video signals R_in, G_in, and B_in are represented by codes S_in and V_in, respectively. When the input video signals R_in, and B_in are signals for performing display exceeding a reproduction range of colors displayable in the image display section 20, if the position in the HSV space is caused to approach the space shown in FIG. 3B by reducing the code S_in as shown in FIG. 4, lowering of brightness of an image can be compensated for while the chroma of the image is lowered.

As shown in FIG. 5, the lookup table referenced by the chroma decrease amount calculation section 12 is set such that a coefficient to lower the chroma as the S and V values based on the input video signals R_in, G_in, and B_in approach 1 is calculated. When the S value is roughly 0.5 or less or the V value is roughly 0.5 or less, the S value does not need to be lowered, so the coefficient to be calculated is “1”.

It should be noted that the lookup table referenced by the chroma decrease amount calculation section 12 can be determined by an experiment or the like using actual equipment or logically determined based on the shape of the color space or the like, for example.

The chroma control section 13 outputs the first input image signal R_in′, the second input image signal G_in′, and the third input image signal B_in′ whose chroma have been changed by carrying out predetermined arithmetic operation processing on the values of the first input image signal R_in, the second input image signal G_in, and the third input image signal B_in based on the calculated chroma decrease amount.

Specifically, the calculated chroma decrease gain is input to the chroma control section 13 so that chroma control is performed on the input video signals R_in, G_in, and B_in. The chroma control is carried out as in the following expression (2).

$\begin{array}{cc}\left[\begin{array}{c}{R}_{\mathrm{in}}^{\prime }\\ G_{\mathrm{in}}^{\prime }\\ B_{\mathrm{in}}^{\prime }\end{array}\right]=G_S·\left[\begin{array}{c}{R}_{\mathrm{in}}\\ G_{\mathrm{in}}\\ B_{\mathrm{in}}\end{array}\right]+\left(1-\mathrm{Gs}\right)·\left[\begin{array}{c}V\\ V\\ V\end{array}\right]& \left(2\right)\end{array}$

The code G_s indicates a chroma decrease amount (chroma decrease gain) calculated for the HSV space. According to the expression (2) above, the chroma S can be made Gs times as large without changing the color phase H and brightness V before and after the arithmetic operation.

The chroma control is performed as described above to obtain the input video signals R_in′, G_in′, and B_in′ whose chroma have been changed.

Subsequently, the multi-primary color signal generation section 14 generates signals for driving the first sub-pixel 22_R, the second sub-pixel 22_G, the third sub-pixel 22_B, and the fourth sub-pixel 22_W based on the input video signals R_in′, G_in′, and B_in′.

For example, as indicated by the broken line of FIG. 6, when performing processing of uniformly decreasing the chroma without taking into account the brightness of the input video signals R_in, G_in, and B_in, the brightness of the image is lowered irrespective of the fact that brighter display is possible under ordinary circumstances.

In contrast, in the first embodiment, when the input video signals R_in′, G_in, and B_in do not exceed the reproduction range of colors displayable in the image display section 20, a high-chroma image can be displayed. When the input video signals R_in, G_in, and B_in exceed the reproduction range of colors displayable in the image display section 20, the lowering of brightness can sufficiently be compensated for.

Next, operations of the multi-primary color signal generation section 14 will be described.

Input to the multi-primary color signal generation section 14 are the input video signals R_in′, G_in′, and B_in′, and signals R_out, G_out, and B_out for driving the first sub-pixel 22_R, the second sub-pixel 22_G, the third sub-pixel 22_B, and the fourth sub-pixel 22_W are output therefrom. For convenience of descriptions, the signals R_out, G_out, and B_out are assumed to be 8-bit signals.

The conversion expression from the signals R_in′, G_in′, and B_in′ to the signals R_out, G_out, and B_out is expressed by the following expressions (3.1) to (3.4).

It should be noted that as a result of the calculations, when the signals R_out, G_out, and B_out exceed 8 bits, the values are rounded to the maximum value of 8 bits (255), and when the signals R_out, G_out, and B_out take negative values, the values are rounded to the minimum value of 8 bits (0).

$\begin{array}{cc}{W}_{\mathrm{out}}=b·\mathrm{MIN}\left(\frac{R_{\mathrm{in}}^{\prime }}{a},\frac{G_{\mathrm{in}}^{\prime }}{a},\frac{B_{\mathrm{in}}^{\prime }}{a}\right)& \left(3.1\right)\\ R_{\mathrm{out}}=R_{\mathrm{in}}^{\prime }-a·W_{\mathrm{out}}& \left(3.2\right)\\ G_{\mathrm{out}}=G_{\mathrm{in}}^{\prime }-a·W_{\mathrm{out}}& \left(3.3\right)\\ B_{\mathrm{out}}=B_{\mathrm{in}}^{\prime }-a·W_{\mathrm{out}}& \left(3.4\right)\end{array}$

The code “b” in the expressions above represents a coefficient expressing a conversion ratio with respect to the fourth sub-pixel 22_W (white pixel), the coefficient having a range of 0 to 1. The conversion ratio with respect to the fourth sub-pixel 22_W becomes minimum at b=0 and becomes maximum at b=1. As already described above, the code “a” represents a coefficient indicating a relationship such as L_w=a*L_rgb.

In the case of a=2, b=1, the above expressions (3.1) to (3.4) are expressed by the following expressions (4.1) to (4.4).

$\begin{array}{cc}{W}_{\mathrm{out}}=1·\mathrm{MIN}\left(\frac{R_{\mathrm{in}}^{\prime }}{a},\frac{G_{\mathrm{in}}^{\prime }}{a},\frac{B_{\mathrm{in}}^{\prime }}{a}\right)& \left(4.1\right)\\ R_{\mathrm{out}}=R_{\mathrm{in}}^{\prime }-2·W_{\mathrm{out}}& \left(4.2\right)\\ G_{\mathrm{out}}=G_{\mathrm{in}}^{\prime }-2·W_{\mathrm{out}}& \left(4.3\right)\\ B_{\mathrm{out}}=B_{\mathrm{in}}^{\prime }-2·W_{\mathrm{out}}& \left(4.4\right)\end{array}$

For convenience of descriptions on the operations, an example of the case where the input video signals R_in′, G_in′, and B_in′ exceed the reproduction range of colors displayable in the image display section 20 and an example of the case where the input video signals R_in′, G_in′, and B_in′ do not exceed the reproduction range will be described.

The signal A shown in FIG. 7 indicates the example of the case where the input video signals R_in′, G_in′, and B_in′ exceed the reproduction range of colors displayable in the image display section 20. In addition, the signal B shown in FIG. 7 indicates the example of the case where the input video signals R_in′, G_in′, and B_in′ do not exceed the reproduction range of colors displayable in the image display section 20.

When the input video signals R_in′, G_in′, and B_in′ are the signal A (511, 0, 0), the values of W_out, R_out, G_out, and B_out are expressed by the following expressions (5.1) to (5.4) from the above expressions (4.1) to (4.4).

$\begin{array}{cc}\begin{array}{c}{W}_{\mathrm{out}}=1*\min \left(511/2,0/2,0/2\right)\\ =0\end{array}& \left(5.1\right)\\ \begin{array}{c}{R}_{\mathrm{out}}=511-2*0\\ =511\to \mathrm{rounded}\mathrm{to}255\end{array}& \left(5.2\right)\\ \begin{array}{c}{G}_{\mathrm{out}}=0-2*0\\ =0\end{array}& \left(5.3\right)\\ \begin{array}{c}{B}_{\mathrm{out}}=0-2*0\\ =0\end{array}& \left(5.4\right)\end{array}$

When the input video signals R_in′, G_in′, and B_in′ are the signal B (256, 128, 128), the values of W_out, R_out, G_out, and B_out are expressed by the following expressions (6.1) to (6.4) from the above expressions (4.1) to (4.4).

$\begin{array}{cc}\begin{array}{c}{W}_{\mathrm{out}}=1*\min \left(256/2,128/2,128/2\right)\\ =64\end{array}& \left(6.1\right)\\ \begin{array}{c}{R}_{\mathrm{out}}=256-2*64\\ =128\end{array}& \left(6.2\right)\\ \begin{array}{c}{G}_{\mathrm{out}}=128-2*64\\ =0\end{array}& \left(6.3\right)\\ \begin{array}{c}{B}_{\mathrm{out}}=128-2*64\\ =0\end{array}& \left(6.4\right)\end{array}$

Further, in the case of a=1, b=0.5, the above expressions (3.1) to (3.4) are expressed by the following expressions (7.1) to (7.4).

$\begin{array}{cc}{W}_{\mathrm{out}}=0.5·\mathrm{MIN}\left(\frac{R_{\mathrm{in}}^{\prime }}{a},\frac{G_{\mathrm{in}}^{\prime }}{a},\frac{B_{\mathrm{in}}^{\prime }}{a}\right)& \left(7.1\right)\\ R_{\mathrm{out}}=R_{\mathrm{in}}^{\prime }-1·W_{\mathrm{out}}& \left(7.2\right)\\ G_{\mathrm{out}}=G_{\mathrm{in}}^{\prime }-1·W_{\mathrm{out}}& \left(7.3\right)\\ B_{\mathrm{out}}=B_{\mathrm{in}}^{\prime }-1·W_{\mathrm{out}}& \left(7.4\right)\end{array}$

When the input video signals R_in′, G_in′, and B_in′ are the signal A (511, 0, 0), the values of W_out, R_out, G_out, and B_out are expressed by the following expressions (8.1) to (8.4) from the above expressions (7.1) to (7.4).

$\begin{array}{cc}\begin{array}{c}{W}_{\mathrm{out}}=0.5*\min \left(511/2,0/2,0/2\right)\\ =0\end{array}& \left(8.1\right)\\ \begin{array}{c}{R}_{\mathrm{out}}=511-1*0\\ =511\to \mathrm{rounded}\mathrm{to}255\end{array}& \left(8.2\right)\\ \begin{array}{c}{G}_{\mathrm{out}}=0-1*0\\ =0\end{array}& \left(8.3\right)\\ \begin{array}{c}{B}_{\mathrm{out}}=0-1*0\\ =0\end{array}& \left(8.4\right)\end{array}$

When the input video signals R_in′, G_in′, and B_in′ are the signal B (256, 128, 128), the values of W_out, R_out, G_out, and B_out are expressed by the following expressions (9.1) to (9.4) from the above expressions (7.1) to (7.4).

$\begin{array}{cc}\begin{array}{c}{W}_{\mathrm{out}}=0.5*\min \left(256/2,128/2,128/2\right)\\ =32\end{array}& \left(9.1\right)\\ \begin{array}{c}{R}_{\mathrm{out}}=256-1*32\\ =224\end{array}& \left(9.2\right)\\ \begin{array}{c}{G}_{\mathrm{out}}=128-1*32\\ =96\end{array}& \left(9.3\right)\\ \begin{array}{c}{B}_{\mathrm{out}}=128-1*32\\ =96\end{array}& \left(9.4\right)\end{array}$

Heretofore, the embodiment of the present invention has been described in detail, but the present invention is not limited to the embodiment above and can be variously modified based on the technical idea of the present invention.

For example, a structure in which the color space conversion section 11 converts the RGB space of the input video signals R_in, G_in, and B_in into an HSL space and the chroma decrease amount calculation section 12 calculates the chroma decrease gain according to S and L values of the input video signals R_in, G_in, and B_in is also possible.

FIG. 8 is a schematic block diagram for describing another structural example of the color space conversion section.

In this structural example, an L value calculation section 114 is added to the color space conversion section 11 described with reference to FIG. 2. The operations of the maximum value calculation section 111, the minimum value calculation section 112, and the S value calculation section 113 have been described with reference to FIG. 2, so descriptions thereof will be omitted.

The L value calculation section 114 calculates the L value based on the values of the input video signals R_in, G_in, and B_in and luminance ratio coefficients L_r, L_g, and L_b using the following expression (10).

L=L _r *R _in +L _g *G _in +L _b *B _in  (10)

note that L_r+L_g+L_b=1

In addition, the chroma control is carried out as in the following expression (11).

$\begin{array}{cc}\left[\begin{array}{c}{R}_{\mathrm{out}}\\ G_{\mathrm{out}}\\ B_{\mathrm{out}}\end{array}\right]=G_S·\left[\begin{array}{c}{R}_{\mathrm{in}}\\ G_{\mathrm{in}}\\ B_{\mathrm{in}}\end{array}\right]+\left(1-\mathrm{Gs}\right)·\left[\begin{array}{c}L\\ L\\ L\end{array}\right]& \left(11\right)\end{array}$

According to the expression above, the chroma S can be converted as in the following expression (12) without changing the color phase H and luminance L before and after the arithmetic operation. The code S_out is a chroma value after the processing, and the code S_in is a chroma value before the processing.

$\begin{array}{cc}{S}_{\mathrm{out}}=\frac{\mathrm{Gs}·V}{\mathrm{Gs}·V+\left(1-\mathrm{GS}\right)·L}·S_{\mathrm{in}}& \left(12\right)\end{array}$

Further, in the descriptions on the embodiment, the H value (color phase value) is not taken into account in the calculation of the chroma decrease amount, but a structure in which the chroma decrease amount is calculated while taking the chroma decrease amount into account is also possible.

It should be noted that the present disclosure may also take the following structures.

[1] A signal generation apparatus that generates, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix,

the signal generation apparatus carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

[2] The signal generation apparatus according to [1] above, including:

a color space conversion section configured to calculate a position in a color space based on values of the first input image signal, the second input image signal, and the third input image signal;

a chroma decrease amount calculation section configured to calculate a chroma decrease amount based on the calculated position in the color space;

a chroma control section configured to output the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed based on the calculated chroma decrease amount; and

a multi-primary color signal generation section configured to generate the signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed.

[3] The signal generation apparatus according to [2] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSV color signals.

[4] The signal generation apparatus according to [3] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on a V value and an S value in the HSV color signals of the color space conversion section.

[5] The signal generation apparatus according to [2] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSL color signals.

[6] The signal generation apparatus according to [5] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on an L value and an S value in the HSL color signals of the color space conversion section.

[7] The signal generation apparatus according to any one of [2] to [6] above,

in which the chroma control section outputs the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed by performing predetermined arithmetic operation processing on the values of the first input image signal, the second input image signal, and the third input image signal based on the calculated chroma decrease amount.

[8] The signal generation apparatus according to any one of [1] to [7] above,

in which the fourth color is white.

[9] A signal generation program that is executed in a signal generation apparatus that generates, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix,

the signal generation program causing the signal generation apparatus to execute the step of

carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

[10] The signal generation program according to [9] above, in which the signal generation apparatus includes:

a color space conversion section configured to calculate a position in a color space based on values of the first input image signal, the second input image signal, and the third input image signal;

a chroma decrease amount calculation section configured to calculate a chroma decrease amount based on the calculated position in the color space;

a chroma control section configured to output the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed based on the calculated chroma decrease amount; and

a multi-primary color signal generation section configured to generate the signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed.

[11] The signal generation program according to [10] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSV color signals.

[12] The signal generation program according to [11] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on a V value and an S value in the HSV color signals of the color space conversion section.

[13] The signal generation program according to [10] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSL color signals.

[14] The signal generation program according to [13] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on an L value and an S value in the HSL color signals of the color space conversion section.

[15] The signal generation program according to any one of [10] to [14] above,

in which the chroma control section outputs the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed by performing predetermined arithmetic operation processing on the values of the first input image signal, the second input image signal, and the third input image signal based on the calculated chroma decrease amount.

[16] The signal generation program according to any one of [9] to [15] above,

in which the fourth color is white.

[17] A signal generation method for generating, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix,

the signal generation method including

carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

[18] The signal generation method according to [17] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the position in the color space is calculated by converting the first input image signal, the second input image signal, and the third input image signal into HSV color signals.

[19] The signal generation method according to [18] above,

in which the chroma decrease amount is calculated based on a V value and an S value in the HSV color signals of the color space conversion section.

[20] The signal generation method according to [17] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the position in the color space is calculated by converting the first input image signal, the second input image signal, and the third input image signal into HSL color signals.

[21] The signal generation method according to [20] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on an L value and an S value in the HSL color signals of the color space conversion section.

[22] The signal generation method according to any one of [17] to [21] above,

in which the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed by performing predetermined arithmetic operation processing on the values of the first input image signal, the second input image signal, and the third input image signal based on the calculated chroma decrease amount are output.

[23] The signal generation method according to any one of [17] to [22] above,

in which the fourth color is white.

[24] An image display apparatus, including:

an image display section in which a first sub-pixel for displaying a first primary color, a second sub-pixel for displaying a second primary color, a third sub-pixel for displaying a third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix; and

a signal generation section configured to generate a signal for driving the image display section based on a first input image signal for displaying the first primary color, a second input image signal for displaying the second primary color, and a third input image signal for displaying the third primary color, that are supplied in correspondence with pixels of an image to be displayed,

in which the signal generation section carries out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generates signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

[25] The image display apparatus according to [24] above, further including:

a color space conversion section configured to calculate a position in a color space based on values of the first input image signal, the second input image signal, and the third input image signal;

a chroma decrease amount calculation section configured to calculate a chroma decrease amount based on the calculated position in the color space;

a chroma control section configured to output the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed based on the calculated chroma decrease amount; and

a multi-primary color signal generation section configured to generate the signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed.

[26] The image display apparatus according to [25] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSV color signals.

[27] The image display apparatus according to [26] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on a V value and an S value in the HSV color signals of the color space conversion section.

[28] The image display apparatus according to [25] above, in which:

the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; and

the color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSL color signals.

[29] The image display apparatus according to [28] above,

in which the chroma decrease amount calculation section calculates the chroma decrease amount based on an L value and an S value in the HSL color signals of the color space conversion section.

[30] The image display apparatus according to any one of [25] to [29] above,

in which the chroma control section outputs the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed by performing predetermined arithmetic operation processing on the values of the first input image signal, the second input image signal, and the third input image signal based on the calculated chroma decrease amount.

[31] The image display apparatus according to any one of [25] to [30] above,

in which the fourth color is white.

DESCRIPTION OF SYMBOLS

• 1 image display apparatus
• 10 signal generation section (signal generation apparatus)
• 20 image display section
• 21 display area
• 22 pixel
• 22 _R first sub-pixel
• 22 _G second sub-pixel
• 22 _B third sub-pixel
• 22 _W fourth sub-pixel
• 111 maximum value calculation section
• 112 minimum value calculation section
• 113 S value calculation section
• 114 L value calculation section
• R_in, R_in′ first input image signal
• G_in, G_in′ second input image signal
• B_in, B_in′ third input image signal

Claims

1. A signal generation apparatus that generates, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix, the signal generation apparatus carrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

2. The signal generation apparatus according to claim 1, comprising: a color space conversion section configured to calculate a position in a color space based on values of the first input image signal, the second input image signal, and the third input image signal;a chroma decrease amount calculation section configured to calculate a chroma decrease amount based on the calculated position in the color space;a chroma control section configured to output the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed based on the calculated chroma decrease amount; anda multi-primary color signal generation section configured to generate the signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed.

3. The signal generation apparatus according to claim 2, wherein: the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; andthe color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSV color signals.

4. The signal generation apparatus according to claim 3, wherein the chroma decrease amount calculation section calculates the chroma decrease amount based on a V value and an S value in the HSV color signals of the color space conversion section.

5. The signal generation apparatus according to claim 2, wherein: the first primary color, the second primary color, and the third primary color are red, green, and blue, respectively; andthe color space conversion section calculates the position in the color space by converting the first input image signal, the second input image signal, and the third input image signal into HSL color signals.

6. The signal generation apparatus according to claim 5, wherein the chroma decrease amount calculation section calculates the chroma decrease amount based on an L value and an S value in the HSL color signals of the color space conversion section.

7. The signal generation apparatus according to claim 2, wherein the chroma control section outputs the first input image signal, the second input image signal, and the third input image signal whose chroma have been changed by performing predetermined arithmetic operation processing on the values of the first input image signal, the second input image signal, and the third input image signal based on the calculated chroma decrease amount.

8. The signal generation apparatus according to claim 1, wherein the fourth color is white.

9. A signal generation program that is executed in a signal generation apparatus that generates, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix, the signal generation program causing the signal generation apparatus to execute the step ofcarrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

10. A signal generation method for generating, based on a first input image signal for displaying a first primary color, a second input image signal for displaying a second primary color, and a third input image signal for displaying a third primary color, that are supplied in correspondence with pixels of an image to be displayed, a signal for driving an image display section in which a first sub-pixel for displaying the first primary color, a second sub-pixel for displaying the second primary color, a third sub-pixel for displaying the third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix, the signal generation method comprisingcarrying out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generating signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.

11. An image display apparatus, comprising: an image display section in which a first sub-pixel for displaying a first primary color, a second sub-pixel for displaying a second primary color, a third sub-pixel for displaying a third primary color, and a fourth sub-pixel for displaying a fourth color are arranged in a 2D matrix; anda signal generation section configured to generate a signal for driving the image display section based on a first input image signal for displaying the first primary color, a second input image signal for displaying the second primary color, and a third input image signal for displaying the third primary color, that are supplied in correspondence with pixels of an image to be displayed,wherein the signal generation section carries out, when the first input image signal, the second input image signal, and the third input image signal corresponding to the pixels are signals for performing display exceeding a reproduction range of colors displayable in the image display section, processing of decreasing chroma with respect to the first input image signal, the second input image signal, and the third input image signal, and generates signals for driving the first sub-pixel, the second sub-pixel, the third sub-pixel, and the fourth sub-pixel based on those signals.