User interactive copy processing for selective color conversion or adjustment without gradation loss, and adjacent non-selected-color areas are not affected

Abstract

A more-natural-looking video is reproduced and a video data having a desired color tone is formed by preserving the tone of a video as an original in color conversion at a desired ratio. To this end, a criterion color register stores color information (hue, chroma and density) for determining whether input pixel data is eligible for conversion, a target color register stores color information indicative of a target color, and a preservation degree register stores a preservation degree that determines the degree of preservation in color conversion. A color determination section determines whether the input pixel data is eligible for conversion, and the determination result is output to a color converter section. The color converter section performs color conversion to eligible pixel data according to the information stored in the criterion color register, target color register and preservation degree register, with the result of the color conversion being output.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a video processing method for color conversion and color adjustment and to a video processing apparatus.

2. Description of the Related Art

Prior art video processing apparatuses such as copying machines perform color conversion in the following sequence.

1) A color to be converted (criterion color) and a color after color conversion are specified.

2) The video data of an original is read and then compared with the color to be converted.

3) When the comparison reveals that the video data agrees with the color to be converted, the video data of the original that is determined as the color to be converted is then converted to the specified color after color conversion.

On the other hand, a color adjustment process may be performed. For example, to stress red a bit more, hue, value and saturation or chroma of an original are accordingly varied.

In the prior art, however, when part of a video is changed, for example, to make reddish the skin color of a person in a photograph or to make bluish the color of clothes, color conversion, if performed, causes gradation such as density and shade of the skin and the clothes to be lost. Furthermore, since color conversion normally affects the entire video, colors other than those of the skin and the clothes are also adjusted (converted).

Specifying a particular area to be subjected to color adjustment allows only that area to be color adjusted. In this case, however, to specify an area, extra means such as a free line is required, and such an action to specify a particular area is not very useful for users.

SUMMARY OF THE INVENTION

Accordingly, it is an object of the present invention to provide a video processing apparatus and a video processing method, in which a particular area of a video to be processed is selectively subjected to a color processing such as color conversion and color adjustment by a simple operation.

To achieve the above object, the video processing apparatus of the present invention includes, a first specifying unit for specifying the color to be converted on a color video, a second specifying unit for specifying the post-conversion color of the color to be converted, a third specifying unit for specifying the degree of color change from the color to be converted to the post-conversion color; and processor for converting the color to be converted to the post-conversion color according to the specified degree of color change.

It is another object of the present invention to provide a video processing apparatus and a video processing method, which simply provides an instruction for the reproduction of the video that has undergone color conversion and color adjustment.

It is yet another object of the present invention to enhance the ease of use of a color setting section that is used in the course of color conversion and color adjustment.

It is yet another object of the present invention to provide a video processing apparatus and a video processing method, which offer novel functions.

These and other objects and features of the present invention will become more apparent when the following detailed description of the invention is considered with the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a color converter circuit according to an embodiment of the present invention.

FIG. 2 is a diagram showing a color conversion in terms of hue, chroma and density in a CMY color space.

FIG. 3 is a diagram showing an example of a color conversion algorithm with a preservation degree of 0%.

FIG. 4 is a diagram showing an example of a color conversion algorithm with a preservation degree of 0%.

FIG. 5 is a diagram showing an example of a color conversion algorithm with a preservation degree of 100%.

FIG. 6 is a diagram showing an example of a color conversion algorithm with a preservation degree of 100%.

FIG. 7 is a block diagram showing a copying machine according the embodiment of the present invention.

FIG. 8 is a diagram showing an example of the control panel 107 shown generally in FIG. 7 .

FIG. 9 , consisting of FIGS. 9A , 9 B and 9 C, is a diagram showing an example of the color palette in the embodiment of the present invention.

FIGS. 10 ( a ) and 10 ( b ) are diagrams showing examples of the monitor 108 shown generally in FIG. 7 .

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring now the drawings, the embodiments of the present invention is discussed in detail.

Embodiment 1

FIG. 7 is the block diagram showing the copying machine that is an example of the video processing apparatus according to embodiment 1 of the present invention. Shown are a CPU 100 for generally controlling the apparatus, a ROM 101 for storing the operational sequence of CPU 100 , and a RAM 102 that is used as the work area for CPU 100 . A color printer section 103 prints a color image, and is of a type that ejects an ink drop of each of YMCK color components. A scanner section 104 reads an original video as a color image or video. A video memory 105 has a capacity of at least one page of color video. The color video data scanned by the scanner section 104 is stored in the video memory 105 . Also shown are a color convertor circuit 106 (to be described in detail later) and a control panel 107 ( FIG. 8 ) provided with switches for entering a diversity of instructions and with a display screen section for presenting messages on screen. A monitor 108 (FIGS. 10 ( a ) and 10 ( b )) presents for on screen verification the processed video which will be converted by the color converter circuit 106 prior to the processed video being printed out by the color printer section 103 . That is, the monitor 108 presents a preview of the processed video. Any type of monitor is acceptable as the monitor 108 . For example, it may be a CRT, FLCD, TFT, or the like. An ID card socket section, 109 is adapted to receive an ID card 111 , with the information on the card being read by CPU 100 .

FIG. 8 shows the example of the touchpad control panel 107 of the copying machine according to embodiment 1 of the present invention. Touchpad keys 801 are used for designating copying at a scale of natural size, reductions or enlargements. A user can thus instruct the copying machine through the touchpad keys 801 to copy an original video to a predetermined size at a desired scale, for example by 70%, 86%, 100%, 115%, 121%, 141%, and so on. A zoom control key 802 zooms the original in steps of 1%; a paper selection key 803 switches between automatic paper selection and manual paper selection. Control keys 804 adjust copying density, and pressing the key labeled A automatically adjusts the copying density to its appropriate level. Control keys 805 select the appropriate copy mode to match the type of each original, such as photographs or maps.

Control keys 806 , 807 and 808 are used for specifying a criterion color, a target color and the degree of preservation, respectively, as will be described later.

Specifying the criterion color and target color is performed by indicating desired colors with the control keys 806 and 807 , and ends with a color specifying step to be described later.

The degree of preservation is entered referring to a slide bar 816 , and the preservation value set is presented in a recognizable manner as shown. (The degree of preservation is set to 25% in FIG. 8. ) A control key 809 is a key used for requesting the so-called “preview” in which, when the color video scanned by the scanner section 104 is subjected to color conversion, the resulting color-converted video is presented for verification on the monitor 108 of FIG. 7 before it is printed.

A key 810 functions in the preview mode. A reduced video resulting from interpolated reading from the video memory 105 is color-converted according to predetermined preservation percentages 0%, 25%, 50%, 75% and 100% and, the key 810 instructs the monitor 108 of FIG. 7 to present the color converted video as multiple videos.

As shown in FIG. 10 ( a ), each of the multiple videos is labeled with information indicating a preservation percentage that has been used in color conversion of the respective video so that the user may easily recognize it. The setting of the preservation percentages is not limited to the above manner in which predetermined preservation percentages are used. To set the preservation percentage, the slide bar 816 may be used to specify a reference preservation percentage with respect to which a predetermined range of preservation percentage, for example, ±5%, ±10%, and so on may be used, and then color-converted multiple videos may be presented on the monitor (FIG. 10 ( b )).

A key 811 is a copy key. When the user is satisfied with the resulting video in the preview, the user executes color copying by pressing the key 811 .

In a multi-video mode, the user indicates the color-converted video having a desired preservation percentage from among the displayed videos in FIG. 10 ( b ) using a pointing device 110 such as a mouse or a pen, and then presses an OK key 812 .

According to the preservation percentage determined and set by the pointing device 110 and OK key 812 , a color conversion process is performed on the scanned color video stored in the video memory 105 . A reduction process is not performed on the scanned color video.

When a video having a large number of gradations is color-converted, the resulting video is again conveniently presented on the monitor 108 for verification. Then, by activating the copy key 811 , video reproduction is performed.

Along with a printout reproduced video, color conversion information indicative of the criterion color, target color and preservation percentage may be printed out so that the color conversion information that has been utilized in the color conversion is recognized as a future reference.

The criterion color and target color in printing may be the just specified colors, or may be entered by a type of palette and the color code in the palette (FIG. 9 ).

If the user does not want to print the color conversion information, he has the option not to print the color conversion information by pressing a printless key 814 .

When the copy key 811 is pressed without any instruction through the pointing device 110 , multiple videos currently presented on-screen on the monitor are printed.

The printout image generally has a tone different from that of what is presented on the monitor because of the coloring characteristic of the type monitor in use. Printing of the multiple videos permits easy comparison and simulates printed states.

Keys 813 are used to present color palettes for criterion and target colors. By activating keys A through C, a diversity of palettes are selectively presented on a palette display screen 815 , and by using an on-screen palette, a color is specified.

The palettes in FIG. 9 are an example actual palettes shown on the palette display screen 815 . The user can thus select color while visually checking it on the palette display. RAM 102 stores the color information of the palettes according to the coordinates of the palette display screen 815 .

Palettes may be conveniently changed from application to application, for example, one for general users and another for designers may be selectively used. Specifically, a general user may prefer a palette of a diversity of colors while a designer may prefer a palette having a particular color tone with detailed gradations.

To meet such user needs, the embodiment of the present invention provides on an individual user basis an ID card 111 which stores a diversity of palette information (R, G, B values).

When the ID card 111 is placed in the card socket section 109 , the palette information is read into RAM 102 , the read palette information is processed and converted into a palette signal by CPU 100 , and is then presented on the palette display screen 815 . As a result, the displayed palette is ready for color specifying.

The slide bar 816 sets a range of criterion. The criterion range will be discussed later.

FIG. 1 is the block diagram of the major portions of the color converter circuit 106 according to the embodiment of the present invention.

A criterion color register stores the information on the color to be converted (criterion color). A target color register 2 stores the information on the after conversion color or post-conversion color (target color). A preservation degree register 3 stores the degree of preservation in color conversion. The preservation degree register 3 holds the information indicative of how much chroma or saturation and density of an original are preserved when they are converted to target colors through the color conversion process (the higher the preservation degree, the closer the result is to the chroma and density of the original video). A color determination section 4 determines whether color conversion is performed to an input video (the data of the original) based on the data stored in the criterion color register 1 , and outputs determination results. Based on the determination results of the color determination section 4 , a color converter section 5 performs color conversion to the input color data of the original according to the preservation degree stored in the preservation degree register 3 and the target color stored in the target color register 2 .

In this embodiment, the RGB data of the input video (the output from the scanner section 104 ) is converted into cyan (C), magenta (M), and yellow (Y), which are then internally converted into hue, chroma and density (value) to be stored once into the video memory 105 . These data are sequentially entered to be color-converted. Therefore, data stored in the preservation degree register 1 and target color register 2 are data of hue, chroma and density (value).

FIG. 2 shows an example of CMY data of one pixel (picture element) in input video data. As shown in FIG. 2 , hue, chroma and density (value) are derived from the input video pixel data (each component data of C, M, and Y). Hue in the video data represented by three components C, M, and Y is expressed by the ratio of the components obtained by subtracting an achromatic color component from each component. Since the achromatic color component is expressed by the minimum value of the three components, hue is expressed by the ratio of two components of the maximum value and minimum value.

For example, suppose that the three components are max for the maximum value, min for the minimum value and mid for the middle value. Hue is expressed by (max-min)/(mid-min). Density is expressed by max and chroma is expressed by max-min.

In FIG. 2 , the maximum value is the C component, the minimum value is the Y component, and the middle value is the M component, thus,

Hue=( C−Y )/( M−Y )

Density= C

Chroma= C−Y

Conversion equations for converting YMC into hue, chroma and density are not limited to the ones above. Alternatively, other conversion equations (a determinant, for example) may be employed.

Discussed next is the color conversion process in which the video data expressed as above is color-converted by the color converter circuit shown in FIG. 1 .

In the following discussion, the hue component of a color C is referred to as H[C], its chroma component is referred to as S[C], and its density component is referred to as D[C].

In FIG. 3 , a color Ch (the color of the original) is color-converted to a color C 2 (the target color) at a preservation degree of 0% (namely, color conversion is performed with no consideration given to the density and chroma of the original), and FIG. 3 indicates the color conversion algorithm in which the color of the original Ch entered to the color converter circuit is identical to a criterion color C 1 .

The criterion color C 1 and target color C 2 are stored respectively in the criterion color register 1 and target color register 2 , and a preservation degree of α=0% is stored in the preservation degree register 3 . The color Ch of the original input is compared with the criterion color C 1 by the color determination section 4 . In this case, the color of the original Ch is identical to the criterion color C 1 , and the color determination section 4 decides to color-convert the color Ch of the original and issues to the color converter section 5 a signal indicative of that decision.

Next, the color converter section 5 performs a color conversion process to the color Ch of the original. Color substitution involved in color conversion process is computed according to the following equations.

H[C 3 ]← H[C 2 ]  Equation 1-1

S[C 3 ]← S[Ch]+ ( S[C 2 ]− S[C 1 ])×(100−α) (%)  Equation 1-2

D[C 3 ]← D[Ch]+ ( D[C 2 ]− D[C 1 ])×(100−α) (%)  Equation 1-3

Now, Ch=C 1 , thus, hue H[C 3 ], chroma S[C 3 ], and density [C 3 ] of a color C 3 after conversion are expressed as follows:

H[C 3 ]= H[C 2 ]  Equation 1-4

S[C 3 ]= S[C 2 ]  Equation 1-5

D[C 3 ]= D[C 2 ]  Equation 1-6

FIG. 4 shows the color conversion algorithm in which the color Ch of the original is converted into the target color C 2 in the color conversion process where the color Ch of the original input to the color converter circuit is not identical to the criterion color C 1 but within a predetermined criterion range. For example, the criterion range may be 10% with respect to each component value of the criterion color, and the color of the original falling within the criterion range is judged as a color to be converted. The criterion range may be freely set up at the option of the user. The criterion range may be set by +A and −B format (A and B denote actual values) rather than by percentage.

The target color, criterion color and criterion range are entered through the control panel 107 as already described. Alternatively, the target color, criterion color and range may be entered as follows: a coordinates input device (such as a digitizer) is connected to the apparatus of the present invention, an original to be colored converted and an original having a target color are set, the locations of the color to be converted and the target color are pointed on the originals, the locations on the originals are read to pick up the colors at the pointed positions.

Either way color conversion is performed on the criterion color or within the predetermined range of the criterion color after the criterion color and target color are set and the criterion range is set.

Suppose that the criterion color C 1 and target color C 2 are stored respectively in the criterion color register 1 and target color register 2 , and that a preservation degree of α=0% is stored in the preservation degree register 3 . The color Ch of the original input is compared with the criterion color C 1 by the color determination section 4 . In this case, the color of the original Ch is in the vicinity of the criterion color C 1 and falls within the criterion range, and the color determination section 4 decides to color-convert the color Ch of the original.

Color substitution in color conversion process is performed according to the above-described equations 1-1, 1-2 and 1-3.

Hue H[C 3 ], chroma S[C 3 ] and density D[C 3 ] of the color C 3 after conversion are expressed as follows.

H[C 3 ]= H[C 2 ]  Equation 1-7

S[C 3 ]= S[Ch]+S[C 2 ]− S[C 1 ]  Equation 1-8

D[C 3 ]= D[Ch]+D[C 2 ]− D[C 1 ]  Equation 1-9

As for S and D, the tone of the original (variations in chroma and density) is expressed by adding to the target color C 2 the difference between the criterion color C 1 and the color Ch of the original.

Examples of color conversion with a preservation degree of 100% is discussed, referring to FIGS. 5 and 6 .

First, data of points on an original representing the area of interest to be color adjusted, for example, data of the skin color of the face of a person in a photograph is picked up as the color C 1 (criterion color) and C 2 (target color). Alternatively, the user may specify colors from previously-described color samples on the color palettes, or may specify predetermined values according to predetermined specifying method such as “bluish” or “reddish” command, or may specify colors by introducing an increase or decrease in the criterion color.

The criterion color C 1 and target color C 2 are stored respectively in the criterion color register 1 and target color register 2 , and a preservation degree of α=100% is stored in the preservation degree register 3 .

The example shown in FIG. 5 is first discussed. The color Ch of the original input is compared with the criterion color C 1 by the color determination section 4 . In this case, the color of the original Ch is identical to the criterion color C 1 , and the color determination section 4 decides to color-convert the color Ch of the original.

Next, the color converter section 5 performs color conversion process to the color Ch of the original.

Color substitution involved in color conversion process is performed according to the equations 1-1, 1-2 and 1-3.

In this case, since the preservation degree α=100%, hue H[C 3 ], chroma S[C 3 ], and density [C 3 ] of a color C 3 after conversion are expressed as follows:

H[C 3 ]= H[C 2 ]  Equation 1-10

S[C 3 ]= S[Ch]   Equation 1-11

D[C 3 ]= D[Ch]   Equation 1-12

In the example in FIG. 6 , the color Ch of the original falls within the criterion range of the criterion color C 1 , and thus hue H[C 3 ], chroma S[C 3 ], and density [C 3 ] of a color C 3 after conversion are expressed in the same way as in the example in FIG. 5 as follows:

H[C 3 ]= H[C 2 ]  Equation 1-13

S[C 3 ]= S[Ch]   Equation 1-14

D[C 3 ]= D[Ch]   Equation 1-15

Namely, with a preservation degree of 100%, the chroma and density (value) of the color Ch of the original remain unchanged while its hue changes.

As described above, according to the above embodiment, the chroma and density (value) of the video as an original in color conversion are preserved at a desired ratio, not only natural video is reproduced, but also video data having a desired color tone is formed. Resulting video can thus be rendered diverse, ranging from a more natural one to a greatly varied one.

Alternate Embodiment

In the embodiment 1, determination and color conversion are performed by deriving hue, chroma and density (value) from each data of cyan C, magenta M and yellow Y. The present invention is not limited to this method.

For example, the color C 3 after color conversion may be determined based on the level of each data of cyan C, magenta M and yellow Y as follows.

The maximum value max[C 3 ] of the color component after color conversion is the density component of the color after color conversion, and thus,

 max[ C 3 ]=max[ Ch ]+{max( C 2 )−max( C 1 )}×(100−α)(%)  Equation 3-1

The minimum value min[C 3 ] of the color component after color conversion is the difference between the maximum value of the color after color conversion and the chroma component after color conversion, and thus,

min[ C 3 ]=max[ C 3 ]−(max[ Ch ]−min[ Ch] ) −{(max[ C 2 ]−min[ C 2 ])×(max[ C 1 ]×min[ C 1 ])}×(100−α) (%)  Equation 3-2

Since the hue of the target color C 2 is identical to the hue of the color C 3 after color conversion, the middle value mid[C 3 ] of the color component after color conversion is expressed as follows.

(max[ C 2 ]−mid[ C 2 ]):(max[ C 2 ]−min[ C 2 ])=(max[ C 3 ]−mid[ C 3 ]): (max[ C 3 ]−min[ C 3 ])  Equation 3-3

Thus, the middle value mid[C 3 ] is

mid[ C 3 ]=max[ C 3 ]−{(max[ C 2 ]−mid[ C 2 ])*(max[ C 3 ]−min[ C 3 ])}/ (max[ C 2 ]−min[ C 2 ])  Equation 3-4

The maximum, middle and minimum values after color conversion are determined in this way. The color of the maximum value is the color of the maximum value in the target color C 3 , the color of the middle value is the color of the middle value in the target color C 3 and the color of the minimum value is the color of minimum value in the target color C 3 .

In the above embodiments, the present invention is applied to a the copying machine. Alternatively, the present invention may be applied to a scanner for reading an original video, a printer that performs a printing process or to any other system in which a processing apparatus for color conversion is stand-alone unit. The present invention may be applied to a system made up a plurality of apparatus, or may be applied to a single-unit apparatus. The present invention may also be applied to a system or apparatus that is program-controlled.

As described above, according to the embodiments of the present invention, color conversion is performed with the tone of the original video preserved and with no loss of gradation after color conversion.

The same specifying method and determination method involved in color conversion are used to select the area to be color adjusted, and part of the original is color-adjusted without extra area setting (determining) means.

As described above, according to the above embodiment, the tone of the video as an original in color conversion is preserved at a desired ratio, not only is natural video reproduced, but also video data having a desired color tone is formed.

Claims

1. An image processing apparatus comprising:a first specifying unit, that specifies a color to be converted among a plurality of colors on a color image; a second specifying unit, that specifies a color after color conversion corresponding to the color to be converted; a third specifying unit, that specifies a degree of preservation in color conversion from the color to be converted to the color after color conversion; a fourth specifying unit, that specifies a criterion range in color conversion; and a processor, that processes a hue of the color to be converted to a hue of the color after color conversion, wherein at least one of chroma and brightness of the color to be converted is converted in accordance with the degree of preservation in color conversion and the criterion range, and each of said first specifying unit, said second specifying unit, said third specifying unit, and said fourth specifying unit is specified in accordance with a user's instructions.

2. The image processing apparatus according to claim 1, wherein each of said first specifying unit and said second specifying unit comprise a digitizer.

3. The image processing apparatus according to claim 1, wherein each of said first specifying unit and said second specifying unit comprise a color palette.

4. The image processing apparatus according to claim 3, wherein information on the color palette is stored in detachable memory means.

5. The image processing apparatus according to claim 1, further comprising a display unit for displaying process results by the processing means.

6. The video processing apparatus according to claim 5, wherein said display unit presents as multiple images the image that are processed at a plurality of degrees of color change.

7. An image processing method comprising the steps of:specifying a color on a color image to be converted; specifying a color after color conversion corresponding to the color to be converted; specifying a degree of preservation in color conversion from the color to be converted to the color after the color conversion; specifying a criterion range on a color image to be converted; and converting a hue of the color to be converted to a hue of the color after color conversion, wherein at least one of chroma and brightness of the color to be converted is converted in accordance with the degree of preservation in color conversion and the criterion range, and each of said first, second, third, and fourth specifying steps are specified in accordance with a user's instructions.

8. The image processing method according to claim 7, wherein each of said color-specifying steps are performed using a digitizer.

9. The image processing method according to claim 7, further comprising the step of presenting process results obtained in said converting step, using a display.

10. The image processing apparatus according to claim 9, wherein the display presents as multiple images the images that are processed at a plurality of degrees of color change.

11. The image processing method according to claim 7, wherein said first and second specifying steps are performed using a color palette.

12. The image processing method according to claim 11, wherein information on the color palette is stored in a detachable memory of an image processor that performs said image processing method.

13. An image processing apparatus comprising:a first specifying unit, that specifies a color to be converted among a plurality of colors on a color image; a second specifying unit, that specifies a color conversion corresponding to the color to be converted; a third specifying unit, that specifies a degree of preservation in color conversion from the color to be converted to the color after color conversion; a fourth specifying unit, that specifies a criterion range in color conversion; and a processor, that processes a hue of the color to be converted to a hue of the color after color conversion, wherein at least one of the chroma and the brightness of the color to be converted is converted in accordance with the degree of preservation in color conversion and the criterion range, and wherein each of said first specifying unit and said second specifying unit comprise a color palette, and information on the color palette is stored in a detachable memory.

14. An image processing method comprising the steps of:specifying a color on a color image to be converted; specifying a color after color conversion corresponding to the color to be converted; specifying a degree of preservation in color conversion from the color to be converted to the color after the color conversion; specifying a criterion range on a color image to be converted; and converting a hue of the color to be converted to a hue of the color after color conversion; and presenting process results obtained in said converting step using a display, wherein the display presents as multiple images the images that are processed at a plurality of degrees of color change, and wherein at least one of the chroma and the brightness of the color to be converted is converted in accordance with the degree of preservation in color conversion and the criterion range.