Patent Application
20070242898
An image processing apparatus according to an embodiment of the present invention will be explained. In the image processing apparatus, a feature quantity extracting device extracts data indicating feature quantity of an inputted image, and an identifying device identifies a new group of image quality parameters corresponding to the inputted image based on the data indicating the feature quantity, then a selecting device selects a group of image quality parameters. When a change judging device judges that a change of the group of image quality parameters is necessary owing to a change of the data indicating the feature quantity, the identifying device identifies a new image quality parameter from among the groups of image quality parameters received in a group of image quality parameters receiving device, the selecting device selects the identified group of image quality parameters, a parameter-replacing device gradually replaces values of the image quality parameter included in former selected group of image quality parameters with values of the image quality parameter included in the selected group of image quality parameters, and the parameter-replacing device makes an adjusting device use the replacing group of image quality parameters. Thus, the image quality is gradually changed so that in the moving image, when the image quality parameter is changed, a change of the image quality is small and a viewer hardly feels a sense of incompatibility.
The image processing apparatus may further include a memory device for memorizing the group of image quality parameters used by the adjusting device, the parameter-replacing device may gradually replace values of the image quality parameter included in the group of image quality parameters stored in the memory device with values of the image quality parameter included in the group of image quality parameters selected by the selected device, and the parameter-replacing device may make the adjusting device use the replacing group of image quality parameters. Thus, when a change to a new group of image quality parameters is required during replacing the values of the image quality parameter, the replacing image quality parameter can be replaced with the values of the new image quality parameter. Therefore, even if the number of the groups of image quality parameters previously received in the receiving device is small, various values of the image quality parameter can be used.
Further, the feature quantity extracting device may extract data indicating feature quantity at every one frame. Thus, in the moving image, a judging accuracy of necessity of changing the group of image quality parameters is improved.
Further, the data indicating the feature quantity extracted by the extracted device may be processed to a histogram. Thus, the necessity of changing the group of image quality parameters is judged easily based on the feature quantity of the image.
Further, the image quality parameter included in the group of image quality parameters may include at least one of brightness, sharpness, hue, and chroma. Thus, the image quality of the image can be adjusted more minutely.
Further, the image processing apparatus may further include a replacing time changing device for changing the replacing time when the replacing device replaces the values of the image quality parameter included in the employed group of image quality parameters. Thus, when a degree of change of the scene is large, the replacing time may be short, while the degree of change of the scene is small, the replacing time may be long. Thus, according to the image, the image quality is adjusted for preventing the viewer from feeling a sense of incompatibility.
Further, in the image processing method according to an embodiment of the present invention, the data indicating the feature quantity of the inputted image is extracted, and the group of image quality parameters corresponding to the inputted image is identified and selected based on the data indicating the feature quantity. When a change of the data indicating the feature quantity is detected and the necessity of changing the group of image quality parameters is occurred, the replacing device gradually replaces the values of the image quality parameter included in the old group of image quality parameters with the values of the image quality parameter included in the new group of image quality parameters, and the adjusting device adjusts the image quality using the replacing image quality parameter. Thus, the image quality of the image is gradually changed, so that in the moving image, when the image quality parameter is changed, the change of the image quality is small, and the viewer hardly feels the sense of incompatibility.
Further, in the image processing program according to the embodiment of the present invention, the feature quantity extracting device extracts the data indicating feature quantity of the inputted image. When the change judging device judges the change of the data indicating the feature quantity and the change of the group of the image quality parameters is required, the identifying device identifies the group of image quality parameters corresponding to the image, and the selecting device selects the group of image quality parameters from the receiving device. Then, a parameter-replacing device gradually replaces values of the image quality parameter included in former selected group of image quality parameters with values of the image quality parameter included in the selected group of image quality parameters, and the parameter-replacing device makes an adjusting device use the replacing group of image quality parameters. Thus, the image quality is gradually changed so that in the moving image, when the image quality parameter is changed, a change of the image quality is small and a viewer hardly feels a sense of incompatibility.
An image processing apparatus 1 according to a first embodiment of the present invention will be explained with reference to
The image processing unit 3 as the adjusting device includes a brightness processing part 3a, a sharpness processing part 3b, and a color processing part 3c. With respect to an RGB formatted signal inputted from the image input terminal 2, the image processing unit 3 adjusts corresponding to adjusting levels respectively prescribed by the brightness, the sharpness, and the color (hue and chroma) as an image quality parameter given by the later-described parameter mixing unit 8, and the adjusted image is outputted from the image output terminal 4.
The brightness processing part 3a adjusts the brightness of the image signal inputted from the image input terminal 2 depending on a brightness parameter given by the parameter mixing unit 8, and outputs to the sharpness processing part 3b. The sharpness processing part 3b adjusts the sharpness of the inputted image signal depending on a sharpness parameter given by the parameter mixing unit 8, and outputs to the color processing part 3c. The color processing part 3c adjusts the color (hue and chroma) of the inputted image signal depending on a look-up table of the color (hue and chroma) given by the parameter mixing unit 8, and outputs to the image output terminal 4.
The scene judging unit 5 as the feature quantity extracting device, the change judging device, and the identifying device generates a hue histogram based on the image signal inputted from the image input terminal 2. The scene judging unit 5 judges the necessity of change of the later-described parameter set based on the generated hue histogram. When the change of the parameter set is necessary, the scene judging unit 5 identifies the parameter set used by the image processing unit 3 depending on a matching of each parameter set. The scene judging unit 5 outputs a selecting instruction of the identified parameter set to the selector 7, and outputs a control signal for notifying the change to the parameter mixing unit 8.
A parameter set receiving unit 6 as the group of image quality parameters receiving device is composed of a nonvolatile memory, and previously receives parameter sets as a plurality of groups of image quality parameters used by the image processing unit 3. The received parameter sets are 5 parameter sets which are a parameter set for green image 6a, a parameter set for blue image 6b, a parameter set for red image 6c, a parameter set for flesh color image 6d, and a parameter set for standard image 6e. Further, a look-up table arranging the parameters of brightness, sharpness, hue, chroma is received in each parameter set. In each parameter set, an adjusting value of image quality parameter optimizes a specific color to be an optimized image quality so that the specific color is more vivid, or emphasized. For example, in the parameter set for blue image 6b, a value of the image quality parameter makes a blue based image vivid. Further, in the parameter set for standard image 6e, a moderate value of the image quality parameter, not biased to any specific color is set.
The selector 7 as the selecting device of groups of image quality parameters selects the parameter set identified by the scene judging unit 5 from a plurality of parameter sets received in the parameter set receiving unit 6, and outputs the selected parameter set to the parameter mixing unit 8.
The parameter mixing unit 8 as the parameter-replacing device replaces the parameter set stored in the parameter memory 9 with the parameter set inputted from the selector 7 based on the control signal notifying the parameter change from the scene judging unit 5.
The parameter memory 9 as the memory device memories the parameter set outputted from the parameter mixing unit 8, namely, used by the image processing unit 3, and is composed of a RAM (Random Access Memory).
Next, in the image processing apparatus 1 shown in
First, just after the image processing apparatus 1 is started up, the parameter set for standard image 6e is outputted from the selector 7 to the parameter mixing unit 8 as a default parameter set. The parameter mixing unit 8 outputs the parameter set for standard image 6e both to the image processing unit 3 and to the parameter memory 9. In the image processing unit 3, depending on each image quality parameter in the parameter set for standard image 6e outputted from the parameter mixing unit 8, the brightness processing part 3a, the sharpness processing part 3b, and the color processing part 3c adjust the image inputted from the image input terminal 2, and output the image to the image output terminal 4. The parameter memory 9 memories a content of the parameter set for standard image 6e.
Next, in the scene judging unit 5, a hue histogram is generated per frame with respect to the image inputted from the image input terminal 2. Then, it is analyzed which hue has a large frequency, and necessity of a change of parameter set is judged. When the change of parameter set is necessary, the parameter set to be changed is identified owing to a matching of each parameter set. Then, the selector 7 receives an instruction of the parameter set to be changed, and a signal is outputted to the parameter mixing unit 8 for notifying the change of the parameter. The selector 7 selects the parameter set received in the parameter set receiving unit 6 depending on the control signal from the scene judging unit 5, and outputs the parameter set to the parameter mixing unit 8.
When the change of the parameter set is notified using the signal from the scene judging unit 5, the parameter mixing unit 8 gradually replaces values of the image quality parameter included in the parameter set received in the parameter memory 9, namely, the parameter set currently used by the image processing unit 3 with values of the image quality parameter included in the newly selected parameter set outputted from the selector 7.
An example of replacing of parameter set will be explained with reference to
The replacing of the values of the parameter will be explained in detail. It is assumed that the parameter set for green image 6a is defined as equations 1 to 3, and the parameter set for standard image 6e is defined as equations 4 to 6. Inputs of functions of the equations 1 to 6 are components of RGB of a pixel at a predetermined coordinates (x, y) on a screen. Namely, the equation 1 is a function for obtaining R (red) component in the parameter set for green image 6a. The equation 2 is a function for obtaining G (green) component in the parameter set for green image 6a. The equation 3 is a function for obtaining B (blue) component in the parameter set for green image 6a. The equation 4 is a function for obtaining R (red) component in the parameter set for standard image 6e. The equation 5 is a function for obtaining G (green) component in the parameter set for standard image 6e. The equation 6 is a function for obtaining B (blue) component in the parameter set for standard image 6e. Incidentally, the function may be replaced with a look-up table describing output values corresponding to input values. The parameter set for green image 6a is a function to allow green color to be seen thicker and more vivid.
R(x,y)=Far(R(x,y),G(x,y),B(x,y)) equation 1
G(x,y)=Fag(R(x,y),G(x,y),B(x,y)) equation 2
B(x,y)=Fab(R(x,y),G(x,y),B(x,y)) equation 3
R(x,y)=Fer(R(x,y),G(x,y),B(x,y)) equation 4
G(x,y)=Fag(R(x,y),G(x,y),B(x,y)) equation 5
B(x,y)=Fab(R(x,y),G(x,y),B(x,y)) equation 6
In
R(x,y)=N*Far(R(x,y),G(x,y),B(x,y))+M*Fer(R(x,y),G(x,y),B(x,y)) equation 7
G(x,y)=N*Fag(R(x,y),G(x,y),B(x,y))+M*Feg(R(x,y),G(x,y),B(x,y)) equation 8
B(x,y)=N*Fab(R(x,y),G(x,y),B(x,y))+M*Feb(R(x,y),G(x,y),B(x,y)) equation 9
Here, N and M is a ratio for combining parameter set for green image 6a and parameter set for standard image 6e, and expressed as follows.
N+M=1 equation 10
Accordingly, the combination of the parameter set for green image 6a and the parameter set for standard image 6e is changed by changing the values of N and M. Further, other parameter except N and M may be used as a third parameter. Incidentally, a color of the image quality parameter has been explained. However, other parameters such as brightness and sharpness may be similarly used. Further, a combination of those is similarly used.
Further, “gradually replacing” means a replacement from the before-changed parameter set to the after-changed parameter set by gradually changing the ratio of N and M. For example, a combination of (N, M) is changed to (0, 1), (0.1, 0.9), (0.2, 0.8), (0.3, 0.7). The way to change N and M may be linear or non-linear. Further, a pitch of the changing value may be smaller. Further, when the value of the parameter is not controlled by a function, and amount of adjustment is directly instructed, the amount of adjustment may be gradually changed from the before-changed to the after-changed amount of adjustment. The parameter set while replacing is stored in the parameter memory 9 at any time.
At the point A in
The image processing unit 3 processes using the replacing parameter set whenever necessary. Therefore, the image outputted from the 4 reflects the replacing. Namely, the image quality of the output image is gradually changed.
According to this embodiment, the image processing apparatus 1 prepares a plurality of parameter sets 6a to 6e having a plurality of image quality parameters with respect to the image quality of the inputted value, and adjusts image quality by changing the parameter sets 6a to 6e depending on a judgement result of the scene judging unit 5. When changing from the currently used parameter set to a new parameter set, the image processing apparatus 1 gradually replaces the values of each parameter in the parameter set with values of the new parameter, and stores the new parameter in parameter memory 9. Further, when the parameter change is occurred while the parameter is replacing, the value of replacing parameter set stored in the parameter memory 9 is gradually replaced with the values of the next parameter set. Thus, a viewer hardly feels a sense of incompatibility, and because the values of the parameter is gradually changed and replaced, a larger number of values of parameter is realized with a smaller number of parameter sets.
Next, an image processing apparatus 50 according to a second embodiment of the present invention will be explained. Incidentally, parts identical to the first embodiment are assigned the same numbers and an explanation of their operation is therefore omitted here.
The first embodiment is composed of hardware, however, the second embodiment is a computer program.
A computer 50 of the image processing apparatus for operating the image processing program according to the second embodiment includes a CPU (Central Processing Unit) 51, a ROM (Read Only Memory) 52, a RAM 53, an image input terminal 54, and an image output terminal 55.
The computer 50 adjusts image quality of an RGB-format image inputted from the image input terminal 54 by running an image processing program stored in the ROM 52 with the CPU 51. The image quality adjusted image is outputted from the image output terminal 55. Similar to the first embodiment, the ROM 52 as the group of image quality parameters receiving member previously receives five parameter sets of the parameter set for green image 6a, the parameter set for blue image 6b, the parameter set for red image 6c, the parameter set for flesh color image 6d, and the parameter set for standard image 6e.
A parameter set selection operation according to the second embodiment will be explained with reference to the flowchart of
First, in step S1 as the feature quantity extracting device, when an image per one frame is inputted, a hue histogram with respect to the frame is generated and a process goes to step S2.
Next, in step S2 as the change judging device, the necessity of change of parameter set is judged according to the hue histogram generated in step S1. When the change is necessary (“Y” in S2), the process goes to step S3. When the change is not necessary (“N” in S2), the process goes to step S1.
Next, in step S3 as the identifying device, a parameter set to be changed is identified according to the matching with each parameter set stored in the ROM 52, and the process goes to step S4.
Next, in step 4 as the selecting device for selecting a group of image quality parameters, the parameter set identified in step S3 is selected from the ROM 52, and the process goes to readout step S5.
Next, in step S5, a parameter changing flag is on, and the process goes to step S1.
An image quality adjusting operation according to the second embodiment will be explained with reference to the flowchart of
First, in step S11 as the adjusting device, the image adjusting operation is started with the parameter set read out from the ROM 52, and the process goes to S12. Incidentally, similar to the first embodiment, the image quality parameter to be adjusted is brightness, sharpness, color (hue, chroma). Further, the adjusting operation is hereafter continued.
Next, in step S12 as the memory device, the currently image adjusting parameter set is started to be stored in the RAM 53, and the process goes to step S13. Incidentally, the storing operation is hereafter continued.
Next, in step S13, whether the parameter set changing flag is on or not is judged. When the flag is on (“Y” in S13), the process goes to step S14 and the flag is turned off. When the flag is off (“N” in S13), the judgement is done again.
Next, in step S14 as the parameter-replacing device, the replacement from the before-changed parameter set stored in the RAM 53 to the after-changed parameter set selected from the ROM 52 is started, and the process goes to step S15. Similar to the first embodiment, the parameter set is gradually replaced.
Next, in step S15, whether the parameter set changing flag is on or not is judged. When the flag is on (“Y” in S15), the process goes to S14, and the flag is turned off. When the flag is off (“N” in S15), the process goes to S16.
Next, in step S16, whether the replacement from the before-changed parameter set to the after-changed parameter set is finished or not is judged. When the replacement is finished (“Y” in S16), the process goes to step S13. When the replacement is not finished (“N” in S16), the process returns to S15.
According to the second embodiment, the hue histogram is generated in step S1, and the necessity of change of parameter set is judged in step S2. When the change is necessary, a new parameter set is identified and selected in steps S3 and S4. Then, in step S14, the parameter set is gradually replaced. Incidentally, because in steps S11 and S12, the image quality adjustment and the storing in the RAM 53 are started, the replacing parameter set is stored in the RAM 53 and used in the adjustment while replacing. Further, when the change of the parameter set is detected in step S15 while replacing, the replacement from the replacing parameter set to the new parameter set is done in step S14. Thus, similar to the first embodiment, a viewer hardly feels a sense of incompatibility. Further, because the values of the parameter is gradually changed and replaced, a larger number of values of parameter is realized with a smaller number of parameter sets. Further, because the adjustment is attained with software, an exclusive hardware is not necessary and flexibility of a system of the adjustment is increased.
Incidentally, in the second embodiment, parameter replacing time in the parameter mixing unit 8 is not defined. However, the replacing time may be fixed or variable. If the replacing time is variable, when a degree of change is large, for example, when changing the channel or turning to a commercial, the replacing time may be short. When the degree of change is small, for example the image moves slowly right to left, the replacing time may be long. Accordingly, a viewer further hardly feels a sense of incompatibility. In this case, the scene judging unit 5 detects the degree of change of the scene, and outputs to the parameter mixing unit 8 as a replacing time changing device, and the parameter mixing unit 8 changes the replacing time.
In the second embodiment, one parameter set is used for a whole display screen. However, as shown in
Further, in the second embodiment, the hue histogram is used for indicating the feature quantity. However, the present invention is not limited to this. Anything used for judging the feature quantity of the image can be used, for example, a histogram of chroma or brightness, distribution of space frequency component, noise amount included in the image, existence of characters, electric field intensity.
Further, in the second embodiment, the parameter set as a group of image quality parameters to be adjusted is brightness, sharpness, hue, and chroma. However, this invention is not limited to this. Parameter with regard to image quality or display of the image can be used, for example, intensity of noise reduction, change of IP (Interlace to Progressive) system, change of scaler factor.
Further, in the second embodiment, the hue histogram is generated per frame for indicating the feature quantity, and the change of parameter set is judged using the hue histogram. However, this invention is not limited to this. The judgement may be done per field or per a plurality of frames.
Further, this invention is not limited to the moving image. This invention can be used for discontinuous images, for example, a slide show in which a plurality of still images are displayed at prescribed intervals of time.
Further, the image processing apparatus of the present invention can be used for an apparatus being able to adjust image quality, such as a television, a monitor display, a television tuner, a DVD player/recorder, a DVD player/recorder with an HDD (Hard Disk Drive), a VCR (Video Cassette Recorder) or the like.
According to the embodiments described above, the image processing apparatus, the image processing method, and the image processing program as following are attained.
(Note 1)
An image processing apparatus 1 having an image processing unit 3 for adjusting image quality with predetermined brightness, sharpness, hue, chroma corresponding to inputted images, said apparatus 1 including:
a parameter set receiving unit 6 for receiving a plurality of parameter sets including brightness, sharpness, hue, chroma;
a scene judging unit 5 for extracting a hue histogram of the inputted image;
the scene judging unit 5 for judging necessity of change of parameter set used by the image processing unit 3 depending on the hue histogram;
the scene judging unit 5 for identifying a new parameter set from a plurality of parameter sets received in the parameter set receiving unit 6 when the scene judging unit 5 judges that changing the parameter set is necessary;
a selector 7 for selecting the parameter set identified by the scene judging unit 5 from the parameter set receiving unit 6; and
a parameter mixing unit 8 for gradually replacing values of brightness, sharpness, hue, chroma included in the before-changed parameter set with values of brightness, sharpness, hue, chroma included in the parameter set identified by the scene judging unit 5 and selected by the selector 7 when the scene judging unit 5 judges that change of parameter set is necessary, and for make the image processing unit 3 use the parameter set.
According to the image processing apparatus 1, because the image quality of the image is gradually changed, when brightness, sharpness, hue, or chroma changes in the moving image, the change of the image quality is small, and a viewer hardly feels a sense of incompatibility.
(Note 2)
An image processing method of adjusting image quality of an inputted image with previously stored brightness, sharpness, hue, and chroma, said method comprising the steps of:
extracting a hue histogram of the inputted image from the inputted image;
identifying and selecting a parameter set corresponding to the inputted image from among the parameter sets including brightness, sharpness, hue, and chroma for adjusting the inputted image based on the hue histogram; and
adjusting and replacing gradually values of brightness, sharpness, hue, chroma included in a before-changed parameter set with values of brightness, sharpness, hue, chroma included in an after-changed and selected brightness, sharpness, hue, chroma when changing the parameter set is necessary based on the hue histogram.
According to the image processing method, because the image quality of the image is gradually changed, when brightness, sharpness, hue, or chroma changes in the moving image, the change of the image quality is small, and a viewer hardly feels a sense of incompatibility.
(Note 3)
An image processing program for operating a computer of an image processing apparatus for adjusting image quality of an inputted image with previously stored brightness, sharpness, hue, and chroma, said program comprising:
step S11 for adjusting image quality of the inputted image with brightness, sharpness, hue, and chroma;
ROM 52 for receiving a plurality of parameter set including brightness, sharpness, hue, and chroma used in step S11;
step S1 for extracting a hue histogram of the inputted image from the inputted image;
step S2 for judging necessity of change of the parameter set used in step S11 based on the hue histogram;
step S3 for identifying a new parameter set from among the parameter sets stored in the ROM 52 when in step S2 changing the parameter set is judged necessary;
step S4 for selecting the parameter set identified in step S3 from the ROM 52; and
step S14 for gradually replacing values of brightness, sharpness, hue, chroma included in a before-changed parameter set with values of brightness, sharpness, hue, chroma included in the parameter set identified in step S3 and selected in step S4 when in step S2 changing the parameter set is judged necessary, said step S14 for making step 11 use the parameter set.
According to the image processing program, because the image quality of the image is gradually changed, when brightness, sharpness, hue, or chroma changes in the moving image, the change of the image quality is small, and a viewer hardly feels a sense of incompatibility.
Although the present invention has been fully described by way of example with reference to the accompanying drawings, it is to be understood that various changes and modifications will be apparent to those skilled in the art. Therefore, unless otherwise such changes and modifications depart from the scope of the present invention hereinafter defined, they should be construed as being included therein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006-114562 | Apr 2006 | JP | national |
