Method and apparatus for image conversion

Abstract

An image feature analyzing section performs an image feature analysis with respect to an input image to output an image feature vector. A parameter output section stores a plurality of image feature vectors and a plurality of parameters corresponding to the respective image feature vectors and outputs an original parameter value corresponding to an image feature vector. A parameter operation setting section determines contents of an operation of an illumination equation parameter, depending on a prescribed image conversion. A parameter operating section operates the original parameter value in accordance with a prescription of the parameter operation setting section, to obtain a new parameter value. An image generating section generates an output image based on the new parameter value.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an image converting apparatus according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining geometric conditions and optical conditions for an illumination equation.

FIG. 3 is a flowchart illustrating the image converting method of the first embodiment of the present invention.

FIG. 4 is a diagram illustrating an image feature analysis employing wavelet transformation.

FIG. 5 is a diagram illustrating an exemplary parameter operation for an image conversion.

FIG. 6 is a diagram illustrating an exemplary edge portion caused by overlapping of two objects.

FIGS. 7A and 7B are diagrams illustrating occurrence of an error in a specular reflection component due to material incorporation, and an exemplary method for canceling the error.

FIGS. 8A and 8B are diagrams illustrating occurrence of an error in a specular reflection component due to material incorporation, and an exemplary method for canceling the error.

FIG. 9 is a diagram illustrating an exemplary method for interpolating surface normal vectors for double enlargement.

FIG. 10 is a diagram illustrating an exemplary method for generalizing expression (2) with respect to an image enlargement ratio.

FIG. 11 is a diagram illustrating an exemplary method for generalizing expression (2) with respect to an image enlargement ratio.

FIG. 12 is a diagram illustrating a second exemplary parameter operation for performing an image conversion.

FIG. 13 is a diagram illustrating a relationship between a location of illumination and an illumination vector.

FIG. 14 is a diagram illustrating a third exemplary parameter operation for performing an image conversion where a diffuse reflection component proportion of a specific material is converted.

FIG. 15 is a diagram illustrating an interface for adjustment of a diffuse reflection component proportion, possessed by an image conversion prescribing section 105.

FIG. 16 is a diagram illustrating a fourth exemplary parameter operation for performing an image conversion where a material of a specific pixel is converted.

FIG. 17 is a diagram illustrating material change interface possessed by the image conversion prescribing section 105.

FIG. 18 is a diagram illustrating a fifth exemplary parameter operation for performing an image conversion where image reduction is performed.

FIG. 19 is a diagram illustrating a method for learning a relationship between image features and illumination equation parameters.

FIG. 20 is a diagram for explaining geometric conditions and optical conditions for an illumination equation.

FIG. 21 is a diagram illustrating another method for obtaining a parameter corresponding to an image feature.

FIG. 22 is a diagram illustrating a first exemplary configuration which implements the present invention, where a personal computer is used.

FIG. 23 is a diagram illustrating a second exemplary configuration which implements the present invention, where a server-client system is used.

FIG. 24 is a diagram illustrating a third exemplary configuration which implements the present invention, where a mobile telephone with camera and a television are used.

Claims

1. A method for converting a first image into a second image, comprising: a first step of performing an image feature analysis with respect to the first image;a second step of referencing a relationship between image features and illumination equation parameters which are associated with each other by a preprocess, and from an image feature of the first image obtained in the first step, obtaining a value of an illumination equation parameter corresponding to the image feature, as an original parameter value;a third step of determining contents of an operation of an illumination equation parameter, depending on a prescribed image conversion;a fourth step of operating the original parameter value in accordance with the operation contents determined in the third step, to obtain a new parameter value; anda fifth step of generating the second image based on the new parameter value,wherein the preprocess comprises the steps of: setting a first parameter value as a value of an illumination equation parameter;generating a learning image from the first parameter value; andperforming an image feature analysis substantially equivalent to the first step, with respect to the learning image, andthe obtained image feature is saved in association with the first parameter value into a database.

2. The method of claim 1, wherein the image feature analysis in the first step is performed using a spatial frequency analysis.

3. The method of claim 1, wherein the first parameter value is set, assuming an illumination equation parameter when the first image is captured.

4. The method of claim 1, wherein the illumination equation represents a luminance in a viewpoint direction by an addition of a diffuse reflection component, a specular reflection component, and an ambient light component.

5. The method of claim 1, wherein the illumination equation parameter includes at least one of a surface normal vector, an illumination vector, a ratio of a diffuse reflection component to a specular reflection component, a reflectance of a diffuse reflection component, and a reflectance of a specular reflection component.

6. The method of claim 1, wherein the third step, when the prescribed image conversion is image enlargement, determines, as the contents of an operation of an illumination equation parameter, to increase a density of at least one of a surface normal vector, an illumination vector, a ratio of a diffuse reflection component to a specular reflection component, a reflectance of a diffuse reflection component, and a reflectance of a specular reflection component.

7. The method of claim 1, wherein the relationship between image features and illumination equation parameters is represented by a plurality of image feature vectors and a plurality of parameter values associated with the respective image feature vectors, and the second step comprises the steps of: selecting a predetermined number of image feature vectors similar to a first image feature vector representing the image feature of the first image, from the plurality of image feature vectors;obtaining a distance between the first image feature vector and each of the predetermined number of image feature vectors; andperforming a weighted addition of parameter values corresponding to the predetermined number of image feature vectors, respectively, depending on the distances obtained with respect to the respective image feature vectors, to calculate the original parameter value.

8. An image converting method comprising: an image feature analyzing section for performing an image feature analysis with respect to an input image to output a first image feature vector representing an image feature of the input image;a parameter output section for referencing an image feature vector database storing a plurality of image feature vectors and an illumination equation parameter database storing a plurality of parameters, the databases being associated with each other by a preprocess, and when receiving the first image feature vector, outputting an original parameter value corresponding to the first image feature vector;a parameter operation setting section for determining contents of an operation of an illumination equation parameter, depending on a prescribed image conversion;a parameter operating section for operating the original parameter value output from the parameter output section in accordance with the operation contents determined by the parameter operation setting section, to obtain a new parameter value; andan image generating section for generating an output image based on the new parameter value output from the parameter operating section,wherein the image converting apparatus performs, as the preprocess: setting a first parameter value as a value of an illumination equation parameter;generating a learning image from the first parameter value;performing an image feature analysis substantially equivalent to the image feature analyzing section, with respect to the learning image; andsaving the obtained image feature in association with the first parameter value into the image feature vector database and the illumination equation parameter database, respectively.