1. Field of the Invention
The present invention relates to an image processing method, an image processing system, an image processing apparatus and an image processing program for performing various image processing while reproducing and displaying digital images according to initial image data (CCD-RAW image data) sent from an image taking apparatus such as a digital camera.
2. Background Arts
To improve image quality of digital images, it is effective to correct images by adjusting parameters (correction parameters) of color balance, white balance, and tone curve of the digital images by using an information processing terminal such as a personal computer (PC). For instance, when the image is taken by a digital camera, the image data is sent from the digital camera to the PC. An operator can obtain intended images by image verification, in which various correction parameters are changed, while observing the images displayed in a monitor of the PC.
It is also possible to perform the image correction in the PC so as not to lose color informations in the digital camera by the use of a digital camera, which allows to output initial image data (RAW data) to the PC without the white balance correction and exposure compensation.
The initial image data is direct output from an image pickup device of the digital camera and cannot be displayed in the monitor without processing. To display the images in the monitor of the PC, it is necessary to perform the image correction to the initial image data according to parameters (hereinafter referred to as correction parameters) for the white balance and the exposure, and convert the initial image data into display image data (hereinafter referred to as development) of Tiff (Tagged Image File Format), for instance. However, data size of the initial image data is significantly large, since the initial image data is formed of pixel data, for instance, with 12 bits or 16 bits per color. Therefore, the development of the initial image data takes a long time. As a result, there arises a problem that the image verification takes a long time when the data size of the initial image data is large, since the development of the initial image data is repeated every time various development parameters are changed. Further, a load in the CPU becomes significantly high during the development. Therefore, other processing is stopped at the time the development is repeated by changing various development parameters.
In the conventional image verification, the operator selects each target image to be verified, and development parameters are changed for each target image. Therefore, it is concerned that it takes a long time when the image verification is performed to initial image data which has a large data size. Above all, to the images taken in the approximately same environment, for instance, in a studio, the development parameters will be the same. Nevertheless, it is inefficient to perform the image verification to each image.
Further, parameters for image adjustment, such as color correction and trimming, can be corrected concurrently with the above development parameters. In the conventional image verification, the image adjustment is performed to the initial image data every time the parameters for the image adjustment are changed along with the above development. Therefore, the image verification takes a long time.
Furthermore, the digital camera outputs the reduced image data, which is compressed in JPEG format, along with the initial image data. The reduced image data is displayed in a list during the image verification. However, colors of the image in JPEG format are often different from those of the display image, since the image in JPEG format is different from the display image in color space and the number of bits. As a result, the operator may recognize the colors different to the actual image when observing the reduced image during the image verification.
An object of the present invention is to provide an image processing method, an image processing system, an image processing apparatus and image processing program for reducing time for image verification when various image correction is performed to initial image data.
The above and other objects of the present invention are achieved by generating a simplified initial image data by thinning out initial image data at a predetermined rate, and performing image correction to the simplified initial image data using a first correction parameter.
A reproducible and displayable simplified display image is generated from the corrected simplified initial image data. The first parameter is changeable by reproducing and displaying the simplified display image. The image correction is performed to the initial image data according to a determined first correction parameter and the display image data is generated.
Every time the first correction parameter is changed, the image correction is performed to the simplified initial image data according to the changed first correction parameter. Further, the simplified display image generated from the corrected simplified initial image data is reproduced and displayed.
After the first correction parameter is determined, it is also possible to perform the image correction to the reproduced and displayed simplified display image according to a second correction parameter, and the image correction is performed to the display image data according to a determined second correction parameter.
Every time the second correction parameter is changed, the image correction is performed to the simplified display image data according to the changed second correction parameter and the corrected simplified display image is reproduced and displayed.
Further, it is possible to change the first correction parameter with respect to initial image data corresponding to a first frame of the image, and the image correction can be performed to the initial image data corresponding to a second frame and on according to the determined first parameter.
It is also possible to change the first correction parameter with respect to the initial image data corresponding to one of plural images obtained by plural shooting, and the image correction is performed to the initial image data corresponding to the other selected frames according to the determined first correction parameter.
In the image processing method according to the present invention, one of a first processing mode and a second processing mode is selectable. The first processing mode enables to change the first correction parameter with respect to the initial image data corresponding to the first frame of the image, and the image correction is performed to the initial image data corresponding to a second and above frames. The second processing mode enables to change the first correction parameter with respect to the initial image data corresponding to one of the plural images obtained by the plural shootings, and the image correction is performed to the initial image data corresponding to other selected images according to the determined first correction parameter.
Further, reduced images corresponding to the initial image data are reproduced and displayed, and reduced images corresponding to the initial image data, which have not yet been subjected to the image correction, are displayed in black-and-white. Therefore, it is possible to prevent the operator from having incorrect color recognition in observing the reduced images which differ in color space and display colors.
The image processing system according to the present invention is constituted of an image shooting apparatus and an image processing apparatus, and includes a data thinning section, which is disposed in one of the image shooting apparatus and the image processing apparatus, for generating simplified initial image data by thinning out the initial image data at a predetermined rate.
An image processing apparatus according to the present invention includes a data thinning section, which generates the simplified initial image data by thinning out the initial image data at a predetermined rate, an image correction section, which performs the image correction to the simplified initial image data according to the first correction parameter and generates a reproducible and displayable simplified display image from the corrected simplified initial image data, and a reproduction and display section which makes the first correction parameter changeable by reproducing and displaying the simplified display image. The image correction section generates the display image data by performing the image correction to the initial image data according to the determined first correction parameter.
According to the present invention, the first correction parameter to the development is adjusted using the simplified initial image data, which is generated by thinning out the initial image data at a predetermined rate, with a small data size. Therefore, the time for the image processing is reduced. Further, it is not necessary to develop the initial image data in the image adjustments, so that the time for image processing is efficiently reduced.
The above objects and advantages of the present invention will become apparent from the following detailed descriptions of the preferred embodiments when read in association with the accompanying drawings, which are given by way of illustration only and thus do not limit the present invention. In the drawings, the same reference numerals designate like or corresponding parts throughout the several views, and wherein:
In
Each section of the digital camera 10 is interconnected via a data bus 12, and CPU 13 controls overall operation of the digital camera 10. A program for operating the digital camera 10 is recorded in ROM 14, and is loaded in RAM 15 when the digital camera 10 is turned on. An image pickup section 16 includes known taking lens, CCD and the like, and photoelectrically converts an optical image of a subject into a digital image data. Camera settings, such as an aperture and a shutter speed, can be set by operating various set-up buttons provided in an operating section 17. It is also possible to determine the camera settings by the PC 30 for the image verification, and transmit camera setting data to the digital camera 10 via the communication cable 11. Further, an additional PC may be connected to the digital camera 10 for controlling shooting.
Image data, which is output from the image pickup section 16, is buffered in the RAM 15. The image data is initial image data (CCD-RAW data), which has not been subjected to image correction such as white-balance processing, and constituted of a plurality of pixel data with gradation value of 12 bits or 16 bits per color. An image processing circuit 18 reduces the gradation value of the initial image data to 8 bits per color, and applies the image correction, such as white-balance processing and gradation conversion, to the image data according to predetermined conditions, which depends on a digital camera model, and outputs corrected image data.
A compression/decompression processing circuit 19 compresses the corrected image data according to a JPEG (Joint Photographic Coding Expert Group) format, and outputs compressed image data. Further, the compression/decompression processing circuit 19 generates JPEG image data (reduced image data) of, for instance, 1280×960 pixels by thinning operations of the corrected image data.
The initial image data is transmitted to the PC 30 for the image verification via an input and output I/F 22 along with the reduced image data. An LCD 23 continuously displays subject images in a shooting mode, and reproduces and displays images stored in a recording media 21 in a reproduction mode. In the embodiment, the initial image data is directly transmitted to the PC 30 for the image verification via the input and output I/F 22. However, it is also possible to transmit the initial image data to the PC 30 for the image verification by recording the initial image data in the recording media 21 and setting the recording media 21 in the PC 30 for the image verification.
The PC 30 for the image verification reproduces and displays an image on a monitor 31 according to the initial image data transmitted from the digital camera 10, and performs various image corrections to the displayed image in response to operation signals sent from input devices such as a keyboard 32 and a mouse 33. Each section of the PC 30 for the image verification is interconnected via a data bus 34, and CPU 36 controls overall operation of the PC 30 for the image verification. The initial image data transmitted from the digital camera 10 is recorded in an external memory device 38, such as a hard disk, via an input and output I/F 37 and the data bus 34. The input devices, such as the keyboard 32 and the mouse 33, are operated to perform the image correction, which will be described later, and to set the camera settings of the digital camera 10.
An image processing program is installed in the external memory device 38 of the PC 30 for the image verification via memory media such as a CD-ROM, a DVD-ROM and the like, or the Internet. When the image processing program is executed by operating the keyboard 32 and the mouse 33, the image processing program is loaded in the RAM 39 and executed.
When the image processing program is executed, a verification screen 50 is displayed in the monitor 31 (see
In the reduced image display area 53, plural reduced images 60-63 are displayed in a row. Each of the reduced images 60-63 is reproduced and displayed according to corresponding reduced image data in JPEG format. In an example shown in
Among the plural reduced images 60-63 displayed in the reduced image display area 53, the reduced images, which have not yet been subjected to the image verification (the reduced images 62 and 63 on the right side in
In the parameter adjustment area 54, two types of screens are provided, one is for development condition adjustment, in which parameters for development (development parameters) are changed, and the other is for image adjustment, in which parameters for image adjustment (adjustment parameters) are changed, and the screen is switched by a changeover tab 70 displayed in an upper portion of the parameter adjustment area 54. When a tab for the development condition adjustment is selected, a development condition adjustment screen 71 is displayed as shown in
When the tab for the image adjustment is selected, an image adjustment screen 80 is displayed as shown in
The development parameters are not limited to those for the tone curve and the white balance as shown in
Steps of the image verification is described by using a flowchart in
According to the reduced image data, the loaded data is displayed in a list form in the reduced image display area 53 of the PC 30 for the image verification. The reduced images are displayed in black-and-white except for the reduced image, which has already been verified or excluded from the image verification, so as to prevent the incorrect color recognition of the operator during observation of the reduced image.
Then, simplified initial image data is generated by thinning out the corresponding initial image data of the image frame, which is selected by the operator, in a predetermined proportion (S4). The temporary development is applied to the simplified initial image data by using the initial development parameters (S5). The simplified display image, which is generated in the temporary development, is displayed as the target image 51 in the target image display area 52 (S6).
The operator observes the target image 51 and changes the development parameters, such as the tone curve and the color temperature (S7). When the development parameters are changed, the temporary development is performed to the simplified initial image data, so that the target image 51 is updated and displayed. That is, the steps S4 and S5 in
After determining the development parameters, the simplified display image is displayed as the target image 51 in the verification screen 50 after being subjected to temporary development, and being corrected of the color balance, the contrast and the trimming by using the initial adjustment parameters (S9). The operator observes the verification screen 51 and changes the adjustment parameters (S10). When the adjustment parameters are changed, the image adjustments (the temporary adjustments), such as the color adjustment and the trimming, are performed to the simplified display image according to the simplified initial image data, and the target image 51 is updated and displayed.
In the above image adjustments, the simplified initial image data with smaller data size is used, so that time for updating and displaying the image can be reduced. Further, the development is not performed when changing the adjustment parameters, so that the time for updating and displaying the image can be reduced. The temporary adjustments are repeated, and when the operator obtains the intended result, the image adjustments are completed and the adjustment parameters are determined (S11).
Simultaneously with changing the adjustment parameters, the development of the initial image data is performed according to the determined development parameters in the background (S12), and the display image data is generated (S13). The time for the image verification is reduced, since the development of the initial image data is not necessary after the image adjustments. After the image adjustments, the image adjustments (actual adjustments), such as the color adjustments and the trimming, are performed to the display image data according to the determined adjustment parameters (S14). The display image data obtained by the actual adjustments is output as the verified image data.
In the above embodiment, the image verification is performed to each frame of the image data. However, it is possible to perform the above image verification to the plural frames. When shooting plural frames in a similar composition and similar shooting environment, the development parameters and the adjustment parameters for obtaining the excellent finished quality of the images as the operator intended remain approximately constant. Consequently, the time for the image verification is further reduced by omitting the steps of the temporary development and the temporary adjustments.
For instance, as shown in
As shown in a time chart of
Then, operator selects the image fames to be subjected to the image correction in the same conditions as the first frame. For instance, when the second and the third image frames are grouped, the development and the image adjustments are applied to the second and the third frames of the initial image data by using the development parameters and the adjustment parameters which are determined at the time of the image verification for the first frame. It is also possible to perform only the development to the initial image data and that the operator can determine the adjustment parameters after repeating the image adjustments.
From the second frame and on, it is possible to shoot next image during the development and the image adjustments. Then, a sixth to a twelfth frames of the image, for instance, are taken and the initial image data are output to the PC 30 for the image verification. The PC 30 for the image verification thins out the initial image data of the sixth frame to generate the simplified initial image data. The operator performs the image verification to the sixth frame in the same manner as the first frame. After the image verification, the operator selects the image frame to be corrected in the same conditions as the sixth frame. For instance, when a seventh to a tenth frames of the images are grouped, the initial image data of the seventh to the tenth frames are subjected to the development and the image adjustments by using the development parameters and the adjustment parameters determined at the image verification of the sixth frame. It is also possible to apply only the development to the initial image data and that the operator determines the adjustment parameters by repeating the image adjustments.
It is also possible to provide modes for performing the image processing in respective sequences shown in
In the above embodiment, the simplified initial image data is generated in the PC 30 for the image verification. However, it is also possible to generate the simplified initial image data in the digital camera 10 by thinning out the initial image data and outputting the simplified initial image data to the PC 30 for the image verification along with the initial image data.
Further, in the above embodiment, the development and the image adjustments are carried out in the PC 30 for the image verification. However, the development and the image adjustments can be carried out in a different terminal. Using the different terminal for the development prevents reduction in processing capacity of the PC 30 for the image verification during the image adjustments.
Although the present invention has been described with respect to the preferred embodiment, the present invention is not to be limited to the above embodiment but, on the contrary, various modifications will be possible to those skilled in the art without departing from the scope of claims appended hereto.
Number | Date | Country | Kind |
---|---|---|---|
2004-048941 | Feb 2004 | JP | national |