Patent Application
20060007323
1. Field of the Invention
The present invention relates to an imaging signal processing circuit for processing a digital imaging signal obtained in a read operation with respect to a solid imaging element by means of the interlace method. The present invention further relates to a camera system.
2. Description of the Related Art
In recent years, a focus has been importantly placed on achieving a higher processing speed and increasing number of recorded contents in the technical field relating to a camera system.
In a camera system of a related technology shown in
The camera system of the related technology has the following problems: the external memory having a large capacity is required for temporarily memorizing the color-converted image data; the external memory is frequently accessed; a two-pass method, in which the encoding-amount-estimate compression processing is previously executed so as to obtain the compression rate in the compression/expansion processing unit and the image data is thereafter read from the external memory and compressed, has to be employed; and the image data outputted from the compression/expansion processing unit is written in the external memory, and the image data on the external memory is read based on the CPU control and recorded on the recording medium via the image data recording unit. Due to the foregoing problems, it is difficult to attain a high-speed processing.
1) A first imaging signal processing circuit according to the present invention comprises:
a color signal processing unit for inputting a digital imaging signal obtained by vertically reading a signal from a solid imaging element by means of N-field interlace method and further digital-converting the signal and executing a color conversion processing for converting the digital imaging signal into a luminance signal and a color difference signal;
a compression/expansion processing unit for executing a compression processing for estimating an encoding amount and thereby previously obtaining a compression rate using the color-converted digital imaging signal, the compression/expansion processing unit further compressing the digital imaging signals up to a field in N fields at which fetch of the digital imaging signal is completed before fetch of the digital imaging signal in a Nth field is completed based on the obtained compression rate and generating compressed image data;
an image data recording unit for transferring and recording the generated compressed image data with respect to a recording medium; and
a CPU (Central Processing Unit) for operating in accordance with a program stored in a program memory and controlling the color signal processing unit, the compression/expansion processing unit and the image data recording unit. In the foregoing constitution, “N” of the N fields is a natural number of at least two.
According to the foregoing constitution, because the compression rate is previously obtained in the encoding-amount-estimate compression processing, a sequence, in which the compression process is executed at same time as the execution of the color conversion processing and enlargement/reduction processing and the compressed image data is directly inputted to the recording medium without the intervention of the external memory, is realized. In other words, a one-pass method is realized, which leads to downsizing of the external memory as a work region in each processing and cost reduction. Further, number of accesses made to the external memory can be reduced, and a higher speed can be thereby realized.
The encoding-amount-estimate compression processing for obtaining the compression rate is preferably executed to the digital imaging signals comprised of entire vertical pixels or a part of the entire vertical pixels and entire horizontal pixels up to the fetch-completed field.
In the foregoing constitution, a horizontal pixel addition processing unit for horizontally adding/mixing the digital imaging signal fetched from the solid imaging element may be further provided in a previous stage of the color signal processing unit.
Accordingly, in the horizontal pixel addition processing unit, an aspect ratio of an estimated image in the horizontal and vertical directions can be adjusted to an aspect ratio of the picked-up image in the compression processing for estimating the encoding amount, an error possibly generated in the estimated encoding amount due to different frequency characteristics in the horizontal and vertical directions can be lessened.
Further, in the foregoing constitution, the CPU may determine an encoding amount adjustment parameter in accordance with image quality information inputted from outside.
In the foregoing constitution, the CPU determines a desired encoding amount in accordance with the image quality information using a predetermined algorithm and determines the encoding amount adjustment parameter based on a calculation implemented using the encoding amount in the encoding-amount-estimate compression processing executed before the fetch of the digital imaging signal in the Nth field is completed and the desired encoding amount.
According to the foregoing constitution, the image quality information such as the number of recorded pixels, image file size, or image quality mode (high image quality, ordinary image quality, low image quality or the like) is set by a user, and the compressed image data corresponding to the set image quality information can be thereby generated.
Further, in the foregoing constitution, the CPU may compare an encoding amount in compressing a body image using the determined encoding amount adjustment parameter to the desired encoding amount to thereby correct the predetermined algorithm in accordance with a magnitude correlation therebetween.
According to the foregoing constitution, the algorithm is corrected in each image shooting. Thereby, the encoding amount can be more accurately estimated as the number of the taken images is increased so as to obtain the desired encoding amount at the time of recording.
The present invention can be developed as a camera system as follows.
A camera system according to the present invention comprises:
a solid imaging element for converting a light received via a photographing lens into an electrical signal and outputting the electrical signal as an imaging signal;
an analog/digital converting circuit for digital-converting the imaging signal into a digital imaging signal; and
any of the before-mentioned imaging signal processing circuits.
Additional objects and advantages of the present invention will be apparent from the following detailed description of a preferred embodiment thereof, which are best understood with reference to the accompanying drawings.
Hereinafter, a preferred embodiment of an imaging signal processing circuit according to the present invention is described in detail referring to the drawings.
The imaging signal processing circuit 100 is formed from LSI, and comprises a horizontal pixel addition processing unit 21, a color signal processing unit 22, an image data compression/expansion processing unit 23, an image data recording unit 24, a display/output unit 25 and a CPU 26.
The color signal processing unit 22 converts a digital imaging signal into a luminance signal and a color difference signal, and executes a color conversion processing for enlarging/reducing the signals to an optional size. The compression/expansion processing unit 23 executes a compression processing for estimating an encoding amount and thereby previously obtaining a compression rate employed in compressing image data using the color-converted digital imaging signal, and executes a body image compression processing using the obtained compression rate. The data processing unit 24 executes a medium transfer processing for transferring the compressed image data to the medium. The display/output unit 25 executes a display/output processing for outputting the image data to an external device. The color signal processing unit 22, compression/expansion processing unit 23, image data recording unit 24 and display/output unit 25 are controlled by the CPU 26. The horizontal pixel addition processing unit 21 is a circuit for vertically thinning pixels by 1/N (N≧2) and horizontally adding/mixing entire horizontal pixels to N pixels. The horizontal pixel addition processing unit 21 is not an indispensable component to be provided.
The program memory 33 stores therein a program for operating the camera system. The CPU 26 reads the program from the program memory 33 and executes it. It is possible for the CPU 26 to rewrite contents of the program memory 33.
The image quality selecting device 34 is a mechanism to be selected by a user using a switch or a menu, wherein the user selects number of pixels to be recorded, image file size, or image quality mode (high image quality, ordinary image quality, low image quality or the like), and the selected image quality information is transmitted to the CPU 26.
Next, an operation of the camera system according to the present embodiment having the foregoing constitution is described.
An image of a photographic subject transmits through the photographic lens 11, is focused on the solid imaging element 12, and photo-electrically converted based on a drive timing of the solid imaging element drive unit 13 to be thereby outputted as an analog signal. Next, the analog signal is amplified and subjected to a noise removal and the like by the analog signal processing unit 14 and converted into a digital imaging signal by the analog/digital converting unit 15.
The imaging signal processing circuit 100, to which the image signal converted into the digital imaging signal by the analog/digital converting unit 15 is inputted, uses the external memory 31 as a work region, and converts the inputted digital imaging signal into image data (encoded data). Below is described in detail an operation of the imaging signal processing circuit 100.
The digital imaging signal transmits through the horizontal pixel addition processing unit 21 and is inputted to the color signal processing unit 22. Then, the digital imaging signal is subjected to the color conversion processing by the color signal processing unit 22 so that the image signals, which are the luminance signal and the color difference signal, are generated. The generated image signals are enlarged or reduced if necessary. The color conversion processing is necessary for displaying the image data on the external device such as a monitor and compressing the image data as recording data. The color-converted digital imaging signal is transmitted to the display/output unit 25 and the compression/expansion processing unit 23. The image signal is compressed by means of the JPEG by the compression/expansion processing unit 23 and outputted as the compressed image data. If necessary, the compressed image data is expanded. The compressed image data is recorded on the recording medium 32 by the image data recording unit 24. The image data outputted from the color signal processing unit 22 is displayed/outputted by the display output unit 25.
In the three-field fetching method, the imaging signal from the solid imaging elements is outputted per 3n lines. An imaging signal 1a is fetched in the order of a first field 1b, a second field 1c and a third field 1d. First, the digital imaging signal of the first field is fetched into the external memory 31.
In the case of providing the horizontal pixel addition processing unit 21, horizontally added/mixed field data and/or non-added/non-mixed field data are fetched.
Next, in parallel with fetch of the second field data into the external memory 31, the first field data is read from the external memory 31 and subjected to the color conversion processing by the color signal processing unit 22. To be brief, the image signals, which are the luminance signal and the color difference signal, are generated.
Next, the generated luminance signal and color difference signal are inputted to the compression/expansion processing unit 23 to be compressed therein so that the compression processing for estimating the encoding amount and thereby obtaining the compression rate is executed. The compression processing for estimating the encoding amount and thereby obtaining the compression rate refers to an image data compressing processing previously executed in order to obtain the compression rate used in compressing the image data. The compression processing for estimating the encoding amount and thereby obtaining the compression rate is necessary for compressing the image data to a certain size or an optional size, wherein a processing for obtaining the compression rate required for compressing the image data is executed using the processing result.
Further, a thumb nail color conversion processing is executed using the first field data read from the external memory 31, and the imaging signal is converted into the luminance signal and the color difference signal and converted into a size of vertical 16 pixels and horizontal 120 pixels, which is a thumb nail size. The thumb nail color conversion processing is necessary for the data recording conforming to standards such as DCF (Design Rule for Camera File System) and DPOF (Digital Print Order Format), and the processing result is used to compress the thumb nail image data and display/output the thumb nail image.
Based on the generation of the thumb nail image data, the pixels are digitally thinned in the horizontal direction, an angle of view is adjusted by means of the addition/mixing processing and the like, and the thumb nail-use luminance signal and color difference signal are generated. In the case of providing the horizontal pixel addition processing unit 21, it becomes unnecessary to digitally adjust the angel of view because the pixels are already added/mixed in the horizontal direction and the angel of view is already adjusted.
Next, the thumb nail-use luminance signal and color difference signal are inputted to the compression/expansion processing unit 23 to be compressed therein, and the thumb nail image is data-compressed. The thumb nail image data compression is necessary for the data recording conforming to the standards such as the DCF and DPOF. The processing result is used to execute the transfer process with respect to the recording medium. The generated thumb nail image data is transferred to the recording medium 32.
Next, in parallel with fetch of the third field data, the first field data and/or the second field data corresponding to the vertical direction are read from the external memory 31. Thereby, the continuous digital imaging signals are serially accomplished. Each of the accomplished serial digital imaging signals is subjected to a body color signal processing executed by the color signal processing unit 22. To be brief, the image signals, which are the luminance signal and the color difference signal, are generated.
Next, a part or all of the foregoing continuous imaging signals are inputted to the compression/expansion processing unit 23 to be compressed therein so that the body image is compressed. The compressed image data of the compressed body image is recorded on the recording medium 32 via the image data recording unit 24 based on the CPU control.
In the present embodiment, the compression rate is already determined in the compression processing for estimating the encoding amount and thereby obtaining the compression rate, which is previously executed. Therefore, it becomes unnecessary to return the color-converted digital imaging signal to the external memory 31 in order to execute the encoding-amount-estimate compressing processing as in the related technology so that the body image can be compressed. Thereby, the number of the bus accesses with respect to the external memory 31 can be lessened, and power consumption can be favorably reduced. Further, a processing speed can be improved because the compression processing for estimating the encoding amount and thereby obtaining the compression rate is already completed. Further, it is possible to rewrite a code header data on the recording medium 32 by the CPU 26.
In the present embodiment, the thumb nail image data can be previously generated because the thumb nail color conversion processing and the thumb nail image data compression processing are previously executed. As a result, for example, when the image data conforming to the standards such as the DCF and DPOF is generated, the compressed body data can be directly transferred to the recording medium 32 without returning to the external memory 31 because the thumb nail image data is already generated at that time. Thereby, the number of the accesses with respect to the external memory bus can be lessened, and the processing speed can be increased.
The sequence in which the compression processing for estimating the encoding amount and thereby obtaining the compression rate, the thumb nail image data compression processing and the like was described using the first field data fetched into the external memory 31. However, as shown in
In the case of providing the horizontal pixel addition processing unit, it is not necessary to use the mixed pixels in order to execute the thumb nail color conversion processing, thumb nail image data compression processing, body color conversion processing and compression processing for estimating the encoding amount and thereby obtaining the compression rate. The mixed pixels and non-mixed pixels may be appropriately selected.
According to the present embodiment, the thumb nail color conversion processing and the thumb nail image data compression processing are previously executed so that the image data can be written in the recording medium without returning to the external memory. Thereby, the number of the accesses with respect to the external memory can be reduced. Further, the external memory as the work region in each processing can be downsized, favorably resulting in a cost reduction.
Because the compression rate is previously obtained in the encoding-amount-estimate compression processing, the sequence, in which the compression processing is executed at the same time as the color conversion processing and the enlargement/reduction processing, and the image data is directly inputted to the recoding medium without the intervention of the external memory, can be realized. More specifically, the one-pass method can be realized, the external memory as the work region in each processing can be downsized, and the cost reduction can be realized. Further, the number of the accesses with respect to the external memory can be reduced thereby attaining a higher speed.
Further, in the horizontal pixel addition processing unit, an aspect ratio of the estimated image in the horizontal and vertical directions can be adjusted to an aspect ratio of the picked-up image in the encoding-amount-estimate compression processing. Thereby, an error possibly generated in the estimated encoding amount due to different frequency characteristics in the horizontal and vertical directions can be lessened.
As an embodiment 2 of the present invention,
In the similar manner as in the embodiment 1, the first field data and the second field data are processed, and thereafter, the first field data and/or the second field data corresponding to the vertical direction is read from the external memory 31 in parallel with fetch of the third field data. Then, the read data is subjected to the color conversion processing, compression processing for estimating the encoding amount and thereby obtaining the compression rate, thumb nail color conversion processing, and thumb nail image data compression processing.
In the similar manner, the first field data and/or second field data or/and third field data corresponding to the vertical direction are read from the external memory 31 in parallel with fetch of the fourth field data and subjected to the color conversion processing, compression processing for estimating the encoding amount and thereby obtaining the compression rate, thumb nail color conversion processing, and thumb nail image data compression processing. Thereby, the continuous digital imaging signals are serially accomplished, and the body color conversion processing is executed by the color signal processing unit 22 to each of the accomplished continuous digital imaging signals. The rest of the constitution corresponds to the description of the embodiment 1.
As an embodiment 3 of the present invention, for example, in the processing sequence in the three-field fetching method shown in
As an embodiment 4 of the present invention, for example, in the processing sequence in the three-field fetching method shown in
As an embodiment 5 of the present invention, a learning sequence for improving an accuracy in estimating the encoding amount of the body image with each photographing is described referring to a flow chart of
The CPU 26 operates in accordance with a program (predetermined algorithm) for setting an encoding amount adjustment parameter stored in the program memory 33.
In Step S1, an image quality is selected by means of the image quality selecting device 34 shown in
In Step S7, the encoding amount in compressing the body image and the desired encoding amount are compared to each other, and the sequence is terminated when the encoding amount of the body image and the desired encoding amount are equal because the estimation is completely accurate in that case. When they are different, the encoding amount in compressing the body image and the desired encoding amount are compared to each other in S8. When the encoding amount in compressing the body image is larger than the other, the parameter is corrected so as to increase the compression rate in Step S9, while the parameter is corrected so as to reduce the compression rate in Step S10 when the encoding amount in compressing the body image is smaller. When the parameter is thus corrected, the encoding amount in compressing the body image can be approximate to the desired encoding amount.
In Step S11, the CPU 26 stores the parameter correction amount obtained in the Step S9 or S10 therein. The CPU 26 analyzes characteristics of each image such as color distribution and composition (for example, person/landscape) for each photographing and stores the analysis result as additional information therein. In Step S12, the CPU 26 judges whether or not the learning and the algorithm for setting the encoding amount adjustment parameter are corrected based on a plurality of parameter correction results and characteristics of picked-up images, which are stored with each photographing. When the recorded contents are few, population of the stored data is small. In order to prevent the divergence of the algorithm due to the learning based on a small number, the Step S12 is provided so that the learning is based on a desired number of photographed contents. When it is decided that the learning and the algorithm are corrected, the algorithm or operational expression are corrected through a feedback in a direction where the correction amount converges to a small value in Step S13.
Omitting the Steps S11 through S13, the parameter is corrected in each photographing, which is also effective.
The parameter and the parameter correction amount stored in the Step S11 and the corrected algorithm and operational expression in the Step S12 are written in the program memory 33 by the CPU 26 when a power supply or a system is activated or the relevant program is not used, and then, read from the program memory 33 and used when the program is executed next.
According to the present embodiment, the accuracy in estimating the encoding amount is improved as the photographed contents are increased when the parameter is corrected and the algorithm is modified with each photographing, and the desired encoding amount can be thereby obtained in the recording operation with respect to the recording medium.
The respective components constituting the respective embodiments may be realized by means of software in a microcomputer.
The present invention is not limited to the described embodiment, and can be variously modified and implemented within the true spirit and scope of the invention.
As thus far described, the imaging signal processing circuit according to the present invention is effective as an imaging signal processing circuit or the like installed in a camera system in which an external memory has a small capacity, the external memory is less frequently accessed, and a high-speed operation is achieved.
| Number | Date | Country | Kind |
|---|---|---|---|
| P2004-203005 | Jul 2004 | JP | national |
| P2005-193902 | Jul 2005 | JP | national |
