1. Field of the Invention
The present invention relates generally to image recording and reproducing apparatuses. More particularly, a technique for recording and reproducing high frame rate images resulting from high speed image shooting.
2. Description of the Related Art
Digital cameras for capturing images of a subject, converting the captured image into image data, and recording the image data on recording media are widely used. Such digital cameras are categorized into digital still cameras that mainly capture still images and digital video cameras that mainly capture moving images.
Digital cameras having a still image shooting function and a moving image shooting function have been developed recently. In one method for simultaneously recording moving images and still images, one frame of a moving image is recorded as a still image during shooting of the moving image. Japanese Patent Laid-Open No. 2001-103361 discloses one example of such digital cameras.
The digital camera disclosed in Japanese Patent Laid-Open No. 2001-103361 switches an operation mode thereof into a still image shooting mode from a moving image shooting mode in response to pressing of a still image shooting button during shooting of a moving image and shoots a still image by still image shooting conditions. A user can shoot a still image at the right moment to shoot a good still image using such a digital camera during shooting of a moving image.
However, since shooting of a moving image is temporarily suspended when a still image is shot in the method disclosed in Japanese Patent Laid-Open No. 2001-103361, loss of frames may affect the recorded moving image.
On the other hand, Japanese Patent Laid-Open No. 2001-054053 discloses an example of a reproducing apparatus for reproducing a recorded moving image. The reproducing apparatus captures one frame of the reproduced moving image as a still image.
The still image capturing apparatus disclosed in Japanese Patent Laid-Open No. 2001-054053 temporarily stores a reproduced frame image displayed on a display screen in a storage device, thereby capturing a still image. In addition, the apparatus disclosed in Japanese Patent Laid-Open No. 2001-054053 allows a user to set a time interval between capturing of frame images and a size of the storage device. As a result, the apparatus can selectively capture frame images that the user wants to capture.
However, the technique disclosed in Japanese Patent Laid-Open No. 2001-054053 is for simply extracting one frame of a reproduced moving image. If an interval between frames of the reproduced moving image is set approximately equal to 1/30 seconds, the apparatus is unable to capture another still image after at least 1/30 seconds elapses since capturing of one still image. Furthermore, long and short time still image capturing, which can be realized by changing the shutter speed as in digital cameras having a still image shooting function, is not available.
An embodiment of the present invention provides an image recording and reproducing apparatus capable of recording image data of still images without affecting continuity of a moving image that is being recorded.
Another embodiment of the present invention also provides an image recording and reproducing apparatus capable of setting a still image capturing condition corresponding to a pseudo-shutter speed when capturing still images from recorded image data.
According to an aspect of the present invention, an image recording and reproducing apparatus that records and reproduces image data shot at a frame rate higher than a normal reproduction rate employed during reproduction of a moving image includes, a moving image storage period setting unit configured to set a moving image storage period in order to determine the number of frame images to be combined when the image data is reproduced as a moving image, a still image storage period setting unit configured to set a still image storage period in order to set the number of frame images to be combined when the image data is reproduced as a still image, a parameter attaching unit configured to attach a parameter indicating the moving image storage period and a parameter indicating the still image storage period to each frame image of the image data, an image recording unit configured to record the image data attached with the parameters by the parameter attaching unit, and a still image recording instructing unit configured to give an instruction to start recording a still image. The parameter attaching unit attaches information indicating the start of recording of the still image to a frame image of the image data in response to the still image recording start instruction received during a recording operation performed by the image recording unit.
According to another aspect of the present invention, an image recording and reproducing apparatus that records and reproduces moving image data shot at a frame rate higher than a normal reproduction rate employed during reproduction of a moving image includes, a generating unit configured to combine a plurality of frame images included in the moving image data recorded on a recording medium to generate a frame image to be displayed, a still image capturing condition setting unit configured to set a still image capturing condition for determining the number of frame images to be combined when the moving image data is reproduced as a still image, a still image capturing instructing unit configured to give an instruction to start capturing a still image, and a controlling unit configured to perform, in response to the still image capturing start instruction received during a reproduction operation performed using the frame image generated by the generating unit, a control operation to select a plurality of frame images and record a still image resulting from combination of the plurality of selected frame images. The number of frame images to be combined is determined in accordance with the still image capturing condition set by the still image capturing condition setting unit.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Exemplary embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
The digital camera can perform image shooting at a speed higher than a normal reproduction rate (vertical frequency) employed in reproduction of a recorded moving image and simultaneously record still images and moving images. More specifically, the digital camera can record image data of still images while maintaining continuity of a moving image that is being recorded. Image data that is shot at a high speed and recorded by the digital camera shown in
The first exemplary embodiment will be described below with reference to
Referring to
The controlling section 105 has a memory 106 and a central processing unit (CPU) 107. The operation section 108 has a moving image storage period setting unit 109, a moving image shooting instructing unit 110, a still image storage period setting unit 111, a still image shooting instructing unit 112, and a reproduction rate setting unit 113.
It is assumed that a user previously sets a moving image storage period 203 and a still image storage period 204 shown in
Upon the user giving an instruction to start shooting (recording) a moving image through the moving image shooting instructing unit 110 (corresponding to a time point A shown in
The CPU 107 of the controlling section 105 sets the image shooting rate 201 ( 1/1200 sec), the moving image storage period 203 ( 1/100 sec), the still image storage period 204 ( 1/200 sec), and the reproduction rate 205 ( 1/60 sec) as image shooting parameters. Here, the moving image storage period 203 corresponds to the shutter speed for moving images. Additionally, the still image storage period 204 corresponds to the shutter speed for still images.
The CPU 107 of the controlling section 105 controls various operations in accordance with application programs stored in the memory 106.
The image shooting parameter attaching section 103 associates the various parameters set by the controlling section 105 with each frame image output from the frame image generating section 102. For example, the parameters may be embedded in a blanking period of frame images. The recording section 104 stores the frame images attached with the parameters indicating the moving image storage period 203 and the image shooting rate 201 as moving image data. The moving image to be recorded is constituted by a plurality of continuous frame images (recorded frame images 206) obtained during shooting of the moving image.
If a user gives an instruction to start shooting (recording) a still image through the still image shooting instructing unit 112 during recording of a moving image (corresponding to a time point B shown in
Although the image shooting parameters are attached to a blanking period of each frame of a moving image in this exemplary embodiment, the image shooting parameters may be attached to a header or a footer of a moving image file or may be generated, separately from an image file, as a management file that records a processing flow.
As described above, in this exemplary embodiment, the moving image storage period 203, the still image storage period 204, and the still image shooting start flag 202 are stored, as image shooting parameters, in association with frame images that are recorded at a high frame rate when a moving image and still images are shot at the same time.
In this manner, still images can be recorded without affecting a moving image currently being shot and recorded. Different shutter speeds can be set for the still images and the moving image. In addition, since the reproduction rate 205 and the image shooting rate 201 are also stored, an reproducing apparatus (e.g., a moving image/still image reproduced frame generating section 300 shown in
The user can set the moving image storage period, the still image storage period, and the reproduction rate freely or a system may store some predetermined values for the moving image storage period, the still image storage period, and the reproduction rate.
A second exemplary embodiment of the present invention will now be described.
Referring to
An example method in which the moving image/still image reproduced frame generating unit 300 generates moving image frames 304 and still image frames 305 reproduced from an image data set obtained by a digital camera will be described.
As shown in
The still image/moving image storage period calculating unit 301 reads out data from the recording section 104. After reading out the data, the still image/moving image storage period calculating unit 301 calculates a period A, which indicates the number of recorded frame images corresponding to the reproduction rate intended by a user. In the example shown in
The still image/moving image storage period calculating unit 301 then calculates, for every 20 frames, a period B, which indicates the number of recorded frame images corresponding to the moving image storage period 203. In this case, the period B corresponds to 1200/100=12 frames.
For each period A (20 frames), the moving image storage processing unit 302 generates the continuous moving image frames 304 on the basis of the period B (12 frames). The generated moving image frames 304 can be displayed on a display device, not shown.
Upon detecting existence of the still image shooting start flag 202, the still image/moving image storage period calculating unit 301 calculates a period C starting from a time point of the frame image associated with the still image shooting start flag 202. The period C indicates the number of recorded frame images corresponding to a period regarding which a still image is generated. The period C is calculated on the basis of the still image storage period 204. In this case, the period C corresponds to 1200/200=6 frames. The still image storage processing unit 303 generates the still image frame 305 from recorded frame images corresponding to the period C (6 frames) starting from the time point of the still image shooting start flag 202. The generated still image frame 305 can be also displayed on a display device, not shown.
As described above, according to this exemplary embodiment, moving images and still images can be generated and reproduced from recorded frame images on the basis of parameters attached to the recorded frame images.
A third exemplary embodiment of the present invention will now be described.
Referring to
The operation section 1104 has a still image capturing condition setting unit 1105, a still image capturing start instructing unit 1106, and a moving image reproduction instructing unit 1107. The controlling section 1108 has a memory 1109 and a CPU 1110.
The recording section 1101 stores moving image data (resolution thereof is equal to 8000×4500) like recorded frames 1202 shown in
On the other hand, a user previously sets a still image capturing speed equal to 1/100 (sec) through the still image capturing condition setting unit 1105 of the operation section 1104. A display rate employed by the display section 1103 for displaying reproduced images is set equal to 1/60 (sec).
Here, the still image capturing speed corresponds to a reproduction shutter speed, namely, a pseudo shutter speed, that is different from the image shooting shutter speed. The image recording and reproducing apparatus according to the exemplary embodiment records high frame rate moving image data and captures a still image from a reproduced video displayed on a display device by appropriately specifying the reproduction shutter speed (still image capturing speed).
A user gives an instruction to reproduce a moving image through the moving image reproduction instructing unit 1107 of the operation section 1104. The moving image storage calculation processing section 1102 performs following calculation processing in accordance with a previously set still image capturing speed 1205 ( 1/100 sec).
More specifically, the moving image storage calculation processing section 1102 calculates a storage period (1200/100=12 frames) of the recorded frames 1202 on the basis of the image shooting rate 1201 and the still image capturing speed 1205, selects and adds the recorded frames 1202 corresponding to the calculated period to generate display frames 1203.
The generated display frames 1203 are displayed on the display section 1103 in accordance with the display rate and the resolution of the display section 1103 (after a time point A shown in
The still image capturing condition setting unit 1105 is for setting still image capturing parameters that define a still image storage period.
Values of trimming start coordinates (a start X coordinate 1206 and a start Y coordinate 1207) and values of trimming end coordinates (an end X coordinate 1208 and an end Y coordinate 1209), which are kinds of capturing parameters associated with frame images, change (at a time point B shown in
As shown in
An enlarged part (trimming region) may be displayed all over the screen without displaying the still image capturing frame 1301 as shown in
This operation corresponds to so-called digital zoom of digital cameras. Since an enlarged image is generated by interpolating pixels, the image quality decreases in proportion to the magnification factor. To avoid this situation, a user may previously set an enlargement threshold. Alternatively, the enlarged image may be generated by interpolating pixels by an image processing section of a reproducing apparatus without setting the threshold.
At a time point C shown in
If the user gives an instruction to rotate the reproduced moving image clockwise through the still image capturing condition setting unit 1105 of the operation section 1104, the values of the trimming start coordinates (the start X coordinate 1206 and the start Y coordinate 1207), the values of the trimming end coordinates (the end X coordinate 1208 and the end Y coordinate 1209), and a rotation angle 1210 change (at a time point D shown in
At a time point E shown in
The still image capturing parameter attaching section 1111 attaches a still image capturing start flag 1204, the various set still image capturing parameters, and the image shooting rate to a representative recorded frame 1202 (blotted part) obtained at the time capturing of the still image is instructed. At this time, the various kinds of information are embedded, as invisible information, in a predetermined data area of the frame image captured as the still image. For example, the various kinds of information are embedded in the blanking, which is a period not displayed as an image.
At a time point F shown in
Although the still image capturing start flag 1204 is embedded in a representative frame image (blotted part) in this exemplary embodiment, the still image capturing start flag 1204 may be stored in association with a plurality of frame images. For example, the flag may be set for all frames corresponding to the storage period or the flag may be set in a starting and end frames.
Additionally, although a case of embedding information, such as the still image capturing parameters and the moving image shooting rate, in the blanking of the recorded frame 1202 has been described in this exemplary embodiment, the information may be stored separately from the recorded frames 1202 as a management file for managing captured still images.
The controlling section 1108 issues the various still image capturing parameters on the basis of the content set by the user through the still image capturing condition setting unit 1105. The CPU 1110 included in the controlling section 1108 controls various operations in accordance with application programs stored in the memory 1109.
As described above, while recording a moving image at a high frame rate, the image recording and reproducing apparatus according to this exemplary embodiment can capture still images after setting the still image capturing speed corresponding to the pseudo shutter speed and various capturing conditions like a digital camera. That is, the image recording and reproducing apparatus according to this exemplary embodiment can capture still images from reproduced images in a manner of shooting photographs.
In addition, the image recording and reproducing apparatus according to this exemplary embodiment can capture still images at a given timing, namely, a moment intended by a user, from reproduced images. Since the storage period can be freely changed during reproduction, the image recording and reproducing apparatus can determine a final still image using desired values set in consideration for the blurring amount resulting from the set shutter speed. The image recording and reproducing apparatus can save the available space of the storage medium (recording medium) by storing the still image capturing conditions in association with frames.
Although the still image capturing speed, the coordinates, and the rotation angle have been described as the still image capturing parameters in this exemplary embodiment, the still image capturing parameters are not limited to these particular examples. Conditions, such as tint, color density, brightness, and contrast, may be stored as the still image capturing parameters.
Only one still image capturing condition pattern is set in the method according to this exemplary embodiment. However, a plurality of still image capturing conditions may be set. Still images may be captured while switching the still image capturing conditions. For example, the plurality of still image capturing conditions may be assigned to respective channels of a television and switched by changing the channels.
A fourth exemplary embodiment of the present invention will now be described.
As shown in
Upon a user pressing the still image reproduction instructing unit 1403 of the operation section 1104, the still image storage calculation processing section 1401 reads out the recoded frame 1202 from the recording section 1101.
Upon detecting a still image capturing start flag 1204, which is one of the still image capturing parameters stored in association with the recorded frame 1202, the still image storage calculation processing section 1401 performs the following calculation processing. More specifically, the still image storage calculation processing section 1401 calculates a still image storage calculation period in accordance with a still image capturing speed 1205 stored in association with the frame.
When reproducing and storing a captured still image, the still image storage calculation processing section 1401 selects a plurality of frame images on the basis of the still image capturing parameters and the image shooting rate associated with the recorded frame 1202, calculates the number of frames to be combined, and generates a still image on the basis of the still image capturing parameters.
Regarding a time point E shown in
When a user attempts to store the still image while browsing the still image displayed on the display section 1103, the still image storage instructing unit 1404 gives an instruction to store the still image. The still image 1402 is then separately stored in the recording section 1101 as a still image file.
An image format of the still image file is based on an image format generally utilized when a digital camera shoots a still image, e.g., exchangeable image file format (Exif).
Referring to
Although the file creation date/time is used as the capturing date/time, the shooting date/time that the user has captured a still image during reproduction may be calculated from a shooting date/time of a moving image or may be selected. The digital camera stores other optical conditions with reference to the moving image data. Alternatively, the other optical conditions may be stored in the still image capturing parameters and the digital camera may store the optical conditions with reference to the still image capturing parameters.
As described above, the image recording and reproducing apparatus according this exemplary embodiment can store a still image file resulting from capturing of a still image in a format similar to that of a file of a still image shot by a digital camera. The image recording and reproducing apparatus can also store a still image file resulting from capturing performed during reproduction separately from moving image data in a manner that the still image is captured with a digital camera. In addition, data is easily exchanged by using a general image format.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2008-092367 filed on Mar. 31, 2008 and No. 2008-092368 filed on Mar. 31, 2008, which are hereby incorporated by reference herein in their entirety.
Number | Date | Country | Kind |
---|---|---|---|
2008-092367 | Mar 2008 | JP | national |
2008-092368 | Mar 2008 | JP | national |