1. Field of the Invention
The present invention relates to a photographed image recording and reproducing apparatus which is capable of reproducing a recorded image, and a photographed image recording and reproducing method.
2. Description of the Related Art
A conventional digital camera is provided with a solid state image pick-up element such as CCD, and has a still-image photographing function of obtaining a still image signal of a subject using such image pick-up element, and of recording the obtained still image signal on a recording storage. Some digital camera has a moving-image photographing function in addition to the above mentioned normal still-image photographing function.
In such digital camera, a technique is employed for performing a still image photographing process during a moving-image photographing process, in which, in response to an instruction to photograph a still image given while the moving-image photographing operation is performed to photograph moving-image frames at a certain moving-image frame frequency, a moving-image frame is photographed at the time when such instruction is given, and the photographed moving-image frame is recorded on the recording storage as a still image. In other words, in such digital camera, the moving-image photographing process and the still-image photographing process are performed concurrently.
For performing the still image photographing process during the moving-image photographing process, another technique has been proposed in which, when the instruction is given to photograph a still image during the moving-image photographing process, the moving-image photographing operation for obtaining moving-image frames is suspended once, and a still image is photographed and recorded on the recording storage during such suspension, and then the moving-image photographing process is resumed to photograph and record the moving-image frames again. In other words, in an interrupt process or in the suspension, the still-image photographing process is performed to photograph a still image.
The present invention has been made in consideration of the circumstances set forth above.
According to one aspect of the invention, there is provided a photographed image recording and reproducing apparatus which comprises a memory for recording plural photographed image data, a reproducing unit for reproducing the photographed image data recorded on the memory, a judging unit for judging whether or not the photographed image data reproduced by the reproducing unit is one of plural photographed image data which are obtained in a simultaneous photographing operation for obtaining more than one image data simultaneously, and an advising unit for giving notice that the photographed image data obtained in the simultaneous photographing operation is reproduced, when the judging unit determines that one of the plural photographed image data obtained in the simultaneous photographing operation is reproduced by the reproducing unit.
According to another aspect of the invention, there is provided a photographed image recording and reproducing apparatus which comprises memory means for recording plural photographed image data, reproducing means for reproducing the photographed image data recorded on the memory means, judging means for judging whether or not the photographed image data reproduced by the reproducing means is one of plural photographed image data which are obtained in a simultaneous photographing operation for obtaining more than one image data simultaneously, and advising means for giving notice that the photographed image data obtained in the simultaneous photographing operation is reproduced, when the judging means determines that one of the plural photographed image data obtained in the simultaneous photographing operation is reproduced by the reproducing means.
According to still another aspect of the invention, there is provided a photographed image recording and reproducing method which comprises reproducing photographed image data recorded on a memory, judging whether or not the reproduced photographed image data is one of plural photographed image data which are obtained in a simultaneous photographing operation for obtaining more than one image data simultaneously, and giving notice that the photographed image data obtained in the simultaneous photographing operation is reproduced, when it is determined that one of the plural photographed image data obtained in the simultaneous photographing operation is reproduced.
According yet another aspect of the invention, there is provided a program for a computer used in a photographed image recording and reproducing apparatus, the program which comprises instructions that cause the computer to reproduce photographed image data recorded on a memory, to judge whether or not the reproduced photographed image data is one of plural photographed image data which are obtained in a simultaneous photographing operation for obtaining more than one image data simultaneously, and to give notice that the photographed image data obtained in the simultaneous photographing operation is reproduced, when the it is determined that one of the plural photographed image data obtained in the simultaneous photographing operation is reproduced.
Now, an embodiment of the invention will be described with reference to the accompanying drawings.
The DSP/CPU 3 is connected with a Timing Signal Generator (TG) 4 for driving the CCD 2, and the TG 4 is connected with a unit circuit 5, which includes a Correlated Double Sampling circuit (CDS circuit) for subjecting an image signal output from the CCD 2 to a correlated double sampling process and for holding the same, an automatic gain control amplifier (AGC) for amplifying the image signal, and an analog/digital converter (AD) for converting the amplified image signal into a digital signal. The output signal from the CCD 2 is converted into the digital signal and further transferred to DSP/CPU 3 through the unit circuit 5.
The DSP/CPU 3 is connected with a display device 6 and a key entering unit 7, and further connected through an address data bus 8 with DRAM 9, a built-in flash memory 10, and a card interface 11. The card interface 11 is electrically connected to a memory card 12 received in a slot (not shown) of the digital camera body 1. The memory card 12 serves a storage memory for storing pick-up still-image data and pick-up moving-image data, and further stores link information to be described later in the present embodiment and serves as a predetermined information storing means of the present invention.
The display device 6 includes a color LCD and its driving circuit, and displays, in a standby state for taking a picture, a through image of an optical image of a subject that is to be photographed with the CCD 2 and further displays, in a recorded-image reproducing mode, a recorded image (still image or moving image) which is read out from the memory card 12 and expanded in the DSP/CPU 3. Further in the recorded-image reproducing mode, the display device 6 displays a still-image mark M1 and a moving-image mark M2, serving according to need as alarm means or display means of the present invention.
The key entering unit 7 includes plural manipulation keys such as a shutter button, a recording start/stop button used for recording a moving image, a link-file key used for reproducing a recorded image, a power key, and a menu key. The key entering unit 7 outputs a key entering signal corresponding to the manipulation key manipulated by a user to the DSP/CPU 3. Other key such as the shutter button can be used as the link-file key.
The DRAM 9 serves as a buffer memory for temporarily storing the digitalized image data of the subject generated by the CCD 2, and further is used as a working memory for the DSP/CPU 3. For instance, when the shutter button is manipulated to photographing a still image, the image data temporarily stored in the DRAM 9 is subjected to the various digital signal processes performed by the DSP/CPU 3, including the signal compression and expansion processes, to be converted into an image file in a predetermined format such as JPEG format, and the image file is finally recorded on the memory card 12.
On the built-in flash memory 10 are stored control programs for the DSP/CPU 3 to control operations of the various sections, that is, control programs for controlling various operations such as an auto-focusing control (AF) and an auto-exposure control (AE), and data necessary for controlling various operations. The DSP/CPU 3 works in accordance with the programs to serve as the discriminating means and control means of the present invention.
Now, operation of the digital still camera 1 having the configuration set forth above will be described.
When the photographing mode has been set, the DSP/CPU 3 causes the CCD 2 to start a photographing operation to display a through image of the subject on the display device 6 at step SA1. A process for displaying the through image is repeatedly performed until a recording-start button or the shutter button is manipulated (at Steps SA2 and SA3: NO).
Meanwhile, upon depression of the shutter button (at step SA2: NO, and at step SA3: YES), the photographing mode is switched to the normal still-image photographing mode. In the normal still-image photographing mode, the still-image photographing process starts, including a process for setting a photographing condition in AF AND AE operations, and a process for photographing and recording the subject by CCD 2 at step SA4. When the still-image photographing process has been completed (at step SA5: YES), the DSP/CUP 3 produces a still-image file on the buffer memory (DRAM 9) and records the same on the memory card 12 at step SA6, and then returns to the process at SA1 to display the through image.
When the record-start button is depressed while the through image is on the display device (at step SA2: YES), the photographing mode is switched to a moving-image photographing mode. In the moving-image photographing mode, a moving-image photographing process starts at step SA7 to photograph and record a moving image (moving frame) at a predetermined frame rate (at a fixed cycle of 1/30 seconds) and at the same time a time counting operation starts at step SA8 to count a time period during which a moving image is photographed based on a clock signal generated by a built-in clock. When photographing the moving frame in the moving-image photographing process, the DSP/CPU 3 causes the CCD 2 to output only pixel data of odd lines in an image frame at a comparatively short interval, and holds the pixel data of odd lines on the buffer memory (DRAM 9), and further subjects the held pixel data to a thinning process to generate data of a predetermined number of pixels. Thereafter, the moving-image recording process is performed until either of the shutter button and the recording stop button is depressed (at steps SA9 and SA15: NO).
When the shutter button is depressed during the moving-image recording process (at step SA9: YES), the photographing mode is switched to the still-image photographing mode in which an interrupt process is performed, and thereafter processes at step SA10 through step SA14 are performed. At the time when the shutter button is depressed, the normal moving-image recording process is suspended and switched to the moving-image recording process at step SA10, in which the last image frame is repeatedly used. In other words, in such moving-image recording process, substitution frame data is produced by reproducing the frame data stored right before the shutter button is depressed, and until the still-image photographing process or the interrupt process is completed, the substitution frame data is used in place of frame data produced by the photographing process as frame data that is to be stored on the buffer memory at a predetermined frame rate.
Then, the still-image photographing process similar to that at step SA4 starts at step SA11, and when the process is completed (at step SA12: YES), a still-image file 101 including data shown in
When the record-stop button is depressed (at step S15: YES), the moving-image photographing process and the time counting process for counting the moving-image photographing time are terminated at steps SA16 and SA17. And when the moving-image photographing operation is not interrupted by the interrupt process set forth above to perform the still-image photographing process (at step SA18: NO), a moving-image file (in motion-jpeg format or other) is created by using moving-image data that has been expanded over the buffer memory, that is, by using moving-image data including plural frames of image data that have been obtained periodically, and the created moving-image file is recorded on the memory card 12 at step SA19. In other words, a moving image file similar to that obtained in the normal moving-image photographing mode is recorded.
Meanwhile, when the interrupt process for photographing a still image occurs during the moving-image photographing operation (at step SA18: YES), a moving-image file 102 shown in
When the reproducing mode is set, the DSP/CPU 3 allows the user to select an image which he or she wants to display from among the still images and moving images recorded on the memory card 12 at step SB1. More specifically, for example, the DSP/CPU 3 lists recorded images on the display device, allowing the user to select his or her desired image among the listed images by manipulating the key, or displays the recorded images sequentially in response to key manipulation by the user, allowing his or her to select one. When the user selects a slide show function for automatically displaying all the recorded images continuously in a slide show, the DSP/CPU 3 automatically selects, in response to a display-start manipulation, the images in an order in which the images are displayed.
When the user select the moving image (at step SB2: YES), the DSP/CPU 3 reads out the selected moving-image file from the memory card 12, and starts the moving image reproducing operation, expanding the recorded moving-image data, or the plural frames of images over the DRAM 9, and displaying the expanded frames of images sequentially at the predetermined frame rate on the display device 6 at step SB3. At this time, on the display device is displayed a frame of image F1 shown in
In the moving-image reproducing operation, the DSP/CPU 3 judges whether or not a reproducing time for the moving image has reached a time which corresponds to five seconds before the still image photographing time 102d embedded as the link information in the moving-image file 102. The DSP/CPU 3 keeps performing the moving-image reproducing operation until the reproducing time reaches the time corresponding to five seconds before the still image photographing time 102d (at step SB4: NO). In case no link information is embedded in the moving-image file which is being reproduced, the result of the judgment at step SB4 is NO at all times, and the moving-image reproducing operation continues. At the time when the moving image has been completely reproduced (at step SB9: YES), (or upon manipulation by the user), the image reproducing operation automatically terminates and the process returns to step SB1, where the user is prompted to select another image.
Meanwhile, in the reproducing operation of the moving image with the link information embedded, when the reproducing time has reached the time corresponding to five seconds before the still image photographing time 102d (at step SB4: YES), the still image mark M1 is displayed on the frame of image F2 that is on the display device 6 at that time in a super imposed manner, as shown in
At the time when the user manipulates the link-file calling key (at step SB6: YES) while the still image mark M1 is on the display device 6, the moving-image reproducing operation is suspended, the still image file is automatically selected and read out from the memory card 12 (at step SB10), which file corresponds to the link still-image file name 102c that is associated with the still-image photographing time 102d and embedded in the moving image file 102. In other words, the still image file is automatically read out from the memory 12, which file is photographed or produced in the interrupt process occurred in a period between five seconds before and five seconds after a time when the moving image (F2) is displayed during the moving-image photographing operation for photographing the moving image which is being reproduced. Then, processes at step SB14 and at steps following to step SB14 are performed.
At step SB14, the still image is displayed on the display device 6 based on the read out still image file and the moving image mark M2 is displayed on the reproduced still image S in a super imposed manner as shown in
When the user manipulates the link-file calling key (at step SB15: YES) while the still image S and the moving image mark M2 are displayed, the moving image file is automatically selected and read out from the memory card 12 at step SB16, which file corresponds to the link moving-image file name 101c embedded as the link information in the file of the still image S which is on the display device 6, or which file was displayed on the display device 6 just before the still image S is displayed. Then, the still-image photographing time 101d embedded together with the link moving-image file name 101c is confirmed, and the moving-image reproducing operation starts with the frame of image F3 shown in
Then, the operation returns to the process at SB7, and the still image mark M1 is removed from the frame of image F3 five seconds after the still-image photographing time (at step SB7: YES and at step SB8). Thereafter, if the moving-image file which is being reproduced contains another link information, the still image mark M1 is displayed for a predetermined time in the processes at steps SB4 through SB7, and upon manipulation by the user of the link information file calling key, the moving-image reproducing operation is suspended and a still image indicated by the link information is displayed. If the moving-image file contains no other link information, the moving image operation is automatically suspended at the time when the rest of the frames of image have been reproduced (at step SB9: YES) (or upon the user's manipulation to suspend the operation), and the operation returns to the process at step SB1, prompting the user to select another image.
Apart from the above process, if the image that is selected by the user at step SB1 is a still image (at step SB2: NO), it is judged at first at step SB11 whether or not the above mentioned link moving-image file name 101c (
When the link moving-image file name 101c is embedded in the file of the still image that is selected by the user (at step SB11: YES), the still image is reproduced and the moving-image mark M2 is displayed on the still image in an over lapping manner at step SB14, performing the processes at step SB15 and at the following steps. More specifically, when the user manipulates the link-file calling key while the still image reproduction is performed, the moving image designated by the link moving image file name 101c is reproduced from the reproducing position of the moving image corresponding to the time designated by the still image photographing time 101d (
As described above, the digital camera 1 according to the present embodiment informs the user by displaying the still image mark M1 during the moving image reproducing operation of the photographed still image available and the time when such still image was photographed, if a still image was photographed during the moving-image photographing operation. Therefore, the user of the digital camera 1 can easily know whether or not a still image is available that was photographed during the moving-image photographing operation (a still image photographed concurrently with the moving image).
Further, when the user manipulates the link-file calling key while the still image mark M1 is displayed on the display device 6, the still image photographed concurrently with the moving image is reproduced at once. As described, the digital camera 1 provides a user-friendly feature that reproduces the still image only when needed. Especially, when a lot of still images photographed simultaneously with the moving image are prepared, the digital camera 1 of the present embodiment may be used more conveniently.
Furthermore, the present digital camera 1 informs the user by displaying the moving image mark M2 during the still image reproducing operation of the photographed moving image available, if a moving image was photographed during the still-image photographing operation. Therefore, the user of the digital camera 1 can easily know whether or not a moving image is available that was photographed during the still-image photographing operation (a moving image photographed simultaneously with the still image). Therefore, the digital camera 1 may be used more conveniently by the user to know if the moving image photographed simultaneously with the still image is available for each of the still images.
When the user manipulates the link-file calling key while the moving image mark M2 is displayed on the display device 6, the moving image photographed simultaneously with the still image is reproduced at once. As described above, the present digital camera 1 provides a user-friendly feature that reproduces the moving image only when needed. Especially, the digital camera 1 automatically reproduces the moving image photographed simultaneously with the still image from a reproducing position of the moving image corresponding to the time when the still image is photographed, and therefore, can be used more conveniently by the user to know under what circumstance the still image was photographed.
The embodiment has been described, in which, when an instruction is given to perform the still-image photographing operation during the moving-image photographing operation, the moving-image photographing operation is suspended at once to perform the interrupt process, allowing the still-image photographing operation to photograph a still image simultaneously with the moving image. But an arrangement may be employed to perform both the moving-image photographing operation and the still-image photographing operation without suspending the moving-image photographing operation. As an example of such arrangement, there is proposed a camera in which, when an instruction is given to perform the still-image photographing operation during the moving-image photographing operation, a frame of image that is photographed just at the time such instruction is given is extracted from the moving image and recorded as a still image, allowing operation to photograph a still image and a moving image concurrently. Another camera may be proposed that is provided with an image pick-up element for photographing a still image and a separate image pick-up element for photographing a moving image, allowing operation to photograph a still image and a moving image simultaneously.
In the instant embodiment, in the still image file 101 and the moving image file 102 (collectively, an image file) are embedded link file names (link moving-image file name 101c, and link still-image file name 102c), respectively, but amendment to the instant embodiment may be made to embed flag information in place of the link file names, which information simply represents that the link file (still image file 101 or moving image file 102) is available. In this amendment, when the flag information is embedded in the image file to be reproduced, a moving image mark or a still image mark is displayed on the reproduced image, but both the image files can not be read out automatically.
In the present embodiment, the link file name (of flag information) is embedded in both the still image file 101 and the moving image file 102, but the embodiment may be modified such that the link file name is embedded in either of the still image file 101 and the moving image file 102.
Further, in the present embodiment, link information (link moving-image file name 101c, link still-image file name 102c) and the still-image photographing times 101d, 102d are embedded in the image file, but the embodiment may be modified such that a separate management file other than the image file is prepared for recording the link information, a still image photographing time, and presence of the link file, or the still image file and the moving image file are given the same file name so as to be linked to each other by using such same file name. Further, the embodiment may be modified to record a date on which a still image is photographed, a time when operation to photograph a moving image starts, and a time when the operation to photograph a moving image finishes, and to judge based on the recorded data whether or not the date and time when the still image is photographed falls between the date and time when the moving-image photographing operation starts and the date and time when the moving-image photographing operation finishes to determine a relationship in linkage between the moving image and the still image. In the present modified embodiment, a special process is not required during the above mentioned recording and photographing operation.
In the embodiment, the still image mark M1 is displayed in the moving-image reproducing operation only for the period defined by times corresponding to five seconds before and five seconds after the time when the still image was photographed, but the embodiment may be modified to display the still image mark M1 at all times in the moving-image recording operation to call the linked still-image files at all times. In the modified embodiment, the still-image photographing time is not required to be embedded in the moving image file. But in this modified embodiment, the DSP/CPU 3 has to be given a reproducing function, and when plural still image files are linked with one moving image file, some device will be necessary to display over the reproduced moving image plural thumbnail images of the linked still images as still image icons for selection by the user, or to read out the plural linked still image files sequentially to display same in a multiple display screen or in a screen slide show (or in an automatic scrolling manner). Further in the modified embodiment, the still-image file names, and data representing the number of images may be displayed in addition to the still image icons and the still images, or in short any information may be used that designates plural still imaged to be linked.
In the present embodiment, when the link-file calling key is manipulated while the moving image mark M2 is displayed in the still-image reproducing operation, the moving image is reproduced from the position of the moving image corresponding to the time when the still-image is photographed, but the moving image may be reproduced from the very beginning. In this case, there in no need to embed such still-image photographing time in the image file.
Further, in the present embodiment, in the image file are embedded the link moving-image file names 101c, 102c, and the still-image photographing times 101d, 102d which indicate a time duration lapsed since the start of the moving image photographing operation, but the embodiment may be modified to record a time at which the moving image photographing operation starts, a time at which the still image photographing operation starts, and the number of frames of image generated while the moving-image photographing operation is performed in the still-image photographing operation and to judge in the image reproducing operation on the basis of the recorded data, the timing of the still-image photographing operation performed in the moving-image photographing operation.
Furthermore, in the present embodiment, the still image mark M1 and the moving image mark M2 are displayed over the reproduced moving image or still image to inform that a linked image is available, but the embodiment may be modified to display the thumbnail image of the linked image over the reproduced image in place of the still image mark M1 and the moving image mark M2 to inform that such linked image is available, or to display information for designating link images such as the link file name, and the number of image in place of the still image mark M1 and the moving image mark M2 to inform that a linked image is available, or to display a message, highlight an image, or use an informing devices such as a LED light to inform that a linked image is available.
In the present embodiment, the user is informed in the image reproducing operation that the link image is available, and the image file to be linked is read out upon manipulation by the user, but the embodiment may be modified to read out the link image automatically to display a thumbnail image thereof, when the image which has a link image is reproduced.
Further, in the present embodiment, only one of the still image and the moving image is displayed in the reproducing mode, but the embodiment may be modified to display the still images and the moving images on a multiple display screen, and further to display the still image marks M1 and the moving image marks M2 respectively over the corresponding images on the multiple display screen for easy review and calling the link image.
The embodiment has been described, in which the invention is applied to the moving image and the still image produced by photographing a still-image during the moving-image photographing operation, but the embodiment may be modified to have two image pick-up elements such as CCD which generates two still images or two moving images, wherein the invention is applied to these still images or moving images. In the modified embodiment, photographing operations are performed simultaneously using these two image pick-up elements with different resolution, field angles, and photographing areas, respectively, and obtained plural images are associated with each other and recorded.
In the above modified embodiment, two image pick-up elements are provided but more than two image pick-up elements may be used and the present invention may be applied to more than two images including still images and moving images that are simultaneously produced respectively by these more than three elements.
Further, in the present embodiment described above, the moving image data and the still image data obtained respectively in the moving-image photographing operation and in the still-image photographing operation are recorded in the one and same memory card, but the moving image data and the still image data may be stored in separate storage media respectively. For example, the embodiment of the invention may be modified such that, when the instruction is given to photograph a still image while moving image data produced by the moving image photographing operation is recorded on a magnetic recording tape, the obtained still image data is recorded on the memory card.
In the embodiments set forth above, the present invention is applied to the digital camera with the moving-image photographing function, but the invention may be applied to apparatus with a photographing function for photographing a still image and a moving image simultaneously, such as a movie camera with a still-image photographing function, a cellular phone with a camera function, a personal digital assistant (PDA) with a camera function, and a personal computer provided with a camera.
Number | Date | Country | Kind |
---|---|---|---|
2003-093562 | Mar 2003 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5937136 | Sato | Aug 1999 | A |
6871010 | Taguchi et al. | Mar 2005 | B1 |
7228061 | Mori et al. | Jun 2007 | B2 |
7257317 | Ohnishi | Aug 2007 | B2 |
20010005442 | Ueda et al. | Jun 2001 | A1 |
20010014202 | Honda et al. | Aug 2001 | A1 |
20020003946 | Sasagawa et al. | Jan 2002 | A1 |
20020140826 | Sato et al. | Oct 2002 | A1 |
20020197067 | Ohnishi | Dec 2002 | A1 |
20050069297 | Kobayashi et al. | Mar 2005 | A1 |
Number | Date | Country |
---|---|---|
1313709 | Sep 2001 | CN |
09-284692 | Oct 1997 | JP |
11-055617 | Feb 1999 | JP |
2000-069407 | Mar 2000 | JP |
2001-111934 | Apr 2001 | JP |
2002-290908 | Oct 2002 | JP |
2003-009044 | Jan 2003 | JP |
2003-092724 | Mar 2003 | JP |
Number | Date | Country | |
---|---|---|---|
20040189823 A1 | Sep 2004 | US |