Patent Application
20180131919
The present general inventive concept generally relates to an image storage apparatus, an image reproducing apparatus, a method of storing an image, a method of reproducing an image, a recording medium, and a photographing apparatus, and more particularly, to an image storage apparatus to store a photographed image, an image reproducing apparatus, a method of storing an image, a method of reproducing an image, a recording medium, and a photographing apparatus.
In recent years, camcorders provide various functions other than a function to photograph an image. In addition, the camcorders could edit various photographed images according to a user's desired editing effect.
For example, the camcorders may provide a function to record the photographed image by including a still image as one file type. At this time, the camcorders are configured to add track data for a still image within a moving image file in a standard MP4 file format (i.e., Motion Picture Experts Group MPEG-4 file format) and to record the moving image file in which the track data is added.
However, in the case where a still image is provided in a recorded moving image and the stored as one file by using the above method, it is impossible to assist the reproducing function in the general-purpose player. Moreover, a user cannot reproduce only the still image data included in a moving image file to watch the still image data.
Accordingly, there is a demand for a method for providing function to adding content to a moving image. The present general inventive concept provides an image storage apparatus which records link information of a contents file within a moving image file and stores the moving image file including the link information when storing the moving image file, and a method of storing an image applied thereto.
Additional embodiments of the present general inventive concept will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the general inventive concept.
Exemplary embodiments of the present general inventive concept may provide an image storage apparatus, including a storage unit to store a moving image file and a contents file are stored, and a controller to record link information of the contents file within the moving image file and to store the moving image file.
The moving image file may be a file of a moving picture experts group 4 (MPEG-4) standard.
The controller may record the link information of the contents file within a meta box of the MPEG-4 standard.
The controller may record the link information of the contents file within a user-defined data box of the MPEG-4 standard.
The link information of the contents file may include a file name of the contents file, a reproducing starting time point, and reproducing time information.
The contents file may be one of a moving image contents file, a still image contents file, and a text contents file.
Exemplary embodiments of the present general inventive concept may also provide an image reproducing apparatus including a storage unit to store a contents file and a moving image file, the moving image file in which link information of the contents file are recorded together with a moving image, and a controller to control a reproducing screen of the moving image file together with a reproducing screen of the contents file to be displayed for a specific period based on the link information.
The moving image file may be a file of an MPEG-4 standard.
The link information may be recorded within a meta box of the contents file according to the MPEG-4 standard.
The link information may be recorded within a user-defined data box of the contents file according to the MPEG-4 standard.
The link information of the contents file may include a file name of the contents file, a reproducing starting time point, and reproducing time information, and the specific period may be a period from the reproducing starting time point to a time point in which the reproducing time is terminated.
The contents file may be one of a moving image contents file, a still image contents file, and a text contents file.
Exemplary embodiments of the present general inventive concept may also provide a method of storing an image, including storing a contents file, and recording link information of the contents file within a moving image file and storing a moving image file in which the link information is recorded.
The moving image file may be a file of an MPEG-4 standard.
The link information of the contents file may include a file name of the contents file, a reproducing starting time, and reproducing time information.
Exemplary embodiments of the present general inventive concept may also provide a method of reproducing an image, including reproducing a moving image file, and displaying a reproducing screen of the moving image file together with a reproducing screen of a contents file linked by link information for a specific period based on the link information recorded within the moving image file.
The moving image file may be a file of an MPEG-4 standard.
The link information of the contents file may include a file name of the contents file, a reproducing starting time and reproducing time information and the specific period may be a period from the reproducing starting time point to a time point in which the reproducing time is terminated.
Exemplary embodiments of the present general inventive concept may also provide a computer-readable recording medium that includes computer-readable codes, that when executed by a computer, carry out a method of storing an image, the method including generating a contents file and a moving image file of an MPEG-4 standard are contained, and storing the moving image file in which link information for the contents file is recordable within a meta box or user-defined data box of the MPEG standard.
Exemplary embodiments of the present general inventive concept may also provide a photographing apparatus, including a camera unit to photograph a moving image, a capture unit to capture the moving image to generate a still image, a storage unit in which a moving image file and a still image file are stored, and when the still image is captured by the camera unit during photographing the moving image by the camera unit, a controller to store a captured still image file in the storage unit and to record link information for the still image within a moving image file generated by the camera unit.
The moving image file may be a file of an MPEG-4 standard.
The controller may record the link information of the captured still image file within a meta box or user-defined data box of the MPEG-4 standard.
The link information of the still image file may include a file name of the still image file, a reproducing starting time point and reproducing time information. The reproducing starting time point may be a time point where the still image file is captured within a reproducing time of the moving image which is being photographed and the reproducing time may be a preset time.
Exemplary embodiments of the present general inventive concept may also provide a photographing apparatus, including a first camera unit to photograph a first moving image, a second camera unit to photograph a second moving image, a storage unit to store a moving image file is stored, and when the second moving image is photographed by the second camera unit during photographing the first moving image by the first camera unit, a controller to store a photographed second moving image file in the storage unit and to record link information of the photographed second moving image file within a first moving image file which is generated by the first camera unit.
The first moving image file may be a file of an MPEG-4 standard.
The controller may record the link information for the photographed second moving image within a meta box or a user-defined data box of the first moving image file according to the MPEG-4 standard.
The link information for the second moving image file may include a file name of the second moving image file, a reproducing starting time point and reproducing time information. The reproducing starting time point may be a time point where the second moving image file starts to be photographed within a reproducing time of the first moving image which is being photographed and the reproducing time may be a reproducing time of the second moving image file.
Exemplary embodiments of the present general inventive concept may also provide an image forming apparatus, including an image capture apparatus to capture a moving image and a still image, a memory to store the captured moving image and the still image, and a controller to generate a contents file including link information, where the generated contents file is stored within a moving image file of the captured moving image in the memory.
The image forming apparatus may include a display to display the moving image file and the contents file including the link information.
The contents file can include at least one of a moving image contents file, a still image contents file, and a text contents file.
The contents file can include a time duration to display at least one of the moving image and the still image.
The contents file can include a frame number of the moving image to be displayed.
Exemplary embodiments of the present general inventive concept may also provide a method of capturing an image, the method including capturing a moving image and a still image, storing the captured moving image and the still image in a memory, and generating a contents file including link information, where the generated contents file is stored within a moving image file of the captured moving image in the memory.
The method may also include displaying the moving image file and the contents file including the link information on a display.
The contents file can include at least one of a moving image contents file, a still image contents file, and a text contents file.
The contents file can include a time duration to display at least one of the moving image and the still image.
As described above, according to exemplary embodiments of the present general inventive concept, the image storage apparatus and the method of storing an image applied thereto, which records the link information of the contents file within the moving image file and stores it when the moving image is stored, are provided so that when a user reproduces the moving image file, the moving image file can be displayed together with the linked contents file on one screen. The contents file, which is a link target, can be independently reproduced.
These and/or other embodiments of the present general inventive concept will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG.4 is a flowchart illustrating a method of reproducing an image according to exemplary embodiments of the present general inventive concept;
Reference will now be made in detail to the embodiments of the present general inventive concept, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. The embodiments are described below in order to explain the present general inventive concept by referring to the figures.
The audio input unit 110 can receive an audio signal via a wired cable or a wireless connection, and/or may receive sound waves and convert them into an electrical signal. Specifically, the audio input unit 110 may be a microphone which directly receives sound, or an audio interface which receives an audio signal from another apparatus.
The audio encoder 115 can compress the received audio signal using an audio compression such as arithmetic coding (AC), advanced audio coding (AAC), bit-sliced arithmetic coding (BSAC), moving picture experts group (MPEG) audio layer-3 (MP3), and the like to generate an audio bit stream. The audio encoder 115 can output the generated audio bit stream to the MP4 file format MUX 140. The audio encoder 115 can be an integrated circuit, a processor, and/or any suitable encoder to carry out the exemplary embodiments of the present general inventive concept disclosed herein.
The video input unit 120 can receive a video signal via a wired and/or wireless link, and/or may include one or more lenses and an image sensor to capture at least one image. More specifically, the video input unit 120 may be a camera which can photograph and/or capture an image, or a video interface which receives a video signal from another apparatus.
The video encoder 125 can compress the received video signal using video compression such as MPEG or H.26x to generate video bit stream. The video encoder 125 can output the generated video bit stream to the MP4 file format MUX 140. The video encoder 125 can be an integrated circuit, a processor, and/or an encoder to carry out the exemplary embodiments of the present general inventive concept disclosed herein.
The capture unit 130 can capture a specific scene of the video signal received from the video input unit 120. The capture unit 130 can output a still image signal for the captured image to the still image encoder 135. The capture unit 130 may be an integrated circuit, a processor, a filed programmable gate array, a programmable logic device, and/or any suitable capture unit to carry out the exemplary embodiments disclosed herein.
The still image encoder 135 can compress the captured still image signal using a compression such joint photographic experts group (JPEG) and the like. The still image encoder 135 can store the compressed still image data in the storage unit 150.
The still image encoder 135 transmits information for the still image to the MP4 file format MUX 140.
The MP4 file format MUX 140 can generate a moving image file of the MPEG-4 standard (e.g., the MP-4 standard) using the audio stream output from the audio encoder 115 and the video stream output from the video encoder 125. The MP4 file format can store the generated MP4 file in the storage unit 150. The MP4 file format MUX 140 may be a multiplexer, an integrated circuit, a processor, and/or any suitable multiplexer to carry out the exemplary embodiments of the present general inventive concept as disclosed herein.
The MP4 file format MUX 140 can record separate link information of a contents file included with the moving image file, when the MP4 file format MUX 140 generates the moving image file. Herein, the contents file may be any one of a moving image contents file, a still image contents file, and a text contents file. For example, the MP4 file format MUX 140 may record the link information for the stored still image file output from still image encoder 135 within the moving image file.
Herein, the link information can include information to link the separate contents file with the moving image file. Accordingly, the moving image file including the link information can be displayed together with the linked contents file during reproduction (e.g., reproduction of the moving image on a display). That is, a user can select from the link information to reproduce one of the linked items (e.g., a still image file, and audio file, etc.).
The link information can include a file name of the contents file, a reproducing starting time point, and reproducing time information. For example, the file name of the contents file may be ‘still image.jpg’, the reproducing starting time point may be frame No. 30, and the reproducing time information may be ‘2 minutes’. A detailed configuration of the link information will be explained later with reference to
The link information may be recorded within a meta box or user-defined data box of the moving image file of the MPEG-4 standard and/or the MP4 standard (MPEG-4 and MP4 are interchangeably used herein throughout). The box file structure (i.e., that includes the meta box and/or the user defined box) can define the best use of the file, and the specifications to which the file complies.
The MP4 file format MUX 140 can generate the moving image file by including the link information when it generates the moving image file.
The storage unit 150 can store the moving image file and the contents file. Herein, the moving image file corresponds to a moving image file of the MPEG-4 standard. The storage unit 150 may be a digital storage device, such as one or more hard disk drives, memory devices (e.g., Random Access Memory (RAM), Flash memory, etc.), solid state drives, and/or any suitable storage unit to carry out the exemplary embodiments of the present general inventive concept as disclosed herein.
The controller 160 can control the operation of the image storage apparatus 100. The controller 160 may be an integrated circuit, a processor, a field programmable gate array, a programmable logic device, an application specific integrated circuit, and/or any other suitable controller to carry out the exemplary embodiments of the present general inventive concept. More specifically, the controller 160 can control the MP4 file format MUX 140 to record the link information of the content file within the moving image file and store the moving image file including the link information in the storage unit 150.
The controller 160 can control the link information of the contents file to be recorded within a meta box or user-defined data box of the MPEG-4 standard.
The controller 160 can control the link information of another contents file to be included within the moving image file and which is to be stored.
The controller 160 may store the moving image file (e.g., the moving image file that is formatted in the MPEG-4 standard) in a separate recording medium (e.g., in a different recording medium from the storage unit 150, or in a different storage area in the storage unit 150). The moving image file can correspond to a file in which the link information of the contents file is within a meta box or user-defined box of the MPEG-4 standard. Herein, the recording medium may be a computer-readable recording medium. For example, a compact disk (CD), a digital versatile disk (DVD), a Blue-ray disk (BD), a flash memory, a universal serial bus (USB) memory device and the like may be used as the recording medium.
The image storage apparatus 100 can store the moving image file of the MPEG-4 by linking a separate contents file. The image storage apparatus 100 can generate the moving image file of the MPEG-4 standard including the link information of the separate contents file. When the moving image file including the link information is reproduced, the linked contents file is also displayed for a predetermined period of time (i.e., a specific period).
Hereinafter, an image reproducing apparatus 200 to reproduce a moving image file of the MPEG-4 as described above will be explained with reference to
As illustrated in
The A/V input unit 210 can receive moving image data including audio and video. More specifically, the A/V input unit 210 can receive a moving image file having a MPEG-4 format. The A/V input unit 210 can be an interface to receive moving image data via a wired and/or wireless communications link. The A/V input unit may include an image capture apparatus to capture moving images and/or still images, and may include an apparatus to receive sound waves and convert the sound into an electrical signal.
The A/V processing unit 220 can decode the moving image file of the MPEG-4 format to divide audio data and video data. The A/V processing unit 220 can output the audio data to the audio output unit 230 and the video output to the display unit 240. The A/V processing unit 220 can be a processor, an integrated circuit, a programmable logic device, a field programmable gate array, an application specific integrated circuit, and/or any suitable processing unit to carry out the exemplary embodiments of the present general inventive concept as disclosed herein.
The storage unit 250 can store the moving image file including a contents file and link information of the contents file. The moving image file is a moving image file of the MPEG-4 format. The link information for the contents file stored in the storage unit 250 can be recorded within a meta box or user-defined box of the moving image file of the MPEG-4 standard. The storage unit 250 may be a digital storage device, such as one or more hard disk drives, memory devices (e.g., Random Access Memory (RAM), Flash memory, etc.), solid state drives, and/or any suitable storage unit to carry out the exemplary embodiments of the present general inventive concept as disclosed herein.
The controller 260 can control the operation of the image reproducing apparatus 200. More specifically, the controller 260 can control the reproduction of the moving image file stored in the storage unit 250. The controller 260 can be a processor, an integrated circuit, a programmable logic device, a field programmable gate array, an application specific integrated circuit, and/or any suitable controller to carry out the exemplary embodiments of the present general inventive concept as disclosed herein.
The controller 260 can control the display of a reproducing screen of the moving image file together with a reproducing screen of the contents file for a predetermined period of time (e.g., specific period) based on the link information when reproducing the moving image file. For example, the controller 260 can control the display of the reproducing screen of the contents file on the reproducing screen of the moving image file in a picture in picture (PIP) screen.
The link information can include a file name of the contents file, a reproducing starting time point, and reproducing time information. For example, a file name of the moving image file can be ‘moving image1.mp4’, the file name of the contents file included in the link information of the moving image file can be ‘still image.jpg’, the reproducing starting time point can be frame No.30, and the reproducing time information can be ‘2 minutes’. When a frame of frame No.30 of ‘moving image1.mp4’ is reproduced, the controller can display ‘still image.jpg’ on the screen. After 2 minutes have elapsed, the controller 260 can remove ‘still image.jpg’ that is displayed on the screen.
When a time point is reached where the contents file is to be displayed based on the link information during reproducing the moving image, the controller 260 can control the display of the reproducing screen of the moving image together with the reproducing screen of the contents file during a reproducing period.
As described above, the image reproducing apparatus 200 can reproduce the moving image file and can reproduce another contents file linked with the moving image file for a predetermined period or time.
Thus, since another contents file is linked with the moving image file of the MPEG-4 standard, a user can confirm the linked contents file on one screen when the user reproduces the moving image. The user can confirm the contents file which is a link target by independently reproducing the contents file.
Hereinafter, a method of storing an image and a method of reproducing an image will be explained with reference to
The image storage apparatus 100 can separately store a contents file at operation S310.
When the image storage apparatus 100 generates a moving image file, it can record link information of the contents file within the moving image file at operation S320. Herein, the contents file may be any one of a moving image contents file, a still image contents file, and a text contents file.
The moving image file can be a moving image file of the MPEG-4 standard. The link information may be recorded in a meta box or user-defined data box of the moving image file of the MPEG-4 standard.
The image storage apparatus 100 can store the moving image in which the link information is recorded at operation S330. For example, the image storage apparatus 100 may record link information for the captured and stored still image file within the moving image file.
Through the above-described method, the image storage apparatus 100 can store the moving image file link with another contents file.
The image reproducing apparatus 200 can reproduce the stored moving image file according to a user's received input at operation S410. The reproducing moving image file can be a moving image file of the MPEG-4 standard which can be linked with another contents file.
The image reproducing apparatus 200 can determine where a reproducing starting time point of the linked contents file is or not based on the link information, during reproducing the moving image file at operation S420.
If the reproducing starting time point reaches at operation S420-Y, the image reproducing apparatus 200 can display a reproducing screen of the moving image file together with a reproducing screen of the contents file for a predetermined period (i.e., a specific period) based on the link information at operation S430. For example, the image reproducing apparatus 200 can display the reproducing screen of the contents file on the screen which displays the moving image in PIP screen.
The image reproducing apparatus 200 can determine whether a termination time point of a reproducing time of the contents file is or not based on the reproducing time information of the link information at operation S440. If the reproducing time of the contents file at operation S440-N does not reach the termination time point, the image reproducing apparatus 200 can continuously display the moving image file and the contents file at operation S430.
When the reproducing time reaches the termination time point at operation S430-Y, the image reproducing apparatus 200 can remove the reproducing screen of the contents file and can continuously display only the reproducing screen of the moving image at operation S450.
For example, it can be assumed that a file name of the moving image file is ‘moving image 1.mp4’, a file name of the contents file included in the link information of the moving image file is ‘still image.jpg’, a reproducing starting time point is frame No.30, and the reproducing time information is ‘2minutes’. When a frame of frame No.3 in ‘moving image 1.mp4’ starts to be reproduced, the image reproducing apparatus 200 can display ‘still image.jpg’ on a screen together with the reproducing image of the moving image file. When 2 minutes have elapsed, the image reproducing apparatus 200 can remove ‘still image.jpg’ that is displayed on the screen.
Thus, when the time point where the other contents are to be displayed is during the reproducing of the moving image file, the image reproducing apparatus 200 can display the reproducing screen of the moving image file as well as the reproducing screen of the contents file during a reproducing period.
As above described, the image reproducing apparatus 200 can reproduce the moving image file, as well as reproduce the moving image file and the contents file linked with the moving image file for a predetermined time.
Since another contents file can be linked within a moving image file of the MPEG-4 standard, when a user reproduces the moving image file, the user can confirm the moving image file together with the contents file on one screen. The user may confirm the contents file of a link target by independently reproducing the contents file.
Hereinafter, a configuration of a moving image file of the MPEG-4 and a detailed configuration of link information included in the moving image file will be explained with reference to
As illustrated in
The ftyp box 510 can be a box area in which information for a file type of the MPEG-4 file is stored.
The moov box 520 can be an area in which information for contents of the MPEG-4 file is recorded in detail. As illustrated in
The mvhd box 521 can correspond to a box in which header information for the moving image contents is recorded. The video trak box 523 can be a box in which information for a video part of the moving image is recorded. The video trak box 523 can include a tkhd box, where the tkhd box can include a tref box. The video trak box 523 can include a mdia box, where the mdia box can include a mdhd box, a hdlr box, and a minf box. The tkhd, tref mdia, mdhd, hdlr and minf boxes are boxes of the MPEG4 standard. The tkhd box may include track header information, the tref box may include track reference information, the mdia box may include media information, the mdhd box may include media header information, the hdlr box may include a handler declaration, and the minf box may include media information.
The audio trak box 525 can be a box in which an audio part of the moving image is recorded. Trak box 527 may include track header information. The udta box 529 is an area in which information arbitrarily set by a user can be recorded and can correspond to a user-defined data box.
The mdat box 530 can correspond to a box area in which substantial contents data is recorded.
The meta box 540 can correspond to a meta box including meta information of contents. The meta box 540 includes an iloc box (item location box) and an inf box (item information box).
For the MPEG-4 moving image file of the above-described configuration, link information can be recorded in a box type within the udta box 529 or the meta box 540.
An image reproducing apparatus 630 can read out (e.g., simultaneously read out) ‘A. MP4 Stream’ of the moving image file and ‘B. Contents’ of the contents file to transmit them to a display device 640. When it is time to reproduce the linked contents file based on the link information, the display device 640 can display a reproducing screen 655 of the contents file within a reproducing screen 650 of the moving image file in a PIP screen type.
When the moving image file linked with the contents file is reproduced, the display device 640 can display the reproducing screen 650 of the moving image file together with the reproducing screen 660 of the contents file.
The size information can include the whole size of the link information box.
The type information can include type information of the link information box, and “edli” can indicate that the present box is the link information box. The title of the type may be changed.
The version information can include a version of the link information box.
The entry count information can include a number of data corresponding to the link information. For example, in the case where four (4) contents files are linked with the moving image file, the entry information can be four.
The data_ID information can be information that includes a contents to be a link target. For example, data_ID of JPEG contents may be ‘0x01’, data_ID of text contents may be ‘0x02’, data_ID of MP4 contents may be ‘0x03’, data_ID of MOV contents may be ‘0x04’, and data_ID of audio video interleaving (AVI) contents may be ‘0x05’. Herein, the JPEG contents includes still image contents and the AVI contents, the MOV contents, and where the AVI contents include moving image contents.
The Sync_Sample_Num information includes a reproducing starting time point of a contents file with respect to a reproducing time of a moving image file. That is, the Sync_Sample_Num information can include reproducing starting time point information of a contents file. The reproducing starting time point may include a reproducing time of the moving image file or a frame number of the moving image file. For example, when the contents file is a captured still image, the reproducing starting time point information may be a time point where the still image file is captured within the reproducing time of the moving image file. When the contents file is a moving image file photographed by a separate camera, the reproducing starting time point information may be a time point where the contents file (that is, the photographed moving image file) starts to be photographed within the reproducing time of the moving image file.
The Play_Duration information can include time information at which a contents time is reproduced. In other words, the Play_Duration information can be reproducing time information for the contents file. For example, when the contents file is a captured still image file, the reproducing time information may be a preset time. When the contents file is a moving image file photographed by a separate camera, the reproducing time point information can be a reproducing time of the contents file (that is, the photographed moving image file).
The name_file information includes file name information of a contents file.
Thus, various information can be recorded to comply with a box standard based on the MPEG-4 format in the link information box.
As described above, the link information box can be included in the user-defined data box or meta data box within the moving image file by complying with the MPEG-4 standard.
Hereinafter, methods of generating and reproducing a moving image file with which a still image file is linked is described with reference to
As illustrated in
The file writer 1030 can generate a JPEG (Joint Photographic Experts Group) stream which is an encoded still image file in a file type and can store the generated JPEG file in a storage unit 150. The file writer 1030 may be an integrated circuit, a processor, and/or any other suitable device to generate a data stream and encode a still image file according to the exemplary embodiments of the present general inventive concept as disclosed herein.
An operation of the camcorder that is the image storage apparatus 100 of
The microphone of the audio input unit 110 can convert sound into audio data. The microphone of the audio input unit 110 can transmit the audio data 10 to an audio encoder 115. The audio encoder 115 may be an integrated circuit, a processor, and/or any suitable encoder to carry out the exemplary embodiments of the present general inventive concept as disclosed herein. The audio encoder 115 can compress the audio data 10 in audio stream 11 and can transmit the audio stream 11 to an MP4 file format MUX 140.
The camera of the video input unit 120 can photograph a moving image and can transmit photographed video data 20 to a video encoder 125. The video encoder 125 may be an integrated circuit, a processor, and/or any suitable encoder to carry out the exemplary embodiments of the present general inventive concept as disclosed herein. The video encoder 125 can compress the video data 20 in video stream 21 and can transmit the video stream 21 to the MP4 file format MUX 140.
The capture unit 130 can capture the photographed image based on the control input received via the user controller 1020. The capture unit 130 can transmit the captured video data 20 to a still image encoder (JPEG encoder) 135. The still image encoder 135 can be a processor, an integrated circuit, or any suitable encoder to carry out the exemplary embodiments of the present general inventive concept. The still image encoder 135 can compress the captured video data 20 in still image stream (JPEG steam) 22 and can transmit the still image stream 22 to the file writer 1030.
The file writer 1030 can generate a still image file (JPEG file) 24 using the still image stream 22 and can store the generated still image file 24 in the storage unit 150. The file writer 1030 can transmit a still image information signal (JPEG info signal) 101 to the MP4 file format MUX 140. Herein, the still image information signal can be information provided to generate link information and can include file name information of the still image file, reproducing starting time point information, and reproducing time information.
The MP4 file format MUX 140 can generate a MP4 moving image file (MP4 file) 23 using the audio stream 11 and the video stream 21 and can store the MP4 moving image file in the storage unit 150. The MP4 file format MUX 140 can include the link information in the MP4 moving image file 23 using the still image information signal 101 and can store the MP4 moving image file including the link information.
The link information may include a file name of the still image file captured by the capture unit 130, a reproducing starting time point, and reproducing time information. Herein, the reproducing starting time point can be a time point where the still image file is captured within a reproducing time of a moving image that is being photographed. The reproducing time can be a preset time. More specifically, if a still image was captured at time point where 10 minutes have elapsed after a moving image begins to be photographed, a name of the still image file is ‘still image 1.jpg’ and the reproducing time of the still image is set as 2 minutes, a controller 160 can set the name of the still image file as ‘still image 1.jpg’, the reproducing starting time point as 10 minutes, and the reproducing time as 2 minutes for the link information of the photographed moving image.
The above process can be controlled to be performed by the control unit of the camcorder of the image storage apparatus 100. More specifically, when the moving image is photographed by the camera unit 110and when the still image is captured by the camera unit 110, the controller can control the storage of the captured still image file in the storage unit and can record link information for the still image file within the moving image file.
In
Referring to first still image file link information 1111, data_ID can be ‘0x01’ so as to indicate a JPEG still image file. Sync_Sample_Num can be ‘30’ so as to indicate that a reproducing starting time point of a first still image file is a 30th frame of a moving image file. Play_Duration can be ‘60’ so as to indicate that a reproducing time of the first still image file is 60 seconds. Data_name can be ‘sam_0001.jpg’ so as to indicate a file name of the first still image file.
A second still image file link information 1113 to nth still image file link information 1115 can be included in the link information box 1110.
Thus, a plurality of still image files may be linked in the link information box 1110.
A moving image file 1210 and a still image file 1220 can be separately stored in the storage unit 150. Link information for a still image file can be included in the moving image file 1210. A reproducing starting time point of the still image (e.g., when 20 minutes is within a reproducing time of the moving image) can be set at the time point where the still image is captured.
In
Accordingly, the image reproducing apparatus 200 can display the reproducing screen 1230 of the moving image file together with the reproducing screen 1240 of the still image file in a PIP screen type.
The image apparatus 200 can display the still image for a preset time (for example, 2 minutes) set in the reproducing time information of the link information in a PIP type. If the preset time elapses, the image reproducing apparatus 200 can display only the reproducing screen 1230 of the moving image file as illustrated in
The camcorder of the image storage apparatus 100 can capture the photographing image and link the captured still image file with the photographing moving image file. Accordingly, it can be set that a user can photograph the moving image and capture the specific frame of the photographed moving image to display it together with the moving image.
As described above, since the captured still image file can be linked in the moving image file of the MPEG-4 standard, the moving image can be reproduced together with the linked still image on one screen. The user can select the capture still image included in a link target so as to independently reproduce the capture still image.
Hereinafter, methods of generating and reproducing a moving image with which another moving image file can be linked according to exemplary embodiments of the present general inventive concept is described below with reference to
As illustrated in
More specially, as illustrated in
The MP4 file format MUX 1320 can generate an additional MP moving image file (MP4 file) 33 using an audio stream 11 and the video stream 31 and can store the MP4 moving image file 33 in a storage unit 150.
The MP4 file format MUX 1320 can transmit a moving image information signal (MP4 infor signal) 102 to a MP4 file format MUX 140. Herein, the moving image information signal 102 can be information provided to generate link information and can include a file name information of the additional moving image file 33, reproducing starting time point information, and reproducing time information.
Herein, the reproducing starting time point can be a time point where the additional moving image file 33 can be captured within a reproducing time of the moving image file being photographed, and the reproducing time can be a reproducing time of the additional moving image file 33.
The MP4 file format MUX 140 can generate an MP4 file moving image file (MP4 file) 23 using the audio stream 11 and video stream 21 and can store the MP4 moving image file 23 in the storage unit 150. The MP4 file format MUX 140 can generate link information to be included in the MP3 moving image file 23 by using the moving image information signal 102, and can store the MP4 moving image file 150 including the link information.
The link information may include a file name of the moving image file 33 photographed by the additional camera unit 1300, a reproducing starting time point, and reproducing time information. Herein, the reproducing starting time point can be a time point where the additional moving image file 33 is captured within a reproducing time of the moving file 23 being disposed, and the reproducing time is a reproducing time of the additional moving image file 33. More specifically, when the additional moving image is photographed at the time point where 10 minutes have elapsed after the moving image begins to be photographed, a name of the additional moving image file can be ‘moving image 1.mp4’. When the additional moving image file has been photographed for total 2 minutes, the camcorder 100 can set the file name as ‘moving image 1.mp4’. The reproducing starting time point can be set as 10 minutes, and the reproducing time can be set as 2 minutes in the link information of the photographed moving image.
The above-described method can be controlled so as to be performed by a controller of the camcorder of the image storage apparatus 100. More specifically, when the camera unit 110 is photographing the moving image (video data) 20, if the additional moving image (video data) 30 is photographed by the additional camera unit 1300, the controller can control the storage of the photographed additional moving image file 33 and can control the storage of the link information for the photographed additional moving image file 33 within the photographing moving image file 23.
As illustrated in
This is similar to the link information box 1110 of
Referring to the second moving image file link information 1413, data_ID may be ‘0x03’ so as to indicate a MP4 moving image, and Sync_Sample_Num may be ‘300’ so as to indicate that the a reproducing starting time point of the second moving file can be a 300th frame of the first moving image file. In addition, Play_Duration can be ‘60’ so as to indicate that a reproducing time of the second moving image is 60 seconds, and data_name can be ‘hdv_0001.mp4’ so as to indicate a file name of the second moving image file.
The first still image file link information 1411 to the nth still image link information 1415 can be included in a link information box 1410.
Thus, a plurality of still image files and a plurality of moving image files can be linked in the link information box 1410.
A first moving image file 1510 and a second moving image file 1520 can be separately stored in a storage unit 150, and the link information for the second moving image file can be included in the first moving image file 1510. More specifically, a reproducing time point of the second moving image file 1520 (when a first moving image reproducing time reaches at 10 minutes) can be set as a time point where the second moving image starts to be photographed.
In
Accordingly, the image reproducing apparatus 200 can display a reproducing screen of the first moving image file 1530 together with a reproducing screen 1540 of the second moving image in a PIP screen type.
The image reproducing apparatus 200 can display the second moving image file for a time set in the reproducing time information of the link information (that is, the reproducing time of the second moving image file) in a PIP type. If the reproducing time of the second moving image file 1520 elapses, the image reproducing apparatus 200 can display only the reproducing screen 1530 of the moving image file as illustrated in
Thus, the camcorder of the image storage apparatus 100 can photograph an additional moving image and link the photographed additional moving image file with the moving image file which is being displayed. Accordingly, user can photograph two moving images using the camcorder of the image storage apparatus 100. One moving image may be set to be displayed together with another moving image at a specific time point.
As described above, since the captured another moving image file is linked within the moving image file of the MPEG-4 standard, when a user reproduces the moving image file, the user can select that the moving image be displayed together with the linked another moving image file on the screen. The user can select the additional moving image file which is a link target so as to independently reproduce the additional moving image file.
Although the exemplary embodiments of the present general inventive concept illustrate a camcorder as a photographing apparatus, any apparatus capable of photographing a moving image file may be used according to the exemplary embodiments of the present general inventive concept. For example, the photographing apparatus may be a digital camera, a mobile phone with a camera, a portable computer, a personal digital assistant (PDA), and the like.
The present general inventive concept can also be embodied as computer-readable codes on a computer-readable medium. The computer-readable medium can include a computer-readable recording medium and a computer-readable transmission medium. The computer-readable recording medium is any data storage device that can store data as a program which can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. The computer-readable transmission medium can be transmitted through carrier waves or signals (e.g., wired or wireless data transmission through the Internet). Also, functional programs, codes, and code segments to accomplish the present general inventive concept can be easily construed by programmers skilled in the art to which the present general inventive concept pertains.
Although various example embodiments of the present general inventive concept have been illustrated and described, it will be appreciated by those skilled in the art that changes may be made in these example embodiments without departing from the principles and spirit of the general inventive concept, the scope of which is defined in the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2010-0083021 | Aug 2010 | KR | national |
This application is a continuation of U.S. patent application Ser. No. 13/218,001, filed on Aug. 25, 2011, which claims the benefit under 35 U.S.C. § 119 from Korean Patent Application No. 10-2010-0083021, filed on Aug. 26, 2010, in the Korean Intellectual Property Office, the disclosures of each of which are incorporated herein by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13218001 | Aug 2011 | US |
| Child | 15862950 | US |
