Patent Application
20080151317
1. Field of the Invention
The present invention relates to an image processing apparatus (e.g., printing apparatus, multi-function peripheral (MFP)), an image processing method, and a storage medium, and, more specifically, to extracting frames from moving image data as still image data and processing the still image data.
2. Description of the Related Art
In recent years, moving image contents can be easily processed as an Internet communication speed and a memory capacity of an information processing apparatus have been increased. In addition, a user can easily take moving images with a digital camera or digital camcoder. Examples of the moving image data include TV program or movie contents, or scenes of a daily life captured by a user.
In this regard, one scene can be selected from the above-described moving image data, and extracted and used as still image data. For example, a scene where a recipe is introduced in a cooking program can be extracted and stored as still image data, and then displayed or printed. Further, a selected scene can be extracted as still image data from moving image data captured by a user while traveling, and the extracted image can be developed to a photograph.
For example, Japanese Patent Application Laid-Open No. 2006-060649 discusses a technique of dividing moving image data into a predetermined number of sections, and extracting and displaying still images corresponding to a predetermined number of frame images belonging to each section to print still images selected by a user.
When a plurality of still image data is extracted by the above-described method or the like, there is a demand to rearrange still image data in the order of reproduction in the moving image data. More specifically, a user may wish to use the extracted still image data to create a table of contents of moving image data, or to extract still image data from moving image data captured by the user while traveling in order to create an album.
However, in the case of extracting still image data from moving image data by the above conventional method, the extracted still image data is stored in independent files. That is, there is no information that associates these still image data with each other, therefore, a plurality of still image data that is stored later cannot be rearranged in the order of reproduction in the moving image data.
Further, in the case of generating still image data, the still image data can be generally given a file name such as 0001, 0002, 0003, . . . , in the order in which the still images are generated. If such a file name can be given even at the time of extracting still image data from moving image data, a plurality of still image data can be rearranged in the order in which the images are extracted.
However, in the case of extracting a desired scene as still image data on fast forward or fast reverse, a sequence of extracted images does not always correspond to a sequence of reproduction. That is, even if still image data are rearranged in accordance with the file name that indicates the order of generation, the still images may not be arranged in the order of reproduction of the moving image data.
Embodiments of the present invention is directed to an image processing apparatus, an image processing method, a program product, and a storage medium for extracting a frame in moving image data as still image data while adding information about a location of the frame in the moving image data.
According to an aspect of the present invention, an image processing apparatus includes: an input unit configured to input moving image data that includes a plurality of frames; a first selecting unit configured to select a frame from the plurality of frames included in the input moving image data; an extraction unit configured to extract the frame selected by the first selection unit from the moving image data as still image data; an adding unit configured to add location information to the extracted still image data as attribute information, the location information indicating a location of the selected frame in the moving image data; a memory unit configured to store the extracted still image data to which the location information is added; a second selecting unit configured to select a plurality of still image data stored in the memory unit; and a printing unit configured to print the plurality of still image data selected by the second selecting unit according to an order determined based on the location information.
Further features and aspects of the present invention will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the invention and, together with the description, serve to explain the principles of the invention.
Various exemplary embodiments, features, and aspects of the invention will be described in detail below with reference to the drawings.
Hereinafter, exemplary embodiments of the present invention will be described.
A control unit 110 is connected to a printer 140 (i.e., an image output device) and a scanner 130 (i.e., an image input device), and controls input/output of image information. On the other hand, the control unit 110 is connected to a local area network (LAN) 190 or Public Switched Telephone Networks (PSTN) (i.e., public line) and controls input/output of image information including moving image data or still image data, or device information.
A central processing unit (CPU) 111 controls the MFP 100 and operates in accordance with programs stored in a random access memory (RAM) 112. The RAM 112 serves as an image memory for temporarily storing image data. A read-only memory (ROM) 113 is a boot ROM and stores a boot program for a system. A hard disk drive HDD 114 stores system software, image data, and programs for controlling operations of the MFP 100. The programs stored in the HDD 114 are loaded onto the RAM 112, and the CPU 111 controls operations of the MFP 100 based on the programs.
An operation unit interface (I/F) 115 connects the operation unit 150 to the control unit 110 to output image data to the operation unit 150 on which the image data is displayed. Further, the I/F 115 transmits information input by a user via the operation unit 150 to the CPU 111. A network I/F 116 is connected to the LAN 190 and controls input/output of various types of information. A Modem 117 is connected to the PSTN and controls input/output of image information.
An audio output unit 118 outputs audio information to a speaker 160 when moving image data or audio data stored in the HDD 114 is reproduced. A wireless LAN I/F 119 performs wireless communications such as infrared communications to transmit/receive moving image data or still image data to/from a portable terminal 180 such as a cell phone, a notebook computer, or a digital camera. Moving image data or still image data received through the wireless LAN I/F 119 is stored in a user box in the HDD 114 as described below. A memory 120 stores moving image data or still image data, similar to the HDD 114. The memory 120 can be a removable external storage device.
An ImageBus I/F 121 controls high-speed input/output of image data through ImageBus. A raster image processor (RIP) unit 123 expands a page description language (PDL) code received from a host PC 170 through the LAN 190 and the network I/F 116, into a bit map image.
A scanner image processing unit 125 performs image correction on image data read from the original by the scanner 130. The printer image processing unit 126 performs image correction on image data output to the printer 140.
An image conversion unit 124 performs image conversion on image data stored in the RAM 112. More specifically, the image conversion unit 124 performs processing such as image rotation or resolution conversion on an image. Moreover, the image conversion unit 124 converts a binary image to a multilevel image, or a multilevel image to a binary image.
A start key 201 is a hard key to instruct the scanner 130 to start reading, or the printer 140 to start printing operation. Within the start key 201, green and red LEDs are incorporated and the green LED is turned on when the printer, scanner, or the like is ready to start operations, and the red LED is turned on when operations cannot be started due to errors or the like. A stop key 202 is a hard key to instruct the scanner 130 to stop the operation.
A hard key group 203 includes a numeric keypad, a log-in key and a user mode key. The numeric key pad is configured to input numerical values such as the number of copies. The log-in key allows a user to enter a user ID or a password to log in to a target website and the user mode key allows to shift an operational mode to a user mode to perform various types of device settings.
In the COPY mode, copying operations are performed in which an image of the original is read by the scanner 130, the read image is input and the input image is printed by the printer 140. In the SEND mode, image data input from the scanner 130 or image data previously stored in the HDD 114 is transmitted to a destination by an e-mail or the like via the LAN 190 or the Internet. In the BOX mode, various types of data stored in a box are processed (editing, printing, sending, etc.). The box refers to a user box where storage areas on the HDD 114 are assigned to each user. In the SCAN mode, an image of the original is read by the scanner 130 and is input, and the image is stored in the box or transmitted through the LAN 190 to the host PC 170.
The above-described modes (i.e., COPY mode, SEND mode, BOX mode, and SCAN mode) can be switched by selecting an appropriate button from the mode buttons 301 to 304. In the example of
If the BOX mode button 303 is selected in
In the case where various types of processing are performed to each file stored in the user box, one of the buttons 411 to 414 is pressed while one of the displayed files is selected. Unless at least one file is selected, the buttons 411 to 414 cannot be selected. A target file can be selected by a user who touches an area where a name of the file is displayed. If the file is selected, a background color of an area which shows attribute information of the selected file, is changed to indicate that the file is selected.
In the example of
If the display button 411 is selected while any file is selected, contents of the selected file can be examined. More specifically, if the selected file is still image data, a preview of the image is displayed. Further, if the selected file is audio data, an audio sound is output from the speaker 160. If the selected file is moving image data, a moving image is reproduced and displayed, and an audio sound is output from the speaker 160. If a plurality of files are selected, the files are displayed and reproduced in order of selection.
If the print button 412 is pressed while any file is selected, the selected file is printed by the printer 140. However, a file that can be printed in this processing is only still image data. If the moving image data or audio data is selected, a warning message is displayed. The printing processing is described in detail later.
If the send button 413 is selected while any file is selected, the selected file is attached to an e-mail and sent to a designated address. The sending processing can be performed not only to still image data but also to moving image data or audio data. Further, if a plurality of files are selected, the files are attached to one e-mail.
If the capture button 414 is pressed while any file is selected, some frames are extracted and printed from the selected moving image data as still image data. A file that can be subjected to this processing is moving image data only. If the still image data or audio data is selected, a warning message is displayed. Further, this processing cannot be performed to a plurality of files at a time. If the plurality of files are selected, a warning message is displayed. In the first exemplary embodiment, a case is described as an example where still image data is extracted from moving image data entitled “Birthday Party” as shown in
In a case where image data is replayed, time code information is added to each frame in moving image data based on the time at which each frame is reproduced.
As shown in
Referring back to
Referring back to
A user selects each button from the button group 713 to instruct playback, stop, fast-forward, fast-reverse, and frame advance to retrieve an image of a frame to be printed. To select a frame that is to be extracted and printed as still image data, reproduction of moving image data is stopped while a desired frame is displayed in the moving image data display area 700, and a capture button 715 is pressed.
When the capture button 715 is pressed, the currently displayed frame is extracted as still image data and stored in the same user box as that which stores the moving image data. At this time, a file name of the new still image data is determined based on time code information corresponding to the extracted frame. That is, in the example of
First, in step S801, it is determined whether a capture processing is instructed by a user. More specifically, if the capture button 414 of
In step S802, it is determined whether a plurality of files are selected in the screen of
If it is determined that the plurality of files are selected in step S802 or a file other than the moving image data is selected in step S803, the processing advances to step S804 to display a warning message and then returns to step S801.
In step S805, selected moving image data is displayed by performing playback, stop, pause, fast-forward, fast-reverse, or frame-advance in accordance with instructions of a user using the button group 713. In a subsequent step S806, it is determined whether an instruction to end capture processing is sent from a user. More specifically, if it is detected that a done button 714 of
In step S807, it is determined whether a user has sent an instruction to pause playback of moving image data. The pause refers to a state where a particular frame is displayed and paused without further reproduction. If a predetermined time has elapsed while capture processing which is described later, is not instructed, the pause is automatically cancelled.
In step S807, if it is determined that the pause is instructed by a user, the processing advances to step S808 to determine whether a user sends an instruction to perform capturing processing. More specifically, if the capture button 715 is pressed in the screen of
In step S808, if it is determined that a user has sent an instruction to perform capturing processing, the processing advances to step S809. In step S809, an image of a displayed frame is clipped as still image data. In a subsequent step S810, a file name generated based on time code information corresponding to the clipped frame is added to the extracted still image data and the data is stored. After that, the processing returns to step S805 to restart reproduction of moving image data.
Further, a user can also select a frame to be extracted as still image data by a method other than the above-described method in which a frame is selected while reproducing the moving image data. For example, a user can directly input time code information and extract a frame corresponding to the input time code information as still image data. Furthermore, any other methods can also be used as long as a frame in the moving image data can be selected.
Next, print processing is described in which a file obtained by extracting a frame included in moving image data as still image data and stored is printed by the above method.
A screen of
The still image data extracted from the frames 502, 503, and 501 are given file names based on time code information of the respective frames, i.e., “01352717”, “01580123”, and “01013724”, and listed in the order in which the still images are extracted.
Here, a case is described where these three files are collectively printed. As described above, a file displayed on the file list is selected, and the print button 412 is selected to print out still image data saved in a user box with the printer 140. If a plurality of files are selected at this time, the print button 412 is pressed to instruct the printer to collectively print these files.
In the case where the plurality of files are designated and collectively printed in accordance with one printing instruction, the files are generally printed in the order in which the files are selected. In the example of
However, the above-described order differs from the order in which the extracted frames are reproduced in the moving image data “Birthday Party”. When only three files are collectively printed as in the above-described example, a user can manually rearrange the files after printing. However, in the case where still image data is extracted from long moving image data or a large number of still images are extracted, a user needs to perform a troublesome task.
Therefore, according to the first embodiment, a mode is provided in which frames of moving image data are automatically rearranged and printed out when a plurality of still image data extracted from frames of the moving image data is collectively printed. As a result, a user can print the extracted still image data in the order in which the still image data of each frame in the moving image data is reproduced without the troublesome processing.
More specifically, a printing condition setting screen illustrated in
Further, the user can determine whether to auto-permute images with a checkbox 1010. If the user instructs auto-permutation, a plurality of files selected on the file list screen of
First, in step S1101, it is determined whether a user has sent an instruction to perform printing processing. More specifically, if the print button 412 of
In step S1102, it is determined whether the selected file is still image data. If it is determined in step S1102 that the selected file is still imaged data, the processing advances to step S1104. If it is determined in step S1102 that the selected file is not still image data, the processing advances to step S1103. In step S1103, a warning message is displayed, then, the processing returns to step S1101. When the plurality of files are selected in step S1102, the processing advances to step S1103 if at least one file that is not still image data is detected.
In step S1104, printing conditions for printing selected files are set in accordance with a user instruction sent by operating the buttons 1001 to 1005. In a subsequent step S1105, it is determined whether a plurality of files are selected on the screen of
On the other hand, if it is determined in step S1105 that the plurality of files is selected, the processing advances to step S1106. In step S1106, it is determined whether an instruction to auto-permute files is sent. More specifically, it is determined whether the checkbox 1010 is marked in the printing condition setting screen of
In step S1107, the plurality of files designated as a printout target in the screen of
As described above, according to the first embodiment, when frames in moving image data are extracted as still image data, a file name based on time code information corresponding to the extracted frames is added to still image data, and the still image data is stored. Then, at the time of collectively printing the plurality of still image data thus stored, the files are automatically rearranged in the order of reproduction in the original moving image data in accordance with a user instruction, and then printed out.
Thus, when the plurality of still image data extracted from the moving image data is collectively printed, a user can easily rearrange the images in the order of reproduction of the original moving image data without performing a troublesome processing. Further, the still image data extracted from moving image data is given a file name based on time code information of a corresponding file. Accordingly, a user can visually and easily check a location or reproduction time of each still image data in the original moving image data.
Next, a second exemplary embodiment of the present invention is described. The second exemplary embodiment differs from the first exemplary embodiment in that, when still image data is extracted from moving image data, the above time code information is added as attribute information instead of the file name. Further, in addition to the time code information, a file name of moving image data for identifying the original moving image is also added as attribute information. The basic configuration of the second exemplary embodiment is the same as that of the first exemplary embodiment, therefore, detailed description will be omitted. The following description is focused on the difference between the first exemplary embodiment and the second exemplary embodiment.
The processing of extracting still image data from moving image data according to the second exemplary embodiment is performed in accordance with the flowchart according to the first exemplary embodiment of
In the first exemplary embodiment, the time code information is added as a file name of still image data. However, if the file name is changed by user operations in this case, auto-permute processing of step S1107 in
Further, in the second exemplary embodiment, in step S810 of
Accordingly, in the second exemplary embodiment, information that identifies moving image data is added as attribute information in addition to the time code information to rearrange still image data based on moving image data so that the still image data can be distinguished according to each moving image.
In
On the property display screen of
If the property button 1201 is pressed while the plurality of files is selected, a scroll key 1306 is displayed on the property display screen. If the scroll key 1306 is selected, a screen is switched to display attribute information of another file. In addition, it is possible to prohibit a user from editing the attribute information. As a result, it is possible to prove when and from which moving image data the still image data is extracted based on the attribute information.
Next, printing processing of the second exemplary embodiment is described. The printing processing of the still image data according to the second exemplary embodiment is performed in accordance with a flowchart of
More specifically, in step S1107 of
First, if a plurality of still image data are selected for printing, the still image data are printed out in the order in which a user selects the image data. Here, if a user instructs an auto-permute processing, first, still image data is sorted based on each moving image data in step S1401. More specifically, the still image data is sorted in accordance with a file name of moving image data added as attribute information.
Further, in a subsequent step S1402, still image data is rearranged based on time code information with respect to each moving image data. That is, in the example of
As a result, the still image data are printed while grouped based on each original moving image data, in the order of reproduction in each moving image data. If printed sheets having each still image data are collectively stapled or discharged based on each original moving image data, usability is improved.
As described above, in the second exemplary embodiment, time code information of a frame extracted as still image data and a file name of the original moving image data are added to still image data as attribute information. Then, when the images are printed, the images are grouped based on each original moving image data and rearranged in accordance with the time code information. Accordingly, the images can be appropriately rearranged even when a plurality of the still image data extracted from plural different moving image data is collectively printed.
In the first and second exemplary embodiments, time code information is used as information indicating a location of each frame in moving image data. However, any other information that represents a sequence of frames can be used. For example, information of serial numbers added to all frames in the moving image data can also be used.
In the exemplary embodiments, the case of printing processing is described. However, aside from the printing processing, the auto-permute processing according to the exemplary embodiments, can be applied to any other cases where a plurality of still image data is collectively selected and processed.
The above is detailed description about the exemplary embodiments. The present invention allows embodiments as a system, an apparatus, a method, a program, or a storage medium (recording medium). More specifically, the present invention is applicable to a system configured by a plurality of devices, or an apparatus composed of one device.
According to the present invention, software programs for executing the above functions of the exemplary embodiments (programs corresponding to the flowcharts in the exemplary embodiments) can be directly or remotely supplied to a system or an apparatus. Therefore, the scope of the present invention encompasses the thus supplied program code which is read and executed by a computer of the system or apparatus.
That is, the scope of the present invention includes a computer program itself for realizing the functional processing of the present invention.
In this case, as long as a program function is included, the other forms such as an object code, a program executed by an interpreter, and script data supplied to an OS can be used.
A recording medium for supplying a program includes a floppy disk, a hard disk, an optical disk, a magneto optical disk, a MO, a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a nonvolatile memory card, a ROM, and a DVD (DVD-ROM, DVD-R)
Besides, as a method of supplying a program, a program can be supplied by downloading the program from an Internet website to a recording medium such as a hard disk using a browser of a client computer. That is, the website is accessed to download a computer program itself of the present invention or a compressed file including an automatic installing function from the website. Further, program codes constituting a program of the present invention are divided into a plurality of files, and the files are downloaded from different websites. That is, a WWW server for downloading to a plurality of users program files that causes a computer to perform functional processing of the present invention, is encompassed in the scope of the present invention.
Further, a program of the present invention can be encoded and stored in a storage medium such as a CD-ROM, and transferred to users. Then, a user who satisfies a predetermined condition is allowed to download key information for decoding the program through the Internet from the website. Then, the encoded program can be executed using the key information and installed to the computer to perform the processing.
Further, the computer executes a read program to perform the above functions of the exemplary embodiment. In addition, an OS running on the computer performs a part or all of the actual processing in accordance with an instruction of the program, and the functions of the exemplary embodiments can be performed through this processing.
Further, the functions of the exemplary embodiments are realized when a program read from the recording medium is written to a memory including an expansion board inserted to a commuter or an expansion unit connected to the computer. That is, the functions of the exemplary embodiments are realized by a CPU in the expansion board or expansion unit executing a part or all of the actual processing in accordance with an instruction of the program.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all modifications, equivalent structures, and functions.
This application claims priority from Japanese Patent Application No. 2006-343047 filed Dec. 20, 2006, which is hereby incorporated by reference herein in its entirety.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006-343047 | Dec 2006 | JP | national |
