Patent Application
20070297016
Preferred embodiments of the present invention will now be described with reference to attached drawings. Each embodiment described below will be helpful in understanding a variety of concepts from the generic to the more specific.
It should be noted that the technical scope of the present invention is defined by claims, and is not limited by each embodiment described below. In addition, all combinations of the features described in the embodiments are not always indispensable for the present invention.
Items of image data 151 to 154 are continuously shot image data obtained continuously with a continuous shooting function of the digital camera 100. When items of image data are continuously obtained with the continuous shooting function of the digital camera 100 like this, only one (e.g., the image data 151) of the items of image data is transferred to the PC 150 as a representative image. The representative image may be transferred at any time. For example, it may be transferred just after the representative image is determined, or when the digital camera 100 receives a transfer instruction from the PC 150. Image data shot and obtained without the continuous shooting function is also transferred to the PC 150 at any time.
A list 155 is for managing the image data 151 to 154 as a group. While described in detail later, in brief, the list 155 indicates that the items of image data 151 to 154 belong to the same group, in which the image data 151 has already been transferred to the PC 150. The list 155 is generated by the digital camera 100 and transferred to the PC 150.
An application 160 is for a user to manage image data received from the digital camera 100, and it runs on the PC 150. A window of the application 160 (hereinafter simply referred to as the “application 160”) displays the already received image data 151. The image data 151 may be displayed in any form recognizable to the user, for example the name of a file containing the image data 151, or a thumbnail image for the image data 151.
The application 160 also includes a thumbnail image acquisition button 161 and an image data acquisition buttons 162 to 164. The thumbnail image acquisition button 161 is a button for the user to give the instruction to acquire thumbnail images for items of image data (i.e., the image data 152 to 154) not yet received by the PC 150 among the items of image data included in the list 155. The image data acquisition buttons 162 to 164 are buttons for the user to give the instruction to individually acquire unreceived items of image data (the image data 152 to 154) belonging to the same group as the image data 151 (the representative image). Once an item of image data corresponding to one of the image data acquisition buttons 162 to 164 are acquired, the corresponding image data acquisition button is made unavailable for user selection, such as by graying out the button.
In the example of
The digital camera 100 is supposed to have a function (hereinafter referred to as an “automatic transfer function”) of automatically transferring shot and obtained image data to an external apparatus such as the PC 150 immediately after shooting.
<External View of Digital Camera 100>
The components of the digital camera 100 shown in
<Hardware Architecture of Digital Camera 100>
The digital camera 100 includes a system bus 210 and the following components connected to the system bus 210.
A CPU 201 controls the entire digital camera 100 by executing a control program stored in a ROM 202.
The ROM 202 is non-volatile memory storing the above control program and so on.
A RAM 203 is volatile memory used as a work area when the CPU 201 executes the control program.
The RAM 203 is also used as an area for temporarily buffering shot image data before the image data is recorded on a storage medium 208.
An image pickup unit 204 includes an optical lens, a CCD, an A/D converter, and so on. The image pickup unit 204 converts light which enters through the optical lens into a digital electronic signal and stores the signal in the RAM 203.
A signal processor 205 performs signal processing such as JPEG encoding and MPEG encoding for the digital electronic signal stored by the image pickup unit 204 in the RAM 203 and generates image data. The generated image data is recorded on the storage medium 208. When images are reproduced, the signal processor 205 reproduces (decodes) the image data recorded on the storage medium 208. Although the signal processor 205 is typically implemented with a dedicated hardware circuit, the CPU 201 may implement the signal processor 205 by executing software (a program) stored in the ROM 202.
The operation unit 206 includes a power button, a shutter button, and so on. The user of the digital camera 100 can give an instruction to the digital camera 100 via the operation unit 206.
The display unit 104 is for displaying images while the image data is being reproduced. The display unit 104 may be a TFT LCD or the like. The display unit 104 may also be used as an electronic viewfinder for successively displaying images picked up by the image pickup unit 204.
A storage medium control unit 207 controls the storage medium 208 to be described below.
The storage medium 208 is for recording the image data and may be implemented by using, for example, a digital video cassette, a DVD-R, a Compact Flash (Registered Trademark), a hard disk, or the like.
A communication I/F 209 is an interface for communicating with external apparatuses and may be based, for example, on USB, IEEE 1394, Ethernet®, or the like. The communication I/F 209 may also include an analog interface that can transmit analog signals (e.g., RGB composite signals) of the image data reproduced by the digital camera 100.
<Flow of Image Data Transfer Processing>
An image pickup condition determination unit 301 determines whether or not the image pickup condition of an item of image data can be regarded to match that of another item of image data. Functions of the image pickup condition determination unit 301 are implemented by functions of components such as the CPU 201 and the signal processor 205 of the digital camera 100.
While the image pickup condition typically includes various parameters such as the shutter speed and the aperture value, this embodiment focuses on only the shooting time. That is, if an item of image data is shot within t seconds (t is a predetermined threshold) from the shooting time of the last item of image data, the image pickup condition determination unit 301 determines that they match in their image pickup condition. Setting the value of t shorter (e.g., around one to two seconds) increases the likelihood that two items of image data matching in their image pickup condition are images with a high correlation with each other. The image pickup condition determination unit 301 determines the shooting time of image data by referring, for example, to Exif information regarding the image data.
Of course, the image pickup condition determination unit 301 may be configured to directly determine the correlation between an item of image data and the last item of image data and if the correlation is high, determine that they match in their image pickup condition.
A list management unit 302 manages the above-described list 155 (the details will be described later). Functions of the list management unit 302 are implemented by functions of components such as the CPU 201 and the storage medium 208 of the digital camera 100.
As shown in
According to the determination result in the image pickup condition determination unit 301, the list management unit 302 manages the list 155. The communication I/F 209 transfers the list 155 and at least one item of image data (e.g., the image data 151 in
It is also possible to input image data already stored on the storage medium 208 to the image pickup condition determination unit 301 without using the image pickup unit 204.
<Directory Structure on Storage Medium 208>
The storage medium 208 has a “ROOT” directory, immediately below which is a “DCIM” directory, further below which are directories containing image data, such as “100 . . . ” and “101 . . . ” directories.
The “100 . . . ” directory contains, for example, four items of image data 151 to 154 matching in their image pickup condition and a corresponding list 155, which constitute a group 401. The “100 . . . ” directory further contains two items of image data 411 to 412 matching in their image pickup condition and a corresponding list 413, which constitute a group 402. The “100 . . . ” directory may contain further groups, or independent items of image data whose image pickup condition matches no other items of image data.
<Structure of List 155>
The list 155 contains a generation date 501, the number of images 502 indicating the number of items of image data included in the list 155, a shooting mode 503 of the digital camera 100 upon generation of the list 155 (in this example, the continuous shooting mode), and so on. The list 155 also contains the name of files of the items of image data 151 to 154 that match in their image pickup condition and are managed as a group by the list 155, and transferred images 504 indicating ones already transferred to the PC 150 among those items of image data.
<Concept of Image Data Transfer Using Automatic Transfer Function>
Before transferring image data, the digital camera 100 must set necessary information including its own IP address and the IP address of the destination PC 150. In addition to the setting of this necessary information, the digital camera 100 and the PC 150 need to be connected with each other in advance with a protocol such as TCP/IP. It is assumed that t is set to a time slightly longer than the interval of continuous shooting.
In
Upon the first release at time 601, the signal processor 205 continuously generates four items of image data at time 602.
Once a first item of image data in the four items of image data has been generated, the image pickup condition determination unit 301 starts determination of the matching of the image pickup condition at time 603 in parallel with generation of the rest of the image data. Since the first item of image data has been shot not less than t seconds after the last shooting, it is determined that the image pickup condition has changed (indicated by “x” in the figure). The first item of image data is sent as a representative image to the communication I/F 209, and the list management unit 302 generates a new list at time 604. The first item of image data, selected as the representative image, is transferred to the PC 150 at time 605.
Since the second to fourth items of image data match the first item of image data in their image pickup condition (indicated by “◯” in the figure), the list management unit 302 adds them to the list as image data belonging to the same group as the first item of image data. However, they are not transferred to the PC 150.
When the first item of image data has been transferred and it is determined that no more image data of the same group as the first item of image data is added, the communication I/F 209 transfers the list to the PC 150 at time 606. That is, if at least one item of image data determined to be unmatched in the image pickup condition by the image pickup condition determination unit 301 is shot or if t or more seconds have elapsed since the last shooting, the group is fixed and the list can be transferred.
Upon the second release at time 607, processing is performed in the same manner as the processing from time 602 to time 606. However, if the transfer of the list for the first release has not been completed at time 611, no image data is transferred until the transfer of the list is completed.
Even when the continuous shooting function is not used, it is determined that the first and second items of image data match in their image pickup condition if the second item of image data is shot within t seconds from the shooting of the first item of image data. Conversely, even when the continuous shooting function is used, it is determined that a series of items of image data do not match in their image pickup condition if the continuous shooting interval is longer than t seconds.
As described above, generation of the image data, determination of the matching of the image pickup condition, management of the list, and transfer of the image data and the list are performed in parallel. Therefore, this embodiment also has an effect of improved data transfer efficiency.
If the image data 152 in the group 401, for example, is deleted after the above-described series of processing, consistency with the list 155 already transferred to the PC 150 is compromised. Therefore, image data for which the list has been generated may be protected (i.e., a deletion inhibit attribute may be added thereto) to prevent the image data from being erroneously deleted.
While the list management unit 302 selects the representative image, the list management unit 302 may select an item of image data other than the one shot first. In that case, the representative image is transferred when it is selected, rather than being transferred at time 605.
<Details of Shooting/Transfer Processing>
In step S701, the signal processor 205 generates image data.
In step S702, the image pickup condition determination unit 301 determines whether or not the image pickup condition of the image data generated in step S701 matches that of last generated image data. If a match is obtained, the process proceeds to step S706 via step S703. Otherwise, the process proceeds to step S704 via step S703.
In step S704, the list management unit 302 generates a new list and records the list on the storage medium 208. The list management unit 302 also registers the image data generated in step S701 on the generated list and sets the image data as a transferred image (see
In step S705, the communication I/F 209 reserves transfer of the image data generated in step S701 to the PC 150. As used herein, to “reserve” means to cause reserved data to be transferred when no data is being transferred between the digital camera 100 and the PC 150. Reservation is performed by, for example, storing the reserved data in a transmission queue (not shown) of the communication I/F 209.
If a match is obtained in the image pickup condition in step S703, the list management unit 302 adds in step S706 the image data generated in step S701 to the list generated in step S704.
In step S707, the CPU 201 determines whether or not a release has been performed. If a release has been performed, the process returns to step S701 to repeat the same processing. Otherwise, the process proceeds to step S708.
In step S708, it is determined whether t seconds have elapsed since the last image data generation. If t seconds have elapsed, the process proceeds to step S709. Otherwise, the process returns to step S707.
In step S709, the communication I/F 209 reserves transfer of the list. However, if only one item of image data is registered on the list, the list need not be transferred because a group of a plurality of items of image data has not been formed.
<Details of Application 160>
Items displayed in the application 160 depend on the representative images and the lists transferred from the digital camera 100.
To focus attention on the group 401, the image data acquisition buttons 162 to 164 are displayed corresponding to the image data 152 to 154 not yet to be transferred. If the image data acquisition button 164 is selected in this state, a transfer request to transfer the image data 154 is sent to the digital camera 100. When the digital camera 100 receives the transfer request, the image data 154 is transferred from the digital camera 100 and placed near the group 401. At this point, an identifier indicating that the image data 154 has been transferred is added to the transferred images 504 on the list 155. Similarly, an addition is made on the list 155 stored on the storage medium 208 of the digital camera 100 so that consistency is maintained.
<Variations>
This embodiment has been described assuming that image data such as the image data 151 is transferred as the representative image from the digital camera 100 to the PC 150. Alternatively, the representative image may be a thumbnail image for image data such as the image data 151, rather than the image data itself. This reduces the time required for transferring the representative image, and only image data that the user needs can be transferred later.
Although it has been assumed that the representative image is the first item of image data in each group (e.g., the group 401), the representative image may be other items of image data. In that case, the representative image is selected after all items of image data belonging to a group, for example the group 401, are generated. The representative image may be selected, for example, by computing all correlations between items of image data belonging to the group and selecting one with the highest total correlation among all other ones as the representative image. Furthermore, two or more items of image data may be selected as representative images.
Although this embodiment has been described assuming that the automatic transfer function of the digital camera 100 is used, the automatic transfer function may not necessarily be used. In such cases, the image data and the lists already stored on the storage medium 208 are transferred from the digital camera 100 to the PC 150. Therefore, this embodiment is even applicable to an image processing apparatus without the image pickup unit 204 as long as the apparatus can store image data and lists.
Furthermore, the digital camera 100 may generate lists at times other than shooting times. For example, when items of image data not grouped into lists are stored in the digital camera 100, if the digital camera 100 receives a list generation instruction from the operation unit 206 or the like, the digital camera 100 generates lists by referring to information such as Exif information about the image data. Specifically, the digital camera 100 uses the Exif information to obtain the image pickup condition (e.g., the shooting order) of the stored items of image data. The digital camera 100 then generates lists with a procedure similar to that of steps S701 to S707 (except S705) in
In other words, the image pickup condition determination unit 301 obtains the image pickup condition of each of the stored items of image data and classifies them by grouping ones that were continuously shot at time intervals not longer than a predetermined time. The list management unit 302 generates as many lists as the number of formed groups and registers items of image data classified into the same group on the same list.
As described above, according to this embodiment, the digital camera 100 groups items of image data matching in their image pickup condition into a group and generates a list of the grouped image data. The digital camera 100 selects a representative image from the grouped image data and transfers the representative image and the list to the PC 150. The application 160 runs on the PC 150. The user can use the application 160 to browse the grouped image data and cause any items of image data other than the representative image to be transferred from the digital camera 100 to the PC 150.
In this manner, it is possible to facilitate the user's selection of items of image data to be transferred to the external apparatus among a plurality of items of image data stored in the image processing apparatus, including ones with a high correlation with each other.
In the first embodiment, the digital camera 100 automatically groups image data. In a second embodiment, when a plurality of ungrouped items of image data are stored on the storage medium 208, the user operates the digital camera 100 to select ones to be transferred to the PC 150 while they are grouped at the same time.
In this embodiment, the configuration of the digital camera 100 is the same as in the first embodiment and thereby will not be described here.
In this embodiment, it is assumed that image data shot by the digital camera 100 is already stored on the storage medium 208. Therefore, as in the first embodiment, the image pickup condition determination unit 301 determines the matching of the image pickup condition when the image data is shot and, based on the determination, determines whether to perform generation of a list or addition to a list. Then, the list management unit 302 generates a list or registers the image data.
Before transfer, the digital camera 100 needs to set necessary information including its own IP address and the IP address of the destination PC 150.
In step S901, the user uses the display unit 104 of the digital camera 100 to browse reproduced image data and select items of image data to be transferred. After selecting the image data, the user presses an image transfer button (not shown) or the like included in the operation unit 206 to start transfer.
In step S902, the image pickup condition determination unit 301 reads the selected image data from the storage medium 208 into the RAM 203 and determines the matching of the image pickup condition by using information on the list associated with the selected image data. If a plurality of items of image data matching in their image pickup condition are selected, the user may be informed thereof via the display unit 104. If a list corresponding to a selected item of image data does not exist, the list management unit 302 generates a list and registers the image data on the list in step S903 as in the first embodiment. If a corresponding list exists, the list management unit 302 registers the selected image data on the transferred images 504.
In step S904, the communication I/F 209 transfers the selected image data and the corresponding list.
The processing described in the above embodiments may be realized by providing a storage medium, storing program codes of software realizing the above-described functions, to a computer system or apparatus. By reading the program codes stored in the storage medium with a computer (or a CPU or MPU) of the system or apparatus and executing them, the functions of the above-described embodiments can be realized. In this case, the program codes read from the storage medium realize the functions according to the embodiments, and the storage medium storing the program codes constitutes the invention. The storage medium, such as a floppy® disk, a hard disk, an optical disk, a magneto-optical disk and the like can be used for providing the program codes. Also, CD-ROM, CD-R, a magnetic tape, a non-volatile memory card, ROM, and the like can be used.
Furthermore, the functions according to the above embodiments are realized not only by executing the program codes read by the computer. The present invention also includes a case where an OS (operating system) or the like working on the computer performs part or the entire processes in accordance with designations of the program codes and realizes the functions according to the above embodiments.
Furthermore, the program codes read from the storage medium may be written in a function expansion card which is inserted into the computer or in a memory provided in a function expansion unit which is connected to the computer. Thereafter, a CPU or the like contained in the function expansion card or unit may perform part or the entire processes in accordance with designations of the program codes and may realize the functions of the above embodiments.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2006-171695, filed on Jun. 21, 2006, which is hereby incorporated by reference herein in its entirety.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006-171695 | Jun 2006 | JP | national |
