Patent Application
20150095827
The present application claims priority under 35 U.S.C. §119 to Japanese Patent Application No. 2013-205847, filed Sep. 30, 2013. Each of the above application is hereby expressly incorporated by reference, in its entirety, into the present application.
1. Field of the Invention
This invention relates to a person image decision apparatus for an electronic album, a method of controlling this apparatus, and a recording medium storing the related control program.
2. Description of the Related Art
As images increase in number, it has become necessary to classify these images. To achieve this, a system in which the classifying operation is performed efficiently to improve the convenience of image management has been considered (Patent Document 1).
Further, in a person image decision apparatus for an electronic album, images suitable for an electronic album are found automatically from among a multiplicity of images upon taking into consideration such factors an image brightness. The images found are then pasted into image pasting areas of the electronic album.
Patent Document 1: Japan Patent No. 4220458
In a case where images suitable for an electronic album are found automatically, there are instances where the intentions of the user are not always reflected in the album. In an arrangement where images suitable for an electronic album are selected by the user one by one, the user will find this troublesome in cases where large numbers of images are involved.
An object of the present invention is to arrange it so that an electronic album can be generated automatically while the intentions of the user are reflected in the album.
According to the present invention, the foregoing object is attained by providing a person image decision apparatus for an electronic album, comprising: a representative person image display control device (representative person image display control means) for controlling a display device in such a manner that representative person images, which represent persons included in a multiplicity of person images, are displayed on a display screen; a representative person image selection device (representative person image selection means) for selecting a representative person image of a person image, which is to be pasted in an image pasting area included in an electronic album, from among the representative person images being displayed on the display screen under control exercised by the representative person image display control device; an image pasting area selection device (image pasting area selection means) for selecting an image pasting area in which will be pasted a person image represented by the representative person image selected by the representative person image selection device; and a person image decision device (person image decision means) for deciding upon a person image, which is to be pasted into the image pasting area selected by the image pasting area selection device, from among person images represented by the representative person image selected by the representative person image selection device.
The present invention also provides a control method suited to the above-described person image decision apparatus for an electronic album. Specifically, the present invention provides a method of controlling a person image decision apparatus for an electronic album, comprising the steps of: a representative person image display control device controlling a display device in such a manner that representative person images, which represent persons included in a multiplicity of person images, are displayed on a display screen; a representative person image selection device selecting a representative person image of a person image, which is to be pasted into an image pasting area included in an electronic album, from among the representative person images being displayed on the display screen under control exercised by the representative person image display control device; an image pasting area selection device selecting an image pasting area in which will be pasted a person image represented by the representative person image selected by the representative person image selection device; and a person image decision device deciding upon a person image, which is to be pasted into the image pasting area selected by the image pasting area selection device, from among person images represented by the representative person image selected by the representative person image selection device.
The present invention also provides a recording medium storing a computer-readable program for implementing a method of controlling a person image decision apparatus for an electronic album.
The representative person image selection device, by way of example, selects a plurality of representative person images of person images, which are to be pasted into image pasting areas included in an electronic album, from among representative person images being displayed on the display screen under control exercised by the representative image display control device; and the person image decision device, by way of example, decides that a person image, which includes a plurality of persons represented by the plurality of representative person images selected by the representative person image selection device, is a person image to be pasted into an image pasting area selected by the image pasting area selection device. The representative person image display control device, by way of example, controls the display device in such a manner that representative thumbnail person images, which are thumbnail images of representative person images representing persons included in a multiplicity of person images, are displayed on the display screen; the representative person image selection device, by way of example, selects a representative thumbnail person image of a person image, which is to be pasted into an image pasting area included in an electronic album, from among representative thumbnail person images being displayed on the display screen under control exercised by the representative person image display control device; the image pasting area selection device, by way of example, selects an image pasting area for pasting a person image represented by the representative thumbnail person image selected by the representative person image selection device; and the person image decision device decides upon a person image, which is to be pasted into the image pasting area selected by the image pasting area selection device, from among person images represented by the representative thumbnail person image selected by the representative person image selection device.
The person image decision device may include, by way of example, a thumbnail person image detection device (thumbnail person image detection means) for finding a thumbnail person image of a person image represented by a representative thumbnail person image selected by the representative person image selection device. In this case, the person image decision device would decide upon a person image, which is to be pasted into an image pasting area selected by the image pasting area selection device, from among person images corresponding to the thumbnail person image found by the thumbnail person image detection device. The person image decision device may include, by way of example, a first person image grouping device (first person image grouping means) for grouping a multiplicity of person images into a plurality of person image groups per person included in the person images. In this case, the person image decision device would decide upon a person image from among person images included in a person image group, which is represented by a representative thumbnail person image selected by the representative person image selection device, from among the person image groups grouped by the first person image grouping device.
The apparatus may further comprise: an image-capture time series grouping device (image-capture time series grouping means) for dividing a multiplicity of person images into a multiplicity of groups in accordance with chronological order of image capture; and a correlation device (correlation means) for correlating the multiplicity of groups, into which the person images have been divided by the image-capture time series grouping device, with pages of an electronic album in such a manner that the older the image-capture time, the earlier the pages with which the groups are correlated. In this case, the person image decision device would decide upon a person image, which is to be pasted into an image pasting area selected by the image pasting area selection device, from among person images that are included in a group correlated with a page on which the image pasting area selected by the image pasting area selection device exists, and that are represented by a representative person image selected by the representative person image selection device.
The person image decision device decides upon person images in such a manner that different person images are pasted into different image pasting areas.
The apparatus may further comprise a notification device (notification means) for notifying of the fact that the person image decision device could not make a decision when such is the case.
The apparatus may further comprise a person image count calculation device (person image count calculation means) for calculating the number of person images that include a person represented by a representative person image. In this case, the representative person image display control device would display the number of person images, which has been calculated by the person image count calculation device, on the display screen in association with the corresponding representative person image.
The representative person image display control device, by way of example, controls the display device in such a manner that representative person images are displayed on the display screen in order of decreasing number of person images.
The apparatus may further comprise a determination device (determination means) for determining whether a new person image has been applied to the person image decision apparatus for an electronic album. In this case, in response to a determination by the determination device that a new person image has been applied to the person image decision apparatus for an electronic album, the person image count calculation device would re-calculate the numbers of person images represented by representative person images.
The representative person image display control device, by way of example, in response to selection of a representative person image selected by the representative person image selection device, may control the display device in such a manner that a person image represented by the selected representative person image is displayed on the display screen.
The representative person image display control device, in response to selection of a plurality of types of representative person images selected by the representative person image selection device, may control the display device in such a manner that a person image that includes a plurality of persons represented by the plurality of types of representative person images is displayed on the display screen.
The representative person image selection device, by way of example, selects a representative person image indicative of display and a representative person image indicative of non-display from among representative person images being displayed on the display screen under control exercised by the representative image display control device; and the person image decision device, by way of example, decides, from among a multiplicity of person images, person images that include a person represented by the representative person image selected by the representative person image selection device as being indicative of display, but that do not include a person represented by the representative person image selected by the representative person image selection device as being indicative of non-display.
The apparatus may further comprise a manual mode setting device (manual mode setting means) for setting a manual mode; and a person image display control device (person image display control means), responsive to setting of the manual mode by the manual mode setting device, for displaying a person image, which includes a person represented by a representative person image selected by the representative person image selection device, on the display screen from among person images of a multiplicity of images.
The apparatus may further comprise a person image detection device (person image detection means) for finding person images, which include a person represented by a representative person image selected by the representative person image selection device, from among a multiplicity of person images. In this case, by way of example, the person image display control device would control the display device in such a manner that the person images found by the person image detection device are displayed on the display screen.
The apparatus may further comprise a second person image grouping device (second person image grouping means) for grouping a multiplicity of person images into a plurality of person image groups per person included in the person images. In this case, the person image display control device would control the display device so as to display on the display screen a person image included in a person image group, which is represented by a representative person image selected by the representative person image selection device, from among person image groups into which the person images have been grouped by the second person image grouping device.
The apparatus may further comprise a person image designation device (person image designation means) for designating a person image, which is to be pasted into an image pasting area selected by the image pasting area selection device, from among person images being displayed on the display screen under control exercised by the person image display control device.
The apparatus may further comprise an electronic album generating device (electronic album generating means) for generating an electronic album by pasting person images, which have been designated by the person image designation device, into image pasting areas selected by the pasting area selection device.
The apparatus may further comprise a third person image grouping device (third person image grouping means) for grouping a multiplicity of person images into a plurality of person image groups per person included in the person images; and a representative person image decision device (representative person image decision means) for deciding, per person image group into which the person images have been grouped by the third person image grouping device, a representative person image of person images included in the person image group. In this case, for example, the representative person image display control device would control the display device in such a manner that the representative person image decided by the representative person image decision device is displayed on the display screen.
In accordance with the present invention, representative person images representing persons included in a multiplicity of person images are displayed on a display screen. A representative person image of a person image to be pasted into an image pasting area of an electronic album is selected by the user from among the representative person images being displayed. Further, the image pasting area into which a person image is to be pasted is selected by the user. Person images to be pasted into image pasting areas are decided from among person images represented by the selected representative person image, as a result of which an electronic album is generated. Although which person image of a particular person is pasted into an image pasting area is selected by the user, the specific person image that will be pasted into the image pasting area is decided by the person image decision apparatus for the electronic album. Even though there are a multiplicity of person images, an electronic album that reflects the intentions of the user is generated. In accordance with the present invention, a multiplicity of person images are represented using representative person images, thereby making it easy for the user to specify images. Accordingly, it is considered that a multiplicity of person images is the number of person images that will not fit on one screen, e.g., ten or more person images. Further, in a case where the present invention is applied to an electronic album, the electronic album will be one in which images of four to five people are arrayed on multiple pages such as 24 pages, 36 pages or 48 pages, and in which an average or four or five images will be placed on each page. In this case, therefore, tens to hundreds of person images are considered to constitute the multiplicity of person images (plurality of person images).
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
A preferred embodiment of the present invention will be described in detail with reference to the drawings.
Although the electronic album generating apparatus 1 is installed in a supermarket or convenience store or the like, an electronic album can also be generated by installing an operation program, described below, in a personal computer in the possession of the user.
The overall operation of the electronic album generating apparatus 1 is controlled by a CPU 2.
The electronic album generating apparatus 1 includes a display device 6 having a touch-sensitive panel 5 formed on a display screen. A signal indicating that the touch-sensitive panel 5 has been touched is input to the CPU 2.
The electronic album generating apparatus 1 further includes an input unit 9 inclusive of a keyboard, mouse and the like, and a memory 10 for storing data and the like temporarily. The electronic album generating apparatus 1 further includes a hard disk 12, a hard-disk drive 11 for accessing the hard disk 12, and a communication unit 13 for communicating with a server or the like via the Internet.
When a CD-ROM (compact disk-read-only memory) (recording medium) 7 storing an operation program (described later) is loaded into a CD-ROM drive 8, the operation program that has been stored on the CD-ROM 7 is read and the read operation program is installed in the electronic album generating apparatus 1. It may of course be arranged so that the operation program is downloaded by the communication unit 13 and the downloaded operation program is then installed in the electronic album generating apparatus 1.
If a memory card 3 storing person image files representing a multiplicity of person images (images that include persons) to be pasted in (combined with) an electronic album is loaded in a memory card reader 4, the multiplicity of image files are read from the memory card 3 by the memory card reader 4.
The memory card 3 storing a multiplicity of person image files (the terminology “multiplicity of person image files” generally refers to files representing tens of images or more that will not fit on one screen, these being person images the number of which is considered to be necessary for generating an electronic album) is loaded in the memory card reader 4 by the user. In response, the multiplicity of person image files stored on the memory card 3 are read by the memory card reader 4 and stored temporarily in the memory 10 (step 21). As shown in
Each of the multiplicity of person images represented by the multiplicity of person image files is subjected to person recognition processing by the CPU 2 so that person discrimination is carried out (step 22). By virtue of these processing steps, the persons included in each of the person images are recognized so that it can be ascertained whether a person is identical with or different from another. When this is done, the person images are grouped person by person (step 23).
With reference to
When the person images are grouped person by person, the number of person images included in each person image group is counted (step 24). For example, the numbers of person images in the respective person image groups are counted with the results being that person image group GA has 243 person images that include “Mr. A”, person image group GB has 211 person images that include “Mr. B”, person image group GC has 167 person images that include “Mr. C”, and person image group GD has 87 person images that include “Mr. D”. (This is the function of person image count calculation means.)
Next, representative thumbnail person images representing the persons of the person images included in the respective person image groups are generated for every person image group (step 25). As shown in
When this is done, a mode selection screen for selecting either a manual mode or automatic mode is displayed on the display screen of the display device 6 (step 26). (This is the function of manual mode setting means and automatic mode setting means.) The manual mode is a mode in which the user selects person images to be pasted in the electronic album while the user checks the person images. The automatic mode is such that although the user makes the decision with regard to the persons of person images to be pasted in the electronic album, specifically it is the CPU 2 of the electronic album generating apparatus 1 that decides the person images to be pasted in the electronic album. The manual mode will be described first.
When the manual mode is set by the user, a layout selection screen shown in
With reference to
When the add-page command area 64 is clicked using a mouse (or when the touch-sensitive panel 5 is tapped), page planning areas are displayed in the page image display area 51 in the order of the pages. For example, initially a page planning area for the first page is displayed in the page image display area 51. If the desired layout image is dragged and dropped onto the page planning area, the layout becomes that of the page indicated by this page planning area (step 32: select layout). When the selection of layout of all pages of the electronic album is finished, the layout quit command area 74 is clicked by the user. Layout selection processing ends as a result (step 33).
A frame designation screen is then displayed on the display screen 50 (step 34). (This is the function of image pasting area selection means.)
A layout image (layout image 71 in
A representative thumbnail person image display area 77 is formed on the right side of the frame designation screen at the upper portion thereof (this is the function of representative person image display control means). The (plurality of) representative thumbnail person images RA, RB, RC and RD generated (decided) in the manner described above are being displayed in the representative thumbnail person image display area 77. The numbers of person images that include the persons represented by the representative thumbnail person images RA, RB, RC and RD are being displayed below and in association with respective ones of the representative thumbnail person images RA, RB, RC and RD. The representative thumbnail person images RA, RB, RC and RD are being displayed on the display screen 50 in order of decreasing number of person images.
Formed on the right side of the frame designation screen at the lower portion thereof is a display-target person image command area 78 for providing the electronic album generating apparatus 1 with a command that causes display of a person image that is to be displayed (this is the function of representative person image selection means). The requirements of a person image that will be pasted in the electronic album are being displayed in the display-target person image command area 78. In the example illustrated in
Formed on the right side of the frame designation screen at the lower portion thereof is a display-target person image command area 88. Areas 91 to 94 are formed within the area 88. Characters reading “DISPLAY THIS PERSON” follow the areas 91 and 92, and characters reading “DO NOT DISPLAY THIS PERSON” follow the areas 93 and 94. By dragging and dropping representative thumbnail person images onto the areas 91 to 94, person images conforming to the requirement set forth in the display-target person image command area 88 will be displayed on the display screen 50. For example, if we assume that the representative thumbnail person images RA, RB, RC and RD have been dragged and dropped onto the areas 91, 92, 93 and 94, respectively, then the CPU 2 will find person images that include the person “Mr. A” represented by the representative thumbnail person image RA and the person “Mr. B” represented by the representative thumbnail person image RB but that do not include the person “Mr. C” represented by the representative thumbnail person image RC and the person “Mr. D” represented by the representative thumbnail person image RD. The person images thus found are displayed on the display screen 50 by clicking the list-display command area 79A.
The frame designation screen shown in
Further, a representative thumbnail person image need not necessarily be dragged and dropped. It may be arranged so that after a desired frame or frames is designated by the user, a desired one or plurality of representative thumbnail person images is selected (clicked) from among the representative thumbnail person images being displayed in the representative thumbnail person image display area 77. In this case as well, person images that include the person represented by the selected representative thumbnail person image are found and displayed on the display screen 50 by clicking the list-display command area 79A.
When the frame designation screen is displayed, the desired layout image is caused to be displayed on the display screen 50 by the user. By moving a cursor 80 onto a frame included in the layout image being displayed and then clicking the mouse, the frame in which a person image is to be pasted is designated. In the example shown in
With reference to
The user drags and drops a desired person image P, which is from among the person images P being displayed in the person image list display area 100, onto a designated frame (frame 81) (step 39). When this is done, the person image P that has been dragged and dropped is pasted in the designated frame 81 (step 40), as shown in
Thus, a person image that includes a desired person can be designated by the user from among a multiplicity of person images in comparatively simple fashion.
Formed at the lower right of the display screen are a back-command area 85 bearing characters reading “BACK” and a complete-command area 86 bearing characters reading “COMPLETE”. The immediately preceding screen is restored as a result of the user clicking the back-command area 85. The electronic album is completed as a result of the user clicking the complete-command area 86. (This is the function of electronic album generating means.)
If a new memory card is loaded in the electronic album generating apparatus and a new person image file is read from the memory card (“YES” at step 41) (this is the function of designation means), then the person image represented by the newly read person image file is subjected to face recognition and person discrimination (step 42). The person that has been discriminated is classified so as to fall in any group of the person image groups into which person images have been grouped in the manner described above (step 43). As a result, the number of person images being displayed below the representative thumbnail person image is re-calculated and updated by the CPU 2 (step 44).
In the foregoing embodiment, person images that include a person represented by a representative person image are found. However, since person image groups GA to GD are generated, as described with reference to FIG.
5, it may be arranged so that these person image groups GA to GD are utilized to display person images that include a person represented by a selected representative person image. For example, in a case where the representative thumbnail person images RA to RD are being displayed, as shown in
In a case also where the automatic mode has been set, the layout selection screen (
If the automatic mode has been set, the automatic decision command area 79B is displayed instead of the list-display command area 79A (see
The horizontal axis in
The person images are grouped in accordance with an image-capture time series in such a manner that the number of groups will be the same as the number of pages in the electronic album (step 112). The number of pages in the electronic album is decided in the processing for selecting the layout in the manner described above. In a case where the number of pages in the electronic album has been predetermined, the person images are grouped by the CPU 2 in accordance with the image-capture time series in such a manner that the number of groups will be the same as the number of pages (this is the function of image-capture time series grouping means).
Assume that the number of pages in the electronic album is five. Accordingly, the person images are grouped into five groups G1 to G5 in accordance with the image-capture time series so as to conform to the number of pages. Image-capture dates and times are graphed from newest to oldest in the order t1, t2, t3, t4 and t5. The groups and the pages of the electronic album are correlated in such a manner that the older the image-capture time, the earlier the album pages with which the groups are correlated (this is the function of correlation means). Each of the groups G1 to G5 includes captured images of different persons. For example, if the group is group G1, then group G1 indicates that person images PA, PB and PC are included. The same holds true for the other groups G2 to G5 as well.
When the person images are divided into groups that are in accordance with the image-capture time series, the person image of a person represented by the designated representative image is pasted in a frame of the page that corresponds to the group (step 41). For example, assume that the automatic decision command area 79B has been clicked under the conditions shown in
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-205847 | Sep 2013 | JP | national |
