1. Field of the Invention
This invention relates to an image database apparatus and to a method of controlling the operation of the database apparatus.
2. Description of the Related Art
There are a variety of types of image database apparatus available. In one example of such an apparatus, keywords corresponding to images are registered in advance. When an image search is performed, a keyword is entered, whereby the image corresponding to the keyword is found. With an image database of this kind, however, appropriate keywords are entered in accordance with the sought images and therefore a great deal of labor is involved.
In another example of an image database apparatus, an image is drawn using draw software and an image that resembles the drawn image is found by a search. However, drawing an image that resembles the sought image is not always easy. Finding a desired image is difficult.
Accordingly, an object of the present invention is to find a desired image with comparatively little labor.
According to the present invention, the foregoing object is attained by providing an image database apparatus comprising an extraction device (extraction means) for extracting representative image data, which represents representative images of a plurality of frames, from an image database in which image data of a number of frames has been stored; a first display control device for controlling a display device in such a manner that the representative images of the plurality of frames represented by the representative image data extracted by the extraction unit are displayed in a coordinate area in a form in which they are distributed in accordance with characteristics of each of the representative images; a designating device (designating means) for designating a desired image from among the images of the plurality of frames distributed in the coordinate area based upon display control performed by the first display control device; a search device (search means) for searching the image database for an image having characteristics that resemble the characteristics of the image designated by the designating device; and a second display control device for controlling the display device in such a manner that retrieved images, which result from the search performed by the search device, are displayed in the coordinate area in conformity with the characteristics thereof.
The present invention provides also an operation control method suited to the image database apparatus. Specifically, the method comprises the steps of: extracting representative image data, which represents representative images of a plurality of frames, from an image database in which image data of a number of frames has been stored; displaying the representative images of the plurality of frames represented by the extracted representative image data on a display device in a form in which the images are distributed in a coordinate area in accordance with characteristics of each of the representative images; designating an image of a desired frame from among the images of the plurality of frames distributed in the coordinate area; searching the image database for images having characteristics that resemble the characteristics of the image designated; and controlling the display device in such a manner that retrieved images, which result from the search, are displayed in the coordinate area in distributed form.
In accordance with the present invention, representative images (representative image data) of a plurality of frames are extracted from images (image data) of a number of frames that have been stored in an image database. The extracted representative images of the plurality of frames are displayed by being distributed in a coordinate area (also referred to as a coordinate plane in which the characteristics of images are placed along the coordinate axes, which may or may not be displayed) in accordance with the characteristics of each of the representative images (color characteristics, lightness characteristics, saturation characteristics and dates of photography of the representative images).
An image resembling a sought image (an image whose characteristics resemble those of the sought image) is designated by the user from among the plurality of representative images displayed in the coordinate area. Images (usually a plurality) having characteristics that resemble those of the designated image are searched from the image database, and the images retrieved by the search are displayed in the coordinate area.
Since representative images of a plurality of frames are displayed in the coordinate area in distributed form, an image resembling the image sought by the user can be readily ascertained visually. Designating the sought image is comparatively easy. When the image is designated, images of a plurality of frames having characteristics that resemble the characteristics of the image are displayed in the coordinate area. The sought image can be selected from the images that have been re-displayed.
Since the labor involved in entering a keyword suited to an image is unnecessary, less effort is required to create the image database. Further, since images of a plurality of frames are displayed and the sought image is selected from these images, the desired image can be found relatively simply as compared with the case where an image resembling the sought image is drawn and an image resembling the drawn image is found.
Preferably, the apparatus further includes a device for performing control so as to repeat the designating of images by the designating device, searching by the search device and display control by the second display control device.
It is preferred that at least one of the first and second display control devices controls the display device so as to display images, in conformity with the characteristics thereof, in a coordinate area that is formed over the entire surface of one window.
Since the coordinate area itself is formed over the entire surface of one window (display screen), the size of one frame of an image appears larger in comparison with a case where one window is split into multiple areas and the coordinate area is formed in one of these areas. A plurality of representative images and other images, etc., displayed in this coordinate area become easier to view.
By way of example, the extraction device extracts the representative image data from image data obtained by applying a KL (Karhunen-Loéve) expansion to image data representing images of a number of frames that have been stored in the image database.
Representative images represented by representative image data extracted by the extraction device are extracted randomly, by way of example.
Preferably, coordinates axes in the coordinate area in which images are displayed in accordance with their characteristics based upon display control by the second display control device are more detailed than coordinate axes in the coordinate area in which images are displayed by being distributed based upon display control by the first display control device.
Even if images of a plurality of frames displayed in distributed form based upon display control by the second display control device have similar characteristics, these images are displayed in a form separated from one another. This makes it easier to find the sought image.
The number of frames of representative images displayed in the coordinate area based upon display control by the first display control device and the number of frames of images displayed in the coordinate area based upon display control by the second display control device may be made the same.
Since the number of frames of images to be displayed will not change, images can be maintained in an easy-to-view state by setting the number of frames of images to be displayed to a suitable number.
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
Preferred embodiments of the present invention will now be described with reference to the drawings.
The overall operation of the image database apparatus is controlled by a CPU 2.
The image database apparatus includes an image database 4 storing image data representing a number of color images (or monochrome images). Data representing the characteristics of the image data also is stored in the image database 4 in correspondence with the image data that has been stored. The characteristics of the image data include the percentage of color in an image, the average lightness of an image, the average saturation of an image and the date of photography of the image.
An output signal from an input unit 3 such as a keyboard or mouse is applied to the CPU 2. The input unit 3 outputs a signal representing an image search command, a signal indicative of the fact that a specific image has been designated, etc.
Also connected to the CPU 2 is a VRAM (Video Random-Access Memory) 1 for temporarily storing image data representing an image to be displayed on the display screen of a display unit 6. The display of an image on the display unit 6 is controlled by a display controller 5.
The image database apparatus according to this embodiment is such that a plurality of images having different characteristics are displayed on the display screen of the display unit 6 as representative images from among the number of images that have been stored in the image database 4. An image resembling a sought image is designated by the user from among the plurality of representative images thus displayed. A plurality of images having characteristics close to those of the designated image are re-displayed on the display screen of the display unit 6. By repeating this processing, the required image is found by the user. Since the required image can be found from among images being displayed on the display screen of the display unit 6, the required image can be found in comparatively simple fashion. Other features of the image database apparatus according to this embodiment will become obvious from the description that follows.
As mentioned above, the image database apparatus according to this embodiment is such that a plurality of representative images are displayed on the display screen of the display unit 6. The representative images selected for this display have various characteristics. The representative images are displayed as follows, by way of example: Consider multidimensional space in which the image characteristics are placed along the coordinate axes. In such case the images are disposed in this multidimensional space. The distances and directions of respective ones of the images from the origin of this multidimensional space are calculated as feature vectors. Representative images having a variety of feature vectors are selected.
However, in actuality, images of a multiplicity of frames have been stored in the image database 4, and the image characteristics of these images are actually multifarious. In order to calculate feature vectors of images of such a large number of frames, a great deal of calculation is required and calculation takes a long period of time. Accordingly, in the image database according to this embodiment, a KL (Karhunen-Loéve) expansion is applied to the image data that has been stored in the image database 4, thereby reducing the number of dimensions (number of coordinate axes) of the space in which the images are placed (step 11). Since the images that have been stored in the image database 4 are disposed in space in which the number of dimensions has been reduced, the time required for calculation of feature vectors can be shortened.
The images that have undergone the KL expansion are disposed in space, after which representative images are extracted based upon the feature vectors of respective ones of the images (step 12). The representative images extracted are displayed on the display screen of the display unit 6 (step 13).
As shown in
Using the input unit 3, the user designates a representative image Ir having characteristics close to those of the required image from among the representative images Ir being displayed on the display screen 21 (step 14). More specifically, the cursor 22 is moved onto the desired representative image Ir and the image is doubled-clicked, for example, using the mouse included as part of the input unit 3, whereby the image is designated. In this embodiment, it is assumed that the user has designated a representative image Is1 in
When this is done, images possessing characteristics near those of the representative image Is1 designated by the user are extracted from the image database 4 (step 15). Images of a number of frames identical with the number (ten) of frames of the representative images Ir displayed on the display screen 21 are extracted. It goes without saying that the number of frames of images extracted need not be the same. The extracted images (thumbnail images), denoted by reference characters It in
As shown in
In the embodiment described above, a KL transform is applied to the image data and representative images are extracted from the images obtained by the KL transform. However, the KL transform need not necessarily be applied. Further, it may be so arranged that representative images are extracted randomly and not based upon feature vectors.
As shown in
Ten frames of thumbnail images are displayed in the coordinate area 24 by being distributed in accordance with their characteristics in the manner illustrated in
Since detailed images are thus displayed, the user can ascertain the details of an image that are not apparent from the thumbnail image thereof.
As many apparently widely different embodiments of the present invention can be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
2001-379397 | Dec 2001 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5341466 | Perlin et al. | Aug 1994 | A |
5821945 | Yeo et al. | Oct 1998 | A |
6121969 | Jain et al. | Sep 2000 | A |
6285995 | Abdel-Mottaleb et al. | Sep 2001 | B1 |
6567797 | Schuetze et al. | May 2003 | B1 |
6804420 | Uehara et al. | Oct 2004 | B2 |
6882746 | Naveen et al. | Apr 2005 | B1 |
6948124 | Combs et al. | Sep 2005 | B2 |
6996782 | Parker et al. | Feb 2006 | B2 |
7023446 | Iwasaki | Apr 2006 | B1 |
Number | Date | Country |
---|---|---|
2000-242648 | Sep 2000 | JP |
2000-305946 | Nov 2000 | JP |
2001-256244 | Sep 2001 | JP |
2001-273302 | Oct 2001 | JP |
Number | Date | Country | |
---|---|---|---|
20030113040 A1 | Jun 2003 | US |