Patent Grant
7253822
1) Field of the Invention
The present invention relates to an image displaying apparatus, an image displaying method, an image displaying program and a computer readable record medium containing the image displaying program suited to successively display image data of a plurality of pictures on a screen of a display or the like.
2) Description of the Related Art
Heretofore, there is a technique wherein a plurality of pictures (for example, documents, photographs or the like) are read out by a picture reading apparatus such as a scanner or the like and converted into electronic data, and the obtained picture image data of the plural pictures (hereinafter, referred simply to as pictures) are successively displayed on a display unit such as a display or the like as if pages are turned over, whereby the user can visually retrieve a specific picture (hereinafter referred to as a picture to be retrieved) in the image data of the plural pictures.
In relation to the above technique, there have been proposed approaches wherein pictures are displayed at high speed in order to improve the picture retrieval efficiency (refer to patent documents 1 through 3 below).
For example, there is proposed in the patent document 1 an approach wherein pictures is thinned out or the fineness (resolution) of the picture is set to a predetermined fineness to decrease the volume of the picture, whereby the display speed for the picture is improved. In the patent document 2, there is proposed an approach wherein the resolution for pictures is degraded, whereby the display speed for the pictures is improved.
In the patent document 3, there is proposed an approach wherein picture expansion of only a specific area showing a characteristic of a picture to be retrieved (that is, a specific picture desired to be obtained in retrieval) is designated when arbitrary pictures are displayed at high speed, the other areas are displayed blank, and pictures on which only the specific area is expanded are displayed on a display unit to carry out retrieval.
[Patent Document 1] Japanese Patent Laid-Open No. HEI 8-077195
[Patent Document 2] Japanese Patent Laid-Open No. 2000-270299
[Patent Document 3] Japanese Patent Laid-Open No. HEI 7-271819
The approaches disclosed in the above patent documents 1 and 2 can be applied when a specific picture is retrieved in a plurality of pictures having clear differences in appearance that one can recognize at a glance. However, when a specific picture is retrieved in a plurality of analogous pictures in the same or almost same form such as slips in the same form, for example, it is difficult to retrieve the specific picture among them because the analogous picture are turned at high speed. In such case, the approaches disclosed in the patent documents 1 and 2 do not allow easy retrieval of a picture that is a target in retrieval.
when a specific slip is retrieved in a plurality of slips in the same form, that is, when a slip put a specific date or a slip in which one of items is corrected is retrieved in a plurality of slips in the same form, it becomes difficult to retrieve the target slip if the plural slips are turned at high speed using the approaches disclosed in the above patent documents 1 and 2. Further, if the slips are turned at a speed exceeding the redraw rate (the so-called refresh rate), there can occur the so-called frame drop that a picture is changed to the next picture before display of the picture is not yet completed, which causes difficulty in visual retrieval.
The approach disclosed in the above patent document 3 simultaneously displays a plurality of pictures having only a specific area which shows a characteristic part of a picture to be retrieved on a display unit, thereby retrieving the picture that is the target in retrieval in the analogous plural pictures in the same or almost the same form without being disturbed by the other similar portions of the plural pictures.
Since the approach disclosed in the patent document 3 simultaneously displays a plurality of pictures on the display unit to allow the user to visually retrieve a picture, the user has to move his/her eyes to visually retrieve the picture that is the target in retrieval in a plurality of pictures. For this, the retrieval speed largely depends on the user, the visibility of the user degrades as compared with the approach wherein the user fixes his/her eyes on one position to retrieve, which causes a danger that the user overlooks the image to be retrieved.
When the user retrieves a large amount of pictures, the load on the user is increased. In order to improve the efficiency of retrieval, it is alternatively possible to increase the number of pictures simultaneously displayed on the display unit. However, when the number of pictures simultaneously displayed is increased, each picture displayed on the display unit is decreased in size, which leads to degradation of the visibility.
In the light of the above disadvantages, an object of the present invention is to provide a picture displaying apparatus, a picture displaying method, a picture displaying program and a computer readable record medium containing the picture displaying program, which allow the user to visually retrieve easily and certainly without degrading the efficiency of retrieval even when the user retrieves a specific picture in a large amount of pictures in the same or almost the same form.
The present invention therefore provides a picture displaying apparatus comprising a storing unit for storing a plurality of pictures, a displaying unit for displaying at least one picture among the plural pictures, an aimed region designating unit for designating a partial region on the picture as an aimed region, an image cutting-out unit for cutting out the aimed region designated by the aimed region designating unit as an aimed region picture from each of the plural pictures, a display controlling unit for displaying the aimed region pictures of the plural pictures cut out by the image cutting-out unit on the displaying unit, the display controlling unit comprising a superposed picture forming unit for forming a superposed picture by superposing a plurality of the aimed region pictures cut out by the image cutting-out unit, and a visual effect controlling unit for displaying each of the aimed region pictures forming the superposed picture formed by the superposed picture forming unit at a predetermined transparency on the aid displaying unit.
It is preferable that the superposed picture forming unit forms the superposed picture by superposing a predetermined number of the aimed region pictures expanded in different layers, respectively. Further, it is preferable that the display controlling unit comprises an image changing controlling unit for changing the aimed region pictures forming the superposed picture by adding a new aimed region picture to the superposed picture and discarding the oldest aimed region picture among the plural aimed region pictures forming the superposed picture.
It is preferable that, when the image changing controlling unit changes the aimed region pictures forming the superposed picture, the image changing controlling unit adds a new aimed region picture and changes step-wisely the layer of each of the aimed region pictures forming the superposed picture, and the visual effect controlling unit sets step-wisely the transparency of each of the aimed region pictures according to a corresponding layer.
It is preferable that the picture displaying apparatus further comprises a picture specifying instructing unit for stopping changing of the aimed region pictures forming the superposed picture by the image changing controlling unit, and controlling to display a desired aimed region picture on the displaying unit.
It is preferable that the visual effect controlling unit enlarges the superposed picture and displays the same on the displaying unit.
The present invention further provides a picture displaying method for displaying a picture on a displaying unit in a picture displaying apparatus comprising a storing unit for storing a plurality of pictures and the displaying unit for displaying at least one picture among the plural pictures, the picture displaying method comprising the steps of an aimed region designating step of designating a partial region on the picture as an aimed region, an image cutting-out step of cutting out the aimed region designated at the aimed region designating step as an aimed region picture from each of the plural pictures, a display controlling step of displaying the aimed region pictures of the plural pictures cut out at the image cutting-out step on the displaying unit, the displaying controlling step comprising a superposed picture forming step of forming a superposed picture by superposing a plurality of the aimed region pictures cut out at the image cutting-out step, and a visual effect controlling step of displaying each of the aimed region pictures forming the superposed picture formed at the superposed picture forming step at a predetermined transparency on the displaying unit.
It is preferable that the superposed picture forming step is a step of forming the superposed picture by superposing a predetermined number of the aimed region pictures expanded in different layers, respectively, and the display controlling step comprises an image changing controlling step of changing the aimed region pictures forming the superposed picture by adding a new aimed region picture to the superposed picture and discarding the oldest aimed region picture among the plural aimed region pictures forming the superposed picture.
It is preferable that, when said aimed region pictures forming said superposed picture are changed at said image changing controlling step, a new aimed region picture is added, and the layer of each of the aimed region pictures forming the superposed picture is step-wisely changed, and a transparency of each of the aimed region pictures is step-wisely set according to a corresponding layer at the visual effect controlling step.
The present invention still further provides a picture displaying program for making a computer execute a function of displaying a picture on a displaying unit in a picture displaying apparatus comprising a storing unit for storing a plurality of pictures and the displaying unit for displaying at least one picture among said plural pictures, the picture displaying program making the computer function as an aimed region designating unit for designating a partial region on the picture as an aimed region, an image cutting-out unit for cutting out the aimed region designated by the aimed region designating unit as an aimed region picture from each of the plural pictures, a display controlling unit for displaying the aimed region pictures of the plural pictures cut out by the image cutting-out unit on the displaying unit, when the picture displaying program makes the computer function as the display controlling unit, the picture displaying program making the computer function as a superposed picture forming unit for forming a superposed picture by superposing a plurality of the aimed region pictures cut out by the image cutting-out unit, and a visual effect controlling unit for displaying each of the aimed region pictures forming the superposed picture formed by the superposed picture forming unit at a predetermined transparency on the displaying unit.
To attain the above object, a computer readable record medium according to this invention contains the above picture displaying program.
According to the picture displaying apparatus, picture displaying method, picture displaying program and the computer readable record medium containing the picture displaying program of this invention, a plurality of cut-out aimed region pictures are superposed to form a superposed picture, and each of the aimed region pictures forming the superposed picture is displayed at a predetermined transparency on the displaying unit. This enables the user to visually retrieve a target picture in a large amount of pictures in the same or almost the same form by visually retrieve in the superposed picture. Additionally, the user can retrieve at a time in a plurality of pictures, which improves the retrieval efficiency. The user needs to look at only the superposed picture formed by superposing characteristic parts (aimed regions) of pictures among which a target picture is present, which can prevent degradation of the visibility for the user who visually retrieves.
According to this invention, a predetermined number of aimed region pictures, each of which is expanded in a different layer, are superposed to form a superposed picture, and when the aimed region pictures forming the superposed picture are changed, a new aimed region picture is added to the superposed picture, while the oldest aimed region picture among the plural aimed region pictures forming the superposed picture is discarded. Accordingly, it is possible to successively add aimed region pictures to the superposed picture, which further improve the retrieval efficiency.
Since only aimed region pictures are handled, it is possible to decrease the amount of data to be handled as compared with a case where whole pictures are handled. This enables high-speed display (changing) while keeping the easy-to-look picture quality, without degrading the resolution of the pictures or thinning out the pictures, that is, without degrading the picture quality of the displayed pictures (superposed picture).
According to this invention, when the aimed region pictures forming the superposed picture are changed, a new aimed region picture is added and the layer of each of the aimed region pictures forming the superposed picture is step-wisely changed, and the transparency of each of the aimed region pictures is step-wisely set according to a corresponding layer. Accordingly, the aimed region picture of the superposed picture does not immediately disappear and cannot be seen, but is kept displayed like an afterimage at a gradually-increased transparency for a predetermined period of time. This enables the user to be able to visually retrieve very easily, and is advantageous to avoid a phenomenon such as drop frame or the like from occurring. Thus, the user can visually retrieve certainly.
The picture displaying apparatus of this invention has a picture specifying instructing unit for stopping changing of the aimed region pictures forming the superposed picture, and controlling to display a desired aimed region picture on the displaying unit. Thus, it becomes possible to certainly retrieve a target picture and specify the same.
Since the picture displaying apparatus of this invention enlarges the superposed picture and displays the same, the visibility is further improved.
Hereinafter, description will be made of embodiments of the present invention with reference to the accompanying drawings.
First, description will be made of a picture retrieval system to which a picture displaying apparatus and a picture displaying method according to a first embodiment of this invention are applied.
As shown in
The picture displaying apparatus and the picture displaying method according to the first embodiment of this invention are applied to the server 101, the picture confirming client 104 and the picture visually retrieving client 105 of the picture retrieval system 100. Hereinafter, the picture displaying apparatus and the picture displaying method according to the first embodiment of this invention will be described in detail. In this embodiment, a plurality of pictures to be retrieved are, for example, slips that contain characters and are in the same or almost the same form.
The picture reading client 102 and the picture recognizing/correcting client 103 will be described in detail later.
The storing unit 10 stores image data of a plurality of pictures (hereinafter referred simply to as pictures) 1, 2, . . . , and n to be retrieved, and layout analysis results 1a, 2a, . . . , and na corresponding to the respective pictures 1, 2, . . . , and n.
The item information 11a is information about one or more (here, plural) items (item names) contained in the picture 1. The item position information 11b is information about coordinates on the picture 1 at which each item of the item information 11a is present, which is related to the relevant item.
The item information 11a and the item position information 11b are obtained by reading the picture 1 by, for example, an OCR apparatus and analyzing the picture 1 in the picture reading client 102 and the picture recognizing/correcting client 103 described above with reference to
The edge position information 11c is information which defines positions of edges (namely, four corners of the picture) of the picture 1. The edge position information 11c can be obtained by using a known technique disclosed in Japanese Patent Application No. 2002-370596 made by this applicant, for example.
As shown in
The pictures 1, 2, . . . , and n are read out by the picture reading client 102 described above with reference to
The positions of the pictures 1, 2, . . . , and n are uniformed on the basis of detected edge positions (edge position information 11c, 12c, . . . , and 1nc) by using, for example, the technique disclosed in the above Patent Application No. 2002-370596.
The displaying unit 20 is a display unit or the like, for example, which displays at least one of the plural pictures 1, 2, . . . , and n stored in the storing unit 10.
The aimed region designating unit 30 designates a characteristic part (partial region) in a picture to be retrieved in the plural pictures 1, 2, . . . , and n as an aimed region in order that the image cutting-out unit 40 to be described later cuts out the aimed region from each of the plural pictures 1, 2, . . . , and n.
Designation of the aimed region by the aimed region designating unit 30 is done by using the techniques disclosed in the above Japanese Patent Application No. 2002-370596 and Japanese Patent No. 3463009, details of which will be described later with reference to
The image cutting-out unit 40 cuts out the aimed regions designated by the aimed region designating unit 30 from the plural pictures 1, 2, . . . , and n as aimed region pictures 1b, 2b, . . . , and nb (refer to
Cutting-out of the aimed region pictures by the image cutting-out unit 40 is done by using the techniques disclosed in the above Japanese Patent Application No. 2002-370596 and Japanese Patent No. 3463009, as well, details of which will be described later with reference to
The aimed region picture storing unit 41 stores the aimed region pictures 1b, 2b, . . . , and nb cut out by the image cutting-out unit 40.
The display controlling unit 50 displays the aimed region pictures 1b, 2b, . . . , and nb of the plural pictures cutout by the image cutting-out unit 40 and stored in the aimed region picture storing unit 41 on the displaying unit 20. As shown in
The superposed picture forming unit 51 is controlled by the image changing controlling unit 55 to be described later to superpose a predetermined number of aimed region pictures 1b, 2b, . . . , and nb of the plural pictures 1, 2, . . . , and n cut out by the image cutting-out unit 40 on one another, thereby to form a superposed picture 51A (refer to
As shown in
As shown in
The visual effect controlling unit 53 controls mainly a displaying method (visual effect) when the superposed picture 51A formed by the superposed picture forming unit 51 is displayed on the displaying unit 20. Here, the visual effect controlling unit 53 enlarges the superposed picture 51A and displays it on the displaying unit 20, and displays each of the aimed region pictures 1b, 2b, . . . , and nb forming the superposed picture 51A at a predetermined transparency in the corresponding layer.
As shown in
Namely, the visual effect controlling unit 53 displays each of the aimed region pictures 1b, 2b, . . . , and nb expanded in the corresponding layer (from the first to the α-th layer) at a transparency of the layer designated by the transparency setting unit 54. As shown in
In the example shown in
The image changing controlling unit 55 controls formation of the superposed picture 51A by the superposed picture forming unit 51 to change the aimed region pictures 1b, 2b, . . . and nb forming the superposed picture 51A. The image changing controlling unit 55 instructs the superposed picture forming unit 51 to form the superposed picture 51A in order that desired aimed region pictures among the aimed region pictures cut out by the image cutting-out unit 40 and stored in the aimed region picture storing unit 41 are formed as the superposed picture 51A and displayed on the displaying unit 20. According to this embodiment, the aimed region pictures 1b, 2b, . . . , and nb are added to the superposed picture 51A in order.
The image changing controlling unit 55 newly adds an aimed region picture to the superposed picture 51A when changing the superposed picture 51A so that the layers of the aimed region pictures forming the superposed picture 51A are step-wisely changed at this point of time. The oldest aimed region picture among the plural aimed region pictures forming the superposed picture 51A is discarded.
Namely, when the superposed picture 51A is changed, the image changing controlling unit 55 newly adds the aimed region picture nb to the first layer, shifts forward each of the aimed region pictures 1b, 2b, . . . , and (n−1)b forming the superposed picture 51A up to this time to the next layer, and discards the aimed region picture (n−(α−1))1b displayed at a transparency of 100% in the α-th layer, thereby changing the superposed picture 51A, as shown in
The image changing frequency designating unit 56 sets the number of aimed region pictures to be successively changed by the image changing controlling unit 55 in the superposed picture 51A in order to successively change the aimed region pictures forming the superposed picture 51A under a control of the image changing controlling unit 55. According to this embodiment, the image changing frequency designating unit 56 can set an arbitrary number from 1 to n.
In other words, in the superposed picture 51A shown in
The image changing speed designating unit 57 sets a speed at which the aimed region pictures forming the superposed picture 51A are successively changed (successive changing speed) when the superposed picture 51A is successively changed with aimed region pictures in number designated by the image changing frequency designating unit 56.
The stop instructing unit 58 stops changing of the superposed picture 51A by the image changing controlling unit 55, and instructs the image changing controlling unit 55 to display only the picture of a predetermined aimed region picture among the aimed region pictures forming the superposed picture 51A on the display unit 55 at this moment.
Namely, the stop instructing unit 58 stops the state in which the superposed picture 51A shown in
Note that the picture of an aimed region picture expanded in a predetermined layer displayed by the stop instructing unit 58 is not limited to the picture of an aimed region picture expanded in the third layer, but the picture of an aimed region picture expanded in any layer in the superposed picture 51A may be displayed on the displaying unit 20.
The page-turning instructing unit 59 instructs the image changing controlling unit 55 to turn the pages so that a desired picture is displayed in the state in which the changing of the superposed picture 51A by the image changing controlling unit 55 is stopped by the stop instructing unit 58 and the picture of a predetermined aimed region picture is displayed on the displaying unit 20. The retrieval is completed by displaying a picture to be retrieved by the page-turning instructing unit 59.
The stop instructing unit 58 and the page-turning instructing unit 59 together function as a picture specifying instructing unit for specifying a picture to be retrieved.
In the picture displaying apparatus according to the first embodiment, aimed region pictures designated by the aimed region designating unit 30 and cut out by the image cutting-out unit 40 are displayed as a superposed picture 51A on the displaying unit 20 by the superposed picture forming unit 51, the visual effect controlling unit 53 and the image changing controlling unit 55. At this time, an aimed region picture newly added to the superposed picture 51A is kept displayed on the displaying unit 20 at a step-wisely increased transparency until the aimed region picture becomes the oldest among the aimed region pictures forming the superposed picture 51A, thus the aimed region picture is displayed for a predetermined period of time as an afterimage, not erased immediately after displayed on the displaying unit 20.
Next, description will be made of a screen displayed on the displaying unit 20 of this picture displaying apparatus.
As shown in
The aimed region designation operating unit 70, the enlarged display operating unit 71, the afterimage display operating unit 72, the page changing operating units 73A through 73H, the stop operating unit 74 and the page-turning operating units 75A through 75D are selectively operated by means of a mouse or a keyboard connected to this picture displaying apparatus to fulfill their functions. Details of these operating units will be described later.
As shown in
Next, description will be made of the picture displaying method according to this embodiment.
Next, the aimed region designating unit 30 takes out a start point and an end point of the partial region (namely, determined by dragging the mouse) (step S12), and extracts display start coordinates, display magnification, whole size (display size) of the picture for designation on the displaying unit 20 (step S13).
The aimed region designating unit 30 obtains absolute coordinates of the partial region on the picture for designation on the basis of the start point and end point of the partial region, the display start coordinates, display magnification and whole size of the picture for designation (picture 1) (step S14).
Next, it is determined whether the item included in the item information 11a of the layout analysis result 1a in the storing unit 10 is present in the partial region or not (step S15). Here, it is determined whether the item of requested dispatch date or the item of dispatch date is included in the item information 11a or not.
When it is determined that the item included in the item information 11a is present within the partial region (Yes route at step S15), position information on this item is obtained from the item position information 11b corresponding to the item information 11a (step S16). When it is determined that this item is not present within the partial region (NO route at step S15), the above step S16 is skipped.
The aimed region designating unit 30 then designates a reference point used by the image cutting-out unit 40 in order to cut out the aimed region at the image cutting-out step S20 to be described later (step S17). The reference point is obtained by the picture reading client 102 and the picture recognizing/correcting client 103 described above with reference to
Here (at step S17), either the position information on the item included in the item position information 11b present within or neighboring to this partial region, or the position information on the four corners of the picture 1 included in the edge position information 11c on the picture 1 is designated as the reference point. When the item included in the item information 11a is present within the partial region, the position information on the item can be obtained. When the item included in the item information 11a is not present within the partial region, the position information on an item included in the item information 11a neighboring the partial region can be designated as the reference point. When the item position information 11b does not exist, the position information on any edge among edges included in the edge position information 11c can be designated as the reference point.
Next, the aimed region designating unit 30 calculates a relative position (coordinates) of the partial region to the reference point (step S18). Namely, using the absolute coordinates of the partial region obtained at the above step S14 or the item position information obtained at the above step S16, relative coordinates of the partial region with respect to the reference point designated at the above step S17 are calculated, and the relative coordinates of the partial region are designated as the aimed region.
The aimed region designating unit 30 sends the relative coordinates and the reference point to the image cutting-out unit 40, and instructs the image cutting-out unit 40 to cut out the relative coordinates as the aimed region (step S19).
As another manner, the aimed region designating unit 30 may display an aimed region setting property screen as shown in
The above steps S13 to S19 are executed by selecting an aimed region designating button 70B of the aimed region designation operating unit 70 by means of the mouse on the screen of the displaying unit 20 shown in
Next, description will be made of a procedure of the image cutting-out step S20.
The image cutting-out unit 40 adds the relative coordinates to the reference point in each of the pictures 1, 2, . . . , and n to determine each cutting-out position (step S23). The image cutting-out unit 40 cuts out the aimed region from each of the pictures 1, 2, . . . , and n to prepare (cut out) each aimed region picture (step S24), and stores it in the aimed region picture storing unit 41 (step S25).
According to this embodiment, a partial region designated at the aimed region designating step S10 is designated as the aimed region on the basis of the above reference point at the aimed region designating step S10, and each aimed region picture is cut out at the image cutting-out step S20 on the basis of the above reference point. Irrespective of a difference in position among the pictures 1, 2, . . . , and n at the time of reading and an error due to expansion and contraction of paper, each of the cut-out aimed region pictures can be stably cut out, and a difference in position and size among the aimed region pictures can be surely prevented when the aimed region pictures are superposed at a superposed picture forming step S31 to be described later.
As shown in
The display controlling step S30 further includes a stop instructing step S34 at which the stop instructing unit 58 stops changing of the superposed picture 51A at the image changing controlling step S32, and instructs to display the picture of a predetermined aimed region picture on the displaying unit 20, and a page-turning instructing step S35 at which, after the stop instructing step S34, the page-turning instructing unit 59 instructs to turn the pages until the picture displayed on the displaying unit 20 becomes a desired picture.
The superposed picture forming step S31 includes a superposed picture number setting step S36 at which the superposed picture setting unit 52 sets the number of aimed region pictures (the number of layers) forming the superposed picture 51A.
The image changing controlling step S32 includes an image changing frequency setting step S37 at which the image changing frequency designating unit 56 sets the number of aimed region pictures to be successively changed in the superposed picture 51A, and an image changing speed setting step S38 at which the image changing speed designating unit 57 sets a speed at which the aimed region pictures are successively changed in the superposed picture 51A.
The visual effect controlling step S33 includes a transparency setting step S39 at which the transparency setting unit 54 sets the transparency in each of the layers forming the superposed picture 51A.
Enlarging the superposed picture 51A and displaying the same at the visual effect controlling step S33 are executed by selecting the enlargement operating unit 71 by means of the mouse on the screen of the displaying unit 20 shown in
Setting of the number of aimed region pictures forming the superposed picture 51A at the superposed picture number setting step S36 or setting of the successive changing speed for the aimed region pictures forming the superposed picture 51A at the image changing speed setting step S38 is implemented by selectively operating the afterimage display operation unit 72 by means of the mouse on the screen of the displaying unit 20 shown in
When the afterimage display operating unit 72 is operated to be moved toward “short,” the number of layers forming the superposed picture 51A is decreased by the superposed picture number setting unit 52 at the superposed picture setting step S36, or the speed designated by the image changing speed designating unit 57 at which the superposed picture 51A is changed by the image changing controlling unit 55 is increased. Conversely, when the afterimage display operating unit 72 is operated to be moved toward “long,” the number of the layers is increased at the superposed picture number setting step S36, or the speed is decreased at the image changing speed designating step S38.
Setting of the number of aimed region pictures in the superposed picture 51A to be successively changed at the image changing frequency setting step S37 is implemented by selecting any one of the image changing operating units 73A through 73H by means of the mouse on the screen of the displaying unit 20 shown in
Each of the buttons 73A through 73H is set to a different number of aimed region pictures to be successively changed by the image changing frequency designating unit 56. For example, when the button 73A is selected, four aimed region pictures are successively turned backward in the superposed picture 51A. When the button 73G is selected, three new aimed region pictures are added to the superposed picture 51A.
According to this picture displaying method, when the user finds out a specific picture to be retrieved (that is, a picture in which the item of requested dispatch date is corrected) while the superposed picture 51A is changed with an afterimage of each aimed region picture remaining on the displaying unit 20 as above at the superposed picture forming step S31, the image changing controlling step S32 and the visual effect controlling step S33, the user selects the stop operating unit 74 by means of the mouse, whereby the stop instructing step S34 is executed to stop the changing of the superposed picture 51A and display the predetermined picture, in order to certainly specify the picture to be retrieved.
When the picture displayed at the stop instructing step S34 is not the picture to be retrieved, the user selects any one of the page turning operating unit 75A through 75D by means of the mouse, in order to display the picture to be retrieved at the page turning instructing step S35. Whereby, the picture to be retrieved is certainly retrieved, and the retrieval is completed.
The stop instructing step S34 and the page-turning instructing step S35 together function as a picture specifying instructing step of specifying a picture to be retrieved.
Here, when the page-turning operating unit 75A is operated, a picture next to the above predetermined picture displayed at present is displayed. When the page-turning operating unit 75B is operated, a picture preceding the above predetermined picture displayed at present is displayed. When the page-turning operating unit 75C is operated, the last picture (here, picture n) among pictures stored in the storing unit 10 is displayed. When the page-turning operating unit 75D is operated, the first picture (here, the picture 1) among pictures stored in the storing unit 10 is displayed.
According to the picture displaying apparatus and the picture displaying method of the first embodiment of this invention, when a specific picture is visually retrieved in a plurality of pictures 1, 2, . . . , and n stored in the storing unit 10, the aimed region designating unit 30 designates a characteristic partial region in a specific picture to be retrieved as an aimed region picture, and the image cutting unit 40 cuts out the aimed region pictures 1b, 2b, . . . , and nb from the respective pictures. The superposed picture forming unit 51 expands a predetermined number of aimed region pictures in different layers, respectively, among the cut-out aimed region pictures to form the superposed picture 1A by superposing the aimed region pictures on one another. The visual effect controlling unit 53 displays each of the aimed region pictures in a corresponding layer at a predetermined transparency in the superposed picture 51A on the displaying unit 20. Accordingly, it is possible to visually retrieve a target picture in a large amount of pictures 1, 2, . . . , and n in the same or almost the same form, and possible to do retrieval at a time in the plural pictures 1, 2, . . . , and n. This improves the efficiency of retrieval.
The user needs to look at only the superposed picture 51A formed by superposing characteristic portions (aimed regions) of pictures to be retrieved, which improves the visibility and facility for the user.
When the image changing controlling unit 55 changes the aimed region pictures forming the superposed picture 51A, a new aimed region picture is added, whereas the oldest aimed region picture among the aimed region pictures forming the superposed picture is discarded at this point of time, whereby the superposed picture 51A is changed. The image changing frequency designating unit 56 can successively add aimed region pictures to the superposed picture 51A, which can further improve the retrieval efficiency.
Since only the aimed region pictures are cut out and displayed, it becomes possible to decrease the amount of handled data as compared with a case where the whole pictures are handled. The superposed picture 51A can be displayed (changed) at high speed by setting the successive changing speed by the image changing speed designating unit 57 so that the superposed picture 51A can be clearly displayed without degrading the resolution of the picture or thinning out the picture, that is, without degrading the picture quality of the displayed picture (superposed picture).
When changing the aimed region pictures forming the superposed picture 51A, the image changing controlling unit 55 step-wisely changes the layer of each of the aimed region pictures forming the superposed picture at this point of time. Additionally, the visual effect controlling unit 53 step-wisely sets the transparency of each of the layers in the superposed picture 51A, as well. Accordingly, the aimed region pictures forming the superposed picture 51A do not immediately disappear and cannot be seen even when a new aimed region picture is added after the aimed region pictures are added to the superposed picture 51A, and the after images of the aimed region pictures are displayed for a predetermined period of time with the transparency of each of the aimed region pictures being step-wisely increased. Accordingly, visual retrieval becomes easy, a phenomenon such as drop frame or the like does not occur even when the screen is changed at high speed, and a target to be retrieved can be found out in certain.
The visual effect controlling unit 53 enlarges only the superposed picture 51A and displays it on the displaying unit 20, which improves the visibility.
The superposed picture setting unit 52 changes the number of aimed region pictures forming the superposed picture 51A, and the image changing frequency designating unit 56 and the image changing speed designating unit 57 change the successive changing speed at which the aimed region pictures forming the superposed picture 51A are changed, so that the afterimage effect of the aimed region pictures can be changed according to the number of the plural pictures 1, 2, . . . , and n in which retrieval is done or the degree of difficulty in retrieval, etc., which further improves the retrieval efficiency.
The stop instructing unit 58 stops (suspends) changing of the superposed picture 51A to display the whole of a predetermined picture on the displaying unit, and the page-turning instructing unit 59 can display a picture to be retrieved. Accordingly, it is possible to certainly retrieve a picture to be retrieved and specify the same.
Since designation of an aimed region by the aimed region designating unit 30 and cutting-out of an aimed region picture by the image cutting-out unit 40 are carried out on the basis of the item position information 11b (12b, . . . , or 1nb) and the edge position information 11c (12c, . . . , or 1nc) obtained at the time of reading of each of pictures 1, 2, . . . , and n, the positions of the aimed region pictures forming the superposed picture 51A are uniformed and superposed without deviating from one another. This can improve the visibility and stably provide the above effects. Since a common part of the pictures such as a ruled line or the like of a slip is exactly superposed on one another, for example, there is no danger that a ruled line of an aimed region picture is overlapped with a ruled line of the other and causes a difficult when the user looks at it. Thus, the visibility is excellent.
In this embodiment, it is alternatively possible that, after changing of the superposed picture 51A by the image changing controlling unit 55 is stopped by the stop instructing unit 58 (stop instructing step S34) functioning as a picture specifying instructing unit (picture specifying instructing step), the stop instructing unit 58 (stop instructing step S34) may display only a predetermined aimed region picture, not the whole picture including a predetermined aimed region picture, on the displaying unit 20, and the page-turning instructing unit 59 (page-turning instructing step S35) may display a desired aimed region picture.
Next, description will be made of a picture displaying apparatus and a picture displaying method according to a second embodiment of this invention. The picture displaying apparatus according to this embodiment is similar in structure to the picture displaying apparatus shown in
Here is thus omitted the description of the same structural parts as the first embodiment, but the description of a characteristic structural part of this embodiment will be now described with reference to the above-described
In the picture displaying method according to this embodiment, a characteristic part (partial region) of a picture to be retrieved is included in the item information 11a, 12a, . . . , and 1na stored in the storing unit 10. The picture displaying method according to this embodiment is applied when the item itself is designated as the aimed region.
As shown in
Next, it is determined whether the item is included in the item information 11a or not (step S12′). When it is determined that the item is not included in the item information 11a (No route at step S12′), this process is terminated.
When it is determined that the item is included in the item information 11a (Yes route at step S12′), item position information on the item (coordinates of the item) is obtained from the item position information 11b (step S13′).
The aimed region designating unit 30 sends the obtained item position information (coordinates of the item) to the image cutting-out unit 40, and instructs the image cutting-out unit 40 to cut out the coordinates of the item as the aimed region (step S14′).
The above steps S12′ to S14′ are executed by inputting an item name in the item name input column 70C at step S11′ on the screen of the displaying unit 20 shown in
Next, description will be made of a procedure of the image cutting-out step S20′.
The image cutting-out unit 40 cuts out the aimed region from each of the pictures 1, 2, . . . , and n on the basis of the coordinates of the item, prepares (cuts out) aimed region pictures (step S23′), and stores them in the aimed region picture storing unit 41 (step S24′).
According to the picture displaying apparatus and the picture displaying method according to the second embodiment of this invention, a partial region corresponding to item information on a picture to be retrieved is directly designated as the aimed region. Thus, the second embodiment can provide the same effect as the above first embodiment.
Next, description will be made of a picture displaying apparatus and a picture displaying method according to a third embodiment of this invention.
The stop condition designating unit 61 designates information (character information) included in an item in the aimed region in the superposed picture 51A (refer to
The image recognizing unit 62 obtains character information included in each aimed region picture by using a technique described in the above Japanese Patent No. 3463009, for example, and determines whether the condition designated by the stop condition designating unit 61 coincides with the character information or not.
When the image recognizing unit 62 determines that the condition designated by the stop condition designating unit 61 coincides with the character information, the stop controlling unit 63 makes the image changing controlling unit 55 stop changing of the superposed picture 51A at the time that the so-determined aimed region picture is displayed on the superposed picture 51A, and instructs the image changing controlling unit 55 to display the picture of that aimed region picture on the displaying unit 20.
The temporarily storing instructing unit 81 stores the picture displayed on the displaying unit 20 by the image changing controlling unit 55 according to the instruction from the stop controlling unit 63 into an exclusive storing unit, or sets a flag to an aimed region picture of the picture in the aimed region picture storing unit 41, thereby being able to again display it later.
Now, description will be made of a screen displayed on the displaying unit 20 by this picture displaying apparatus.
As shown in
Next, description will be made of the picture displaying method according to this embodiment.
As shown in
The stop controlling step S40 includes a stop condition setting step S41, an image recognizing step S42 and a stopping step S43.
At the stop controlling step S40, the stop condition setting unit 61 designates predetermined character information included in a characteristic part (item) of a picture to be retrieved as the stop condition at the stop condition setting step S41 in order to retrieve a picture that is a target in retrieval. At this time, a stop condition setting property screen as shown in
At image recognizing step S42, the image recognizing unit 62 determines whether the character information on each of aimed region pictures meets the stop condition set at the stop condition setting step S41, and the stop condition is satisfied or not.
The image recognizing unit 62 obtains character information on a predetermined item in each of the aimed region pictures, using the technique as described in the above Japanese Patent No. 3463009, for example (step S42b), and compares the obtained character information in each of the aimed region pictures with the stop condition (step S42c).
When the stop condition coincides with the character information, that is, when the stop condition is satisfied (Yes route at step S42d), the image recognizing unit 62 instructs the stop controlling unit 63 to stop changing of the superposed picture 51A by the image changing controlling unit 55 at the point of time that the aimed region picture meeting the stop condition is displayed on the superposed picture 51A (step S42e).
When the stop condition is not satisfied (No route at step S42d), the process at the image recognizing step S42 is terminated.
When the stop condition is satisfied at the image recognizing step S42, the stop controlling unit 63 stops changing of the superposed picture 51A by the image changing controlling unit 55 at the stopping step S43, and displays a picture of the aimed region picture satisfying the stop condition on the displaying unit 20.
According to the third embodiment of this invention, the picture displaying apparatus and the picture displaying method can provide the same effects as the above first embodiment. A characteristic part (character information or the like) in a picture to be retrieved is set as the stop condition, changing of the superposed picture 51A is stopped when an aimed region picture meeting the stop condition is detected, and a picture of the aimed region picture is displayed on the displaying unit 20. Accordingly, automatic retrieval becomes possible by setting the stop condition, which further improves the retrieval efficiency.
As a modification of this embodiment, the above character information may be retained in the layout analysis results 1a, 2a, . . . , and na of the storing unit 10, and the image recognizing unit 62 (the image recognizing step S42) may obtain the character information on each of aimed region pictures from the layout analysis results 1a, 2a, . . . , and na.
Next, description will be made of a picture displaying apparatus and a picture displaying method according to a fourth embodiment of this invention.
The stop condition designating unit 64 designates the rate of change in the ground color of aimed region pictures forming the superposed picture 51A. The stop condition designating unit 64 designates the upper limit of the rate of change in the ground color of an aimed region picture added to the superposed picture 51A this time to an aimed region picture added to the superposed picture 51A the last time.
The ground color comparing unit 65 detects (extracts) the ground color change rate of an aimed region picture added to the superposed picture 51A this time to an aimed region added to the superposed picture 51A the last time, and compares the detected change rate with the upper limit value (predetermined value) of the change rate set by the stop condition designating unit 64. When the change rate is larger than the upper limit value, the ground color comparing unit 65 determines that the stop condition is established.
When the ground color comparing unit 65 determines that the stop condition is established, the stop controlling unit 66 makes the image changing controlling unit 55 stop changing of the superposed picture 51A at the point of time that the so-determined aimed region picture is displayed on the superposed picture 51A, and instructs the image changing controlling unit 55 to display the picture of that aimed region picture on the displaying unit 20.
Next, description will be made of the picture displaying method according to this embodiment.
The stop controlling step S60 includes a stop condition setting step S61, a ground color comparing step S62 and a stopping step S63.
At the stop controlling step S60, the stop condition setting unit 64 designates the upper limit value of the ground color change rate of a characteristic part (aimed region) of a picture to be retrieved as the stop condition at the stop condition setting step S61 in order to retrieve the picture that is a target in retrieval.
At the ground color comparing step S62, the ground color comparing unit 65 determines whether the stop condition is established or not on the basis of the stop condition set at the stop condition setting step S61 and the ground color change rate of each aimed region picture.
The ground color comparing unit 65 obtains the ground color of the aimed region picture, using the technique as described in Japanese Patent Laid-Open No. HEI 11-096362 made by this applicant, for example (step S62b).
The ground color comparing unit 65 then determines whether detection of the ground color on this occasion is the second or later time (step S62c). When this detection is not the second or later time, that is, when this detection is the first time (No route at step S62c), the process at the ground color comparing step S62 is terminated.
When detection of the ground color on this occasion is the second or later time (Yes route at step S62c), the change rate in the ground color of an aimed region picture added to the superposed picture 51A this time to an aimed region picture added to the superposed picture 51A the last time is detected (step S62d).
It is then determined whether a result of the detection is not less than the upper limit value of the change rate set as the stop condition or not, that is, whether the stop condition is established or not (step S62e). When the stop condition is established (Yes route at step S62e), the ground color comparing unit 65 instructs the stop controlling unit 63 to stop changing of the superposed picture 51A by the image changing controlling unit 55 at the point of time that the aimed region picture satisfying the stop condition is displayed on the superposed picture 51A (step S62f).
When the stop condition is not established (No route at step S62e), the process at the ground color comparing step S62 is terminated.
When the stop condition is established at the ground color comparing step S62, the stop controlling unit 66 stops changing of the superposed picture 51A by the image changing controlling unit 55 at the stopping step S63, and displays the picture of the aimed region picture satisfying the stop condition on the displaying unit 20.
According to the fourth embodiment of this invention, the picture displaying apparatus and the picture displaying method can provide the same effect as the above first embodiment. According to the fourth embodiment, the ground color change rate of a characteristic part (aimed region) of a picture to be retrieved is set as the stop condition, changing of the superposed picture 51A is stopped when an aimed region picture satisfying the stop condition is determined, and the picture of that aimed region picture is displayed on the displaying unit 20. Accordingly, automatic retrieval becomes feasible by setting the stop condition, which further improves the retrieval efficiency. The fourth embodiment is particularly suitable for use to the picture confirming client 104 described above with reference to
As a modification of this embodiment, the ground color information may be beforehand retained in the layout analysis results 1a, 2a, . . . , and na of the storing unit 10, and the ground color comparing unit 62 (ground color comparing step S62) may obtain the ground color information on each of aimed region pictures from the layout analysis results 1a, 2a, . . . , and na.
Note that the present invention is not limited to the above examples, but may be modified in various ways without departing from the scope of the invention.
For example, the visual effect controlling unit may expand each of aimed region pictures forming the superposed picture 51A at the same transparency in the corresponding layer, in the above embodiments. When the image changing controlling unit 55 changes the aimed region pictures forming the superposed picture 51A, a new aimed region picture may be added, and the oldest aimed region picture may be simply discarded with the layers on which the aimed region pictures are expanded not moved, that is, without step-wisely shifting the layers of the aimed region pictures forming the superposed picture 51A at this point of time.
Functions of the aimed region designating unit 30, the image cutting-out unit 40, the aimed region picture storing unit 41, the display controlling unit 50, the image changing frequency designating unit 56, the image changing speed designating unit 57, the stop instructing unit 58, the page-turning instructing unit 59, the stop condition setting units 61 and 64, the image recognizing unit 62, the stop controlling units 63 and 66, the ground color comparing unit 65 and the temporarily storing instructing unit 81 are implemented by executing a predetermined application program (picture displaying program) by a computer (including a CPU, an information processing unit, various terminals).
This program is provided in a form that the program is stored in, for example, a computer readable record medium such as a flexible disk, a CD-ROM, a CD-R, a CD-RW, a DVD or the like. In which case, the computer reads out the picture displaying program from the record medium, transfers the program to an internal storage unit or an external storage unit to store the program therein, and uses the program. Alternatively, the program may be recorded on a storage (record medium) such as a magnetic disk, an optical disk, a magneto-optical disk or the like, and provided to the computer from the storage over a communication line, for example.
Here, the computer is a concept including hardware and an OS (operating system), which signifies hardware that operates under a control of the OS. When the OS is not required and the application program solely operates the hardware, the hardware itself corresponds to the computer. The hardware has at least a microprocessor such as a CPU or the like, and a means for reading out the computer program recorded on the record medium. The application program as being the above picture displaying program includes program codes for allowing the computer to implement functions as the aimed region designating unit 30, the image cutting-out unit 40, the aimed region picture storing unit 41, the display controlling unit 50, the image changing frequency designating unit 56, the image changing speed designating unit 57, the stop instructing unit 58, the page-turning instructing unit 59, the stop condition setting units 61 and 64, the image recognizing unit 62, the stop controlling units 63 and 66, the ground color comparing unit 65, and the temporarily storing instructing unit 81. A part of the functions may be implemented, not by the application program, but by the OS.
As the record medium in the above embodiments, it is possible to use various medium which can be read out by a computer such as an IC card, a ROM cartridge, a magnetic tape, a punched card, an internal storage of a computer (storage such as RAM, ROM or the like), an external storage, a printed matter on which codes such as bar codes are printed, etc., other than the above flexible disk, CD-ROM, CD-R, CD-RW, DVD, magnetic disk, optical disk and magneto-optic disk.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2004-067611 | Mar 2004 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6661425 | Hiroaki | Dec 2003 | B1 |
| 6831661 | Itoh et al. | Dec 2004 | B1 |
| 6880122 | Lee et al. | Apr 2005 | B1 |
| 6888577 | Waki et al. | May 2005 | B2 |
| Number | Date | Country |
|---|---|---|
| HEI 64-72270 | Mar 1989 | JP |
| HEI 2-197918 | Aug 1990 | JP |
| HEI 3-226862 | Oct 1991 | JP |
| HEI 6-149890 | May 1994 | JP |
| HEI 7-65026 | Mar 1995 | JP |
| HEI 7-168844 | Jul 1995 | JP |
| HEI 7-168927 | Jul 1995 | JP |
| HEI 7-230470 | Aug 1995 | JP |
| HEI 7-253769 | Oct 1995 | JP |
| HEI 7-271819 | Oct 1995 | JP |
| HEI 8-36583 | Feb 1996 | JP |
| HEI 8-77195 | Mar 1996 | JP |
| HEI 8-87519 | Apr 1996 | JP |
| 2000-270299 | Sep 2000 | JP |
| 2003-131654 | May 2003 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20050204299 A1 | Sep 2005 | US |
