Patent Application
20070188628
1. Field of the Invention
The present invention relates to an image display controlling apparatus, an image display controlling method and an image display controlling program, which can be employed particularly preferably in a technique for displaying a plurality of image data easily viewable by a viewer in an apparatus for displaying and observing digital image data.
2. Description of the Relates Art
With the start of the digital high vision broadcast and spread of television receivers compatible to the high vision, dynamic and high quality video images can be enjoyed compared with the conventional ones. In contrast, according to the spread of electronic still cameras, more and more users enjoy electronic still images and video images displayed not only on a personal computer but also on a television monitor screen.
Then, in the case the user view a still image or a video image on the television receiver, in general, the user selects the data to be reproduced by viewing a list of thumbnails displayed on the monitor screen and selecting the thumbnail.
In contrast, recently, a memory with the memory capacity dramatically increased can be utilized, and thereby the number of the images to be stored is increased dramatically. For example, digital photographs of more than 500 pieces can be stored in a memory card. Therefore, it is not easy for a user to find out a desired image datum out of the image data of the large amount.
As a technique for arranging the image data of a large amount efficiently on a screen for facilitating the selection by the user himself, for example, the techniques disclosed in the patent document 1 (Unexamined Patent Publication No. 2001-306375) and the patent document 2 (Unexamined Patent Publication No. Hei 09-259130) can be presented. Among them, the patent document 1 discloses a technique for easily finding out desired data by moving thumbnail images while superimposing and displaying the same. Moreover, the patent document 2 discloses a technique for finding out desired data by displaying the image data in a three dimensional space (3D space) and moving the virtual view point.
However, according to the above-mentioned conventional techniques, since the thumbnail images are displayed while being superimposed, and thus the important portions for judging the photographs can be hidden.
Specifically, as shown in
However, in the case these photographs are displayed with the other photographs while being superimposed, as shown in
Accordingly, an object of the present invention is to provide an image display controlling apparatus, an image display controlling method and an image display controlling program, capable of displaying a large number of image data while maintaining the state to be listed by the content intended by the photographer at the time of shooting, easily finding out the purposed image in the case of selecting a desired image by judging the displayed images, and searching and finding out a desired image easily by the user even in the state with a large number of digital images arranged efficiently on the screen.
In order to achieve the above-mentioned object, according to the present invention, in the case of displaying a plurality of images, at least attention area information set for each image and date and time information are stored, protection area information is produced by setting the protection area in the attention area according to the evaluation of the attention area information based on the standard date and time information and the image date and time information, and the plurality of the images are listed and displayed with the image superimposition controlled based on the produced protection area information.
That is, a first aspect of the present invention is an image display controlling apparatus comprising: a memory means for storing an attention area information and a date and time information for each image data of a plurality of images to be displayed on an image display means, an evaluation means for evaluating the attention area information based on a standard date and time information and the date and time information and producing a protection area information for a protection area set within the attention area, and an adjusting means for listing and displaying the plurality of the images with a superimposition controlled based on the protection area information, the plurality of the images are listed and displayed.
A second aspect of the present invention is an image display controlling method comprising: a step of storing the attention area information and the date and time information for each image data of a plurality of images data, a step of evaluating the attention area information based on the standard date and time information and the date and time information, a step of producing protection area information for a protection area set within the attention area, and a step of listing and displaying the plurality of the images with the superimposition of the display of the plurality of the images controlled based on the protection area information.
A third aspect of the present invention is an image display controlling program for having a display controlling means for controlling an image display means execute: a step of storing the attention area information and the date and time information for each image data of a plurality of images, a step of evaluating the attention area information based on the standard date and time information and the date and time information, a step of producing protection area information for a protection area set within the attention area, and a step of listing and displaying the plurality of the images with the superimposition of the display of the plurality of the images controlled based on the protection area information.
As heretofore explained, according to the present invention, since the protection area obtained by evaluating the attention area information set in the image data according to the date and time information of the image data and the standard date and time information is controlled so as to be displayed according to the superimposition with the other images at the time of displaying a large number of image data with a part of the image data display range superimposed with each other, a larger number of image data can be displayed while maintaining the state to be listed by the content intended by the photographer at the time of shooting so that a purposed image can be find out easily at the time of selecting a desired image by judging the displayed images.
The invention, together with further advantages thereof, may best be understood by reference to the following description taken in conjunction with the accompanying drawings in which:
Hereinafter, the embodiments of the present invention will be explained with reference to the drawings. The same numerals are applied to the same or corresponding parts in the all drawings in the following embodiments.
First, an image display controlling apparatus according to the first embodiment according to the present invention will be explained.
(Digital Television Receiving Apparatus)
First, a signal received by an antenna (not shown) is inputted into a tuner section 101 shown in
By the demultiplexer section 102, the video data and the audio data are taken out from the TS data provided by the time division multiplexing of the video, audio data and electronic program guide (PG) data and the data broadcast data, or the like supplied from the tuner section 101 so as to be supplied to a image/sound decoder section 103. The video data processed by the image/sound decoder section 103 are written in a video memory 107. The video data written in the video memory 107 are supplied to a display device 112 as an image displaying means via a display synthesis section 108. On the other hand, the audio data processed by the image/sound decoder section 103 are outputted from an audio output section 104.
A card slot 109 is an interface for the connection with a removable memory card, or the like. According to the first embodiment, it is used for inputting the image data photographed by a digital camera. The image data input section 105 is an input circuit for inputting the digital image data from a memory card (not shown) connected with the card slot 109. The image processing section 106 is for applying an image process to the digital image data inputted from the image data input section 105. The digital image data with the image process applied are stored in a video memory 107 as one of the memory means.
A display control section 110 is an arithmetic processing unit comprising, for example, a CPU (central processing unit). The display control section is a control circuit for commanding reading of the image to the image data input section 105, commanding execution of the process to the image processing section 106, writing the display data to the video memory 107, commanding the synthesis process to the display synthesis section 108, and commanding storage of the information to the storage section 113 as the memory means. Moreover, the display control section 110 to serve as the adjusting means and the evaluation means can obtain the input data from the remote controller 114 via the user input section 111. Moreover, the display control section 110 serves also as the related information obtaining section for obtaining the photographing data applied to the digital image data via the image data input section 105. Moreover, in the case the image display controlling method according to the present invention is realized as a software program, various processing steps are executed by the display control section according to the program. Moreover, the display control section 110 serves also as a so-called layout determining section for controlling the display position of the image data based on the related information obtained from the image data by the cooperation with the image processing section 106.
(Remote Controller Device)
Next, the remote controller device for supplying an operation signal to the DIGITAL TELEVISION RECEIVING APPARATUS by the user will be explained.
As shown in
A power source key 202 is a key for turning on or off the power source. A cursor determining key 203 comprises a cursor key and a determining key with the determining key disposed in the center of the up, down, right and left buttons.
The up and down keys 204, 205 comprises mainly two keys of up and down. Numeral keys 206 comprise numeral keys of 1 to 9 and 0 arranged in a matrix. Color keys 207 comprise, for example, buttons of four colors including blue, red, green and yellow.
Moreover, a monitor board key 208 is a key for switching the display mode to be displayed on the television receiving unit. Furthermore, a viewer key 209 is a key for calling the image viewer function. The remote controller 114 shown in
The image data used as an example in the first embodiment are still image and video data photographed by the digital camera. As the still image data, those recorded in the memory card as the still image data film after applying the JPEG compression process by the digital camera are used. Moreover, as the video data, as in the case of the still image data, an image group with the JPEG compression process applied per frame unit by the digital camera, recorded in the memory card as the video image data file are used. In the description hereafter, the “image data” denote at least one of the still image data and the video image data.
Then, each image data have the information at the time of photographing by the digital camera applied. The information at the time of photographing includes in addition to the photographing date and time and the type of the camera, for example, the photographing scene mode, the focus position information showing the focus position in the finder at the time of photographing, the stroboscope light emission state information, the information showing the distance with respect to the object, the zooming state information, or the like as the attention area information. According to the digital camera used in the first embodiment, one having any of “left”, “middle”, “right” recorded as the focus position information in the finder at the time of photographing is used.
(Operation of the Digital Television Receiving Apparatus)
Next, the operation of the digital television receiving apparatus 100 according to the first embodiment will be explained. The list display of the digital images in the digital television receiving apparatus 100 according to the first embodiment will be started by an operation of calling the image viewer function by the remote controller operation after loading and mounting the memory card into the card slot 109 by the user.
According to the first embodiment, the attention area is a round area with a radius r1 around the focus point position on the image data set by the focus position information, and three areas are set according to the “left”, “middle” and “right” of the focus position information. Moreover, the attention area shown in
In the case the “viewer” key 209 of the remote controller is pressed shown in
That is, first, in the step S301, the total number of the image files present in the memory card inserted in the card slot 109 is read out and stored by the display control section 110 via the image data input section 105.
Then, in the next step S302, 1 is set in the counter N for showing the ordinal number of the image data so as to be initialized. Thereafter, in the step S303, the Exif header information of the Nth image file is read out. In this stage, the Exif header information of the first image file is read out.
Then, in the step S304, whether or not the focus position information is included in the Exif header information of a predetermined image is judged. As a result, in the case the focus position information is included in the Exif header information, it proceeds to the step S305 so that the attention area of the focus position corresponding to the focus position information is determined by the display control section 110 out of the three attention areas of the left focus point attention area, the central focus attention area and the right focus point attention area shown in
In the case the photographing scene mode is included in the image data in the step S306, it proceeds to the step S307 so that the attention area corresponding to the photographing scene mode information is determined out of the attention areas shown in
Thereafter, it proceeds to the step S309 so as to add 1 to the counter N. Then, it proceeds to the step S310 so that whether or not the counter N is the same as or less than the image total number is judged. As a result of the judgment, in the case the counter N is not same as or less than the image total number, that is, the value of the counter N is more than the image total number, the list display process is finished. On the other hand, in the case the counter N is same as or less than the image total number, it returns to the step S308 so as to execute successively the same processes to the image data by the display control section 110. Thereby, the attention area is determined successively for each image data for the image total number (steps S309, S310).
At the stage with the attention areas set for the all image data, the operation process is finished. Then, the attention areas set as mentioned above are stored in the storage section 113 together with the photographing information applied to the image data.
(Process for Determining the Protection Area)
Next, the protection area in each image data will be determined according to the photographing date and time information (hereinafter, it is referred to as the date and time information) as the date and time information included in each image data. That is, as to the size of the protection area, a different area is provided according to the attention area and the photographing date and time of the individual image. The method for determining the protection area for each image data will be explained specifically hereafter.
That is, as shown in
Next, it proceeds to the step S402 so that the time unit at the time of calculating the passed time from the standard date and time will be selected. Specifically, for example, it is selected based on the difference with respect to the time and date farthest from the reference time and date out of the time and date information of the image data to be displayed. Then, in the case the difference is more than one day or several days (specifically, for example, 3 days), the day is selected as the unit, and in the case it is more than several months (specifically, for example, 3 months), the month is selected as the unit. On the contrary, in the case the difference is less than 1 day, the hour or the minute is selected.
Next, it proceeds to the step S403 so that the integration variable Sum of the total temporary protection area to be described later, and the counter N of the image data and the counter c are initialized. Specifically, the integration variable Sum of the total temporary protection area is set at 0, the counter N at 1 and c at 0.
Thereafter, it proceeds to the step S404 so that the attention area of the image data are evaluated based on the date and time data. Specifically, the passed time ΔN from the photographing date and time information to the standard date and time is calculated based on the selected passed time unit concerning the Nth image data.
Thereafter, it proceeds to the step S405 so that whether or not ΔN is 0 or more is judged. As a result of the judgment, in the case ΔN is negative, that is, the standard date and time is former than the photographing date and time, the image data are not dealt with as the display subject so that it proceeds to the step S410 to be described later. On the other hand, in the case ΔN is 0 or positive, it proceeds to the step S406 so that the image data are dealt with as the display subject.
Thereafter, it proceeds to the step S407 so that the temporary evaluation coefficient αN of the attention area is calculated in a form including the coefficient k based on the passed time. Here, the temporary evaluation coefficient αN is the coefficient for evaluating the attention area and calculating the protection area according to the passed time ΔN from the photographing date and time of the image data N to the reference date and time. According to the first embodiment, it is defined by the formula 1 such that the protection area becomes gradually smaller according to the passed time.
αN=exp(−kΔN) (formula 1)
Then, it proceeds to the step S408. Here, the protection area is the area to be obtained by evaluating the area of the attention area SON in proportion to the coefficient of the formula 1. That is, the temporary area SN of the protection area of the image data N can be calculated by the following formula 2.
SN=αN×SON (formula 2)
As mentioned above, the attention area in the first embodiment is defined by a circle having a radius r1, r3, or an ellipse having longer diameter and shorter diameter of 2r2 and r2. Therefore, the temporary area SON of the attention area is calculated by the following (formula 3) to (formula 6), respectively.
(Attention area according to the focus position information)
SON=π(r1)2 (formula 3)
(photographing mode information: attention area by the person mode)
SON=π(r2)2 (formula 4)
(photographing c mode information: attention area by the scenery mode)
SON=2π(r2)2 (formula 5)
(attention area in the case of not having the photographing information)
SON=π(r3)2 (formula 6)
That is, in the step S409, the temporary total area Sum of the protection area integrated for the N pieces of image data is calculated as a polynomial of k by developing the (formula 1) to an appropriate progression. The following (formula 7) is the case of the polynomial development to the binomial term of k.
Sum=ak2+bk+c (formula 7)
After executing the calculations, in the step S410, 1 is added to the counter N for the calculation of the processed number of pieces.
The calculation in the above-mentioned steps S404 to step S409 is repeated until the number of the image data to be processed exceeds the total number of the images.
In the case the calculation process is executed for the all image data to be processed, then, it proceeds to the step S412 so that the coefficient k for displaying the image data on the display area is calculated. That is, as it will be described later, the position control for not superimposing the protection areas with the other parts superimposed with each other is executed. Moreover, on the other hand, the area not to be superimposed on the outside of the protection area is present. Then, the area Sum of the protection area should be disposed in the displayable area, that is, in the area of the display area Sall. Thereby, with the ratio of the protection area effective with respect to the display area represented as the superimposition efficiency β, the (formula 8) condition is needed.
Sall≧(1/β)×Sum (formula 8)
Then, in the step S412, the coefficient k for setting the protection area by evaluating the attention area according to the passed time to the standard date and time is calculated by the (formula 7).
Then, after initializing the counter N (N=1) in the step S413, the steps S414 to S417 are executed successively. Thereby, from the ΔN calculated already in the step S404 and the k calculated in the step S412, SON satisfying the formula 2 and rN1, rN2 or rN3 according to the kind of the attention area are calculated for each image data N so as to set the protection area. Here, rN1, rN2 or rN3 are calculated by the following formulae.
(Attention area according to the focus position information)
SN=π(rN1)2 (formula 9)
(photographing mode information: attention area by the person mode)
SN=π(rN2)2 (formula 10)
(photographing mode information: attention area by the scenery mode)
SN=2π(rN2)2 (formula 11)
(attention area in the case of not having the photographing information)
SN=π(rN3)2 (formula 12)
(Control of the Display Process)
Next, the control of the display process based on the protection area evaluated and set as mentioned above will be explained. According to the display process of the first embodiment, efficient arrangement and display is purposed by adjusting the display positions of the image data of a plurality of pieces and the upper and lower relationship of the superimposition without superimposing the protection areas of the image data.
Here, first, the image data to be newly arranged are disposed at a position with the outer rim of the protection areas thereof to be contacted on the outer rim of the display areas of the image data already arranged. Moreover, in the area with the display areas of the image data superimposed, the image data display to be newly disposed are superimposed below the image data display already disposed. At the same time, the position to have the display area increase by the new arrangement minimally is selected. That is, at least one pattern to have the minimum area including the protection area to be displayed is retrieved so that the smallest pattern out of the minimum patterns is determined. Reversely, a combination to have the maximum superimposition area of the area other than the protection area out of the display area of the image data is retrieved and arranged. Here, for simplifying the retrieval process, first, a position to have the minimum value of the distance from the center of the display area to the outer rim of the display area of the image data already disposed is regarded as the arrangement candidate position. Then, a position capable of ensuring the display without superimposing the protection areas is retrieved around the position so that the total display area in the case of arranging the image data at the retrieved position is calculated. After calculating the total display area for a plurality of times, the position with the smallest display area is determined as the arrangement position out of the plurality of the arrangement candidate positions. The detailed procedure thereof is shown in
As shown in
Then, it proceeds to the step S506 so that whether or not another position to have the minimum value is present is judged. In the case the position to have the minimum value is present, it proceeds to the step S507 so that the image data display is disposed at the position to have the minimum value. Thereafter, it proceeds to the step S508 so that the image data position is moved to the limit position without superimposing the protection areas in the image data newly arranged in the display area of the image data newly arranged and the display area of the image data already arranged.
Thereafter, it proceeds to the step S509 so that the limit position without superimposing the protection areas in the image data newly arranged is set as the position Pi. Moreover, the display total area at the time, that is, the area obtained by subtracting the area of the superimposed portion from the total of the display area of the already arranged image data and the display area of the image data newly arranged is provided as Si. Furthermore, 1 is added to the counter i of the number of the processes.
Then, these steps S505 to S509 are executed until the above-mentioned position to have the minimum value is not present for the same image data. At the stage with the position becomes absent, it proceeds from the step S506 to the step S510.
In the step S510, the position to have the minimum display total area Si shown in the step S509 is calculated at a plurality of the positions Pi. Then, the display total area Si in the case of disposing the image data at the positions Pi to have the minimum value is provided as the total area Sum.
Next, it proceeds to the step S511 so that the new image data with the position confirmed at the positions Pi are displayed on the rearmost side (lower side) with respect to the image data already disposed. Thereafter, it proceeds to the step S512 so as to add 1 to the counter N for the processed number of pieces. Then, it proceeds to the step S513 so that whether or not the image data to be the Nth display subject are present is judged.
In the case the image data are present, it proceeds to the step S504 so that the steps S504 to S513 are executed repeatedly according to each process. Then, the control of the display process is finished at the stage with the display subject image data are not present.
Moreover,
Moreover, according to the first embodiment, the standard date and time can be selected according to the user operation. That is, as shown in
Moreover, the standard date and time can be set according to the position of the slide bar 302. The time axis representing the range of the photograph date and time is adjusted according to the photograph date and time information of the image data to be the subject of the display control. Moreover, the graduations on the axis are adjusted according to the passed time unit selected in the display control. The position of the slide bar 302 shown in
The control of displaying the image data prior to the standard date and time without displaying the image data thereafter is included in the operation of the above-mentioned display control section 110. That is, according to the process of setting the protection area for each image data (
As explained above, according to the first embodiment, at the time of displaying the image data with a part of the display ranges superimposed with each other in order to display a large number of image data, the control operation is executed such that the attention areas are provided as the protection area not to be hidden by the superimposition. Thereby, even in the case a part of the display area of the image data is hidden by the display of the other image data, display can be executed with the user's photograph intention maintained. Thereby, display can be provided such that the user can easily find out the purposed photograph.
That is, in the case of photographing with a digital camera having a plurality of focus positions by the user in general, the user himself photographs while confirming the focus onto the part regarded as important. Therefore, in the case the user understands the display or finds out the purposed image data while displaying a plurality of the photographed image data, the area regarded as important at the time of photographing, that is, the attention area is the important key.
Furthermore, as to the attention areas, by setting the protection area by evaluating the attention areas of the older image data narrower according to the date and time information of the image data, a larger number of image data can be displayed.
Moreover, since the image data with newer date and time are displayed on the front side, the older image data are hidden gradually behind the newer image data while maintaining the display of the characteristic attention areas recognizably. The display change is close to the state of successively disposing newer prints of a large number of photographs printed actually on older prints, it can easily be accepted as to the user's operation convenience. Also in this case, since the image data are superimposed with the attention areas displayed as much as possible, the nature of maintaining the photographing intention so as to facilitate the purposed photograph finding out operation can be maintained.
Furthermore, by changing the standard date and time so that the image data prior to the standard date and time are displayed again according to the same display control, the parts hidden by the image data newer than the standard date and time can be displayed larger again so that the image data in the date and time range can easily be judged. Since the display state is close to the state of reproducing the past state by eliminating the prints newer than the standard date and time in the actual state of superimposing the prints, it can be provided to the user as a function with a familiar operation convenience.
Although the case of displaying the image data prior to the standard date and time has been explained in the first embodiment explained above, it is also possible to display only the image data newer than the reference date and time, or provide two reference dates and times so as to display the image data included in the period defined thereby. Also in these cases, by evaluating the attention areas using the date and time to be the reference for setting the protection areas according to the display purpose so as to adjust the display positions according to the above-mentioned process procedure, a display capable of easily finding out the purposed photograph by storing the image data photograph intention while displaying a larger number of the image data can be enabled.
On the other hand, also in the case of photographing using the photograph scene mode of “scenery” or “person”, the attention area substantially impressive to the user can be set. For example, in the case of a scenery photograph, the scenery as a whole remains as the user's “impression” in most cases so that it is necessary to find out the portion for judging and selecting the photograph. Moreover, in the case of a personal photograph, the face portion is the photographing intention in most cases so that the face tends to be disposed in the central area of the photograph image in most cases.
By displaying such an attention areas while protecting without being hidden by the “superimposition”, like the case of the attention areas by the evaluation position, display can be executed while maintaining the intention at the time of photographing by the user as well as display can be executed while facilitating the operation of finding out the purposed photograph.
Moreover, as to the attention areas, by setting the protection area by evaluating the attention areas of the older image data narrower according to the date and time information of the image data, a larger amount of the image data can be displayed while maintaining the nature of facilitating the operation of finding out the purposed photograph while storing the photographing intention so that the familiar operation convenience can further be provided by the change of the reference date and time.
Moreover, although the two kinds of the “scenery” and “person” photographing scene modes have been presented in the above-mentioned first embodiment, it is not limited thereto. Also in the case of using the photographing scene modes of “night view”, “macro”, or the like, display can be controlled by setting the attention areas reflecting the photographing scene intention.
Next, an image display controlling apparatus according to the second embodiment according to the present invention will be explained. According to the second embodiment, the case of executing the display control of the image data by the attention area information having the distribution concerning the attention degree will be explained. In the second embodiment herebelow, the parts different from those of the first embodiment will be explained and the configurations same as those of the first embodiment will not be explained.
Like the display control section 110 according to the first embodiment, the display control section 401 commands reading of the image to the image data input section 105, commands execution of the process to the image processing section 106, writes the display data to the video memory 107, commands the synthesis process to the display synthesis section 108, and commands storage of the information to the storage section 113 as the memory means. Moreover, the display control section 401 as the evaluation means and the adjusting means obtains the input data from the remote controller 114 via the user input section 111, and functions as a related information obtaining section for obtaining the photographing data applied to the digital image data via the image data input section 105. Furthermore, according to the second embodiment, the display control section 401 functions as a display control section in cooperation with the image processing section 106 by obtaining the attention area distribution in the image data stored in the storage section 113 by controlling the face recognizing section 402.
In the case the image data stored in the storage section 113 are inputted according to the command of the display control section, the face recognizing section 402 detects the face area of a person present in the image data so as to output the attention area information having the probability distribution. The attention area information is stored in the storage section 113 as a part of the image data related information.
However, since the right hand of the person in the image is at a position on a part of the face, the skin area extends beyond the original face range so that the skin color area shape is too unnatural to be judged as it is as the face area, and furthermore, the boundary of the original face area can hardly be judged. Therefore, the face area of the right cheek portion of the person is recognized as a distribution to have the probability lowered gradually. Moreover, as to the expansion of the person's hair area, the left head section (on the right side in
According to the second embodiment, the display control section 401 extracts each image data by the face recognizing section 402. With the “face recognition probability distribution” to be stored in the storage section 113 as the related information provided as the attention area, the image display process in the image viewer function is executed.
In the case the recognizable face area is extracted in the image data, it proceeds to the step S605 so that the probability distribution according to the face recognizing process is set as the attention area information of the image data. Thereafter, in the step S607, the accumulation area table is produced. The accumulation area table is the data representing the area of a certain probability or more in the probability distribution of the image data by the number of the pixels.
On the other hand, in the case the recognizable face area is not present in the image data, it proceeds to the step S606 so that the standard attention area information having the distribution with the center of the image as the attention point is set as shown in
(Parameter Determining Control Process)
Next, the control process for determining the parameter for controlling the portion of the protection area without being hidden under the other image data display areas while evaluating the attention areas of the image data to be the display subject according to the standard date and time by the display control section 401 will be explained.
That is, as shown in
Next, in the step S702, the time unit at the time of calculating the passed time from the standard date and time will be selected. Then, it proceeds to the step S703 so that the variable necessary for the display control is initialized. Sum is the variable for calculating the calculating the total sum of the temporary protection area, N is the counter for successively dealing with the image data, c is the counter for the number of the pieces of the image data to be the display subject, Pmin is the parameter for the display control, and Pi is the value of the predetermined parameter candidate.
Then, in the step S704, the photograph date and time information of the related information concerning the Nth image data and the standard date and time information are compared by the display control section 401. In the case the photograph date and time is prior to the reference date and time, the image data are the display subject. Then, it proceeds to the step S707 so that the temporary protection area SN of the image data is calculated.
That is, the function for evaluating the attention area according to the passed time ΔN from the photograph date and time of the Nth image data to the standard date and time is defined as shown in
αN=1−(1−Pmin)exp(−kΔN) (formula 13)
αN is for providing the probability to be the lower limit employed as the protection area in the probability distribution of the face area. By the parameter pi(=P1, P2, . . . ) provided to the Pmin, the evaluation degree can be adjusted. Here, according to the process procedure shown in
Next, in the step S708, the calculated temporary protection area SN is added to the total sum Sum or the temporary protection area. Through the step S709 and the step S710, the total sum Sum of the temporary protection area for one parameter Pi is calculated.
Thereafter, it proceeds to the step S711 so that the total sum Sum of the temporary protection area is compared with the display total area Sall using the superimposition efficiency β. As a result of the comparison, in the case it is judged that the total sum Sum of the temporary protection area is not accommodated within the display total area Sall in consideration to the superimposition efficiency, it proceeds to the step S712 so that the total sum Sum of the temporary protection area and counter N are initialized, and 1 is added to i for changing the value of Pmin to a new Pi so as to evaluate the protection area again.
On the other hand, in the step S711, in the case it is judged that the total sum Sum of the temporary protection area is accommodated within the display total area Sall in consideration to the superimposition efficiency β, Pi at the time is adopted as the parameter Pmin value. Thereafter, in the step S713, after initializing the counter N, the protection area is set for the image data to be the display subject in the steps S714 to S717 as in the steps S414 to S416 in the first embodiment.
(Formula 14) is another example of the (formula 13) for providing the lower limit of the probability for adopting as the protection area with respect to the passed time ΔN, representing the change shown in
αN=1−Pmin×exp(−kiΔN) (formula 14)
In the case the (formula 14) is used, according to the procedure of
Next, based on the protection area evaluated and set according to the passed time ΔN from the probability distribution of the attention area by the display control section 401, the display process for the image data is executed. The display process control is for displaying the image data of a plurality of pieces while efficiently arranging the same without superimposing the protection areas of the image data.
Therefore, in the area with the display areas of the image data superimposed at a position to have the outer rim of the protection area of the image data to be disposed newly on the outer rim of the display area of the image data disposed already contacted, it is disposed so as to be superimposed on the lower side (more rear side) of the image data disposed already as well as the position to have the increase of the display area by the new arrangement minimally is selected for the arrangement. In other words, the position to have the maximum superimposition area of the area other than the protection area out of the display area of the image data is retrieved for the arrangement.
That is, as in the case of the display control process according to the first embodiment, the position to have the minimum value of the distance from the center of the display area to the outer rim of the display area of the image data disposed already is selected as the arrangement candidate position so that the position capable of ensuring the display of the protection area around the position is retrieved and the total display area in the case of disposing the image data on the position is calculated. The position to have the smallest display area out of a plurality of the arrangement candidate positions is determined as the arrangement position. The procedure of the display process control is same as the procedure shown in
As shown in
Moreover, in general, according to the image data with a person photographed, as long as the image area capable of grasping the characteristics of the photographed person is shown, the content of the image data can be understood on the whole. Furthermore, even in the case it cannot be fully understood, it provides an important key in the retrieval operation. This denotes that the selection of the face area as the attention area of the image data of a personal photograph is extremely effective.
Then, according to the second embodiment, since the control is executed without hiding the protection area by superimposing a plurality of the image data with the attention area provided as the protection area at the time of displaying sections of the display ranges of the image data superimposed with each other for displaying a large amount of image data in a certain display area with the protection area determined based on the extraction probability distribution with the face area in the image data to be extracted by the image process as the characteristic area, a display capable of easily finding out a purposed image out of the image data displayed by a large amount can be provided.
Moreover, since the attention areas are evaluated according to the extraction probability of the face recognition at the time of evaluating the attention area of the older image data narrower according to the date and time information of the image data, the parts with a high probability representing the characteristics are displayed centrally, even in the case the number of pieces to be displayed is increased, the finding easiness can hardly be reduced, and thus it is advantageous.
Furthermore, according to the second embodiment, as in the case of the first embodiment, the familiar operation convenience close to the real operation of finding out a purposed photograph out of the real photographed piled by a large amount can be provided to the user by optionally changing the standard date and time by the operation element on the screen or another means.
Moreover, according to the second embodiment, although the example of the case of adopting the date and time information as the reference for evaluating the attention area has been explained, the evaluation reference is not always limited to the date and time information as long as it is based on the configuration of the present invention of determining the protection area by evaluating the attention area for controlling the display without superimposition of the area.
Specifically, for example, the evaluation can be carried out based on the similarity of the images. Moreover, also in this case, the images of a higher similarity suited for the purpose can be displayed conspicuously as long as the images of a lower priority out of the candidates for achieving the purpose can be displayed with the characteristic portions maintained in an area according to the necessity. Therefore, a practical list display of a larger number of pieces of image data to be viewed and found out easily can be realized.
As heretofore explained, although the embodiments of the present invention have been explained specifically, the present invention is not limited to the above-mentioned embodiments, and various modifications can be provided based on the technical idea of the present invention. For example, the numerical values presented in the above-mentioned embodiments are merely an example, and different numerical values can be used as needed.
This application claims priority from Japanese Patent Application No. 2004-6905 filed Jan. 14, 2004, which is hereby incorporated by reference, herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2004-006905 | Jan 2004 | JP | national |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11036401 | Jan 2005 | US |
| Child | 11734621 | Apr 2007 | US |
