Patent Application
20120098839
This nonprovisional application claims priority under 35 U.S.C. §119(a) on Patent Application No. 2010-259718 filed in Japan on Nov. 22, 2010 and Patent Application No. 2010-236922 filed in Japan on Oct. 21, 2010, the entire contents of which are hereby incorporated by reference.
1. Field of the Invention
The present invention relates to an image reproduction device, an image reproduction method and a program for reproducing an image.
2. Description of Related Art
As a method of reproducing a plurality of input images, there is a reproduction method using a slide show. In the reproduction method using a slide show, input images that are selected as a reproduction target are sequentially displayed one by one at given time intervals. Before the slide show is reproduced, a user can select a desired reproduction target from a large number of input images recorded in a recording medium.
An example of a display screen that is displayed when an image reproduction device receives an operation of selecting a reproduction target is shown in
As, for example, the recording capacity of a recording medium has been increased in recent years, a user easily shoots digital images one after another, and often shoots a large number of sheets of similar images in a short time period (for example, the user often shoots the same person with substantially the same composition in the background of the same scenery a large number of times). When all similar images (hereinafter also referred to as a similar image group) are reproduced, it is likely that the similar images are displayed one after another and the details of the display are redundant, and a time period necessary for the reproduction is increased. Hence, an operation of selecting, as a reproduction target, only typical input images that are desired to be reproduced from among the similar image group is generally performed.
On the other hand, while a slide show is being reproduced, the user may desire to change the reproduction target. For example, although the reproduction of the slide show is started with the second input image selected as the reproduction target from the first to fourth input images constituting the similar image group, during the reproduction of the slide show, the user may realize that an image suitable as the reproduction target is not the second input image but the third input image. In this case, the user of a conventional image reproduction device temporarily stops the reproduction of the slide show, newly selects the reproduction target, and then restarts the reproduction of the slide show. A display screen for newly selecting the reproduction target is the same display screen as show in
As described above, in the conventional method as shown in
As described above, in the conventional image reproduction device, the same display screen and the same selection method are used both for the first selection of the reproduction target and for the reselection of the reproduction target. Specifically, for example, as described above, when the input image selected as the reproduction target is desired to be changed from the second input image to the third input image, the user needs to find and select the desired third input image from all the input images while scrolling, as necessary, the display image as shown in
A method of extracting, based on similarity between a plurality of input images, typical input images from the input images and reproducing only the typical input images in a slide show is suggested; this method does not facilitate the realization of the user interface as described above.
In the typical slide show reproduction method, input images included in the reproduction target are simply arranged either in order of file number or in order of generation time and are sequentially displayed on a display screen one by one at given time intervals. In general, the file numbers are given according to the order of generation time. Hence, in the reproduction of the slide show, the reproduction is basically performed in chronological order, and, depending on input images, reproduction images as a whole may produce image effects similar to those of a story.
On the other hand, the image reproduction device often has the function of processing input images. The processing of the input images refers to the change of the brightness, the chroma or the hue of the input images, the enlargement or the reduction of the image size of the input images or the like.
It is now assumed that, as shown in
Hence, when a slide show including the input images 901 to 905 as the reproduction target is reproduced, as shown in
Digital cameras that can shoot a still image while shooting a moving image are widely used. Consider a case where, in this type of digital camera, as shown in
A method of reproducing a slide show according to similarity between a plurality of images is proposed.
It can be said that the input image 901 and the input image 904 of
According to the present invention, there is provided a first image reproduction device including: a target image selection portion that selects, according to a selection operation, n sheets of target images from m sheets of input images (m and n are integers of two or more, and m>n), the selected n sheets of target images being sequentially displayed on a display screen such that slide show reproduction is performed; an image classification portion that classifies the m sheets of input images into a plurality of classes based on an image feature quantity extracted from each of the input images; and a display control portion that displays, when an input of the selection operation is received, the input images on the display screen in an arrangement based on a result of the classification of the image classification portion.
According to the present invention, there is provided a second image reproduction device including: a target image selection portion that selects, according to a selection operation, n sheets of target images from m sheets of input images (m and n are integers of two or more, and m>n), the selected n sheets of target images being sequentially displayed on a display screen such that slide show reproduction is performed, in which, when a predetermined operation is received while a p-th round of slide show reproduction is being performed, an input image that is not selected as one of the target images in the p-th round of slide show reproduction is displayed, and selection of target images in a (p+1)-th round of slide show reproduction or in rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction is received (p is a natural number).
According to the present invention, there is provided a first image reproduction method including: a target image selection step of selecting, according to a selection operation, n sheets of target images from m sheets of input images (m and n are integers of two or more, and m>n); a reproduction step of sequentially displaying the selected n sheets of target images on a display screen such that slide show reproduction is performed; an image classification step of classifying the m sheets of input images into a plurality of classes based on an image feature quantity extracted from each of the input images; and a display control step of displaying, when an input of the selection operation is received, the input images on the display screen in an arrangement based on a result of the classification of the image classification step.
According to the present invention, there is provided a second image reproduction method including: a target image selection step of selecting, according to a selection operation, n sheets of target images from m sheets of input images (m and n are integers of two or more, and m>n); a reproduction step of sequentially displaying the selected n sheets of target images on a display screen such that slide show reproduction is performed; and a selection reception step of displaying, when a predetermined operation is received while a p-th round of slide show reproduction is being performed, an input image that is not selected as one of the target images in the p-th round of slide show reproduction, and of receiving selection of target images in a (p+1)-th round of slide show reproduction or in rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction (p is a natural number).
According to the present invention, there is provided a third image reproduction device that reproduces a plurality of input images including first and second input images, the image reproduction device including: a reproduction control portion that performs slide show reproduction in which the plurality of input images are sequentially reproduced; and a link information processing portion that generates link information corresponding to a relationship between the first and second input images when the second input image is an image based on the first input image or when the first input image is a moving image and the second input image is a still image shot in a shooting time period of the first input image, in which the reproduction control portion performs, when the link information is present, the slide show reproduction based on the link information.
According to the present invention, there is provided a third image reproduction method that reproduces a plurality of input images including first and second input images, the image reproduction method including: a reproduction control step of performing slide show reproduction in which the plurality of input images are sequentially reproduced; and a link information processing step of generating link information corresponding to a relationship between the first and second input images when the second input image is an image based on the first input image or when the first input image is a moving image and the second input image is a still image shot in a shooting time period of the first input image, in which, in the reproduction control step, when the link information is present, the slide show reproduction is performed based on the link information.
Examples of embodiments of the present invention will be specifically described below with reference to accompanying drawings. In the referenced drawings, like parts are identified with common symbols, and their description will not be basically repeated.
A first embodiment of the present invention will be described.
The image sensing device 1 includes an image sensing portion 11, an AFE (analog front end) 12, a main control portion 13, an internal memory 14, a display portion 15, a recording medium 16 and an operation portion 17. The display portion 15 may be considered to be provided in an external device (not shown) of the image sensing device 1.
The image sensor 33 photoelectrically converts an optical image that enters the image sensor 33 through the optical system 35 and the aperture 32 and that indicates a subject, and outputs, to the AFE 12, an electrical signal obtained by performing the photoelectrical conversion. Specifically, the image sensor 33 has a plurality of light-receiving pixels that are two-dimensionally arranged in a matrix, and each of the light-receiving pixels stores, in each round of shooting, the signal charge of a charge amount corresponding to an exposure time. Analog signals from the light-receiving pixels having a size proportional to the charge amount of the stored signal charge are sequentially output to the AFE 12 according to a drive pulse produced within the image sensing device 1.
The AFE 12 amplifies the analog signal output from the image sensing portion 11 (the image sensor 33), and converts the amplified analog signal into a digital signal. The AFE 12 outputs this digital signal as RAW data to the main control portion 13. The amplification degree of a signal in the AFE 12 is controlled by the main control portion 13.
The main control portion 13 is formed with a CPU (central processing unit), a ROM (read only memory), a RAM (random access memory) and the like. Based on the RAW data from the AFE 12, the main control portion 13 generates image data indicating an image (hereinafter also referred to as a shooting image) shot by the image sensing portion 11. The image data generated here includes, for example, a brightness signal and a color-difference signal. The RAW data itself is one type of image data; the analog signal output from the image sensing portion 11 is also one type of image data. The main control portion 13 also functions as a display control portion that controls the details of a display on the display portion 15, and performs control necessary for the display on the display portion 15.
The internal memory 14 is formed with a SDRAM (synchronous dynamic random access memory) or the like, and temporarily stores various types of data generated within the image sensing device 1.
The display portion 15 is a display device that has a display screen such as a liquid crystal display panel, and displays, under control of the main control portion 13, a shot image and an image and the like recorded in the recording medium 16. When, in the present specification, “display” and “display screen” are simply mentioned, they refer to the display and the display screen on the display portion 15. The display portion 15 is provided with a touch panel 19; the user touches the display screen of the display portion 15 with an operation member (such as a finger or a touch pen), and can thereby provide a specific instruction to the image sensing device 1. The touch panel 19 can be omitted.
The recording medium 16 is a nonvolatile memory such as a card semiconductor memory or a magnetic disc, and records, under control of the main control portion 13, image data on the shooting image and the like. The operation portion 17 includes a shutter button 20 or the like that receives an instruction to shoot a still image, and receives various types of operations from the outside. The details of the operation performed on the operation portion 17 are transmitted to the main control portion 13.
The image sensing device 1 has a slide show function to sequentially reproduce a plurality of input images on the display portion 15. In the slide show function, the input images are sequentially displayed on the display screen of the display portion 15; this type of sequential display is referred to as the slide show reproduction. The input image refers to an arbitrary still image or moving image. Here, it is assumed that the input image is a still image or moving image shot by the image sensing device 1, and that image data on the input image is recorded in the recording medium 16. When image data is recorded in the recording medium 16, the image data may be compressed. For ease of description, a description will be given below regardless of whether or not the image data is compressed.
The image data on the input image is stored in the image file, and then can be recorded in the recording medium 16.
As shown in
The reproduction of a still image in the slide show reproduction refers to the display of the still image only for a predetermined time period. The reproduction of a moving image in the slide show reproduction refers to the display of all sections or a partial section of the moving image. The partial section may be one frame section. In this case, when the moving image is reproduced in the slide show reproduction, only a typical frame (for example, the first frame) among a plurality of frames that form the moving image is displayed only for a predetermined time period. In the following description, unless particularly otherwise specified, the input image is assumed to be a still image.
Based on image data on an input image that is fed from the recording medium 16 or image data on an input image that is fed without intervention of the recording medium 16, the image analysis portion 51 analyzes the details of the input image. This analysis includes image feature quantity extraction processing that is performed by the image feature quantity extraction portion 61. In the mage feature quantity extraction processing, the image feature quantity extraction portion 61 extracts the image feature quantity of the input image from the image data on the input image. The image feature quantity of the input image is a quantity that depends on the image feature of the input image, that is, a quantity that depends on the shape, the color, the texture and the like of an object present on the input image; here, a feature vector is assumed to be derived as the image feature quantity of the input image. As the method of deriving the image feature quantity or the feature vector, an arbitrary method including a known method (for example, the method disclosed in JP-A-2009-134411) can be utilized. For example, a method defined in MPEG (moving picture experts group) 7 is applied to the input image, and thus it is possible to derive the feature vector of the input image.
The derivation of the feature vector can be performed on each input image. The feature vector derived from the input image IM[i] is represented by FV[i]. As shown in
The relationship degree derivation portion 62 performs similarity evaluation processing for evaluating the similarity of the image feature between two arbitrary input images, and derives the relationship degree of the two input images based on the result of the similarity evaluation processing. It may be considered that a similarity evaluation portion (not shown) which performs the similarity evaluation processing is included in the relationship degree derivation portion 62.
The similarity evaluation processing performed on two different input images IM[i] and IM[j] will be described (i and j are integers; i≠j). The feature vector is a vector quantity that needs to be arranged in the feature space FS of a plurality of dimensions as shown in
Based on the result of the similarity evaluation processing performed on input images IM[i] and IM[j], the relationship degree derivation portion 62 can determine the relationship degree between the input images IM[i] and IM[j]. Simply, for example, the degree of the similarity itself can be utilized as the relationship degree. Specifically, for example, if the similarity on the image feature between the input images IM[i] and IM[j] is determined to be high, the relationship degree between the input images IM[i] and IM[j] is determined to be high whereas, if the similarity on the image feature between the input images IM[i] and IM[j] is determined to be low, the relationship degree between the input images IM[i] and IM[j] can be determined to be low.
The relationship degree may be determined by adding other information to the result of the similarity evaluation processing. The other information refers to, for example, the shooting time data and the shooting site data (see
Specifically, for example, even when the distance d[i, j] is less than the reference distance dREF, if an inequality “d[i, j]+Δd>dREF” holds true (Δd has a predetermined positive value) and the shooting time difference between the input images IM[i] and IM[j] is equal to or more than a predetermined reference time difference, the relationship degree between the input images IM[i] and IM[j] may be determined to be low. By contrast, even when the distance d[i, j] is equal to or more than the reference distance dREF, if an inequality “d[i, j]−Δd<dREF” holds true and the shooting time difference between the input images IM[i] and IM[j] is less than the predetermined reference time difference, the relationship degree between the input images IM[i] and IM[j] may be determined to be high.
Likewise, for example, even when the distance d[i, j] is less than the reference distance dREF, if the inequality “d[i, j]+Δd>dREF” holds true (Δd has a predetermined positive value) and the distance difference between the shooting sites of the input images IM[i] and IM[j] is equal to or more than a predetermined reference distance difference, the relationship degree between the input images IM[i] and IM[j] may be determined to be low. By contrast, even when the distance d[i, j] is equal to or more than the reference distance dREF, if the inequality “d[i, j]−Δd<dREF” holds true and the distance difference between the shooting sites of the input images IM[i] and IM[j] is less than the predetermined reference distance difference, the relationship degree between the input images IM[i] and IM[j] may be determined to be high.
Although, in the method of deriving the relationship degree described above, the relationship degree is evaluated in two steps (specifically, whether the relationship degree is high or low is determined), the relationship degree may be classified into three steps or more.
The image classification portion 63 of
In a case where the relationship degrees RD[1, 2] and RD[3, 4] are high, when any one or more of the relationship degrees RD[1, 3], RD[1, 4], RD[2, 3] and RD [2, 4] are high, the input images IM[1] to IM[4] may be classified into a common class. Alternatively, in a case where the relationship degrees RD[1, 2] and RD[3, 4] are high, only when any two or three or more of the relationship degrees RD[1, 3], RD[1, 4], RD[2, 3] and RD [2, 4] are high, the input images IM[1] to IM[4] may be classified into a common class.
Since the relationship degree is determined based on the image feature quantity, the classification based on the relationship degree is equivalent to the classification based on the image feature quantity. The classification may not be performed through the relationship degree, and the classification may be directly performed based on the feature vector.
In the classification of the input images based on the feature vectors of the input images, clustering processing can be used. Since the method of performing the clustering processing is known, one example of the method will be simply described here. For example, as shown in
The selection processing portion 52 of
The display control portion 53 controls the details of a display on the display portion 15; the display control portion 53 controls the display portion 15 such that, in the slide show reproduction, n sheets of target images are sequentially displayed on the display screen at given time intervals. In the present embodiment, the reproduction of the image is synonymous with the display of the image. The non-target images are not reproduced while the slide show is being reproduced. Specifically, for example, when the input images IM[1], IM[2] and IM[5] are set at the target images, and the input images IM[3] and IM[4] are set at the non-target images, in the slide show reproduction, the input images IM[3] and IM[4] are not displayed at all, and the input images IM[1], IM[2] and IM[5] are sequentially displayed at given time intervals (in other words, the reproduction time period of each of the input images IM[3] and IM[4] is set at zero).
However, in the slide show reproduction, the non-target image may be reproduced only for a short time period. In other words, in the slide show reproduction, not only the target images may be sequentially reproduced but also the non-target image may be reproduced only for a reproduction time period shorter than the reproduction time period of the target image. In this case, the selection operation can be said to be an operation of setting the reproduction time period of each of the input images. Specifically, for example, when the input images IM[1], IM[2] and IM[5] are set at the target images, and the input images IM[3] and IM[4] are set at the non-target images, in the slide show reproduction, while or after the input images IM[1], IM[2] and IM[5] are sequentially displayed at given time intervals, the input images IM[3] and IM[4] each may be displayed only for a time period ts. The time period ts (for example, 0.5 second) is shorter than the reproduction time period tL (for example, three seconds) of each of the input images IM[1], IM[2] and IM[5] that are the target images. The reproduction time period is synonymous with the display time period.
Before the slide show reproduction is performed, the operation mode of the image sensing device 1 can be set at a target image selection mode for selection of the target image. In the first embodiment, the operation of the image sensing device 1 in the target image selection mode will be described below. In the following description, a case where input images 301 to 308 shown in
The above classification of the input images 301 to 308 shown in
In the target image selection mode, the display control portion 53 divides the entire display region of the display screen of the display portion 15 into a plurality of pieces, and thereby sets a plurality of class display regions in the display screen. Here, four class display regions are assumed to be set in the display screen. Specifically, as shown in
Each of the class display regions is further subdivided into a plurality of element display regions. Here, four element display regions are assumed to be provided in each of the class display regions; as shown in
In the class display region AR[i], the regions AR[i, 1], AR[i, 2], AR[i, 3] and AR[i, 4] are arranged in this order from top to bottom. The regions AR[1, j], AR[2, j], AR[3, j] and AR[4, j] are arranged in this order along the horizontal direction from left to right.
As shown in
The display control portion 53 can be provided with a check box in each element display region where an input image is displayed (in other words, in each input image displayed). In
In the target image selection mode, the display control portion 53 first allocates the first to fourth classes to the class display regions AR[1] to AR[4], respectively, and displays, in the class display region AR[i], an input image belonging to the i-th class. When, in this state, a predetermined scrolling operation is performed, the second to fifth classes can be allocated to the class display regions AR[1] to AR[4], respectively, and an input image belonging to the (i+1)-th class can be displayed in the class display region AR[i]. Here, however, it is assumed that the first to fourth classes are allocated to the class display regions AR[1] to AR[4].
It is now assumed that one sheet of target image is set for each of the classes. Specifically, for example, it is assumed that the input images 301, 302, 304 and 308 are set at target images and the input images 303, 305 to 307 are set at non-target images, and that this state is an initial display state.
Since, as described above, the first to fourth classes are allocated to the class display regions AR[1] to AR[4], respectively, in the display screen of
The display control portion 53 displays input images such that the target images are displayed in the element display regions AR[1, 1], AR[2, 1], AR[3, 1] and AR[4, 1] arranged in the uppermost step of the display screen. The rule that the target images are always displayed in the element display regions AR[1, 1], AR[2, 1], AR[3, 1] and AR[4, 1], that is, the rule that the target images are not displayed in element display regions other than the element display regions AR[1, 1], AR[2, 1], AR[3, 1] and AR[4, 1] is referred to as a rule a for convenience. In the display screen of
The user specifies an arbitrary input image displayed on the display screen, and then can variously change the state of the check box corresponding to the specified input image. The user uses the operation portion 17 or the touch panel 19, and thereby can provide an instruction to specify the input image and an instruction to change the state of the check box. Alternatively, it is possible to directly and variously change the state of an arbitrary check box without the intervention of the specification of the input image. For convenience, the state of the check box is also referred to as a check state. The first to fourth check states that the check box 330 of
The first check state is a state that corresponds to off reproduction; when the state of the check box 330 is the first check state, the input image 331 is set at a non-target image. The second to fourth check states are states that correspond to on reproduction; when the state of the check box 330 is the second, third or fourth check state, the input image 331 is set at target image.
In a case where the state of the check box 330 is the third check state, when the slide show reproduction is started, the input image 331 that is the target image is turned 90 degrees in the rightward direction and is displayed. In a case where the state of the check box 330 is the fourth check state, when the slide show reproduction is started, the input image 331 that is the target image is turned 90 degrees in the leftward direction and is displayed. The turning of the input image 331 is realized by know geometrical conversion. In a case where the state of the check box 330 is the second check state, when the slide show reproduction is started, the input image 331 that is the target image is displayed as it is without being turned as described above.
For example, in a state where the display of
Now, consider a case where, with the initial display state of
Until any operation is further provided by the user, the display control portion 53 can also maintain the display shown in
A reclassification method when, as shown in
The image classification portion 63 can perform the reclassification of the input image 305 based on the feature vector. In this case, based on the feature vectors of the input images 304, 305 and 306, to which of the input images 304 and 306 the input image 305 is more similar is evaluated, and, if the input image 305 is evaluated to be more similar to the input image 304 among the input images 304 and 306, the input image 305 is preferably reclassified into the third class to which the input image 304 belongs. By contrast, if the input image 305 is evaluated to be more similar to the input image 306 among the input images 304 and 306, the input image 305 is preferably reclassified into the fourth class to which the input image 306 belongs. If, in the feature space FS (see
The image classification portion 63 can also perform reclassification based on the shooting times of the input images 304 to 307. Specifically, for example, when the input images 304, 305, 306 and 307 are shot in this order, the input image 305 that is a non-target image is classified into the class of a target image shot before the input image 305 among the input images 304 and 306 that are target images, and the input image 307 that is a non-target image is classified into the class of a target image shot before the input image 307 among the input images 304 and 306 that are target images. Since both the input image 304 and the input image 306 are target images shot before the input image 307, in this case, the input image 307 is preferably classified into the class of a target image shot at a time closer to the shooting time of the input image 307, that is, into the fourth class to which the input image 306 belongs (see
When, as shown in
If, with the second display state being the starting point, the user performs an operation of changing the input image 306 from the target image to the non-target image (that is, the user performs an operation of changing the state of the check box corresponding to the input image 306 from the second check state to the first check state), the third class and the fourth class shown in
If, with the second display state being the starting point, as shown in
In the first embodiment, a plurality of input images are classified into a plurality of classes according to similarity between the input images, and input images similar to each other are collected in a common class display region and are displayed. Therefore, the user can intuitively and instantaneously recognize, from the display positions of the input images, a similarity relationship between a plurality of input images, and easily performs an operation of selecting only desired input images as the target images from input images similar to each other.
When the rule α is applied, since the target images are always arranged and displayed in the uppermost step of the display screen, the user can instantaneously confirm what input images are set at the target images.
It is not mandatory to obey the rule α. When, with the second display state corresponding to
Although, in the method described above, the operation of changing the state of the check box corresponds to the selection operation for selecting target images, the specific method of the selection operation can be variously changed.
When the rule α is applied, a plurality of target images are arranged and displayed in the element display regions AR[1, 1], AR[2, 1], AR[3, 1] and AR[4, 1] positioned in the uppermost step of the display screen. Instead of this, a plurality of target images may be arranged and displayed in the element display regions AR[1, 4], AR[2, 4], AR[3, 4] and AR[4, 4] positioned in the lowermost step of the display screen. In either case, a plurality of target images are arranged and displayed in the horizontal direction of the display screen.
Although, in the example described above, the class display regions AR[1] to AR[4] are arranged in the horizontal direction on the display screen, as shown in
Although, in the example described above, the number of class display regions set on the display screen is 4, the number may be 2, 3 or 5 or more. Likewise, although, in the example described above, the number of element display regions provided in each of the class display regions is 4, the number may be 2, 3 or 5 or more.
A second embodiment of the present invention will be described. The second embodiment is based on the first embodiment; unless a contradiction arises, the description of the first embodiment can be applied to that of the second embodiment. In the second embodiment, a display operation that is performed while the slide show is being reproduced will be described.
All target images are individually reproduced once and thus one round of slide show reproduction is completed, and, after the completion of the one round of slide show reproduction, the image sensing device 1 can perform the slide show reproduction one more time either according to an instruction from the user or automatically. In the image sensing device 1, while the p-th round of slide show reproduction is being performed, target images for the (p+1)-th round of slide show reproduction can be set or target images for the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction can be set. In the following description, it is assumed that, while the p-th round of slide show reproduction is being performed, target images for the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction can be set. Here, p is a natural number. If the p-th round of slide show reproduction is regarded as the current round of slide show reproduction, the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction can be respectively referred to as the next round of slide show reproduction and the rounds of slide show reproduction subsequent to the next round of slide show reproduction.
It is assumed that, as in the first embodiment, the initial classification shown in
When, with the initial set state STA being maintained, a plurality of rounds of slide show reproduction are repeatedly performed, in the first round of slide show reproduction, only the input images 301, 302, 304 and 308 are sequentially displayed, and thereafter, in the second round of slide show reproduction, only the input images 301, 302, 304 and 308 are sequentially displayed again (the same is true of the following rounds of slide show reproduction). However, when, while a certain target image is being displayed, an image associated with the target image is present, the display control portion 53 displays, while the target image is being displayed, an association icon RIC indicating that the image associated with the target image is present. The image associated with the certain target image indicates a non-target image that belongs to the same class as the target image. Hence, for example, in the initial set state STA (see
An example of the association icon RIC is shown in
The display modes of the slide show reproduction include a normal display mode in which only the target images are sequentially displayed at given time intervals and an association image display mode in which only the non-target images or the target images and the non-target images are sequentially displayed at given time intervals. First to sixth specific examples will be described below as specific examples of the slide show reproduction including an example of the operation of switching the display modes. Unless a contradiction arises, what is described in a certain specific example can be applied to another specific example.
The first specific example will be described.
When the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, and the input images 301, 302 and 304 are sequentially displayed. When the downward direction key 82 is pressed down at the timing TA1 when the input image 304 is displayed, the display mode is changed from the normal display mode to the association image display mode, and, after the input image 304, the input images 305 and 306 that are images associated with the input image (target image) 304 are sequentially displayed. When the rightward direction key 84 is pressed down at the timing TA2 when the input image 306 is displayed, the display mode is returned from the association image display mode to the normal display mode, and the target image 308 of a class subsequent to the class to which the target image 304 belongs (that is, the target image of the fourth class) is displayed.
When the image associated with the target image is displayed in the association image display mode, the association icon RIC may be displayed together with the associated image (the same is true of the other specific examples, which will be described later). The association icon RIC that is displayed together with the target image and the association icon RIC that is displayed together with the associated image which is a non-target image may differ in the design of the association icon RIC from each other (the same is true of the other specific examples, which will be described later).
The input image 306 that is displayed last in the association image display mode is newly set at a target image (in other words, it is selected as a new target image). Accordingly, the input image 304 that has been the target image in the p-th round of slide show reproduction is changed to a non-target image. In other words, the pressing-down operation performed in the p-th round of slide show reproduction switches the target image belonging to the third class from the input image 304 to the input image 306. Hence, in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction, the input images 301, 302, 306 and 308 are sequentially displayed (the input image 304 is not displayed).
When the input image 306 is changed from the non-target image to the target image, the input image 304 may fail to be changed from the target image to the non-target image, and the input image 304 may be kept set at the target image.
The second specific example will be described.
When the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, and the input images 301, 302 and 304 are sequentially displayed. When the downward direction key 82 is pressed down at the timing TB1 when the input image 304 is displayed, the display mode is changed from the normal display mode to the association image display mode, and, after the input image 304, the input images 305, 306 and 307 that are images associated with the input image (target image) 304 are sequentially displayed. If, after the input image 307 is displayed for a predetermined time period, the user operation including the operation of pressing down the rightward direction key 84 is not performed, the input images 304, 305, 306 and 307 are again displayed sequentially and repeatedly, with the input image 304 being started in this display.
The third specific example will be described.
When the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, and the input images 301, 302 and 304 are sequentially displayed. When the downward direction key 82 is pressed down at the timing To when the input image 304 is displayed, the display mode is changed from the normal display mode to the association image display mode, and, after the input image 304, the input images 305 and 306 that are images associated with the input image (target image) 304 are sequentially displayed. When the upward direction key 81 is pressed down at the timing TC2 when the input image 306 is displayed, while the association image display mode is maintained, after the input image 306, the input images 305 and 304 are sequentially displayed in this order. Specifically, at the timing TC2, the order of display of the input images belonging to the third class is reversed
If, after the timing TC2, the downward direction key 82 is pressed down again when the input image 304 is displayed, after the input image 304, the input images 305 and 306 (and furthermore the input image 307) are sequentially displayed, although this is not shown in
The fourth specific example will be described.
When the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, and the input images 301, 302 and 304 are sequentially displayed. When the downward direction key 82 is pressed down at the timing TD1 when the input image 304 is displayed, the display mode is changed from the normal display mode to the association image display mode, and, after the input image 304, the input images 305, 306 and 307 that are images associated with the input image (target image) 304 are sequentially displayed. If, after the input image 307 is displayed for a predetermined time period, the user operation including the operation of pressing down the rightward direction key 84 is not performed, the display control portion 53 automatically returns the display mode from the association image display mode to the normal display mode (that is, returns the display mode to the normal display mode when, in the association image display mode, the display of the images associated with the input image 304 is all completed). Hence, after the input image 307, the target image 308 of a class subsequent to the class to which the target image 304 belongs (that is, the target image of the fourth class) is displayed.
The input image 307 that is displayed last in the association image display mode is set at a new target image (in other words, it is selected as a new target image). In other words, the input image 307 is set at a target image in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction. Accordingly, the input image 304 that has been the target image in the p-th round of slide show reproduction may be changed to a non-target image or the input image 304 may be kept set at the target image. If, while the input image 307 is being displayed, a predetermined operation (for example, the operation of pressing down the rightward direction key 84) is not be performed by the user, the input image 307 may be kept set at the non-target image.
The fifth specific example will be described.
When the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, and the input images 301, 302 and 304 are sequentially displayed. When the downward direction key 82 is pressed down at the timing TE1 when the input image 304 is displayed, the display mode is changed from the normal display mode to the association image display mode, and, after the input image 304, the input images 305, 306 and 307 that are images associated with the input image (target image) 304 are sequentially displayed. If, after the input image 307 is displayed for a predetermined time period, the user operation including the operation of pressing down the rightward direction key 84 is not performed, the display control portion 53 automatically returns the display mode from the association image display mode to the normal display mode (that is, returns the display mode to the normal display mode when, in the association image display mode, the display of the images associated with the input image 304 is all completed). Hence, after the input image 307, the target image 308 of a class subsequent to the class to which the target image 304 belongs (that is, the target image of the fourth class) is displayed.
When the user presses down the set key 85 in the association image display mode, the associated image that is displayed at the time of the pressing down is set at a new target image (in other words, is selected as a new target image). In the fifth specific example, it is assumed that the set key 85 is pressed down at a timing TE2 when the input image 305 is displayed. When the set key 85 is pressed down at the timing TE2, the display control portion 53 displays the check box CB of the second check state together with the input image 305 (see
The operation of pressing down the set key 85 at the timing TE2 causes the input image 305 to become the target image in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction. Accordingly, the input image 304 that has been the target image in the p-th round of slide show reproduction may be changed to a non-target image or the input image 304 may be kept set at the target image.
The sixth specific example will be described.
As shown in
Specifically, when the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, and the input images 301 and 302 are sequentially displayed. When the downward direction key 82 is pressed for a long time at the timing TF1 when the input image 302 is displayed, the display mode is changed from the normal display mode to the association image display mode, and, after the input image 302, the input image 303 that is an image associated with the input image (target image) 302 is displayed. The image associated with the input image 302 is only the input image 303. Hence, if, after the input image 303 is displayed for a predetermined time period, the user operation including the operation of pressing down the rightward direction key 84 is not performed, the display control portion 53 displays the target image 304 of a class subsequent to the class to which the target image 302 belongs (that is, the target image of the third class), and furthermore, after the input image 304, the input images 305 and 306 associated with the input image 304 are sequentially displayed. In the sixth specific example, the rightward direction key 84 is pressed down at the timing TF2 when the input image 306 is displayed. Then, the display control portion 53 returns the display mode from the association image display mode to the normal display mode, and displays the target image 308 of a class subsequent to the class to which the target image 304 belongs (that is the target image of the fourth class).
In the association image display mode, the input images (that is, the input images 303 and 306) that are displayed last in each class are set at new target images (in other words, are selected as new target images). Specifically, the input images 303 and 306 are respectively set at target images in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction. Accordingly, the input images 302 and 304 that have been the target images in the p-th round of slide show reproduction may be changed to non-target images or the input images 302 and 304 may be kept set at the target images. If, while the input image 303 is being displayed, a predetermined operation is not be performed by the user, the input image 303 may be kept set at the non-target image (the same is true of the input image 306).
As described above, when the image sensing device 1 of the second embodiment receives a predetermined operation (for example, the operation of pressing down the downward direction key 82) from the user while the p-th round of slide show reproduction is being performed, the image sensing device 1 changes the display mode from the normal display mode to the association image display mode, and displays an input image (that is a non-target image in the p-th round of slide show reproduction) that has not been selected as a target image in the p-th round of slide show reproduction. Then, the image sensing device 1 receives the selection (in other words, the selection operation) of target images in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction. Specifically, for example, when the target image 304 is displayed while the p-th round of slide show reproduction is being performed, if the image sensing device 1 receives a predetermined operation (for example, the operation of pressing down the downward direction key 82), the image sensing device 1 displays the non-target images (305, 306 and 307) of a class to which the input image 304 belongs, and receives the reselection (the reselection operation) of target images while this display is being performed. In other words, the image sensing device 1 receives the selection (in other words, the selection operation) of the target images in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction.
As described above, in the second embodiment, while the slide show reproduction is being performed, the association image display mode for displaying images associated with the input image can be started up, and, during that time, target images can be reselected. Since, in the association image display mode, the current target image and the associated image that is the current non-target image are continuously displayed, the user can rapidly reselect, while recognizing the relationship (similarity) between those images, the desired image as the target image.
Although, in each of the specific examples described above, the display mode is switched by the cross key 80 between the normal display mode and the association image display mode, an operation member and an operation method for realizing such switching can be changed variously. Likewise, although the method of selecting the target image with the set key 85 has been described above, the selection method can be changed variously. For example, the switching of the display mode and the selection of the target image may be realized by the use of the touch panel 19, a trackball or the like (not shown).
As in the first embodiment, even in a mode other than the association image display mode, in the slide show reproduction, a non-target image may be reproduced only for the short time period ts (in other words, the time period ts may be greater than zero). In other words, in the slide show reproduction of the normal display mode, it is alternatively possible not only to sequentially reproduce the target images but also to reproduce the non-target image only for a reproduction time period shorter than the reproduction time period of each target image. In this case, the operation of selecting or setting the target images can be said to be an operation of setting the reproduction time period of each input image. When the time period ts>0, the following operation can be performed.
In the slide show reproduction of the normal display mode, the input images 301 to 308 are sequentially displayed such that each target image is displayed for the reproduction time period tL (for example, 3 seconds) and each non-target image is displayed for the reproduction time period ts (for example, 0.5 second). On the other hand, in the slide show reproduction of the association image display mode, the reproduction time period of the non-target image is increased such that the reproduction time period of each target image is equal to that of each non-target image. As described above, tL>tS.
For example, when the p-th round of slide show reproduction is started in the initial set state STA, the display mode is set at the normal display mode, the input images 301 and 302 that are target images are sequentially displayed, each for the time period tL, then the input image 303 that is a non-target image is displayed only for the time period tS and thereafter the input image 304 that is a target image is displayed only for the time period tL. When the downward direction key 82 is pressed down while the input image 304 is being displayed, the display mode is changed from the normal display mode to the association image display mode, and the input images 305, 306 and 307 that are non-target images are displayed, each for the time period tL. Then, if the rightward direction key 84 is pressed down at a timing when the input image 306 is displayed, the input image 306 is set at a target image in the (p+1)-th round of slide show reproduction and the rounds of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction.
After this setting, when the (p+1)-th round of slide show reproduction or the round of slide show reproduction subsequent to the (p+1)-th round of slide show reproduction is started, in the normal display mode, the input images 301 and 302 that are target images are sequentially displayed, each for the time period tL, then the input image 303 that is a non-target image is displayed only for the time period tS, thereafter the input image 306 that is a target image is displayed only for the time period tL and thereafter the input images 304, 305 and 307 that are non-target images are sequentially displayed, each for the time period tS. If the input image 304 is kept set at the target image, the reproduction time period of the input image 304 is tL.
A third embodiment of the present invention will be described. Unless a contradiction arises, the description of the first and second embodiments can be applied to that of the third embodiment and a fourth embodiment to be described later. The overall configuration of the image sensing device 1 according to the third embodiment is the same as in the first embodiment or the second embodiment.
The image sensing device 1 has an image edition function of processing an input image and a slide show function of sequentially reproducing a plurality of input images on the display portion 15. As described above, the input image is an arbitrary still image or moving image.
As shown in
When an input image is a moving image, for example, the shooting time of the input image is assumed to be, for example, the shooting start time of the moving image as the input image. When a certain input image is an image itself that is obtained by being shot with the image sensing device 1 (that is, when the certain input image is not an image that is obtained by being subjected to process edition processing, which will be described later), the shooting time of the input image agrees with the generation time. When an input image stored in an image file is an image that is obtained by being subjected to the process edition processing, which will be described later, since the generation time of the input image is a time when the process edition processing is performed, the shooting time of the input image differs from the generation time. Only any one of the shooting time data and the generation time data may be included in the additional data.
The image processing portion 91 can freely process, according to an edition instruction from the user, an arbitrary input image recorded in the recording medium 16. An arbitrary instruction from the user including the edition instruction can be realized by performing an operation on the touch panel 19 or the operation portion 17. Processing for processing the input image according to the edition instruction is referred to as the process edition processing. Arbitrary processing for changing image data on the input image according to the edition instruction corresponds to the process edition processing on the input image. For example, processing for changing the brightness, the chroma or the hue of all or part of the input image, processing for enlarging or reducing the image size of the input image, processing for cutting part of the input image (that is, trimming of the input image) and processing for superimposing an arbitrary index (such as a character or an icon) on the input image correspond to the process edition processing on the input image.
The link information processing portion 92 generates link information as necessary, and records the link information in the recording medium 16. The significance of the link information and the method of utilizing the link information will be described later.
The display control portion 93 performs control for displaying, on the display screen of the display portion 15, an arbitrary input image read from the recording medium 16 or an image based on an input image. The slide show control portion 94 performs processing for sequentially reproducing a plurality of input images using the display portion 15. To sequentially reproduce a plurality of input images at given intervals is referred to as the slide show reproduction. The reproduction of the input image means the display of the input image on the display screen.
In the following description, when it is necessary to distinguish between an input image that has not been subjected to the process edition processing and an input image that is obtained by being subjected to the process edition processing, the former input image is particularly referred to as an original image, and the latter input image is particularly referred to as a processed image. A still image or moving image that is obtained by being shot with the image sensing device 1 is first recorded in the recording medium 16 without being subjected to the process edition processing. The still image or moving image that is recorded at this point is the original image. Thereafter, when the process edition processing is performed on the original image, the original image that has been subjected to the process edition processing (that is, an image that is obtained by performing the process edition processing on the original image) is the processed image.
It is now assumed that five input images 201 to 205 shown in
At least one or more of the input images 201 to 205 may be a moving image. If the input image 201 is a moving image, the reproduction of the input image 201 while the slide show reproduction is being performed is the reproduction of a typical frame (for example, the first frame) of the moving image as the input image 201 or the reproduction of part or all of the moving image as the input image 201. Here, all the input images 201 to 205 are assumed to be still images. It is also assumed that the input images 201, 202, 203 and 205 are original images and that the input image 204 is a processed image.
It is assumed that the input image 201 is first shot, that the input image 202 is then shot and that the input image 203 is thereafter shot. It is assumed that, after the input image 203 is shot, the process edition processing is performed to process the input image 201, and that the input image 204 is generated by performing the process edition processing on the input image 201. For example, an image that is obtained by cutting part of the input image 201 is assumed to be the input image 204. After the generation of the input image 204, the input image 205 is assumed to be shot. Hence, among the shooting times of the input images 201, 202, 203 and 205, the shooting time of the input image 201 is the earliest, and the shooting time of the input image 205 is the latest. Since the input image 204 is an image based on the input image 201, the shooting time of the input image 204 can be assumed to be the same as that of the input image 201; thus, it is possible to make shooting time data within the header region of an image file 224 agree with shooting time data within the header region of an image file 221. On the other hand, among the generation times of the input images 201 to 205, input images whose generation times are the first, the second, the third and the fourth earliest are the input images 201, 202, 203 and 204, respectively, and an input image whose generation time is the latest is the input image 205. It is also possible to make the shooting site data on a processed image agree with the shooting site data on an original image on which the processed image is based. Thus, it is possible to make the shooting site data within the header region of the image file 224 agree with the shooting site data within the header region of the image file 221.
Sequence numbers can be included in the file names. These sequence numbers are referred to as file numbers. Here, it is assumed that the file numbers “1”, “2”, “3”, “4”, “5”, . . . are given to input images in order from the input image whose generation time is the earliest to the input image whose generation time is the latest. Hence, the file numbers “1”, “2”, “3”, “4” and “5” are allocated to the file names of the image files 221, 222, 223, 224 and 225. In the example of
The user uses the operation portion 17 or the touch panel 19, and thereby can provide an instruction to perform the slide show reproduction in which the input images 201 to 205 are included in the reproduction target. When this instruction is provided, the slide show control portion 94 can perform basic slide show reproduction α1 that is one type of slide show reproduction.
In the basic slide show reproduction α1, the input images 201 to 205 are simply arranged in order of file number, and they are sequentially reproduced one by one. Specifically, the input images 201 to 205 are sequentially reproduced one by one such that an input image to which a smaller file number is given is reproduced earlier. In other words, reproduction places of the first, the second, the third, the fourth, the fifth, . . . are given to input images in ascending order of file number. The input images are sequentially reproduced in ascending order of reproduction place (the same is true of improved slide show reproduction β1 and the like, which will be described later). It is assumed that the i-th reproduction place is less than the (i+1)-th reproduction place.
Alternatively, in the basic slide show reproduction α1, the input images 201 to 205 are simply arranged in order of generation time, and they are sequentially reproduced one by one. Specifically, the input images 201 to 205 are sequentially reproduced one by one such that an input image corresponding to an earlier generation time is reproduced earlier. In other words, the reproduction places of the first, the second, the third, the fourth, the fifth, . . . are given to input images in order from the input image corresponding to the earliest generation time to the input image corresponding to the latest generation time.
In all cases, in the basic slide show reproduction α1, the reproduction order of the input images 201 to 205 are determined based on only the file numbers of the input images 201 to 205 or only the generation times of the input images 201 to 205; consequently, as shown in
There are several points in the basic slide show reproduction α1 that need to be improved. The slide show control portion 94 can perform the improved slide show reproduction β1 that has benefits as compared with the basic slide show reproduction α1. The improved slide show reproduction β1 is also one type of slide show reproduction. In the following description of the third embodiment, unless particularly otherwise specified, the improved slide show reproduction β1 is assumed to be performed as the slide show reproduction.
In order to realize the improved slide show reproduction β1, the link information need to be generated and recorded by the link information processing portion 92 of
In the link method A1, as shown in
In the link method A2, as shown in
In the link method A3, as shown in
Even when any one of the link methods A1 to A3 is employed, the link information indicates that the input image 204 is a processed image based on the input image 201 and that the input image 201 is an original image on which the processed image 204 is based.
As the specific procedure of performing the improved slide show reproduction β1, specific procedures B1 to B3 will be described below. Even in any one of the specific procedures B1 to B3, if the link information is not recorded in the recording medium 16, the same reproduction as the basic slide show reproduction α1 is performed.
[Specific Procedure B1]
The specific procedure B1 of the improved slide show reproduction β1 will be described. In the specific procedure B1, the link method A1 corresponding to
First, in step S11, in the link method A1, the link information is recorded in the header region corresponding to a processed image. Then, when, in step S12, an instruction to start the slide show reproduction is provided by the user, in step S13, the slide show control portion 94 reads, from the recording medium 16, header information on all image files to be reproduced, and thereby acquires the link information. The header information refers to data or information that is stored in the header region. Here, the link information is acquired from the header region of the image file 224. When the link information is acquired, in step S14, the slide show control portion 94 performs slide show reproduction (that is, the improved slide show reproduction β1) based on the link information.
If, for example, power to the image sensing device 1 is interrupted while recording processing is being performed on a certain image file, the image file may be destroyed and thus it may be impossible to restore it. When the link method A1 is utilized, since recording processing is not performed on the image file of an original image at the time of recording of the link information, the image file of the original image is prevented from being lost (or the loss of the image file is reduced).
In the slide show reproduction in step S14, any one of the following reproduction methods C1 to C4 can be employed.
Reproduction Method C1
The reproduction method C1 will be described. In the reproduction method C1, the slide show control portion 94 identifies, based on the link information, which input image is an original image on which a processed image is based, omits the identified original image from the reproduction target and then performs the slide show reproduction. Hence, the input image 201 is omitted from the reproduction target and is not reproduced, and the input images 202 to 205 are sequentially reproduced as the reproduction target.
The slide show control portion 94 can set the reproduction order of the input images 202 to 205 with reference to the basic reproduction order described above.
For example, based on the file numbers or the generation times of the input images 202 to 205, the reproduction order of the input images 202 to 205 can be determined. In this case, as shown in
For the input images 202, 203 and 205, the reproduction places are set based on the file numbers or the generation times whereas the reproduction place that should have been given to the original image 201 in the basic slide show reproduction α1 may be given to the processed image 204. In this case, as shown in
Reproduction Method C2
The reproduction method C2 will be described. In the reproduction method C2, the slide show control portion 94 identifies, based on the link information, which input image is a processed image, omits the processed image from the reproduction target and then performs the slide show reproduction. Hence, the input image 204 is omitted from the reproduction target and is not reproduced, and the input images 201 to 203 and 205 are sequentially reproduced as the reproduction target.
When the reproduction method C2 is employed, the slide show control portion 94 can set the reproduction order of the input images 201 to 203 and 205 in the same method as in the basic slide show reproduction α1. Consequently, in this case, as shown in
Since, in the basic slide show reproduction α1, the original image 201 and the processed image 204 that is expected to be similar to the original image 201 are separately reproduced, the details of the reproduction can be redundant. Since, in the reproduction method C1 or C2, the reproduction of any one of the original image 201 and the processed image 204 is omitted, such redundancy is expected to be improved. Although, in the example of
Reproduction Method C3
The reproduction method C3 will be described. In the reproduction method C3, the slide show control portion 94 identifies, based on the link information, which input image is a processed image and what input image is an original image on which the processed image is based and simultaneously reproduces the original image and the processed image identified.
Specifically, for example, as shown in
Alternatively, for example, as shown in
Since, in the basic slide show reproduction α1, the original image 201 and the processed image 204 that is expected to be similar to the original image 201 are separately reproduced, the details of the reproduction can be redundant. Since, in the reproduction method C3, the original image 201 and the processed image 204 are simultaneously reproduced, such redundancy is expected to be improved.
Reproduction Method C4
The reproduction method C4 will be described. In the reproduction method C4, the slide show control portion 94 identifies, based on the link information, which input image is a processed image and what input image is an original image on which the processed image is based and determines the reproduction order of a plurality of input images (in other words, changes the basic reproduction order described above) such that the original image and the processed image identified are reproduced continuously in time.
Specifically, the reproduction place given to the processed image 204 is changed from the reproduction place in the basic reproduction order such that the original image 201 and the processed image 204 are continuously reproduced. The reproduction places are given to the other input images (201 to 203 and 205) in the same method as in the basic slide show reproduction α1. Consequently, as shown in
The slide show reproduction usually proceeds chronologically; a viewer of the slide show reproduction predicts or expects that the reproduction proceeds chronologically. The reproduction proceeds chronologically, and thus the reproduction images as a whole produce image effects similar to those of a story. If, as in the basic slide show reproduction α1 (
[Specific Procedure B2]
The specific procedure B2 of the improved slide show reproduction β1 will be described. In the specific procedure B2, the link method A2 corresponding to
First, in step S31, in the link method A2, the link information is recorded in the header region corresponding to an original image. Then, when, in step S32, an instruction to start the slide show reproduction is provided by the user, in step S33, the slide show control portion 94 arranges all the image files to be reproduced in order of file number or generation time. Consequently, the image files 221 to 225 are set at the first to fifth image files, respectively. Then, in step S34, 1 is substituted into a variable j, and, in step S35 subsequent to step S34, the slide show control portion 94 reads header information on the j-th image file. Thereafter, in step S36, whether or not the read header information includes the link information is checked. If the read header information includes the link information, in step S37, the slide show control portion 94 performs the reproduction of the input image based on the link information whereas, if the read header information does not include the link information, in step S38, the slide show control portion 94 reproduces the input image of the j-th image file. After the reproduction in step S37 or S38, in step S39, 1 is added to the variable j, and then the process returns to step S35. Each type of processing in step S35 and the following steps is repeatedly performed until no image file of the reproduction target is present.
Any one of the reproduction methods C1 to C4 described above can be applied to the reproduction processing in step S37. In other words, the reproduction processing in step S37 can be performed such that the same reproduction result as in the slide show reproduction performed with the reproduction method C1, C2, C3 or C4 described above is obtained.
When the link method A2 is employed, since the link information is present in the header region of the input image 201, the reproduction processing in step S37 is performed when j=1.
Hence, for example, based on the link information acquired when j=1, the original image 201 may be omitted from the reproduction target, and thereafter, as shown in
Alternatively, for example, based on the link information acquired when j=1, the processed image 204 may be omitted from the reproduction target, and thereafter, as shown in
Alternatively, for example, based on the link information acquired when j=1, the original image 201 on which the processed image 204 is superimposed or the processed image 204 on which the original image 201 is superimposed may be generated, and thereafter, as shown in
Alternatively, for example, by giving the first and second reproduction places to the input images 201 and 204, respectively, based on the link information acquired when j=1, as shown in
In the operation shown in
Even when the link method A2 corresponding to
[Specific Procedure B3]
The specific procedure B3 of the improved slide show reproduction β1 will be described. In the specific procedure B3, the link method A3 corresponding to
First, in step S51, in the link method A3, the link information is stored in the link file 230 and is recorded in the recording medium 16. Then, when, in step S52, an instruction to start the slide show reproduction is provided by the user, in step S53, the slide show control portion 94 reads the link file 230 from the recording medium 16, and thereby acquires the link information. Thereafter, in step S54, the slide show control portion 94 performs the slide show reproduction (that is, the improved slide show reproduction β1) based on the link information. The slide show reproduction in step S54 is the same as in step S14 of
It can also be considered that a list obtained by listing pieces of header information which are sequentially read by repeating step S35 of
When the link method A3 is utilized, since recording processing is not performed on the image files of the original image and the processed image at the time of recording of the link information, the image files of the original image and the processed image are prevented from being lost (or the loss of the image files is reduced).
[Application B4]
An application B4 of the improved slide show reproduction β1 will be described. The user uses the touch panel 19 or the operation portion 17, and thereby can provide an instruction to perform various file operations to the image sensing device 1. The file operations include, for example, processing for changing the file name of a certain image file and processing for removing a certain image file from the recording medium 16.
Although the link information indicates a correspondence relationship between a plurality of input images, a problem may occur if, after the production of the link information, the file name of an image file related to the link information is changed or an image file related to the link information is removed.
For example, in a case where the link method A2 of
Hence, in the application B4, a method of strengthening the reliability of the correspondence relationship indicated by the link information is proposed. The method of strengthening the reliability can be applied to any one of the specific procedures B1 to B3. As will be described below, whether or not the link information is valid or invalid is determined, and thus it is possible to strengthen the reliability.
It is now assumed that, as shown in
If the input image 252 is the processed image based on the original image 251, pieces of shooting time data on those images should agree with each other. Hence, a condition (hereinafter referred to as a first condition) under which the pieces of shooting time data on the image files 271 and 272 agree with each other may be set, and, if the first condition is satisfied, the link information 281 may be determined to be valid whereas, if the first condition is not satisfied, the link information 281 may be determined to be invalid.
If the input image 252 is the processed image based on the original image 251, pieces of shooting site data on those images should agree with each other. Hence, a condition (hereinafter referred to as a second condition) under which the pieces of shooting site data on the image files 271 and 272 agree with each other may be set, and, if the second condition is satisfied, the link information 281 may be determined to be valid whereas, if the second condition is not satisfied, the link information 281 may be determined to be invalid.
If the input image 252 is the processed image based on the original image 251, they are somewhat similar to each other. Hence, a condition (hereinafter referred to as a third condition) under which the input images 251 and 252 are similar to each other may be set, and, if the third condition is satisfied, the link information 281 may be determined to be valid whereas, if the third condition is not satisfied, the link information 281 may be determined to be invalid. As the method of determining whether or not the input images 251 and 252 are similar to each other, an arbitrary determination method including a known method (for example, a method disclosed in JP-A-2006-140559 or JP-A-2006-246127) can be utilized. The image feature quantities of the input images 251 and 252 are individually extracted from the image data on the input images 251 and 252, and the image feature qualities of the input images 251 and 252 are compared with each other, and thus it is possible to determine whether or not the input image 251 and 252 are similar to each other.
Only if any two of the first to third conditions are satisfied, the link information 281 may be determined to be valid, or only if all the first to third conditions are satisfied, the link information 281 may be determined to be valid.
If the link information 281 is determined to be valid, the reliability of the event in which the input image 252 is the processed image based on the original image 251 is determined to be high, and the slide show control portion 94 can perform the slide show reproduction as described in the specific procedures B1 to B3. On the other hand, if the link information 281 is determined to be invalid, the reliability of the event in which the input image 252 is the processed image based on the original image 251 is determined to be low, and the slide show control portion 94 can ignore the presence of the link information 281 and perform the slide show reproduction.
If, as shown in
A fourth embodiment of the present invention will be described. The fourth embodiment is based on the third embodiment; with respect to what is not particularly described in the fourth embodiment, unless a contradiction arises, the description of the third embodiment is also applied to that of the fourth embodiment.
In the fourth embodiment, it is assumed that shooting is performed in the shooting order as shown in
It is assumed that, as time goes by, times t1, t2, t3, t4, t5 and t6 come in this order. It is assumed that a time period from the time t1 to the time t4 is the shooting time period of the moving image 501, and that, at the times t2 and t3 in the shooting time period of the moving image 501, the still images 502 and 503 are shot, respectively. From RAW data at the time t2, it is possible not only to generate the frame of the moving image 501 at the time t2 but also to generate the still image 502 (the same is true of the time t3). It is assumed that, after the completion of shooting of the moving image 501, the still images 504 and 505 are shot at the times t5 and t6, respectively.
Here, it is assumed that shooting time data on the moving image 501 indicates the shooting start time t1 of the moving image 501. Hence, among the input images 501 to 505, the shooting time of the input image 501 is the earliest. As in the third embodiment, file numbers can be included in the file names of the image files 521 to 525. Here, it is assumed that the file numbers “1”, “2”, “3”, “4” and “5” are given to input images in order from the input image whose shooting time is the earliest to the input image whose shooting time is the latest. In other words, the file numbers “1”, “2”, “3”, “4” and “5” are allocated to the file names of the image files 521, 522, 523, 524 and 525, respectively. In the example of
The extensions of file names usually differ between the image file of a moving image and the image file of a still image. Hence, the image file of a moving image and the image file of a still image both of which have a common file number can be simultaneously stored in the recording medium 16. Here, however, it is assumed that, as described above, different file numbers are given to the input images 501 to 505.
The user uses the operation portion 17 or the touch panel 19, and thereby can provide an instruction to perform the slide show reproduction in which the input images 501 to 505 are included in the reproduction target. The reproduction of the input image 501 while the slide show reproduction is being performed is the reproduction of a typical frame (for example, the first frame) of the moving image as the input image 501 or the reproduction of part or all of the moving image as the input image 501. When the instruction to perform the slide show reproduction is provided, the slide show control portion 94 (see
In the basic slide show reproduction α2, the input images 501 to 505 are simply arranged in order of file number, and they are sequentially reproduced one by one. Specifically, the input images 501 to 505 are sequentially reproduced such that an input image to which a smaller file number is given is reproduced earlier. In other words, the reproduction places of the first, the second, the third, the fourth, the fifth, . . . are given to input images in ascending order of file number. As described in the third embodiment, the input images are sequentially reproduced in ascending order of reproduction place (the same is true of the improved slide show reproduction β2 and the like, which will be described later).
Alternatively, in the basic slide show reproduction α2, the input images 501 to 505 are simply arranged in order of shooting time, and they are sequentially reproduced. Specifically, the input images 501 to 505 are sequentially reproduced such that an input image corresponding to an earlier shooting time is reproduced earlier. In other words, the reproduction places of the first, the second, the third, the fourth, the fifth, . . . are given to input images in order from the input image corresponding to the earliest shooting time to the input image corresponding to the latest shooting time.
In all cases, in the basic slide show reproduction α2, the reproduction order of the input images 501 to 505 is determined based on only the file numbers of the input images 501 to 505 or only the shooting times of the input images 501 to 505; consequently, as shown in
In the following description, an input image that is shot in the shooting time period of a moving image and that is a still image is particularly referred to as a target still image, and an input image in which one or more target still images are shot in the shooting time period of the input image itself and that is a moving image is referred to as a target moving image. Hence, the input image 501 is the target moving image, and the input images 502 and 503 are the target still images.
There are several points in the basic slide show reproduction α2 that need to be improved. The slide show control portion 94 can also perform the improved slide show reproduction β2 that has benefits as compared with the basic slide show reproduction α2. The improved slide show reproduction β2 is also one type of slide show reproduction. In the following description of the fourth embodiment, unless particularly otherwise specified, the improved slide show reproduction β2 is assumed to be performed as the slide show reproduction.
In order to realize the improved slide show reproduction β2, the link information need to be generated and recorded by the link information processing portion 92 of
In the link method D1, as shown in
In the link method D2, as shown in
In the link method D3, as shown in
Even when any one of the link methods D1 to D3 is employed, the link information indicates that the input image 501 is a target moving image and that the input images 502 and 503 are target still images that are shot in the shooting time period of the target moving image 501.
The specific procedure of the improved slide show reproduction β2 is the same as any one of the specific procedures B1 to B3, which are described in the third embodiment with reference to
In the improved slide show reproduction β2, any one of the following reproduction methods E1 to E5 can be employed.
Reproduction Method E1
The reproduction method E1 will be described. In the reproduction method E1, the slide show control portion 94 identifies, based on the link information, which input image is a target moving image, omits the target moving image from the reproduction target and then performs the slide show reproduction. Hence, the input image 501 is omitted from the reproduction target and is not reproduced, and the input images 502 to 505 are sequentially reproduced as the reproduction target. The slide show control portion 94 can set the reproduction order of the input images 502 to 505 in the same method as in the basic slide show reproduction α2. Hence, for example, as shown in
Reproduction Method E2
The reproduction method E2 will be described. In the reproduction method E2, the slide show control portion 94 identifies, based on the link information, which input image is a target still image, omits the target still image from the reproduction target and then performs the slide show reproduction. Hence, the input images 502 and 503 are omitted from the reproduction target and are not reproduced, and the input images 501, 504 and 505 are sequentially reproduced as the reproduction target. The slide show control portion 94 can set the reproduction order of the input images 501, 504 and 505 in the same method as in the basic slide show reproduction α2. Hence, for example, as shown in
Since, in the basic slide show reproduction α2, as shown in
Reproduction Method E3
The reproduction method E3 will be described. In the reproduction method E3, the slide show control portion 94 identifies, based on the link information, which input image is a target moving image and which input image is a target still image and simultaneously reproduces the target moving image and the target still image.
Specifically, for example, as shown in
Alternatively, for example, as shown in
Which of the target moving image and the target still image is allocated to the first division display region is only different between the example shown in
Since, in the basic slide show reproduction α2, the target moving image 501 and the target still images 502 and 503 that are the same as or similar to frames in the target moving image 501 are separately reproduced, the details of the reproduction can be redundant. Since, in the reproduction method E3, the target moving image and the target still image are simultaneously reproduced, such redundancy is expected to be improved.
Reproduction Method E4
The reproduction method E4 will be described. In the reproduction method E4, the slide show control portion 94 identifies, based on the link information, which input image is a target moving image and which input image is a target still image. Then, the slide show control portion 94 sets a specific time period with reference to the shooting time of the target still image, and reproduces, in the slide show reproduction, the target moving image in the specific time period.
The specific example of the reproduction method E4 will be described with reference to
After the setting of the specific time periods Pt2 and Pt3, in the slide show reproduction, as shown in
When, in the slide show reproduction, the entire moving image is reproduced, the necessary reproduction time period is relatively long, and the details of the reproduction can be redundant. On the other hand, it is highly likely that a shooting scene at a timing when a target still image is shot is a scene which is relatively important for a photographer. In view of this, when a moving image is reproduced in the slid show reproduction, as described above, only part of the moving image at times around the shooting time of the target still image is reproduced. Thus, only the main part is reproduced, and the redundancy of the details of the reproduction is improved.
Reproduction Method E5
The reproduction method E5 will be described. In the reproduction method E5, the slide show control portion 94 identifies, based on the link information, which input image is a target moving image and which input image is a target still image. Then, when the slide show control portion 94 reproduces the target moving image in the slide show reproduction, the slide show control portion 94 inserts the reproduction of the target still image while the target moving image is being reproduced.
The specific example of the reproduction method E5 will be described with reference to
After the setting of the time periods P[1] to P[4], in the slide show reproduction, as shown in
As described above, when the moving image 501 is reproduced in the slide show reproduction, the reproduction of the target still images 502 and 503 is inserted while the moving image 501 is being reproduced. In this way, as in the reproduction method E4, only the main part of the moving image is reproduced, and the redundancy of the details of the reproduction is improved. A time relationship between the target moving image and the target still image is easily understood by the viewer of the slide show, and image effects similar to those of a story in the slide show can be enhanced.
<<Variations>>
In the embodiments of the present invention, various modifications are possible as necessary within the range of technical ideas indicated by the scope of claims. The embodiments described above are simply examples of embodiments of the present invention; the significance of terms of the present invention or constituent requirements is not limited to the description of the above embodiments. The specific values indicated in the above description are simply examples; naturally, they can be changed to various different values. Explanatory notes 1 to 3 will be described below as explanatory matters that can be applied the embodiments described above. The subject matters of the explanatory notes can freely be combined together unless a contradiction arises.
[Explanatory Note 1]
Although, in each of the embodiments described above, basically, the input images are sequentially reproduced one by one in the slide show reproduction, in the slide show reproduction, the input images may be sequentially reproduced in groups of k sheets (k is an integer of two or more).
[Explanatory Note 2]
When an input image is reproduced in the image sensing device 1, the image sensing device 1 functions as an image reproduction device. As shown in
[Explanatory Note 3]
The image sensing device 1 and the electronic apparatus (101 or 401) can be formed with hardware or a combination of hardware and software. When the image sensing device 1 and the electronic apparatus (101 or 401) are formed with software, the block diagram of a portion realized by the software represents a functional block diagram of the portion. In particular, all or part of a function realized with the image analysis portion 51, the selection processing portion 52 and the display control portion 53 or all or part of a function realized with the image processing portion 91, the link information processing portion 92 and the display control portion 93 may be described as a program, the program may be executed on a program execution device (for example, a computer) and thus all or part of the function may be realized.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2010-236922 | Oct 2010 | JP | national |
| 2010-259718 | Nov 2010 | JP | national |
