This nonprovisional application claims priority under 35 U.S.C. §119(a) on Patent Application No. 2010-106091 filed in Japan on May 6, 2010, the entire contents of which are hereby incorporated by reference.
1. Field of the Invention
The present invention relates to an imaging device that is capable of shooting and recording a moving image.
2. Description of Related Art
Digital video cameras are typically provided with a record button. A user of such a digital camera is allowed to give an instruction to start image recording by pressing the record button and to give an instruction to stop (that is, to finish) image recording by pressing the record button again or by pressing a separately provided stop button. The user gives instructions to start and stop the image recording such that a scene that he or she desires to securely record takes place during a recording period.
The digital video camera is provided with an encoder that performs the encoding of moving image data; recording of moving image data into a recording medium is performed after encoding processing performed on the moving image data by the encoder. The encoder is not able to execute the encoding processing again until a required warm-up period elapses after the encoder finishes execution of the encoding processing according to the instruction to stop image recording (see
With reference to
The photographer desires to record the scene of the bride and groom coming into the wedding place, and it is the most desirable for the photographer to start the moving image shooting all over again by setting the image-recording starting time to time TA2. In other words, it is the most desirable for the photographer to change the time for starting the image recording from time TA1 to time TA2. However, it is difficult for the photographer to predict when the bride and groom will come into the wedding place before they actually do. If the image recording is suspended at time TA2′ that is immediately before time TA2, the photographer may miss the scene of the bride and groom coming into the wedding place, which is the most important scene, due to the presence of the required warm-up period. Thus, if the photographer gives priority to avoiding the missing of the scene of the bride and groom coming into the wedding place, it is impossible for the photographer to suspend the image recording. As a result, as shown in
With reference to
As a result, as shown in
Incidentally, a technology has been proposed in which, when a shutter key operation is performed, first and second image shooting periods specified by the photographer are used to store a moving image corresponding to the first image shooting period which is before the shutter key operation and a moving image corresponding to the second image shooting period which is after the shutter key operation. However, this technology is for storing data of a moving image shot around a time point at which a still image is shot, and does not contribute to solving the conventional problem which is described above with reference to
According to the present invention, an imaging device includes: an input moving image obtaining portion which obtains input moving image data which is image data of a moving image; an image processing portion which includes a plurality of processing blocks which apply predetermined processing to the input moving image data to thereby generate output moving image data; an operation portion which accepts a plurality of operations including a starting operation in which an instruction to start image recording is given; and a control portion which selects any of the plurality of processing blocks as a target processing block and, after the starting operation is performed, records the output moving image data from the target processing block into a recording medium. Here, the control portion switches a processing block to be selected as the target processing block among the plurality of processing blocks according to an operation performed on the operation portion.
The significance and benefits of the invention will be clear from the following description of its embodiments. It should however be understood that these embodiments are merely examples of how the invention is implemented, and that the meanings of the terms used to describe the invention and its features are not limited to the specific ones in which they are used in the description of the embodiments.
Hereinafter, an embodiment of the present invention will be described specifically with respect to the drawings. Among different drawings referred to in the course of the description, the same parts are identified by the same reference signs (numerals), and in principle no overlapping description of the same parts will be repeated.
An AFE 12 amplifies an analog signal outputted from the image sensor 33, converts the amplified analog signal into a digital signal, and outputs the obtained digital signal to a former stage processing portion 13.
The former stage processing portion 13 applies predetermined former stage processing (demosaicing processing, noise reduction processing, etc) to the signal outputted from the AFE 12, and outputs the resulting signal to an image processing portion 14. As described above, the imaging device 1 is also capable of shooting and recording a still image, but the following description of the present embodiment will be focused on characteristic operations and structures related to the shooting and recording of a moving image. Image data of a moving image fed from the former stage processing portion 13 to the image processing portion 14 will be referred to as input moving image data. The input moving image data is image data of a moving image based on a signal outputted from the image sensor 33. The image sensor 33 sequentially performs image shooting at a predetermined frame rate (for example, 60 fps (frame per second)) to thereby generate a signal based on which the input moving image data is generated.
The image processing portion 14 includes an input switching portion 20, an output switching portion 23, an encoder 21 which is a first encoder, and an encoder 22 which is a second encoder; the image processing portion 14 selectively uses the encoders 21 and 22 to generate output moving image data from the input moving image data. A state of the image processing portion 14 for which the encoder 21 is selected will be referred to as a first selection state, and a state of the image processing portion 14 for which the encoder 22 is selected will be referred to as a second selection state.
In the first selection state, the input moving image data is fed via the input switching portion 20 to the encoder 21, and the encoder 21 executes predetermined encoding processing on the input moving image data to thereby generate output moving image data to be fed via the output switching portion 23 to a memory driver 15. In the second selection state, the input moving image data is fed via the input switching portion 20 to the encoder 22, and the encoder 22 executes predetermined encoding processing on the input moving image data to thereby generate output moving image data to be fed via the output switching portion 23 to the memory driver 15.
Steps of the encoding processing performed by the encoder 21 in the first selection state are the same as steps of the encoding processing performed by the encoder 22 in the second selection state. The input moving image data is encoded through the encoding processing, and the resulting encoded moving image data is generated as the output moving image data. Any method may be adopted as the encoding method in the encoding processing, and the method may comply with any specification. For example, it is possible to make the encoding method in the encoding processing comply with H.264 or MPEG-4 (Moving Picture Experts Group-4).
The memory driver 15 creates an image file in a recording medium 16, and stores the output moving image data into the image file. Thereby, the output moving image data is recorded in the recording medium 16. The memory driver 15 operates under control of the main control portion 18, and thus, in the following description, an event in which the memory driver 15 records the output moving image data into the recording medium 16 may be described, for example, as an event in which the main control portion 18 records the output moving image data into the recording medium 16. Incidentally, the recording, the storing and the accommodating of data here are used synonymously with one another. The recording medium 16 is a nonvolatile memory such as a semiconductor memory, a magnetic disc, or the like.
An operation portion 17 accepts various operations performed by a user. Information as to which operation has been performed on the operation portion 17 is transmitted to the main control portion 18. The main control portion 18 controls various portions of the imaging device 1 in a centralized manner. In particular, according to which operation has been performed on the operation portion 17, the main control portion 18 switches the state of the imaging processing portion 14 between the first and second selection states.
An encoder that generates output moving image data that should be fed to the memory driver 15 will be particularly called an effective encoder, and encoders other than the effective encoder will each be called an ineffective encoder. In the first selection state, the encoder 21 is the effective encoder and the encoder 22 is the ineffective encoder. In the second selection state, the encoder 21 is the ineffective encoder and the encoder 22 is the effective encoder. The processing of switching the state of the image processing portion 14 between the first and second selection states can be said to be processing of selecting an effective encoder from the encoders 21 and 22, or processing of switching an encoder (a processing block) to be selected as the effective encoder (a target processing block) between the encoders 21 and 22.
In the first selection state, it is possible to feed the input moving image data not only to the encoder 21 but also to the encoder 22 and make both the encoders 21 and 22 execute the encoding processing, but it is advisable that the operation (including the operation of executing the encoding processing) by the encoder 22 be stopped in the first selection state. Likewise, in the second selection state, it is possible to feed the input moving image data not only to the encoder 22 but also to the encoder 21 and make both the encoders 21 and 22 execute the encoding processing, but it is advisable that the operation (including the operation of executing the encoding processing) by the encoder 21 be stopped in the second selection state. By stopping the operations as described above, wasteful power consumption and the like can be reduced.
Operations that the user is allowed to perform on the operation portion 17 include: a first instruction operation for giving an instruction to start image recording; a second instruction operation for giving an instruction to stop image recording; a third instruction operation for giving an instruction to cancel an already performed operation; and a fourth instruction operation for giving an instruction to restart image recording. However, it is possible to omit one of the third and fourth instruction operations. The term “image recording” or the term “recording” means recording image data of a moving image obtained by using the image sensor 33 into the recording medium 16.
When the first instruction operation is performed on the operation portion 17, a recording start signal is generated in the operation portion 17 to be transmitted to the main control portion 18 and the image processing portion 14;
when the second instruction operation is performed on the operation portion 17, a recording stop signal is generated in the operation portion 17 to be transmitted to the main control portion 18 and the image processing portion 14;
when the third instruction operation is performed on the operation portion 17, a cancellation signal is generated in the operation portion 17 to be transmitted to the main control portion 18 and the image processing portion 14; and
when the fourth instruction operation is performed on the operation portion 17, a recording restart signal is generated in the operation portion 17 to be transmitted to the main control portion 18 and the image processing portion 14.
The first to fourth instruction operations are different from one another. A separate button may be assigned to each instruction operation, or it is also possible to assign a plurality of instruction operations to a common button such that the plurality of instruction operations are each realized as an operation on the common button. There will be described some examples below, which are adoptable in the imaging device 1, of the method of assigning the first to fourth instruction operations to buttons.
In a first method of assignment of the first and second instruction operations, a record button 101 and a stop button 102, which are shown in
In a second method of assignment of the first and second instruction operations, a record button 111 shown in
In a first method of assignment of the third and fourth instruction operations, dedicated buttons 121 and 122, which are shown in
A second method of assignment of the third and fourth instruction operations is realized in combination with the above-described first method of assignment of the first and second instruction operations. In this method, operations of pressing the record button 101 and the stop button 102 for less than a predetermined length of time correspond to the first and second instruction operations, respectively. On the other hand, operations of pressing the record button 101 and the stop button 102 for the predetermined length of time or longer correspond to the third and fourth instruction operations, respectively. Alternatively, operations of pressing the record button 101 and the stop button 102 for the predetermined length of time or longer correspond to the fourth and third instruction operations, respectively.
A third method of assignment of the third and fourth instruction operations is also realized in combination with the above-described first method of assignment of the first and second instruction operations. In this method, an odd-numbered operation of pressing the record button 101 corresponds to the first instruction operation and an even-numbered operation of pressing the record button 101 corresponds to the third or fourth instruction operation. Alternatively, an odd-numbered operation of pressing the stop button 102 corresponds to the second instruction operation and an even-numbered operation of pressing the stop button 102 corresponds to the third or fourth instruction operation.
Various other methods of button assignment are adoptable, and examples of such methods of button assignment will be described along with descriptions of practical operation examples which will be described later. Incidentally, in a case where a display portion (not shown) provided in the imaging device 1 is equipped with a touch panel function, the above-described buttons may be realized as buttons displayed on the display portion. In this case, the display portion functions as an operation portion as well. The above description deals with examples where each of the instruction operations corresponds to a pressing operation of a button; however, each of the instruction operations may be an operation other than pressing a button. For example, each of the instruction operations may be an operation of turning a dial or any operation on a touch panel (for example, tracing the display screen surface with a finger).
As shown in
The state of each encoder may be presented to the user by using the display portion (not shown) or the like provided in the imaging device 1. For example, the above-mentioned display portion may display, with respect to each of the encoders, whether the encoder is in the state of performing the encoding processing, in the state of waiting for the required warm-up period to elapse, or in the stand-by state. Furthermore, for example, the above-mentioned display portion may display which encoder is currently performing the encoding processing, and which encoder is not currently performing the encoding processing. Furthermore, for example, the above-mentioned display portion may display the detail of the processing that each encoder is currently performing. Furthermore, for example, when the encoder 21 is in the state of waiting for the required warm-up period to elapse, the above-mentioned display portion may display how much time needs to elapse before the state of the encoder 21 shifts to the stand-by state (this applies to the encoder 22 as well). These displays make it possible for the user to know the correct system state of the imaging device 1, and thus to make efficient use of the system.
Next, first to fourth operative examples will be described as operative examples of the operation of the imaging device 1.
The first operative example will be described.
In the first operative example, it is assumed that the recording start signal is generated by the user performing the first instruction operation at time tA1, that the recording restart signal is generated by the user performing the fourth instruction operation at time tA2, and that the recording stop signal is generated by the user performing the second instruction operation at time tA3. The input moving image data obtained through shooting performed between time tA1 and time tA3 is fed to the image processing portion 14 between time tA1 and time tA3.
Since the image processing portion 14 is in the first selection state at time tA1, the encoder 21 executes the encoding processing on the input moving image data obtained through shooting performed between time tA1 and time tA2, to thereby generate the output moving image data between time tA1 and time tA2 based on the input moving image data between time tA1 and time tA2. Between time tA1 and time tA2, the memory driver 15 creates the image file F1 in the recording medium 16, and accommodates the output moving image data between time tA1 and time tA2 into the image file F1 under the control of the main control portion 18.
When the recording restart signal is generated at time tA2, the main control portion 18, at time tA2 or immediately after time tA2, quickly switches the state of the image processing portion 14 from the first selection state to the second selection state (that is, switches the encoder to be selected as the effective encoder from the encoder 21 to the encoder 22).
Since the encoder 22 is in the stand-by state at time tA2 (see
When the recording stop signal is generated at time tA3, the main control portion 18 stops the encoding processing executed by the encoder 22. Unless a particular operation is performed after time tA3, the image file F1 in which the output moving image data between time tA1 and time tA2 is accommodated and the image file F2 in which the output moving image data between time tA2 and time tA3 is accommodated remain stored in the recording medium 16. In a case where the image files are given file numbers as sequential numbers according to the order of generation, the main control portion 18, for example, gives a file number “001” to the image file F1 and a file number “002” to the image file F2.
Incidentally, if a recording restart signal is generated instead of the recording stop signal at time tA3, which is different from the situation illustrated in
As described above, by providing a plurality of encoders such that the effective encoder is switched among them in response to the generation of the recoding restart signal, it is possible to start image recording all over again at a desired time even in the middle of recording. That is, recording starting time can be changed as often as desired. In the example shown in
In a case in which a user finds the scene shot between time tA1 and time tA2 of no importance to him or her, and thus desires to start image recording all over again at time tA2, if the user is using a conventional imaging device, he or she needs to suspend the recording operation once and then give an instruction to start image recording again. With the conventional imaging device, however, if the user stops image recording once, recording cannot be restarted until the required warm-up period elapses thereafter, and this may cause the user to miss a chance of shooting an important scene happening during the required warm-up period. Or, if the user of the conventional imaging device desires to avoid failing to shoot an important scene, he or she needs to give up suspending the image recording, which often results in generation of an image file containing a redundant scene. In contrast, according to the present embodiment, a user is able to start image recording all over again at time tA2 by performing the operation for generating the recording restart signal at time tA2. This makes it possible to restart image recording immediately at time tA2 even in the middle of a recording operation, and thus to obtain the image file F2 which does not contain a redundant scene.
Incidentally, if the user finds it unnecessary to store the image file F1, he or she is able to delete the image file F1 from the recording medium 16 later by performing a predetermined operation on the operation portion 17.
Alternatively, after the recording restart signal is generated at time tA2, the image file F1, being considered as an unnecessary file, may be deleted from the recording medium 16 independently of an operation by the user (see
A second operative example will be described.
In the second operative example, it is assumed that the recording start signal is generated at time tB1 by the user performing the first instruction operation, that the recording stop signal is generated at time tB2 by the user performing the second instruction operation, that the cancellation signal is generated at time tA3 by the user performing the third instruction operation, and that the recording stop signal is generated again by the user performing the second instruction operation again at time tB4. The length of time Δt between time tB2 and time tB3 is shorter than a predetermined reference time TH. The input moving image data obtained through shooting performed between time tB1 and time tB4 is fed to the image processing portion 14 between time tB1 and time tB4.
Since the image processing portion 14 is in the first selection state at time tB1, the encoder 21 executes the encoding processing on the input moving image data obtained through shooting performed between time tB1 and time tB2, to thereby generate the output moving image data between time tB1 and time tB2 based on the input moving image data between time tB1 and time tB2. Between time tB1 and time tB2, the memory driver 15 creates the image file F3 in the recording medium 16, and accommodates the output moving image data between time tB1 and time tB2 in the image file F3 under the control of the main control portion 18.
And, when the recording stop signal is generated at time tB2, the main control portion 18, at time tB2 or immediately after time tB2, quickly switches the state of the image processing portion 14 from the first selection state to the second selection state (that is, switches the encoder to be selected as the effective encoder from the encoder 21 to the encoder 22). Since the encoder 22 is in the stand-by state at time tB2 (see
Here, a file operation performed in the second operative example will be described, with time at which a recording stop signal is generated indicated by tB. Incidentally,
In the case in which the cancellation judgment is made, the main control portion 18 considers the operation performed by the user at time tB (that is, the second instruction operation for generating a recording stop signal) to have been cancelled by the user; the main control portion 18 accommodates the output moving image data between time tB and time tB′ based on the input moving image data between time tB and time tB′ into an image file, and stores the image file in the recording medium 16. Here, it is assumed that a first recording stop signal is generated at time tB, and a second recording stop signal is generated at time tB′. Time tB and time tB′ in the case in which the cancellation judgment is made correspond to time tB2 and time tB4, respectively, in the example shown in
On the other hand, in the case in which the effectiveness judgment is made, the main control portion 18 determines that the operation performed by the user at time tB (that is, the second instruction operation for generating the recording stop signal) to be effective; the main control portion 18 deletes, from the recording medium 16, the image file accommodating the output moving image data between time tB and time (tB+TH) that has been temporarily stored in the recording medium 16 between time tB and time (tB+TH). Time tB and time (tB+TH) in the case in which the effectiveness judgment is made correspond to time tB2 and time tB2′, respectively, in the example shown in
With reference to the example shown in
When the recording stop signal is generated at time tB4, the main control portion 18 stops the encoding processing executed by the encoder 22. Unless a particular operation is performed after time tB4, the image file F3 in which the output moving image data between time tB1 and time tB2 is accommodated and the image file F4 in which the output moving image data between time tB2 and time tB4 is accommodated remain stored in the recording medium 16. In a case where image files are given file numbers as sequential numbers in the order of generation, the main control portion 18, for example, gives a file number “001” to the image file F3 and a file number “002” to the image file F4.
Incidentally, although no operation is indicated with respect to the time zone after time tB4 in
As described above, by providing a plurality of encoders such that the effective encoder is switched among them in response to the generation of the recoding stop signal for the encoding processing to be continuously performed, even after the instruction to stop image recording is given, performance of the operation for generating the cancellation signal has the same effect as cancelling the instruction to stop image recording. In the example shown in
There may be a case in which an instruction to stop image recording is given at time tB2 but an important scene that needs to be recorded takes place thereafter. In such a case, the user of the conventional imaging device once again gives the instruction to start image recording, but with the conventional imaging device, the user is not allowed to restart image recording until after a lapse of the required warm-up period. In contrast, with the imaging device 1 according to the present embodiment, the user is allowed to restart image recording as soon as he or she performs the operation for generating the cancellation signal when he or she recognizes the important scene after time tB2. Thereby, a moving image starting at time tB2 is recorded, and thus missing of the important scene is avoided.
After the recording stop signal is generated, information of cancellation-signal accepting time may be indicated to the user by using, for example, the display portion (not shown) of the imaging device 1 (this applies to later-described third and fourth operative examples as well). The cancellation-signal accepting time indicates time (time length) left until the end of a period during which the cancellation judgment is allowed to be made. Thus, in the examples shown in
A third operative example will be described. As described above,
Thus, after time tB2, the following operations are performed. Before time tB2′, the main control portion 18 is not able to determine whether to make a cancellation judgment or an effectiveness judgment with respect to the operation performed at time tB2 (that is, the second instruction operation for generating the recording stop signal). Hence, the main control portion 18 makes the effective encoder execute the encoding processing between time tB2 and time tB2′. Thus, the encoder 22, which is the effective encoder between time tB2 and time tB2′, executes the encoding processing on the input moving image data obtained through shooting performed between time tB2 and time tB2′, to thereby generate the output moving image data between time tB2 and time tB2′ based on the input moving image data between time tB2 and time tB2′. Between time tB2 and time t tB2′, the memory driver 15 creates the image file F4 in the recording medium 16, and accommodates the output moving image data between time tB2 and time tB2′ into the image file F4 under the control of the main control portion 18.
If it is recognized that the cancellation signal is not generated between time tB2 and time tB2′, the main control portion 18 makes the effectiveness judgment with respect to the operation performed at time tB2 (that is, the second instruction operation for generating the recording stop signal), and deletes, from the recording medium 16, the image file F4 accommodating the output moving image data between time tB2 and time tB2′ and temporarily stored in the recording medium 16 between time tB2 and time tB2′. In this way, image data that the user does not intend to record is automatically deleted from the recording medium 16.
Incidentally, in the second or third operative example, it is possible to realize the following operations with a single record button 111 (see
On the other hand, in a case in which time that is longer than the reference time TH elapses between the operation of pressing the record button 111 for the second time and the operation of pressing the record button 111 for the third time, it is advisable that the effectiveness judgment be made with respect to the operation of pressing the record button 111 for the second time (see
A fourth operative example will be described.
When the recording stop signal is generated at time tB4, the main control portion 18, at time tB4 or immediately after time tB4, quickly switches the state of the image processing portion 14 from the second selection state to the first selection state (that is, switches the encoder to be selected as the effective encoder from the encoder 22 to the encoder 21). Since the encoder 21 is in the stand-by state at time tB4, the encoder 21 is able to start executing the encoding processing immediately at time tB4. It is desirable that the reference time TH be set to have a length equal to the required warm-up period or longer for the purpose of securely maintaining the encoder 21 in the stand-by state at time tB4.
It is assumed that the cancellation signal is not generated thereafter between time tB4 and time tB5. Time tB5 indicates time that comes a lapse of the reference time TH after time tB4. The main control portion 18 is not able to determine, before time tB5, whether to make a cancellation judgment or an effectiveness judgment with respect to the operation performed at time tB4 (that is, the second instruction operation for generating the recording stop signal). Hence, the main control portion 18 makes the effective encoder execute the encoding processing between time tB4 and time tB5. Thus, the encoder 21, which is the effective encoder between time tB4 and time tB5, executes the encoding processing on the input moving image data obtained through shooting performed between time tB4 and time tB5, to thereby generate the output moving image data between time tB4 and time tB5 based on the input moving image data between time tB4 and time tB5. Between time tB4 and time tB5, the memory driver 15 creates an image file F5 in the recording medium 16, and accommodates the output moving image data between time tB4 and time tB5 into the image file F5 under the control of the main control portion 18.
If it is recognized that the cancellation signal is not generated between time tB4 and time tB5, the main control portion 18 makes the effectiveness judgment with respect to the operation performed at time tB4 (that is, the second instruction operation for generating the recording stop signal), and deletes, from the recording medium 16, the image file F5 accommodating the output moving image data between time tB4 and time tB5 and temporarily stored in the recording medium 16 between time tB4 and time tB5. In this way, it is possible to automatically delete image data that the user does not intend to record from the recording medium 16.
Incidentally, considering that the operation performed by the user at time tB3 indicates that the user desires to cancel the instruction to stop image recording, after the image file F3 accommodating the output moving image data between time tB1 and time tB2 and the image file F4 accommodating the output moving image data between time tB2 and time tB4 are created, these image files may be combined to create a new image file F34, and the image file F34 may be stored in the recording medium 16 as shown in
<<Modifications and Variations>>
The specific values given in the descriptions above are merely examples, which, needless to say, may be modified to any other values. In connection with the embodiments described above, supplementary explanations applicable to them will be given below in Notes 1 to 4. Unless inconsistent, any part of the contents of these notes may be combined with any other.
[Note 1]
The imaging device 1 of
[Note 2]
The image processing portion 14 of
[Note 3]
The imaging device 1 may be used by being incorporated in any apparatus (e.g., a mobile terminal such as a mobile phone).
[Note 4]
It is possible to realize the imaging device 1 of
Number | Date | Country | Kind |
---|---|---|---|
2010-106091 | May 2010 | JP | national |