Patent Grant
9894262
The present disclosure relates to display control apparatuses, programs, and display control methods.
Digital cameras have in recent years become widespread. For example, digital cameras are produced as a dedicated apparatus or are incorporated in other apparatuses (e.g., a smartphone). Images generated through an image sensor, image processing circuit, and the like of a digital camera are typically stored as digital data and are displayed on a monitor.
A typical digital camera has functions of automatically performing exposure adjustment, color balance adjustment depending on the type of a light source, and the like, during shooting. Also, many digital cameras have a plurality of shooting modes corresponding to the types of subjects or the purposes of shooting, such as a person, flower, landscape, or night scene. Also, after a desired shooting mode has been selected during shooting, conditions for shooting, such as shutter speed, f-number, light source type, and the like, are automatically set suitable for the type of a subject or the purpose of shooting. Moreover, provided is a function of changing the tone of an image by an effect, depending on the preference of the user of the digital camera.
Patent Literature 1 describes a technique for use in the digital camera having the above functions that displays a live preview image (or a through image) on a monitor while displaying sample images obtained by changing the tone of an image captured at some time point as thumbnails on the monitor. This technique allows the user of the digital camera to select a thumbnail having the desired image tone while viewing the live preview image, and cause the digital camera to set shooting conditions.
However, in the technique described in Patent Literature 1, a sample image displayed as a thumbnail is an image which has been obtained based on an image captured at some time point, and therefore, a live preview image may not match a thumbnail. Therefore, the user has difficulty in imagining which change it is desirable should be made in the tone of a live preview image even based on thumbnails. In other words, the user has difficulty in determining which thumbnail it is desirable should be selected to make shooting conditions.
On the other hand, thumbnails may be updated at a frame rate which is close to the frame rate of a live preview image. However, it takes time to perform image processing to obtain a thumbnail, and therefore, actually, the frame rate of a thumbnail may be lower than the frame rate of a live preview image. As a result, thumbnails may not be smoothly displayed, and may be displayed as if it dropped some frames. Therefore, there is a risk that viewing thumbnails causes the user a lot of stress.
Therefore, it is desirable to provide a way to allow the user to easily check a captured image after image processing, without stress, during shooting.
According to the present disclosure, there is provided a display control apparatus including: a display control unit configured to cause a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and a determination unit configured to determine whether or not a predetermined user operation has been recognized. If it is determined that the predetermined user operation has been recognized, the display control unit updates the one or more processed images to be displayed.
According to the present disclosure, there is provided a program for causing a computer to function as: a display control unit configured to cause a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and a determination unit configured to determine whether or not a predetermined user operation has been recognized. If it is determined that the predetermined user operation has been recognized, the display control unit updates the one or more processed images to be displayed.
According to the present disclosure, there is provided a display control method including: causing a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and determining whether or not a predetermined user operation has been recognized. If it is determined that the predetermined user operation has been recognized, the one or more processed images to be displayed are updated.
As described above, according to the present disclosure, the user is allowed to easily check a captured image after image processing, without stress, during shooting.
Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the drawings, elements that have substantially the same function and structure are denoted with the same reference signs, and repeated explanation is omitted.
Note that description will be provided in the following order.
1. External appearance of display control apparatus
2. First embodiment
3. Second embodiment
4. Hardware configuration
5. Conclusion
Firstly, an external appearance of a display control apparatus according to an embodiment of the present disclosure will be described with reference to
For example, the display control apparatus 100 includes a display apparatus 101. The display control apparatus 100 displays a screen which is intended to be shown to the user of the display control apparatus 100, on the display apparatus 101.
Also, for example, the display control apparatus 100 includes a touch panel. In this case, the display apparatus 101 is a display surface of the touch panel. Also, the display control apparatus 100 detects the user's touch on the touch panel, and recognizes the user's touch operation based on the result of the detection.
Also, for example, the display control apparatus 100 includes a camera 103. An image generated through the camera 103 is stored in the display control apparatus 100, and displayed on the display apparatus 101.
Next, an example hardware configuration of the display control apparatus 100 according to an embodiment of the present disclosure will be described with reference to
The CPU 71 controls the entire display control apparatus 100.
The lens block 73, which is an optical system, is driven by the motor 75. Also, the motor 75 is controlled by the motor driver 77. The motor driver 77 controls the motor 75 according to a control signal from the CPU 71, to extend and collapse lenses when the power supply is turned on and off, or the like, to change the magnification of a zoom optical system, to adjust the focus, to adjust the diaphragm, and the like.
The image sensor 79 is, for example, any image sensor, such as a charge coupled device (CCD) or complementary metal oxide semiconductor (CMOS). The image sensor driver 81 controls the image sensor 79 according to a timing signal which is generated by the timing generator 83 according to a control signal of the CPU 71. The image sensor 79 converts an optical image of a subject imaged by the lens block 73 into an image capture signal by photoelectric conversion under the control of the image sensor driver 81, and outputs the image capture signal to the signal processing circuit 85.
The signal processing circuit 85 includes a circuit which removes noise contained in the image capture signal, an analog/digital converter which converts the image capture signal after noise removal into a digital signal, and the like. The signal processing circuit 85 outputs the resultant digital image capture signal to the image processing circuit 87. The image capture signal is RAW-formatted image data (hereinafter referred to as “RAW data”).
The image processing circuit 87 converts the image capture signal into YUV-formatted image data (hereinafter referred to as “YUV data”) containing a luminance (Y) signal and color difference (UV) signals. Also, the image processing circuit 87 optionally performs pixel interpolation. Also, the image processing circuit 87 performs image processes such as white balance adjustment, edge enhancement, changing of image tone, and the like, under the control of the CPU 71. The YUV data converted by the image processing circuit 87 is successively stored into the SDRAM 89. Also, in a shooting waiting state of a recording mode, each time one frame of YUV data is accumulated in the SDRAM 89, a live preview image (or a through image) corresponding to that YUV data is displayed on the monitor 91. The monitor 91 may be implemented using a liquid crystal, organic light-emitting diode (OLED), cathode ray tube (CRT), or the like. The monitor 91 is, for example, a display surface of the touch panel.
The YUV data is, for example, compressed into image data in some format such as the joint photographic experts group (JPEG), JPEG2000, or the like. Thereafter, the compressed image data is stored to the internal memory 93 included in the display control apparatus 100, or the removable external memory 95 (e.g., a memory card) connected to the display control apparatus 100 through an interface (not shown). Note that, in a playback mode, image data stored in the internal memory 93 or external memory 95 is read out by the CPU 71 according to a user operation as appropriate, converted into YUV data, which is then output to the SDRAM 89. Thereafter, the YUV data is displayed on the monitor 91.
A microcomputer (not shown) is connected to the CPU 71. Also, the key input device 97 (a TACT switch, etc.), the touch detection surface 99, and a power supply control circuit (not shown) are connected to the microcomputer. The touch detection surface 99 is, for example, a touch detection surface of the touch panel.
The microcomputer regularly scans a key input operation to the key input device 97 and a touch operation on the touch detection surface 99. Thereafter, the microcomputer detects the user's key input operation to the key input device 97, and provides the detection result to the CPU 71. Also, the microcomputer detects the user's touch on the touch detection surface 99, and provides the detection result to the CPU 71. Also, the microcomputer controls power supply from the power supply control circuit.
An example hardware configuration of the display control apparatus 100 has been described above. This is for illustrative purposes only. The display control apparatus 100 may include other components such as a communication circuit and the like in addition to the above components, or may not necessarily include all of the above components.
Firstly, a first embodiment of the present disclosure will be described. According to the first embodiment of the present disclosure, a live preview image, and a processed image(s) after image processing, are displayed, and the one or more processed images are updated according to a predetermined user operation.
<3. 1. Configuration of Display Control Apparatus>
An example configuration of a display control apparatus 100-1 according to the first embodiment will be described with reference to
(Image Capture Unit 110)
The image capture unit 110 obtains image data through an image sensor. The image data is, for example, RAW data.
For example, in the image capture unit 110, an image capture signal is output by the image sensor, and noise removal, analog/digital conversion, and the like are performed on the image capture signal. As a result, the above image data is obtained. The image capture unit 110 provides the image data to the control unit 150 (image processing unit 153).
Note that, as an example, the image capture unit 110 is implemented by the lens block 73, the motor 75, the motor driver 77, the image sensor 79, the image sensor driver 81, the timing generator 83, the signal processing circuit 85, and the like.
(Input Unit 120)
The input unit 120 detects a user operation. Thereafter, the input unit 120 provides the detection result to the control unit 150 (operation recognition unit 155).
For example, the input unit 120 detects the user's touch on the touch panel. Thereafter, the input unit 120 provides the detection result (e.g., touch position information) to the control unit 150 (operation recognition unit 155).
Also, the input unit 120 detects the user's key input operation to the key input device. Thereafter, the input unit 120 provides the detection result to the control unit 150 (operation recognition unit 155).
Note that, as an example, the input unit 120 may be implemented by the key input device 97, the touch detection surface 99, the above microcomputer (not shown), and the like.
(Display Unit 130)
The display unit 130 displays a screen which is intended to be shown to the user of the display control apparatus 100-1. In other words, the display unit 130 corresponds to the display apparatus 101. For example, the display unit 130 displays the screen under the control of the control unit 150 (display control unit 157).
Note that, as an example, the display unit 130 is implemented by the monitor 91 and the like. In other words, the display unit 130 is, for example, a display surface of the touch panel.
(Storage Unit 140)
The storage unit 140 stores a program and data for operation of the display control apparatus 100-1. Also, for example, the storage unit 140 stores image data obtained through the image capture unit 110 and/or the control unit 150 (image processing unit 153).
Note that, as an example, the storage unit 140 may be implemented by the SDRAM 89, the internal memory 93, the external memory 95, and the like.
(Control Unit 150)
The control unit 150 provides various functions of the display control apparatus 100-1. For example, the control unit 150 executes programs stored in the storage unit 140 or other storage media to provide the various functions. The control unit 150 includes an image capture control unit 151, the image processing unit 153, the operation recognition unit 155, an operation determination unit 156, the display control unit 157, and a parameter changing unit 159.
Note that, as an example, the image processing unit 153 may be implemented by the CPU 71, the image processing circuit 87, and the like.
(Image Capture Control Unit 151)
The image capture control unit 151 performs controls involved with image capture performed by the image capture unit 110.
For example, the image capture control unit 151 controls timing of image capture. More specifically, for example, the image capture control unit 151 provides a control signal for timing of image capture to the image capture unit 110, to control timing of image capture.
Also, for example, the image capture control unit 151 controls drive of the image capture unit 110. More specifically, for example, the image capture control unit 151 sends a control signal for drive to the image capture unit 110, to extend and collapse lenses when the power supply is turned on and off, or the like, to change the magnification of a zoom optical system, to adjust the focus, to adjust the diaphragm, and the like.
(Image Processing Unit 153)
The image processing unit 153 generates an image by performing image processing. For example, the image processing unit 153 generates an image based on image data obtained through the image sensor. Specifically, the image processing unit 153 generates an image based on image data provided by the image capture unit 110. The image data is, for example, RAW data.
Live Preview Image
In particular, in this embodiment, the image processing unit 153 generates a live preview image (or a through image) based on image data obtained through the image sensor. For example, in a waiting state of a shooting mode, the image processing unit 153 generates live preview images based on image data successively obtained through the image sensor.
Processed Image
Also, in particular, in this embodiment, the image processing unit 153 generates one or more processed images using respective image processing conditions, based on one of the image data that has been captured at some time point. For example, the image data is RAW data, and the one or more processed images are any image that can be generated by image processing based on RAW data. Also, the image processing conditions are any conditions for image processing.
For example, the image processing conditions include conditions for a development process of RAW data (hereinafter referred to as “development conditions”). The development conditions include, for example, white balance, contrast, brightness, and the like. As an example, a first processed image may be an image which is generated by a development process using first development conditions, and a second processed image may be an image which is generated by a development process using second development conditions. As a specific example, the first processed image may be an image having a higher contrast than that of a standard image, and the second processed image may be a brighter image than a standard image.
Also, for example, the image processing conditions include a modification process (and modification conditions of the modification process) which are further applied to an image after the development process. The modification process is, for example, extraction of a particular color (color accent), conversion into a negative image, conversion into an artistic image, and the like. As an example, a third processed image may be an image which has been subjected to a first modification process, and a fourth processed image may be an image which has been subjected to a second modification process. As a specific example, the third processed image may be an image in which a particular color has been extracted, and the fourth processed image may be an image which has been converted into an artistic image.
As described above, the image processing unit 153 may generate a processed image based on image data using any conditions for image processing.
Also, as described above, the image processing unit 153 generates one or more processed images based on one of the image data that has been obtained at some time point. That time point includes, for example, any time point after the display control unit 157 issues an instruction to generate a new processed image (e.g., a time point immediately after that). Specifically, the image processing unit 153 generates a new processed image after receiving the instruction from the display control unit 157. Also, the time point may include a time point when a shooting mode starts. Specifically, the image processing unit 153 may generate a first processed image when a shooting mode starts.
Also, for example, the one or more processed images may be an image containing a subject recued in size, the subject being captured in all or a portion of the live preview image. Specifically, the image processing unit 153 generates one or more processed images containing a subject reduced in size, the subject being captured in all or a portion of the live preview image. As an example, the one or more processed images are an image containing an entire subject reduced in size, the subject captured in the live preview image.
Also, for example, the one or more processed images are a plurality of processed images. Specifically, the image processing unit 153 generates a plurality of processed images using respective image processing conditions. In addition, for example, a subject captured in each of the plurality of processed images has at least a portion in common with a subject captured in one or more others of the plurality of processed images. As an example, a subject captured in each of the plurality of processed images has all portions in common with subjects captured in all the others of the plurality of processed images. In other words, the plurality of processed images contain the same subject.
(Operation Recognition Unit 155)
The operation recognition unit 155 recognizes a user operation. For example, the input unit 120, when detecting a user operation performed by the user of the display control apparatus 100-1, provides the result of the detection of the user operation to the operation recognition unit 155, and the operation recognition unit 155 obtains the detection result. Thereafter, the operation recognition unit 155 recognizes the user operation based on the detection result.
For example, the user operation includes a touch operation on the touch panel. Specifically, the operation recognition unit 155 recognizes a touch operation on the touch panel. More specifically, for example, the operation recognition unit 155 recognizes a touch event as a touch operation on the touch panel. The touch event includes, for example, tap, double tap, drag, flick, pinch, and the like. For example, the operation recognition unit 155 successively obtains touch position information as the detection result of a user operation, and recognizes a touch event from the touch position information successively obtained.
Also, for example, the user operation includes the user's key input operation to the key input device. Specifically, the operation recognition unit 155 recognizes a key input operation to the key input device. More specifically, for example, the operation recognition unit 155 recognizes the type of a key input operation as a key input operation to the key input device.
(Operation Determination Unit 156)
Determination of Update Operation
The operation determination unit 156 determines whether or not a predetermined user operation (hereinafter referred to as an “update operation”) has been recognized.
For example, the update operation is a predetermined touch operation on the touch panel. More specifically, for example, the update operation is a touch operation at a predetermined position on the touch panel. As an example, the update operation is a touch operation at a position on the touch panel where the one or more processed images are displayed. Specifically, the operation determination unit 156 determines whether or not a touch operation (i.e., an update operation) has been recognized at a position on the touch panel where the one or more processed images are being displayed.
For example, the operation determination unit 156 monitors a user operation recognized by the operation recognition unit 155 to determine whether or not the user operation matches the update operation, thereby determining whether or not the update operation has been recognized. Thereafter, if the update operation has been recognized, the operation determination unit 156 notifies the display control unit 157 that the update operation has been recognized.
Determination of Parameter Changing Operation
The operation determination unit 156 determines whether or not another predetermined user operation (hereinafter referred to as a “parameter changing operation”) has been recognized.
For example, as described below, a parameter for generating at least one of the one or more processed images is changed by the parameter changing unit 159. Also, the parameter changing operation is a touch operation at a position on the touch panel where an object for changing the parameter (hereinafter referred to as a parameter changing object) is displayed. The operation determination unit 156 determines whether or not a touch operation (i.e., a parameter changing operation) at a position on the touch panel where a parameter changing object is being displayed has been recognized.
For example, the operation determination unit 156 monitors a user operation recognized by the operation recognition unit 155 to determine whether or not the user operation matches the parameter changing operation, thereby determining whether or not the parameter changing operation has been recognized. Thereafter, if the parameter changing operation has been recognized, the operation determination unit 156 notifies the parameter changing unit 159 that the parameter changing operation has been recognized.
(Display Control Unit 157)
The display control unit 157 causes the display apparatus 101 to display a screen which is intended to be shown to the user. As described above, the display apparatus 101 corresponds to the display unit 130, and therefore, the display control unit 157 causes the display unit 130 to display the screen.
Display of Live Preview Image and Processed Image
In particular, in this embodiment, the display control unit 157 causes the display unit 130 to display a live preview image which is generated based on image data obtained through the image sensor, and one or more processed images which are generated using respective image processing conditions based on one of the image data that has been obtained at some time point. For example, the display control unit 157 causes the display unit 130 to display a screen containing a live preview image and one or more processed images generated by the image processing unit 153.
For example, the one or more processed images are an image containing a subject reduced in size, the subject being captured in all or a portion of the live preview image. Specifically, the display control unit 157 causes the display unit 130 to display one or more processed images containing a subject reduced in size, the subject being captured in all or a portion of the live preview image. As an example, the one or more processed images are an image containing a subject reduced in size, the subject being captured in all the live preview image.
By a processed image containing a subject reduced in size, the subject being captured in the live preview image being thus displayed, the user is allowed to easily visually compare the live preview image with the processed image. Therefore, by viewing the live preview image and the processed image, the user can easily imagine what kind of captured image will be obtained.
Also, for example, the one or more processed images are a plurality of processed images. Specifically, the display control unit 157 causes the display unit 130 to display a live preview image and a plurality of processed images.
A plurality of processed images are thus displayed, and therefore, the plurality of processed images generated using different image processing conditions can be visually compared. Therefore, the user can more easily determine which image process is desirable.
Also, for example, the plurality of processed images are displayed side by side. Specifically, the display control unit 157 causes the display unit 130 to display the plurality of processed images side by side.
A plurality of processed images are thus displayed side by side, and therefore, the user can more easily visually compare the plurality of processed images. In other words, the user can more easily determine which image processing condition is more desirable.
Also, for example, a subject captured in each of the plurality of processed images has at least a portion in common with a subject captured in one or more others of the plurality of processed images. As an example, a subject captured in each of the plurality of processed images has all portions in common with a subject captured in all the others of the plurality of processed images. In other words, the plurality of processed images contain the same subject.
A plurality of processed images thus have a captured subject in common, and therefore, the user is allowed to more easily visually compare the plurality of processed images. In other words, the user can more easily determine which image processing condition is more desirable.
For example, the above processed images are displayed. A specific example of screens will now be described with reference to
A live preview image and a processed image(s) are thus displayed.
Updating of Processed Image
Also, in particular, in this embodiment, when it is determined that the above update operation has been recognized, the display control unit 157 updates the one or more processed images to be displayed.
For example, when the update operation has been recognized, the display control unit 157 is notified by the operation determination unit 156 that the update operation has been recognized. Thereafter, the display control unit 157 instructs the image processing unit 153 to generate a new processed image. Thereafter, the display control unit 157 causes the display unit 130 to display a live preview image, and one or more processed images which are generated based on image data at a new time point. Thus, the one or more processed images are updated. A specific example of the updating of a processed image will now be described with reference to
Therefore, as shown in
As a result, if the update operation is performed when necessary, the user is allowed to view a processed image containing a subject similar to that of a live preview image. Therefore, the user is allowed to easily check a captured image after image processing. Also, a processed image is updated only when the update operation has been performed, and therefore, the situation is avoided that the processed image is displayed as if it dropped some frames like when the processed image is not updated at a frame rate similar to that of a live preview image. Therefore, the user is allowed to check a captured image after image processing without stress. In other words, the user is allowed to easily check a captured image after image processing, without stress, during shooting.
Also, because the update operation is a touch operation, the user can easily perform an operation while viewing the screen, and therefore, is allowed to more easily update a processed image. Also, because the update operation is a touch operation at a position where a processed image is displayed, the user is allowed to update a processed image by a more intuitive operation.
Notification of Updating of Processed Image
Also, for example, when the one or more processed images have been updated, the user who has performed the update operation is notified that the one or more processed images have been updated. For example, when it is determined that the update operation has been recognized, the display control unit 157 causes the display unit 130 to display a screen containing the live preview image and the one or more processed images, the screen notifies update of the one or more processed images.
More specifically, for example, the screen contains an animation about the one or more processed images, the animation notifies update of the one or more processed images (hereinafter referred to as a “notification animation”). Specifically, when it is determined that the update operation has been recognized, the display control unit 157 causes the display unit 130 to display a screen containing the notification animation. The notification animation is, for example, fade-in of the one or more processed images. Also, the notification animation may be other animations such as flicker of the one or more processed images, zoom-in of the one or more processed images, and the like. A specific example of the notification animation will now be described with reference to
Note that, instead of the notification animation, the screen may contain an object which notifies update of the one or more processed images (hereinafter referred to as a “notification object”). Specifically, when it is determined that the update operation has been recognized, the display control unit 157 may cause the display unit 130 to display a screen containing the notification object. The notification object is, for example, a graphical object surrounding the one or more processed images. Also, the notification object may be other objects such as an arrow object pointing at the one or more processed images, an object containing text information such as “Updated,” and the like. A specific example of the notification object will now be described with reference to
Thus, the notification of updating of a processed image more reliably ensures that the user notices that the processed image has been updated, and also allows the user to understand a relation between the update operation and the updating of a processed image. Also, the notification using the screen even more reliably ensures that the user viewing the screen notices that a processed image has been updated. For example, the above notification animation is considerably noticeable on the screen. Therefore, the notification animation even more reliably ensures that the user viewing the screen notices that a processed image has been updated. Also, for example, the above notification object has only a small amount of data to be processed, and therefore, according to the notification object, the amount of data to be processed in the display process can be reduced while the user viewing the screen is allowed to notice the updating.
Display of Object for Changing Parameter
Also, for example, as described above, a parameter for generating at least one of the one or more processed images is changed by the parameter changing unit 159. Also, the display control unit 157 causes the display unit 130 to display an object for changing the parameter (i.e., a parameter changing object). As an example, the parameter changing object is a scrollbar. A specific example of this will now be described with reference to
(Parameter Changing Unit 159)
The parameter changing unit 159 changes a parameter for generating a processed image. As an example, when a processed image is an image containing a higher contrast than that of a standard image, the parameter is the degree of contrast of the processed image.
In particular, when the live preview image and the one or more processed images are displayed on the display unit 130, the parameter changing unit 159 changes a parameter for generating at least one of the one or more processed images.
Also, in particular, when it is determined that the parameter changing operation has been recognized, the parameter changing unit 159 changes the parameter.
For example, when it is determined that the parameter changing operation has been recognized, the operation determination unit 156 notifies the parameter changing unit 159 that the parameter changing operation has been recognized. Thereafter, the parameter changing unit 159 changes the parameter for generating one or more processed images according to the parameter operation.
As an example, when a screen shown in
Thus, when a processed image is being displayed, a parameter for generating the processed image is changed. This allows the user to adjust a parameter while actually viewing a processed image. Therefore, the user can easily check what a captured image after image processing will be like when a parameter is adjusted. In other words, convenience for the user is improved.
Also, the touch operation using the parameter changing object allows for adjustment of a parameter by an easy operation while viewing the screen.
<3. 2. Flow of Process>
Next, an example display control process according to the first embodiment will be described with reference to
Initially, in step S301, a shooting mode of an application for shooting begins.
In step S303, the image processing unit 153 generates one or more new processed images.
In step S305, the image processing unit 153 generates a live preview image.
In step S307, the display control unit 157 updates a screen containing the live preview image and the one or more processed images.
In step S309, the operation determination unit 156 determines whether or not an operation of ending the application or the shooting mode has been performed. If the end operation has been performed, the process is ended. Otherwise, the process proceeds to step S311.
In step S311, the operation determination unit 156 determines whether or not an update operation has been performed. If an update operation has been performed, the process proceeds to step S313. Otherwise, the process returns to step S305.
In step S313, the display control unit 157 instructs the image processing unit 153 to generate a new processed image. Thereafter, the process returns to step S303.
Next, a second embodiment of the present disclosure will be described.
As described above, JP 2007-194819A describes the technique of displaying a live preview image (or a through image) on a monitor while displaying sample images obtained by changing the tone of an image captured at some time point as thumbnails on the monitor. With this technique, the user of the digital camera selects a thumbnail having a desired image tone while viewing the live preview image, to set the digital camera to image capture conditions.
However, in the above technique, the sample image is displayed as a thumbnail, and therefore, is an image reduced in size more than the live preview image. Therefore, it may be difficult for the user to check details of what kind of captured image will be obtained, even by viewing the sample image displayed as a thumbnail.
Therefore, it is desirable to provide a way to allow the user to easily check a captured image after image processing, in greater detail.
Therefore, according to the second embodiment of the present disclosure, displayed are a live preview image, and a processed image containing a subject which is enlarged in size compared to the live preview image.
<4. 1. Configuration of Display Control Apparatus>
An example configuration of a display control apparatus 100-2 according to the second embodiment will be described with reference to
Note that the image capture unit 110, input unit 120, display unit 130, and storage unit 140 of the second embodiment are not different from those of the first embodiment. Also, an image capture control unit 151, image processing unit 153, operation recognition unit 155, operation determination unit 156, and parameter changing unit 159 included in the control unit 160 of the second embodiment are not different from those of the first embodiment. Therefore, here, an image processing unit 163 and display control unit 167 which are included in the control unit 160 will be described.
(Image Processing Unit 163)
The image processing unit 163 generates an image by performing image processing. For example, the image processing unit 163 generates an image based on image data obtained through an image sensor. Specifically, the image processing unit 163 generates an image based on image data provided by the image capture unit 110. The image data is, for example, RAW data.
Live Preview Image
The image processing unit 163 generates a live preview image (or a through image) based on image data obtained through the image sensor. This is the same as what has been described as to the image processing unit 153 according to the first embodiment.
Processed Image
Also, the image processing unit 163 generates one or more processed images using respective image processing conditions based on one of the image data that has been obtained at some time point. For example, the image data is RAW data, and the one or more processed images are any image that may be generated by image processing based on RAW data. Also, the image processing conditions are any conditions related to image processing.
For example, the image processing conditions include conditions for a development process of RAW data (hereinafter referred to as “development conditions”). Also, for example, the image processing conditions include a modification process which is additionally performed on an image after the development process (and modification conditions for the modification process). These are the same as those which have been described as to the image processing unit 153 according to the first embodiment.
Thus, the image processing unit 163 may generate a processed image using any conditions for image processing based on image data.
Also, the above time point is, for example, some time point after the display control unit 157 has issued an instruction to generate a new processed image (e.g., a time point immediately after that). This is also the same as that which has been described as to the image processing unit 153 according to the first embodiment.
In particular, in this embodiment, the one or more processed images are an image containing a subject which is enlarged in size compared to the live preview image. Specifically, the image processing unit 163 generates one or more processed images containing a subject which is enlarged in size compared to the live preview image.
Also, for example, the one or more processed images are a plurality of processed images. Specifically, the image processing unit 163 generates a plurality of processed images using respective image processing conditions. Also, for example, a subject captured in each of the plurality of processed images has at least a portion in common with a subject captured in one or more others of the plurality of processed images.
(Display Control Unit 167)
The display control unit 167 causes the display apparatus 101 to display a screen which is intended to be shown to the user. As described above, the display apparatus 101 corresponds to the display unit 130, and therefore, the display control unit 157 causes the display unit 130 to display the screen.
Display of Live Preview Image and Processed Image
In this embodiment, the display control unit 167 causes the display unit 130 to display a live preview image which is generated based on image data obtained through the image sensor, and one or more processed images which are generated using respective image processing conditions based on one of the image data that has been obtained at some time point. For example, the display control unit 167 causes the display unit 130 to display a screen containing the live preview image and one or more processed images generated by the image processing unit 163.
Also, in particular, in this embodiment, the one or more processed images are an image containing a subject which is enlarged in size compared to the live preview image. Specifically, the display control unit 157 causes the display unit 130 to display one or more processed images containing a subject which is enlarged in size compared to the live preview image.
By an image containing a subject enlarged in size being thus displayed, the user is allowed to view details of a captured image after image processing. Therefore, the user can check what kind of captured image will be obtained, in greater detail, based on a processed image.
Also, for example, the one or more processed images are a plurality of processed images. Also, for example, the plurality of processed images are displayed side by side. Also, for example, a subject captured in each of the plurality of processed images has at least a portion in common with a subject captured in one or more others of the plurality of processed images. These are the same as those that have been described as to the display control unit 157 according to the first embodiment.
For example, the above processed image is displayed. Specific examples of screens will now be described with reference to
A live preview image and a processed image(s) are thus displayed.
Updating of Processed Image
Also, for example, in the second embodiment as well, when it is determined that the update operation has been recognized, the display control unit 167 updates the one or more processed images to be displayed. This is the same as that which has been described as to the display control unit 157 according to the first embodiment.
Notification of Updating of Processed Image
Also, for example, in the second embodiment as well, when the one or more processed images have been updated, the user who has performed the update operation is notified that the one or more processed images have been updated. This is the same as that which has been described as to the display control unit 157 according to the first embodiment.
Display of Object for Changing Parameter.
Also, for example, in the second embodiment as well, the display control unit 167 causes the display unit 130 to display an object for changing the parameter (i.e., a parameter changing object). This is the same as that which has been described as to the display control unit 157 according to the first embodiment.
<4. 2. Flow of Process>
The display control process according to the second embodiment is similar to the display control process according to the first embodiment which has been described with reference to
The display control apparatus 100 and display control process according to embodiments of the present disclosure have been described with reference to
As a result, if an update operation is performed when necessary, the user is allowed to view a processed image containing a subject similar to that of a live preview image. Therefore, the user is allowed to easily check a captured image after image processing. Also, a processed image is updated only when an update operation has been performed, and therefore, the situation is avoided that the processed image is displayed as if it dropped some frames like when the processed image is not updated at a frame rate similar to that of a live preview image. Therefore, the user is allowed to check a captured image after image processing without stress. In other words, the user is allowed to easily check a captured image after image processing, without stress, during shooting.
For example, the display apparatus is a display surface of a touch panel, and the update operation is a predetermined touch operation on the touch panel.
As a result, the user can easily perform an operation while viewing the screen, and therefore, is allowed to more easily update a processed image.
For example, the update operation is a touch operation at a position on the touch panel where the one or more processed images are displayed.
This allows the user to update a processed image by a more intuitive operation. In other words, operability is improved.
For example, if the one or more processed images are updated, the update of the one or more processed images is notified to a user who has performed the update operation.
This ensures that the user notices that a processed image has been updated. Also, this allows the user to understand a relation between an update operation and the updating of a processed image.
For example, if it is determined that the update operation has been recognized, the display apparatus displays a screen notifying update of the one or more processed images, the screen containing the live preview image and the one or more processed images.
This more reliably ensures that the user viewing the screen notices that a processed image has been updated.
For example, the screen contains an animation (that is, notification animation) notifying the update of the one or more processed images, the animation being related to the one or more processed images.
The above notification animation is considerably noticeable in the screen. Therefore, the notification animation more reliably ensures that the user viewing the screen notices that a processed image has been updated.
For example, the screen contains an object (that is, notification object) notifying the update of the one or more processed images.
The above notification object has only a small amount of data to be processed, and therefore, according to the notification object, the amount of data to be processed in a display process can be reduced while the user viewing the screen is allowed to notice the updating.
For example, the one or more processed images are each an image containing a subject which is enlarged in size compared to the live preview image.
This allows the user to view details of a captured image after image processing. Therefore, the user can check what kind of captured image will be obtained, in greater detail, based on a processed image.
For example, the one or more processed images are each an image containing a subject which is reduced in size, the subject being captured in all or a portion of the live preview image.
This allows the user to easily visually compare a live preview image with a processed image. Therefore, by viewing the live preview image and the processed image, the user can easily imagine what kind of captured image will be obtained.
For example, the one or more processed images are a plurality of processed images.
As a result, a plurality of processed images generated using different image processing conditions can be visually compared. Therefore, the user can more easily determine which image process is desirable.
For example, the plurality of processed images are displayed side by side.
This allows the user to more easily visually compare a plurality of processed images. In other words, the user can more easily determine which image process conditions are more desirable.
For example, a subject captured in each of the plurality of processed images has at least a portion in common with the subject captured in one or more others of the plurality of processed images.
This allows the user to more easily visually compare a plurality of processed images. In other words, the user can more easily determine which image process conditions are more desirable.
Also, for example, when the live preview image and the one or more processed images are being displayed on the display apparatus, a parameter for generating at least one of the one or more processed images is changed. Also, it is determined whether or not a parameter changing operation has been recognized. Also, if it is determined that the parameter changing operation has been recognized, the parameter is changed.
This allows the user to adjust a parameter while actually viewing a processed image. Therefore, the user can easily check what a captured image after image processing will be like when a parameter is adjusted. In other words, convenience for the user is improved.
For example, the display apparatus is a display surface of a touch panel. In addition, the display apparatus additionally displays an object for changing the parameter. Moreover, the parameter changing operation is a touch operation at a position on the touch panel where the object is displayed.
This allows the user to adjust a parameter by an easy operation while viewing the screen.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
For example, also, an example in which the update operation is a touch operation at a position where one or more processed images are being displayed, has been described. The present disclosure is not limited to this example. The update operation may be a touch operation at other positions (e.g., a position in the vicinity of a position where one or more processed images are being displayed, a position where an object representing a button is displayed, etc.), instead of a touch operation at a position where one or more processed images are being displayed. Also, the update operation may be a touch operation at any position (e.g., double tap at any position, pinch at any position, etc.), instead of a touch operation at a predetermined position. Also, the update operation may be other operations (e.g., a key input operation, an audio input operation, an input operation using a sensor, etc.), instead of a touch operation.
Also, an example in which a user operation recognized is monitored by an operation determination unit, has been described. The present disclosure is not limited to this example. For example, when an update operation or a parameter changing operation has been recognized, the operation recognition unit notifies the operation determination unit that the update operation or the parameter changing operation has been recognized. Thereafter, based on the reception of the notification, the operation determination unit may determine that the update operation or the parameter changing operation has been recognized.
Also, an example in which a screen displayed on a display apparatus is used to notify that a processed image has been updated, has been described. The present disclosure is not limited to this example. For example, other means (e.g., sound, vibration, etc.) may be used to notify that a processed image has been updated, instead of or in combination with notification using a screen.
Also, an example in which the display control apparatus is a smartphone has been described. The present disclosure is not limited to this example. For example, the display control apparatus may be other apparatuses having a camera and a display apparatus (e.g., a digital camera, tablet terminal, etc.) in addition to a smartphone. Also, the display control apparatus may be an apparatus which does not have a camera or a display apparatus. Specifically, the display control apparatus may be an apparatus (e.g., a server, etc.) which communicates with another apparatus having a camera or a display apparatus.
Moreover, the processing steps of the display control processing in the present specification do not necessarily have to be executed in time series in the order described in the flowchart. For example, the processing steps in the display control process may be executed in the order different from the order described in the flowchart, or may be executed in parallel.
Further, it is possible to create a computer program for causing hardware such as a CPU, a ROM, and a RAM which are incorporated into a display control apparatus to exert functions equivalent to those in the configuration of the display control apparatus. Further, a recording medium storing the computer program is also provided.
Additionally, the present technology may also be configured as below.
(1)
A display control apparatus including:
a display control unit configured to cause a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and
a determination unit configured to determine whether or not a predetermined user operation has been recognized,
wherein if it is determined that the predetermined user operation has been recognized, the display control unit updates the one or more processed images to be displayed.
(2)
The display control apparatus according to (1),
wherein the display apparatus is a display surface of a touch panel, and
wherein the predetermined user operation is a predetermined touch operation on the touch panel.
(3)
The display control apparatus according to (2),
wherein the predetermined user operation is a touch operation at a position on the touch panel where the one or more processed images are displayed.
(4)
The display control apparatus according to any one of (1) to (3),
wherein if the one or more processed images are updated, the update of the one or more processed images is notified to a user who has performed the predetermined user operation.
(5)
The display control apparatus according to any one of (1) to (4),
wherein if it is determined that the predetermined user operation has been recognized, the display control unit causes the display apparatus to display a screen notifying update of the one or more processed images, the screen containing the live preview image and the one or more processed images.
(6)
The display control apparatus according to (5),
wherein the screen contains an animation notifying the update of the one or more processed images, the animation being related to the one or more processed images.
(7)
The display control apparatus according to (5),
wherein the screen contains an object notifying the update of the one or more processed images.
(8)
The display control apparatus according to any one of (1) to (7),
wherein the one or more processed images are each an image containing a subject which is enlarged in size compared to the live preview image.
(9)
The display control apparatus according to any one of (1) to (7),
wherein the one or more processed images are each an image containing a subject which is reduced in size, the subject being captured in all or a portion of the live preview image.
(10)
The display control apparatus according to any one of (1) to (9),
wherein the one or more processed images are a plurality of processed images.
(11)
The display control apparatus according to (10),
wherein the plurality of processed images are displayed side by side.
(12)
The display control apparatus according to (10) or (11),
wherein a subject captured in each of the plurality of processed images has at least a portion in common with the subject captured in one or more others of the plurality of processed images.
(13)
The display control apparatus according to any one of (1) to (12), further including:
a changing unit configured to change a parameter for generating at least one of the one or more processed images when the live preview image and the one or more processed images are being displayed on the display apparatus,
wherein the determination unit determines whether or not another predetermined user operation has been recognized, and
wherein if it is determined that the another predetermined user operation has been recognized, the changing unit changes the parameter.
(14)
The display control apparatus according to (13),
wherein the display apparatus is a display surface of a touch panel,
wherein the display control unit causes the display apparatus to additionally display an object for changing the parameter, and
wherein the another predetermined user operation is a touch operation at a position on the touch panel where the object is displayed.
(15)
A program for causing a computer to function as:
a display control unit configured to cause a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and
a determination unit configured to determine whether or not a predetermined user operation has been recognized,
wherein if it is determined that the predetermined user operation has been recognized, the display control unit updates the one or more processed images to be displayed.
(16)
A display control method including:
causing a display apparatus to display a live preview image generated based on image data obtained through an image sensor, and one or more processed images generated using respective image processing conditions based on one of the image data which has been obtained at some time point; and
determining whether or not a predetermined user operation has been recognized,
wherein if it is determined that the predetermined user operation has been recognized, the one or more processed images to be displayed are updated.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-001016 | Jan 2013 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2013/080914 | 11/15/2013 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2014/109129 | 7/17/2014 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 8332429 | Poirier | Dec 2012 | B2 |
| 9497384 | Panek-Rickerson | Nov 2016 | B2 |
| 20030169350 | Wiezel | Sep 2003 | A1 |
| 20050088542 | Stavely | Apr 2005 | A1 |
| 20130293746 | Iki | Nov 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| HEI-11-284884 | Oct 1999 | JP |
| 2005-078343 | Mar 2005 | JP |
| 2005-110097 | Apr 2005 | JP |
| 2005-229326 | Aug 2005 | JP |
| 2007-194819 | Aug 2007 | JP |
| 2012-015827 | Jan 2012 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20150358532 A1 | Dec 2015 | US |
