Patent Grant
10033938
This application is based upon and claims the benefit of priority from prior Japanese Patent Application No. 2015-094379, filed May 1, 2015, the entire contents of which are incorporated herein by reference.
1. Field of the Invention
The present invention relates to an image pickup apparatus and a method for controlling the same.
2. Description of the Related Art
Image pickup apparatuses generally include an image pickup device for picking up an image based upon light, an optical system, such as a lens, for forming an image of the light on the image pickup device, a shutter for controlling time when light is incident upon the image pickup device through the optical system, and a display device for displaying the image picked up by the image pickup. For example, Jpn. Pat. Appln. KOKAI Publication No. 2009-260510 proposes an image pickup apparatus which allows a user to confirm an object by displaying a through image to display images picked up by the image pickup apparatus one by one. The image pickup apparatuses control a process, such as an automatic focus (AF) process and an automatic exposure (AE) process, in response to an output from the image pickup device.
An image pickup apparatus as described above performs an image-pickup operation of stopping picking up a through image and operating a shutter to pick up a still image. When exposure is completed, the shutter is opened to resume picking up the through image. However, the image pickup apparatus cannot perform image pickup auxiliary control because it cannot pick up a through image with timing when the shutter is not completely opened after the exposure is completed. Thus, the image pickup apparatus has the problem that it is likely to be inconvenient because its image pickup auxiliary control timing is delayed when a continuous image pickup operation is carried out.
It is therefore an object of the present invention to provide a more convenient image pickup apparatus and a method for controlling the same.
Advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The advantages of the invention may be realized and obtained by means of the instrumentalities and combinations particularly pointed out hereinafter.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention, and together with the general description given above and the detailed description of the embodiments given below, serve to explain the principles of the invention.
An image pickup apparatus and a method for controlling the image pickup apparatus according to one embodiment will be described in detail below with reference to the accompanying drawings.
As illustrated in
The lens 10 is designed to transmit light and form an image of the light on the image pickup device 12. The lens 10 includes an image pickup lens in which a plurality of lenses are combined, a diaphragm mechanism, a lens control unit for controlling operations of the image pickup lens and the diaphragm mechanism, a focus ring, and a zoom ring.
The image pickup lens is designed to transmit a light ray from an object and form an image of the light ray on the imaging plane of the image pickup device 12. The image pickup lens includes a lens for focusing (a focus lens), a focal length varying lens (a variator lens and a compensator lens) and a relay lens. The image pickup lens moves the focus lens in the optical axis direction of the image pickup lens under the control of the lens control unit or by the operation of the focus ring to form an image of the object on the imaging plane of the image pickup device 12. The image pickup lens also moves the variator lens and the compensator lens in the optical axis direction of the image pickup lens under the control of the lens control unit or by the operation of the zoom ring to change a focal length.
The diaphragm mechanism is so configured that it can freely be opened or closed to adjust the amount of light that is incident upon the image pickup device 12 through the image pickup lens, under the control of the lens control unit.
The lens control unit is configured to communicate with the main control unit 19. The lens control unit controls driving of the focus lens, that of the variator lens and the compensator lens and that of the diaphragm mechanism in accordance with an input from the main control unit 19, an operation of the focus ring and the operation of the zoom ring. Furthermore, the lens control unit is able to detect a focal length of the image pickup lens by detecting the positions of the variator lens and the compensator lens. The lens control unit supplies the detected focal length of the image pickup lens to the main control unit 19.
The shutter unit 11 is a mechanism for adjusting the amount of light that is incident upon the image pickup device 12 through the lens 10. The shutter unit 11 is, for example, a focal plane shutter. As illustrated in
In an image pickup standby state in which the image pickup apparatus 1 is able to perform an imaging operation of recording a still image, the shutter unit 11 maintains an open state in which the front and rear curtains 21 and 22 are completely open. The front curtain 21 is provided in the lower part of the shutter unit 11 and the rear curtain 22 is provided in the upper part of the shutter unit 11. When an imaging operation is carried out, the shutter unit 11 starts to close the front curtain from bottom to top. The shutter unit 11 brings a semi-light-shielding state in which the image pickup device 12 is partly light-shielded by the front curtain 21, from when it starts to close the front curtain 21 until it completely closes the front curtain 21. When the front curtain 21 is completely closed, the shutter unit 11 starts to open the front curtain 21 from top to bottom and close the rear curtain 22 from top to bottom. In this case, light is incident upon the image pickup device 12 through a slit formed between the front curtain 21 that opens from top to bottom and the rear curtain 22 that closes from top to bottom. When the front curtain 21 completely opens and the rear curtain 22 completely closes, the shutter unit 11 starts to open the rear curtain 22 from bottom to top. The shutter unit 11 brings a semi-light-shielding state in which the image pickup device 12 is partly light-shielded by the rear curtain 22, from when it starts to open the rear curtain 22 until it completely opens the rear curtain 22. When the rear curtain 22 is completely opened, the front and rear curtains 21 and 22 are brought into an open state again and the image pickup apparatus 1 is brought into an image pickup standby state. The shutter unit 11 includes a sensor for sensing, e.g. an open/close state of each of the front and rear curtains 21 and 22. If the sensor senses an open/close state of each of the front and rear curtains 21 and 22, the shutter unit 11 is able to detect whether it is in an open state or a semi-light-shielding state. The shutter unit 11 includes an optical sensor such as a photocoupler or a magnetic sensor, as a sensor for sensing an open/close state of each of the front and rear curtains 21 and 22.
The image pickup device 12 is provided behind the lens 10, or inside the casing of the image pickup apparatus 1. The image pickup device 12 has an imaging plane on which a plurality of imaging pixels, which photoelectrically convert light into electric charges and store the electric charges, are arranged. A color filter is provided on the imaging plane upon which light of each of the imaging pixels is incident. The image pickup device 12 is configured by a charge coupled device (CCD) image sensor, a complementary metal oxide semiconductor (CMOS) image sensor or another image pickup device. The image pickup device 12 converts an object image, which is formed on the imaging plane by light collected through the lens 10, into an electrical signal corresponding to the amount of light to generate an image signal. Furthermore, the imaging plane of the image pickup device 12 has a plurality of AF areas. In the AF areas, a plurality of imaging pixels, a plurality of first focusing pixels and a plurality of second focusing pixels are arranged. The first and second focusing pixels are restricted by their different incident areas. Like the imaging pixels, the first and second focusing pixels photoelectrically convert incident light into electric charges and store the charges. The imaging plane of the image pickup device 12 is formed by, e.g. a plurality of imaging pixels arranged two-dimensionally. This two-dimensional arrangement does not necessarily exclude an image pickup device having sensitivity in its depth direction or an image pickup device having pixels arranged randomly, but may include these image pickup devices if they have at least pixels arranged on the plane. A curved sensor whose imaging plane is curved to prevent aberration has recently been announced and includes pixels arranged two-dimensionally; thus, this sensor is referred to herein as one including pixels arranged two-dimensionally in a broad sense.
The signal processing unit 13 reads an image signal captured by the image pickup device 12 under the control of the main control unit 19. The signal processing unit 13 performs different processes for the read image signal under the control of the main control unit 19. The signal processing unit 13 converts the processed image signal into image data of a digital signal and supplies it to the main control unit 19.
The image data includes a still image and a through image. The still image represents image data captured by the image pickup device 12 in accordance with the foregoing image pickup operation. The through image represents image data captured continuously by the image pickup device 12 when no image pickup operation is performed. For example, the signal processing unit 13 is able to capture continuous through images by reading through images picked up by the image pickup device 12 in a cycle based on the control of the main control unit 19. The signal processing unit 13 reads a through image from the image pickup device 12 in a cycle of 60 fps, 120 fps or the like.
The through image includes a first through image and a second through image. When the shutter unit 11 is opened, the signal processing unit 13 captures a first through image in which the shutter unit 11 does not block light transmitted through the lens 10. When the shutter unit 11 is rendered in a semi-light-shielding state, the signal processing unit 13 captures a second through image including a light-shielded area where the rear curtain 22 of the shutter unit 11 blocks part of light transmitted through the lens 10.
The image processing unit 14 performs different image processings, such as color correction, gamma (γ) correction, contrast correction, black and white/color mode processing and through-image processing, for image data under the control of the main control unit 19. Furthermore, the image processing unit 14 compresses image data in JPEG format under the control of the main control unit 19 and converts the compressed image data into JPEG data of JPEG-format image data. The image processing unit 14 supplies the JPEG data to the main control unit 19.
The operation unit 15 includes a plurality of operation members by which a user performs different operations of the image pickup apparatus 1. The operation members include a release button 15a, a power button 15b, a recording button 15c, a directional pad 15d, an OK button 15e, a play button 15f, a cancel button 15g, a menu button 15h, a first operation dial 15i, a second operation dial 15j and other different buttons.
The release button 15a is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction for image pickup operation and image pickup auxiliary control to pick up a still image. The image pickup auxiliary control is a process such as an automatic exposure (AE) process and an automatic focusing (AF) process. The operation unit 15 provides the main control unit 19 with an instruction for image pickup auxiliary control when the release button 15a is half pushed. The operation unit 15 also provides the main control unit 19 with an instruction for image pickup operation to pick up a still image when the release button 15a is all pushed.
The power button 15b is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction to turn on or off the image pickup apparatus 1.
The recording button 15c is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction to start and finish picking up a moving image.
The directional pad 15d is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction to select an operation corresponding to one of the left, right, top and bottom directions. For example, the operation unit 15 provides the main control unit 19 with an instruction to select an operation corresponding to one of the left, right, top and bottom directions in the menu in accordance with a user's operation of the directional pad 15d. Furthermore, for example, the operation unit 15 provides the main control unit 19 with an instruction to move an automatic focusing (AF) area on the imaging plane in accordance with a user's operation of the directional pad 15d.
The OK button 15E is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction for execution. The OK button 15E is located, for example, at the center of the directional pad 15d.
The play button 15f is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction for play. The operation unit 15 provides the main control unit 19 with an instruction to play a still image or a moving image recorded on a recording medium when a user operates the play button 15f.
The cancel button 15g is an operation member for causing a user to provide an instruction for cancellation. The operation unit 15 provides the main control unit 19 with an instruction to erase a still image or a moving image recorded on a recording medium when a user operates the cancel button 15g.
The menu button 15h is an operation member for causing a user to provide the image pickup apparatus 1 with an instruction to display a menu screen.
The first and second operation dials 15i and 15j are each an operation member for causing a user to provide the image pickup apparatus 1 with an instruction for exposure control. For example, the operation unit 15 provides the main control unit 19 with an instruction to change parameters for exposure control, such as a diaphragm value, a shutter speed, ISO and an exposure value when a user operates the first operation dial 15i or the second operation dial 15j.
Furthermore, the operation unit 15 can be configured to include a touch sensor that is formed integrally with a display device of the display unit 16. The touch sensor is, for example, a resistive touch sensor or a capacitive touch sensor. The operation unit 15 can be configured to receive a signal from the touch sensor to perform an operation corresponding to each of the operation members.
The display unit 16 displays a screen on the basis of image data supplied from the main control unit 19. The display unit 16 includes a display device and a drive circuit for causing the screen to be displayed on the display device on the basis of the image data. The display unit 16 includes, for example, a display panel 31 and an electronic view finder (EVF) 32 as the display device. The display unit 16 also includes an eye sensor 33 for sensing whether a user looks through the EVF 32. The display panel 31 is configured by a liquid crystal display, an organic EL display, a device for displaying another screen, or the like. The EVF 32 includes, for example, a display device such as a liquid crystal display and an organic EL display, and an eyepiece optical system.
When the eye sensor 33 senses that a user looks through the EVF 32, the display unit 16 turns off the display panel 31 to cause the EVF 32 to display a screen. When the eye sensor 33 does not sense that a user looks through the EVF 32, the display unit 16 turns off the EVF 32 to cause the display panel 31 to display a screen.
The memory I/F 17 includes a card slot into which a recording medium M with a plurality of contact terminals can be inserted and a contact terminal which is electrically connected to the contact terminals of the recording medium M when the recording medium M is inserted into the card slot. The recording medium M is, for example, a memory card. The memory I/F 17 relays data between the recording medium M and the main control unit 19.
The acceleration sensor 18 senses a variation in acceleration of the casing of the image pickup apparatus 1 to detect the inclination of the casing of the image pickup apparatus 1. The acceleration sensor 18 also senses a variation in acceleration of the casing of the image pickup apparatus 1 to detect whether the lens 10 and casing of the image pickup apparatus 1 are panned or not. In other words, the acceleration sensor 18 senses that a user follows an object by panning.
The main control unit 19 controls the operation of each unit of the image pickup apparatus 1. The main control unit 19 includes, for example, a CPU and a memory. The main control unit 19 fulfills different functions if the CPU reads a program out of the memory and executes it. For example, the main control unit 19 serves as an operation determination unit 40, an image pickup control unit 41, an image pickup auxiliary control unit 42, a recording control unit 43, a display control unit 44 and a state determination unit 45.
The operation determination unit 40 determines an operation input by the operation unit 15. In other words, the operation determination unit 40 recognizes what operation is instructed by the operation unit 15.
Upon receipt of an instruction to perform an image pickup operation, the image pickup control unit 41 controls each unit to perform the image pickup operation. When the image pickup control unit 41 receives an instruction to perform an image pickup operation, it inputs a control signal to the lens 10 to drive the diaphragm mechanism and also inputs a control signal to the shutter unit 11 to drive the front curtain 21 and the rear curtain 22, thus performing an image pickup operation of picking up a still image. The image pickup control unit 41 generates a control signal which is to be input to the shutter unit 11 and the lens 10 on the exposure conditions resulting from an operation or image pickup auxiliary control of the image pickup auxiliary control unit 42.
Furthermore, the image pickup control unit 41 is able to perform image pickup operations continuously. For example, when the image pickup control unit 41 receives an instruction to perform image pickup operations continuously, it inputs a control signal to the lens 10 to drive the diaphragm mechanism and operate the shutter unit 11 continuously, thus performing a continuous image pickup operation of performing image pickup operations continuously. For example, the image pickup control unit 41 switches between a mode (continuous image pickup mode) of performing a continuous image pickup operation and a mode of not performing a continuous image pickup operation in response to an operation of the operation unit 15.
Furthermore, the image pickup control unit 41 controls a through image picked up by the image pickup device 12. For example, the image pickup control unit 41 controls the signal processing unit 13 to read a through image picked up by the image pickup device 12 in a preset cycle. The image pickup control unit 41 controls the signal processing unit to capture a first through image with timing when the shutter unit 11 is rendered in an open state. The image pickup control unit 41 also controls the signal processing unit to capture a second through image with timing when the shutter unit 11 is rendered in a semi-light-shielding state.
The image pickup auxiliary control unit 42 performs image pickup auxiliary control prior to an image pickup operation. The image pickup auxiliary control unit 42 acquires information for image pickup auxiliary control and performs image pickup auxiliary control on the basis of the acquired information. For example, the image pickup auxiliary control unit 42 performs image pickup auxiliary control on the basis of a through image picked up by the image pickup device 12. The image pickup auxiliary control unit 42 performs an image pickup operation on the basis of a result of the image pickup auxiliary control. Since the image pickup device 12 is not able to pick up a through image during the image pickup operation, the image pickup auxiliary control unit 42 stops the image pickup auxiliary control during the image pickup operation.
In this embodiment, the image pickup auxiliary control unit 42 performs image pickup auxiliary control between an image pickup operation in the continuous image pickup mode and an image pickup operation. The image pickup auxiliary control unit 42 can be configured to apply a result of image pickup auxiliary control used in the first image pickup operation of the continuous image pickup operation in the continuous image pickup mode to another image pickup operation of the continuous image pickup operation.
The image pickup auxiliary control unit 42 includes, for example, an AF control unit 51, an exposure control unit 52, an angle-of-view control unit 53, a white balance (WB) control unit 54, a scene determination unit 55 and an inter-frame noise reduction (NR) processing unit 56.
The AF control unit 51 performs an AF process that is one of the image pickup auxiliary processes. For example, the AF control unit 51 generates a control signal for driving a focus lens of the lens 10 on the basis of image data output from the image pickup device 12 and inputs the generated control signal to the lens control unit. More specifically, the AF control unit 51 performs a contrast AF process, a phase difference AF process or another AF process on the basis of image data acquired in an arbitrary AF area on the imaging plane of the image pickup device 12 to generate a control signal for driving a focus lens of the lens 10. For example, the AF control unit 51 has a single autofocus mode (AF-S) in which AF is performed once when the release button 15a is half pushed, a continuous autofocus mode (AF-C) in which AF is performed continuously while the release button 15a is being half pushed, or another autofocus mode.
When the AF control unit 51 performs the contrast AF process, it computes a contrast of an object image formed in an arbitrary AF area on the imaging plane of the image pickup device 12 on the basis of image data output from the image pickup device 12 and supplies the lens control unit of the lens 10 with a control signal for moving the focus lens. The AF control unit 51 controls the lens control unit of the lens 10 to stop moving the focus lens in a position where the contrast becomes the highest.
When the AF control unit 51 performs the phase difference AF process, it compares the positions of images of the same object by image data detected by a plurality of first focusing pixels arranged in an arbitrary AF area on the imaging plane of the image pickup device 12 and image data detected by a plurality of second focusing pixels to detect an interval between the images. On the basis of the detected image interval, the AF control unit 51 computes an amount of shift between the current position of the focus lens and the focus position. The AF control unit 51 generates a control signal on the basis of the computed amount of shift and inputs the generated control signal to the lens control unit of the lens 10 to control the lens control unit of the lens 10 to move the focus lens to the focus position.
The exposure control unit 52 performs control of exposure conditions (exposure control) which is one of the image pickup auxiliary processes. For example, the exposure control unit 52 controls exposure conditions such as an amount of opening (diaphragm value) of the diaphragm mechanism of the lens 10, an open time of the shutter unit 11 (shutter speed), and sensitivity of the image pickup device 12 (ISO speed) at the time of image pickup. For example, the exposure control unit 52 sets exposure conditions such as a diaphragm value, a shutter speed and an ISO speed on the basis of the operation of the operation unit 15.
Furthermore, the exposure control unit 52 performs a computation process for exposure control on the basis of image data output from the image pickup device 12. For example, the exposure control unit 52 computes the brightness of an object on the basis of image data output from the image pickup device 12. The exposure control unit 52 sets an exposure value in accordance with an operation of the operation unit 15 and performs an AE process to set the exposure conditions such as a diaphragm value, a shutter speed, and an ISO speed at the time of image pickup in such a manner that the brightness of an object becomes equal to a preset exposure value. For example, the exposure control unit 52 computes the brightness of an object on the basis of an area (AE area) of part of the image data output from the image pickup device 12 to perform an AE process. Furthermore, for example, the exposure control unit 52 can be configured to compute the brightness of an object for each of the AE areas and integrate the brightnesses to perform an AE process.
The angle-of-view control unit 53 controls an angle of view which is one of the image pickup auxiliary processes. The angle-of-view control unit 53 recognizes the focal length of the image pickup lens on the basis of an input from the lens control unit of the lens 10 and performs control corresponding to the recognized focal length. Furthermore, the angle-of-view control unit 53 generates a control signal for changing the focal length of the image pickup lens of the lens 10 in accordance with the operation of the operation unit 15 and inputs the generated control signal to the lens control unit of the lens 10.
The WB control unit 54 performs WB control which is one of the image pickup auxiliary processes. The WB control unit 54 performs a computation process for controlling a white balance on the basis of image data output from the image pickup device 12. The WB control unit 54 controls a gain of each of RGB pixels of the image pickup device 12 on the basis of a result of the computation process.
The scene determination unit 55 performs a scene determination which is one of the image pickup auxiliary processes. The scene determination unit 55 determines a scene on the basis of image data output from the image pickup device 12. The scene is, for example, a landscape, a person, sports and a night view. For example, the scene determination unit 55 is able to supply information indicative of the determined scene to the exposure control unit 52 to cause the exposure control unit 52 to perform exposure control corresponding to the scene.
The inter-frame NR processing unit 56 performs an inter-frame NR process which is one of the image pickup auxiliary processes. The inter-frame NR processing unit 56 performs a noise reduction process of reducing noise of image data by the known algorithm using image data of a plurality of frames output from the image pickup device 12. For example, the inter-frame NR processing unit 56 performs smoothing all of a plurality of frames in such a manner that a difference in pixel value between coordinates of image data in a current frame and those of image data in its preceding frame becomes equal to or smaller than a preset value.
The recording control unit 43 includes an intermediate buffer for recording a still image and a moving image temporarily. The recording control unit 43 records, e.g. a still image and a moving image captured through an image pickup operation in the intermediate buffer one by one. The recording control unit 43 files the still image, the moving image, etc. recorded in the intermediate buffer and writes them to the recording medium M attached to the memory I/F 17. The filed still image is a file in which a predetermined header is added to image data of the still image. For example, data indicative of exposure conditions is recorded in the header as tag data.
The display control unit 44 controls a display process to be performed by the display unit 16′. For example, the display control unit 44 supplies image data to the display unit 16 to control a screen to be displayed on the display device of the display unit 16. For example, the display control unit 44 supplies the display unit 16 with a still image generated by the image pickup device 12 through an image pickup operation to cause the display unit 16 to display the still image. Furthermore, the display control unit 44 supplies the display unit 16 with a through image read by the image pickup control unit 41 to cause the display unit 16 to display the through image. The display control unit 44 causes the display unit 16 to display a through image in a frame cycle of 60 fps, 120 fps or the like.
Moreover, the display control unit 44 generates OSD data for causing the display unit 16 to make an on-screen display (OSD) including, e.g. various icons and characters, on the basis of different items of setting information and a state of the image pickup apparatus 1. For example, the display control unit 44 generates OSD data for displaying on the display device of the display unit 16 an image pickup mode, different items of setting information, a battery remaining amount, the number of shots and a time period for which image pickup is available in the image pickup apparatus 1, an AF area and the like. The display control unit 44 supplies the display unit 16 with image data on which OSD display based on the OSD data is superimposed.
The state determination unit 45 recognizes different states of the image pickup apparatus 1. For example, the state determination unit 45 determines whether there is a light-shielded area on the through image. In accordance with an operating state of the shutter unit 11 when the image pickup device 12 picks up a through image, the state determination unit 45 determines whether the through image is a first through image not including a light-shielded area or a second through image including a light-shielded area. For example, the state determination unit 45 determines that the through image is a second through image if the rear curtain 22 of the shutter unit 11 is being opened when the image pickup apparatus 12 picks up the through image.
Furthermore, the state determination unit 45 specifies a light-shielded area in the second through image. For example, the state determination unit 45 specifies a light-shielded area in the second through image on the basis of the position of the rear curtain 22 of the shutter unit 11 when the second through image is picked up. For example, the state determination unit 45 also specifies an area in the second through image, which is darker than a preset value, as a light-shielded area.
The state determination unit 45 also determines whether image pickup auxiliary control can be performed on the basis of the second through image. For example, the state determination unit 45 determines whether image pickup auxiliary control can be performed on the basis of the second through image on a specific condition that the state of the image pickup apparatus 1 meets. For example, the state determination unit 45 compares the second through image picked up by the image pickup device 12 with the last still image, and determines that the image pickup control unit 41 can perform image pickup auxiliary control when a difference between the last still image and the second through image is smaller than a preset reference value. For example, when a difference between the last still image and the second through image is smaller than a preset reference value, the state determination unit 45 supplies the image pickup auxiliary control unit 42 with information indicating that a result of the image pickup auxiliary control used in an image pickup operation when the last still image is picked up can be used; thus, the image pickup auxiliary control unit 42 need not newly perform image pickup auxiliary control. For example, the state determination unit 45 supplies the image pickup auxiliary control unit 42 with information indicating that a result of AF and AE processes used in the last image pickup operation can be used; thus, the image pickup auxiliary control unit 42 can perform the next image pickup operation without newly performing an AF process or an AE process.
For example, the state determination unit 45 computes a similarity between the last still image and the second through image excluding a light-shielded area and determines that a difference between the last still image and the second through image is smaller than a reference value when the computed similarity is equal to or greater than a preset value. The state determination unit 45 also determines that a difference between the last still image and the second through image is smaller than a reference value when an object image common to the last still image and the second through image excluding a light-shielded area can be detected. More specifically, the state determination unit 45 extracts an object image from the last still image and performs pattern matching for searching the second through image for the extracted object image to detect an object image common to the last still image and the second through image excluding a light-shielded area.
In other words, the state determination unit 45 determines whether a difference in data to be compared between the last still image and the second through image is smaller than a reference value. For example, the state determination unit 45 treats images in the same area of the still image and the second through image, as data to be compared. For example, the state determination unit 45 treats an object image common to the still image and the second through image, as data to be compared.
When the state determination unit 45 determines that a difference between the last still image and the second through image is equal to or larger than a reference value, it determines whether the image pickup auxiliary control unit 42 can perform image pickup auxiliary control based upon the second through image, on the basis of a light-shielded area of the second through image and a control point when the last still image is picked up. For example, when the control point is located outside the light-shielded area of the second through image, the state determination unit 45 determines that the image pickup auxiliary control unit 42 can perform image pickup auxiliary control based upon the second through image. The state determination unit 45 supplies the image pickup auxiliary control unit 42 with information indicating that the image pickup auxiliary control can be performed, with the result that the image pickup auxiliary control unit 42 can perform image pickup auxiliary control.
The left-sided image in
For example, the state determination unit 45 determines whether the AF area 80 is included in a light-shielded area 72 in the second through image 73 when the last still image 71 is picked up. When the AF area 80 is not included in the light-shielded area 72, the state determination unit 45 determines that the AF control unit 51 of the image pickup auxiliary control unit 42 can perform an AF process. The state determination unit 45 supplies the AF control unit 51 with information indicating that an AF process can be performed, thus making it possible to cause the AF control unit 51 to perform an AF process.
The state determination unit 45 also determines whether the AE area 81 is included in the light-shielded area 72 in the second through image 73 when the last still image 71 is picked up. When the AE area is not included in the light-shielded area 72, the state determination unit 45 determines that the exposure control unit 52 of the image pickup auxiliary control unit 42 can perform an AE process. The state determination unit 45 supplies the exposure control unit 52 with information indicating that an AE process can be performed to allow the exposure control unit 52 to perform an AE process.
When the image pickup apparatus 1 is in the normal state, the state determination unit 45 does not determine whether image pickup auxiliary control can be performed, during a period from when the image pickup operation is completed until the shutter unit 11 is opened. Accordingly, as shown in
When the image pickup apparatus 1 is in the specific state, the state determination unit 45 determines whether image pickup auxiliary control can be performed based upon the last still image 71 and the second through image 73 during a period from when the image pickup operation is completed until the shutter unit 11 is opened. As shown in
The specific condition represents a case where a user needs to confirm a through image earlier. In other words, the state determination unit 45 determines that the state of the image pickup apparatus 1 meets the specific condition when the image pickup apparatus 1 is in a state that requires shortening a time period from when a still image is completely picked up until image pickup auxiliary control is carried out (an image pickup state in which a time lag becomes a problem). For example, the state determination unit 45 recognizes a state of the image pickup apparatus 1 on the basis of a setting status of the image pickup control unit 41 and image pickup auxiliary control unit 42, an output of the eye sensor 33, an output of the acceleration sensor 18 and the like, and determines that the image pickup apparatus 1 is in a specific state if the recognized state of the image pickup apparatus 1 meets the specific condition.
The specific condition includes, for example, conditions that a user looks through the EVF 32 in a continuous image pickup mode, a user follows an object by panning, the mode of autofocus is an AF-C, the shutter speed is faster than a preset shutter speed, and the focal length of the image pickup lens of the lens 10 is greater than a preset focal length.
The preset shutter speed is, for example, a second of time corresponding to 1/focal length which easily exerts an influence of a camera shake or a second of time corresponding to 2n/focal length to which tolerance is added by a camera shake correction mechanism. In general, the preset shutter speed may be, for example, 1/250 second at which an object that moves quickly is picked up frequently.
The preset angle of view corresponds to, for example, a case where the focal length is 70 mm for telescopic imaging. In addition, the preset angle of view can be set as a given focal length which makes it difficult to frame a moving object.
For example, the state determination unit 45 may determine that the image pickup apparatus 1 is in the specific state when an object distance is shorter than 60 cm of an object distance in the case of short-distance imaging such as macro photography.
An operation of the image pickup apparatus 1 according to one embodiment will be described in detail with reference to
When the image pickup apparatus 1 is in an image pickup standby state, the main control unit 19 controls the image pickup device 12 to pick up a first through image (step S11). The main control unit 19 supplies the first through image to the display unit 16 to display the first through image on the display device of the display unit 16 (step S12).
The main control unit 19 determines whether the release button 15a of the operation unit 15 is half pushed (step S13). In other words, the main control unit 19 determines whether the operation unit 15 supplies an operation to provide an instruction for image pickup auxiliary control such as an AE process and an AF process. When the main control unit 19 determines that the release button 15a of the operation unit 15 is half pushed (YES in step S13), it performs image pickup auxiliary control such as an AE process and an AF process (step S14).
The main control unit 19 determines whether the release button 15a of the operation unit 15 is all pushed (step S15). In other words, the main control unit 19 determines whether the operation unit 15 inputs an operation to provide an instruction for image pickup operation. When the main control unit 19 determines that the release button 15a of the operation unit 15 is all pushed (YES in step S15), it stops displaying a through image and performs an image pickup operation (step S16). In this case, the main control unit 19 operates the shutter unit 11, controls the image pickup device 12 to pick up a still image 71, files the still image and records the filed image on the recording medium M.
The main control unit 19 determines whether the state of the image pickup apparatus 1 meets the foregoing specific condition (step S17). When the main control unit 19 determines that the state of the image pickup apparatus 1 does not meet the specific condition (NO in step S17), it determines whether the shutter 11 is opened by opening the rear curtain 22 completely after the image pickup operation (step S18). In other words, the main control unit 19 determines whether the shutter unit 11 is opened after the image pickup operation. The main control unit 19 continues to perform a process of step S18 until the shutter unit 11 is opened.
When the main control unit 19 determines that the shutter unit 11 is opened (YES in step S18), it determines whether the process should be completed (step S19). In other words, for example, the main control unit 19 controls the operation unit 15 to operate the power button 15b of the operation unit 15 and determines whether the operation uni 15 inputs an instruction to complete the process. When the main control unit 19 determines that the process is completed (YES in step S19), it turns off the power to complete the process. When the main control unit 19 determines that the process is not completed (NO in step S19), it returns to step S11.
When the main control unit 19 determines that the release button 15a of the operation unit 15 is not half pushed (NO in step S13), or when it determines that the release button 15a is not all pushed (NO in step S15), the the main control unit 19 moves to step S19.
When the main control unit 19 determines that the state of the image pickup apparatus 1 does not meet the specific condition as described above, it stops displaying a first through image during a period from after the image pickup operation is performed until the shutter unit 11 is opened.
When the main control unit 19 determines that the state of the image pickup apparatus 1 meets the specific condition (YES in step S17), it determines whether the shutter unit 11 is opened after the image pickup operation (step S21). When the main control unit 19 determines that the shutter unit 11 is opened after the image pickup operation (YES in step S21), it moves to step S19.
When the main control unit 19 determines that the shutter unit 11 is not opened after the image pickup operation (NO in step S21), it controls the image pickup apparatus 12 to pick up a second through image 73 (step S22). The main control unit 19 compares the second through image 73 and the still image 71 picked up by the image pickup operation in step S16 (step S23).
The main control unit 19 determines whether a difference between the still image 71 and the second through image 73 is smaller than a preset reference (step S24).
When the main control unit 19 determines that the difference between the still image 71 and the second through image 73 is not smaller than the preset reference (NO in step S24), the main control unit 19 determines whether the AF area 80 of the second through image 73 is located outside the light-shielded area 72 (step S25). When the main control unit 19 determines whether the AF area 80 is located outside the light-shielded area 72 (YES in step S25), it performs an AF process (step S26). When the main control unit 19 determines whether the AF area 80 is located inside the light-shielded area 72 (NO in step S25), it moves to step S27.
The main control unit 19 determines whether the AE area 81 of the second through image 73 is located outside the light-shielded area 72 (step S27). When main control unit 19 determines that the AE area 81 is located outside the light-shielded area 72 (YES in step S27), it performs an AE process (step S28) and moves to step S21. When main control unit 19 determines that the AE area 81 is located inside the light-shielded area 72 (NO in step S27), it moves to step S21.
For example, the state determination unit 45 of the main control unit 19 determines whether image pickup auxiliary control based on the second through image 73 can be performed on the basis of the still image 71 and the second through image 73 excluding the light-shielded area 72 during a period from when image pickup of the still image 71 is completed until the shutter 11 is opened. When the state determination unit 45 determines that image pickup auxiliary control based on the second through image 73 can be performed, the image pickup auxiliary control unit 42 performs image pickup auxiliary control based on the second through image 73.
Furthermore, when a control point at which data is acquired for use in image pickup auxiliary control when the last still image 71 is picked up is located outside the light-shielded area 72 of the second through image 73, the state determination unit 45 determines that image pickup auxiliary control based on the second through image 73 can be performed.
When the state determination unit 45 determines that a difference between the still image 71 and the second through image 73 is smaller than a preset reference (YES in step S24), the main control unit 19 performs an AF process and an AE process using results of the AF and AE processes performed in step S14 (step S29). For example, the state determination unit 45 determines whether a difference in data to be compared between the last still image 71 and the second through image 73 is smaller than a reference value. When the state determination unit 45 determines that a difference in data to be compared between the last still image 71 and the second through image 73 is smaller than a reference value, the image pickup auxiliary control unit 42 performs image pickup auxiliary control to pick up the next still image using a result of the image pickup auxiliary control when the last still image 71 is picked up.
The main control unit 19 performs processes of steps S22 to S29 during a period from after the image pickup operation is performed until the shutter unit 11 is opened.
The foregoing configuration allows the image pickup auxiliary control to be performed using the second through image 73 including the light-shielded area 72 picked up by the image pickup device 12 during a period from when the image pickup operation is completed until the shutter unit 11 is opened. Furthermore, the main control unit 19 is able to perform the next image pickup operation using a result of the last image pickup auxiliary control when a difference between the still image 71 and the second through image 73 is smaller than the reference. The main control unit 19 is also able to perform the image pickup auxiliary control on the basis of the second through image 73 if the control point of the last image pickup auxiliary control is located outside the light-shielded area 72 of the second through image 73 even though a difference between the still image 71 and the second through image 73 is smaller than the reference.
It is thus possible to quicken timing at which the image pickup auxiliary control is carried out even though the image pickup operation is continuously performed. Accordingly, a user can prevent image pickup timing from being missed without being caught by the image pickup auxiliary control. As a result, there can be provided a more convenient image pickup apparatus and a method for controlling the image pickup apparatus.
As shown in
In the example of
When the main control unit 19 determines that the autofocus mode is set in the AF-C(YES in step S31), it performs a face detection process based on the second through image 73 and determines whether a face is detected (step S32). When the main control unit 19 determines that a face is detected (YES in step S32), it performs an AF process (step S33) and, in this case, the main control unit 19 performs an AF process using a face-detected area as an AF area.
When the main control unit 19 determines that a face is not detected (NO in step S32), it is performing a tracking AF process of tracking an object image and determines whether the object image under tracking can be detected from the second through image 73 (step S34). When the main control unit 19 determines that the object image under tracking can be detected from the second through image 73 (YES in step S34), it performs an AF process (step S33) and, in this case, the main control unit 19 performs an AF process using an object-image-detected area as an AF area.
When the main control unit 19 determines that an object image under tracking cannot be detected from the second through image 73 (NO in step S34), it is performing a prediction AF process of predicting AF areas one by one and determines whether the next. AF area is located outside the light-shielded area 72 of the second through image 73 (step S35). When the main control unit 19 determines that the next AF area is located outside the light-shielded area 72 of the second through image 73 (YES in step S35), it performs an AF process (step S33) and, in this case, the main control unit 19 performs an AF process on the basis of the predicted AF area.
When the main control unit 19 determines that the next AF area is not located outside the light-shielded area 72 of the second through image 73 (NO in step S35), it determines whether the last AF area under image pickup auxiliary control is located outside the light-shielded area 72 of the second through image 73 (step S36). When the main control unit 19 determines that the last AF area under image pickup auxiliary control is located outside the light-shielded area 72 of the second through image 73 (YES in step S36), it performs an AF process (step S33) and, in this case, the main control unit 19 performs an AF process on the basis of the last AF area under image pickup auxiliary control.
The foregoing configuration also allows the main control unit 19 to quicken timing at which image pickup auxiliary control is carried out. Accordingly, a user can prevent image pickup timing from being missed without being caught by the image pickup auxiliary control. If timing at which image pickup auxiliary control is carried out in the AF-C mode to perform AF processes one by one is particularly quicken, a user can quicken timing at which image pickup auxiliary control is carried out when he or she wishes to increase the speed of the image pickup auxiliary control.
Furthermore, the main control unit 19 can be so configured that the display unit 16 outputs a second through image which is captured when the shutter unit 11 is half light-shielded. It is thus possible to shorten a blackout time period for which no through image is displayed after an image pickup operation is performed and, in other words, it is possible to shorten a time lag for displaying the through image.
In the foregoing example, an AF process and an AE process are performed as image pickup auxiliary control; however, the image pickup auxiliary control is not limited to this example. The image pickup auxiliary control may include different processes such as WB control, scene determination, inter-frame NR processing and inter-frame tone control. The image pickup auxiliary control may also include any process if it is performed to generate an image that complies with a photographer's intention.
For example, the main control unit 19 can be configured to determine a location of a light source and it performs WB control on the basis of the second through image 73 when the light source is located outside the light-shielded area 72. The main control unit 19 can also be configured to perform WB control on the basis of the second through image 73 excluding the light-shielded area 72 when the light source is located inside the light-shielded area 72.
For example, the main control unit 19 can be configured to determine a scene on the basis of the second through image 73 excluding the light-shielded area 72 of the second through image 73 when the size of the light-shielded area 72 is smaller than a preset size.
For example, the main control unit 19 can be configured to perform an inter-frame NR process on the basis of the second through image 73 excluding the light-shielded area 72 of the second through image 73 when the size of the light-shielded area 72 is smaller than a preset size.
For example, the main control unit 19 can be configured to perform an inter-frame tone control process of correcting the tone of an image on the basis of the second through image 73 excluding the light-shielded area 72 of the second through image 73 when the size of the light-shielded area 72 is smaller than a preset size.
Furthermore, the display control unit 44 can be configured to display a through image using the second through image and the still image in a specific state in which the state of the image pickup apparatus 1 meets the specific condition. For example, the display control unit 44 can be configured to supply the display unit 16 with a second through image 73 including a light-shielded area 72 and cause the display unit to display the through image during a period from when the image pickup operation is completed until the rear curtain 22 of the shutter unit 11 is completely opened.
In the foregoing embodiment, the image pickup apparatus 1 is configured to capture a second through image while a light-shielded area is formed on the imaging plane of the image pickup device 12 by the rear curtain 22 of the shutter unit 11; however, the present invention is not limited to this configuration. The image pickup apparatus 1 has only to be configured to capture a second through image when the shutter unit 11 is half light-shielded. In other words, the image pickup apparatus 1 has only to be configured to capture a second through image while the rear curtain 22 is opened and the front curtain 21 is closed. Moreover, the front curtain 21 and rear curtain 22 of the shutter unit 11 of the image pickup apparatus 1 are configured by the mechanical shutter; however, the present invention is not limited to this configuration. One of the front and rear curtains 21 and 22 has only to be configured as an electronic shutter and, in this case, the image pickup apparatus 1 captures a second through image when the imaging plane of the image pickup device 12 is half light-shielded by the electronic shutter of the shutter unit 11.
In the foregoing embodiment, the image pickup apparatus 1 is configured to include a lens 10; however, the present invention is not limited to this configuration. The image pickup apparatus 1 has only to be configured to include a detachable mount lens in place of the lens 10.
Not only the functions of the foregoing embodiments are carried out by hardware, but also the programs describing the functions using software can be read in a computer and executed. The functions can also be carried out by choosing one of software and hardware appropriately.
Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2015-094379 | May 2015 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 8269881 | Neil | Sep 2012 | B2 |
| 8345152 | Pittock | Jan 2013 | B2 |
| 20110149129 | Kim, II | Jun 2011 | A1 |
| Number | Date | Country |
|---|---|---|
| 2009-260510 | Nov 2009 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20160323492 A1 | Nov 2016 | US |
