Patent Grant
8514281
This application claims the benefit of Japanese Patent Application No. 2008-199533, filed in Japan Aug. 1, 2008, which is hereby incorporated by reference herein in its entirety.
The present invention relates to an imaging apparatus having a magnification converting lens capable of switching between an inserted state and an extracted state with respect to an optical axis.
Conventionally, there has been known an imaging apparatus having a magnification converting lens in addition to a variable power lens. The variable power lens is a lens which continuously changes magnification by moving the lens in an optical axis direction and is exemplified by an optical zoom lens. In contrast to this, the magnification converting lens is a lens which discontinuously shifts magnification by inserting into and extracting from the optical axis and is typically called an extender. The magnification converting lens includes an enlarged type and a reduced type, which are called a teleconverter and a wide-converter respectively.
The enlarged-type magnification converting lens is useful in imaging at high magnification. When the magnification is low, the magnification converting lens is extracted, and in that state, the magnification is adjusted by the variable power lens. When the magnification is increased and only the variable power lens is not sufficient for magnification, the magnification converting lens is inserted for imaging at high magnification. For example, such a technique is disclosed in Japanese Patent Laid-Open No. 2005-202263.
Meanwhile, in a security camera, and like, a mask (masks) may be composited to a privacy zone (zones) in an image for privacy protection. The privacy zone is, for example, a private home. For example, mask data representing a predetermined privacy zone is preliminarily stored in the imaging apparatus. Based on the mask data, a mask is composited to a privacy zone of an imaging image and the image in the privacy zone is hidden. For example, such a technique is disclosed in Japanese Patent Laid-Open No. 2001-69494.
However, the conventional imaging apparatus has a problem in that when the imaging magnification is discontinuously changed by switching the magnification converting lens, the angle of view is greatly changed, the mask is shifted from the privacy zone, the privacy zone extends beyond the mask, and the part to be hidden may be revealed. For example, when the imaging magnification is increased by inserting the extender, the angle of view is narrowed, the privacy zone is enlarged and moved relatively to the image, and the image may be shifted from the mask.
In view of the above background, the present invention has been made, and an object of the present invention is to provide an imaging apparatus capable of preventing a privacy zone from being shifted from a mask when a magnification converting lens is switched.
An imaging apparatus of the present invention comprises: an imaging unit having a magnification converting lens capable of switching between an inserted state and an extracted state with respect to an optical axis; a signal processing unit which composites a mask to an object region of a privacy zone in an image generated by the imaging unit; and a control unit which controls the signal processing unit according to switching of the magnification converting lens, wherein when the magnification converting lens is switched, the control unit instructs the signal processing unit to change the mask region in the image according to a magnification shift caused by the switching of the magnification converting lens and maintains the privacy zone in a masked state after the switching of the magnification converting lens.
Another aspect of the present invention is an imaging method for imaging an image by an imaging unit having a magnification converting lens capable of switching between an inserted state and an extracted state with respect to an optical axis, and compositing a mask to an object region of a privacy zone in the image generated by the imaging unit, wherein when the magnification converting lens is switched, the mask region in the image is changed according to a magnification shift caused by the switching of the magnification converting lens, and the privacy zone is maintained in a masked state after the switching of the magnification converting lens.
As described above, the present invention changes the mask region in the image according to a magnification shift caused by the switching of the magnification converting lens and maintains the privacy zone in a masked state after the switching of the magnification converting lens. This can prevent the privacy zone from being shifted from the mask when the magnification converting lens is switched.
As described below, the present invention has other aspects. Accordingly, the disclosure of the present invention is intended to provide some aspects of the present invention, but not intended to limit the scope of the invention described and claimed herein.
Hereinafter, the present invention is described in detail. Note that the following detailed description and the accompanying drawings do not limit the invention. Instead, the scope of the invention is defined by the accompanying Claims.
An imaging apparatus of the present invention comprises: an imaging unit having a magnification converting lens capable of switching between an inserted state and an extracted state with respect to an optical axis; a signal processing unit which composites a mask to an object region of a privacy zone in an image generated by the imaging unit; and a control unit which controls the signal processing unit according to switching of the magnification converting lens, wherein when the magnification converting lens is switched, the control unit instructs the signal processing unit to change the mask region in the image according to a magnification shift caused by the switching of the magnification converting lens and maintains the privacy zone in a masked state after the switching of the magnification converting lens.
The above configuration allows the mask region in the image to be changed according to a magnification shift caused by the switching of the magnification converting lens so as to maintain the privacy zone in a masked state after the switching of the magnification converting lens, thereby preventing the privacy zone from being shifted from the mask when the magnification converting lens is switched.
Moreover, the imaging apparatus of the present invention may further comprise a rotation mechanism which rotates the imaging unit, wherein when the magnification converting lens is switched during rotation of the imaging unit, the control unit instructs the signal processing unit to change a position and a size of the mask region according to an imaging direction change and the magnification shift and maintains an object region to be masked before and after the switching of the magnification converting lens.
The above configuration allows the position and the size of the mask region to be appropriately adjusted if the size and the position of the privacy zone is changed due to the switching of the magnification converting lens during rotation of the imaging unit. Thus, the above configuration can prevent the privacy zone from being shifted from the mask when the magnification converting lens is switched.
Further, in the imaging apparatus of the present invention, when the magnification converting lens is switched, the control unit may instruct the signal processing unit on the imaging magnification and the imaging direction after the switching of the magnification converting lens, and the signal processing unit may calculate, as the mask region, a relative region of the privacy zone to an imaging region after the switching of the magnification converting lens from the imaging magnification and the imaging direction instructed by the control unit and may composite the mask to the calculated mask region.
The above configuration can prevent the privacy zone from being shifted from the mask by appropriately changing the mask region when the magnification converting lens is switched.
Moreover, the imaging apparatus of the present invention may further comprise an image recording unit which records an image imaged by the imaging unit, wherein the control unit may control the signal processing unit in such a manner that during switching of the magnification converting lens, an image recorded in the image recording unit before the switching is outputted as an interpolated image and mask movement is restricted in the interpolated image according to the rotation of the imaging unit by the rotation mechanism.
In the above configuration, during switching of the magnification converting lens, an image recorded in the image recording unit before the switching is outputted as an interpolated image. This can prevent an image taken by the magnification converting lens from being outputted and thus can output a natural image not providing the user with a feeling of strangeness. Further, the restriction of the mask movement in the interpolated image according to the rotation of the imaging unit can prevent the mask from being shifted from the privacy zone of the interpolated image.
Further, in the imaging apparatus of the present invention, the control unit may change a size of the mask region a predetermined transient period earlier or later than the switching timing of the magnification converting lens in such a manner that the size of the mask region is larger than the size of the object region of the privacy zone.
The above configuration allows the size of the mask region to be surely larger than the size of the object region of the privacy zone and thus the privacy zone can be surely covered with the mask. As the transient size change process before or after the switching timing, in order to increase the magnification by switching the magnification converting lens, the mask region size is increased at a predetermined time (transient period) earlier than that of the switching. In other word, the mask region is enlarged, and after a predetermined time elapses, the lens switching starts. The predetermined time refers to a time corresponding to, for example, a predetermined number of frames, and may be one frame of time. Meanwhile, in order to reduce the magnification by switching the magnification converting lens, the mask region size is reduced after a predetermined time (for example, a time corresponding to a predetermined number of frames, and may be one frame of time) elapses from the switching completion.
Further, in the imaging apparatus of the present invention, the control unit may be configured such that when the magnification converting lens is switched during rotation of the imaging unit, the rotation speed of the imaging unit by the rotation mechanism is changed according to the magnification shift so as to maintain an object movement speed in the image before and after the magnification converting lens is switched.
The above configuration makes, regardless of the presence or absence of the magnification converting lens, an operational feeling when rotating the imaging unit equal, and makes the operation easy. In the above configuration, when the angle of view is changed due to a magnification shift, the rotation speed of the imaging unit may be changed in proportion to the angle of view, namely, in inverse proportion to magnification.
Moreover, in the imaging apparatus of the present invention, the imaging unit may further comprise a variable power lens which continuously changes imaging magnification, and the control unit may be configured in such a manner that when the magnification converting lens is switched during magnification change of the variable power lens, a magnification change speed of the variable power lens is changed according to the magnification shift so as to maintain the object size change speed in the image before and after the magnification converting lens is changed.
The above configuration allows the user to feel equally easy to perform a magnification change operation regardless of the presence or absence of the magnification converting lens. In the above configuration, when the angle of view is changed due to a magnification shift, the magnification change speed may be changed in proportion to the angle of view, namely, in inverse proportion to magnification.
Moreover, the imaging apparatus of the present invention may further comprise a sound collecting microphone which acquires a sound of the imaging region, and the control unit may control at least one of the sensitivity and the directivity of the sound collecting microphone according to switching of the magnification converting lens. In the above configuration, when the magnification converting lens is switched, the sound of an area to be imaged after the switching is appropriately acquired.
Further, in the imaging apparatus of the present invention, the control unit may suppress at least one of a movement detection function, an error detection function, and a warning output function by an image process during the switching of the magnification converting lens. The above configuration can appropriately prevent an erroneous detection or an erroneous operation during switching of the magnification converting lens.
Further, in the imaging apparatus of the present invention, the control unit may perform a process to restrict recording an image during the switching of the magnification converting lens. The above configuration can prevent an unwanted image from being recorded during switching of the magnification converting lens and can easily process the recorded image.
Further, in the imaging apparatus of the present invention, the control unit may send information indicating that the magnification converting lens is being switched according to switching of the magnification converting lens, together with the image to the outside. The above configuration can determine the image during switching of the magnification converting lens at a receiving side and can appropriately process the image at the receiving side. For example, when an error part search is performed by the image process, the image during switching can be excluded from the search target and thereby an erroneous detection can be prevented.
Further, in the imaging apparatus of the present invention, the control unit may record switching execution of the magnification converting lens. The above configuration can determine an image during switching of the magnification converting lens from the recorded image and can appropriately process the recorded image. For example, when an error part search is performed by the image process, the image during switching can be excluded from the search target and thereby an erroneous detection can be prevented.
Further, in the imaging apparatus of the present invention, the imaging unit may have a variable power lens which continuously changes the imaging magnification, and the control unit may control the variable power lens according to switching of the magnification converting lens and may maintain the imaging magnification when the magnification converting lens is switched. The above configuration can smoothly change the imaging magnification when the magnification converting lens is switched.
Further, in the imaging apparatus of the present invention, when the imaging magnification reaches a predetermined threshold insertion magnification, the control unit may insert the magnification converting lens; when the imaging magnification reaches a predetermined threshold extraction magnification, the control unit may extract the magnification converting lens; and the threshold insertion magnification and the threshold extraction magnification may be set differently. The above configuration can reduce switching frequency of the magnification converting lens. When an enlarged-type magnification converting lens is used, the threshold insertion magnification is set higher than the threshold extraction magnification. When a reduced-type magnification converting lens is used, the threshold extraction magnification is set higher than the threshold insertion magnification.
Further, in the imaging apparatus of the present invention, the imaging unit may have a variable power lens which continuously changes the imaging magnification, the control unit may receive a magnification instruction which instructs the imaging magnification, may switch the magnification converting lens according to the magnification instruction based on preset switching control information associating the magnification instruction with whether to insert or extract the magnification converting lens, and may control the variable power lens according to the inserted/extracted state of the magnification converting lens and the magnification instruction. The above configuration can achieve the magnification instruction in such a manner that when the imaging magnification is instructed, the magnification converting lens is automatically inserted or extracted, and the magnification of the variable power lens is controlled according to the inserted/extracted state of the magnification converting lens. Thus, the operator can easily operate without considering the presence or absence of the magnification converting lens.
Further, in the imaging apparatus of the present invention, the control unit may switch the magnification converting lens in conjunction with at least one of a movement detection function, an error detection function, and a warning output function by an image process. The above configuration allows the movement detection, the error detection, and the warning output to be performed at an appropriate magnification. For example, movement detection accuracy can be improved by increasing the magnification at movement detection. This can increase detection accuracy and can ensure warning output operation.
Another aspect of the present invention is an imaging method in which an image is imaged by an imaging unit having a magnification converting lens capable of switching between an inserted state and an extracted state with respect to an optical axis and a mask is composited to an object region of a privacy zone in the image generated by the imaging unit, and when the magnification converting lens is switched, a mask region in the image is changed according to a magnification shift caused by switching of the magnification converting lens, and the privacy zone is maintained in a masked state after the switching of the magnification converting lens. The above aspect can also provide the above described advantages of the present invention. Various additional configurations described above regarding the aspect of the imaging apparatus can also be applied to this aspect.
Hereinafter, the imaging apparatus according to an embodiment of the present invention will be described using the drawings.
As illustrated in the Figure, the imaging unit 3 includes a first group lens 21, a variable power lens 23, an aperture unit 25, a focus lens 27 and an extender 29 as a component of an optical system. The variable power lens 23 constitutes an optical zoom lens and is moved in an optical axis direction by a variable power lens drive unit 31 so as to continuously move the imaging magnification. The magnification of the variable power lens 23 is detected by a variable power lens magnification sensor 33 and inputted to the control unit 13. The extender 29 is an example of a magnification converting lens of the present invention and is inserted into and extracted from the optical axis so as to discontinuously change the imaging magnification. The extender 29 is driven by an extender drive unit 35.
The imaging unit 3 further comprises an imaging element 37. The above optical system forms an object image on an imaging surface of the imaging element 37. The imaging element 37 converts the image to an electrical signal. The imaging element 37 is an imaging sensor device such as a CCD or a CMOS.
The signal processing circuit 5 is a circuit which processes the image generated by the imaging unit 3 and corresponds to the signal processing unit of the present invention. The signal processing circuit 5 has a function of compositing a mask to a privacy zone in the image. In addition, the signal processing circuit 5 may include a movement detection function and may further include an error detection function. The error detection may be performed based on movement detection results. Moreover, the control unit 13 or the like may further include a warning output function at the time of error detection.
The image recording unit 7 is configured of a memory and records the image generated by the imaging unit 3. The recorded image is read under control of the control unit 13.
The rotation mechanism 9 is configured to rotate the imaging unit 3 and is configured of for example, a turntable. The rotation mechanism 9 may include a motor and a mechanism for transmitting the rotation. The rotation mechanism 9 may have a pan drive mechanisms and a tilt drive mechanisms. In this case, the rotation mechanism 9 may have a pan motor and a tilt motor and may rotate the imaging unit 3 in a pan direction and in a tilt direction. The rotation of the rotation mechanism 9 is controlled by the control unit 13. The rotation mechanism 9 supplies rotation angles (pan angle and tilt angle) to the control unit 13 as imaging direction information.
The sound collecting microphone 11 collects sounds around the location where the imaging apparatus 1 is set. The sound collecting microphone 11 is controlled by the control unit 13 and thereby sensitivity and directivity are adjusted.
The control unit 13 is configured to control the entire imaging apparatus 1. When an operation instruction is received from the operation terminal 15, the control unit 13 controls various components of the imaging apparatus 1 according to the operation instruction. As the operation instruction, imaging magnification information and imaging direction information are inputted. In addition, the control unit 13 outputs the image generated by the imaging apparatus 1 to the operation terminal 15 and the image recording apparatus 17. The operation terminal 15 displays the image on the monitor 19 and the image recording apparatus 17 records the image therein.
The magnification instruction unit 41 acquires the magnification of the variable power lens 23 supplied from the variable power lens magnification sensor 33 to the imaging unit 3. Note that the imaging unit 3 controls the extender drive unit 35 and has information on the switching state of the extender 29. This information is supplied to the magnification instruction unit 41. The magnification instruction unit 41 calculates the imaging magnification based on the magnification of the variable power lens 23 and the switching state of the extender 29. When the extender 29 is not inserted, the magnification instruction unit 41 calculates the imaging magnification from only the magnification of the variable power lens 23. When the extender 29 is inserted, the magnification instruction unit 41 calculates the imaging magnification from the magnification of the variable power lens 23 and the magnification of the extender 29. Then, the imaging magnification instruction unit 41 supplies the imaging magnification to the signal processing circuit 5.
In addition, the direction instruction nit 43 calculates the imaging direction based on information on the rotation angle of the imaging unit 3 supplied from the rotation mechanism 9 to the control unit 13. The imaging direction is the direction of the optical axis of the imaging unit 3. The information on the imaging direction may be a central coordinate of the imaging region. The information on the imaging direction is also supplied to the signal processing circuit 5.
As illustrated in
The magnification acquisition unit 51 and the direction acquisition unit 53 acquire an imaging magnification and an imaging direction from the magnification instruction unit 41 and the direction instruction unit 43. The mask data storage unit 55 stores mask data representing the range of a predetermined privacy zone in a global space. The mask data storage unit 55 may be, for example, a non-volatile memory.
The imaging region calculation unit 61 of the mask composition unit 57 calculates the angle of view from the imaging magnification and calculates the imaging region from the angle of view and the imaging direction. The mask region calculation unit 63 calculates the mask region in the imaging region based on the mask data stored in the mask data storage unit 55. The mask region calculation unit 63 calculates a relative region of the privacy zone to the imaging region as the mask region in the imaging region. Then, the coordinate conversion unit 65 performs coordinate conversion of the mask region so as to match the image size and a mask is composited to the image in the mask region after the coordinate conversion.
Hereinbefore, the configuration of the imaging apparatus 1 according to an embodiment of the present invention has been described. Hereinafter, the operation of the imaging apparatus 1 will be described.
First, a schematic operation of the imaging apparatus 1 will be described. When an operator operates the operation terminal 15 and inputs an operation instruction, the operation instruction is sent from the operation terminal 15 to the imaging apparatus 1 and received by the control unit 13. Note that the operation instruction includes an imaging magnification and an imaging direction.
In order to match the imaging magnification with the instructed value, the control unit 13 controls the variable power lens drive unit 31 and the extender drive unit 35 to change the imaging magnification. In addition, the control unit 13 controls the rotation mechanism 9 to orient the imaging unit 3 in the instructed imaging direction.
When the imaging magnification is low, the control unit 13 controls the extender drive unit 35 to extract the extender 29 from the optical axis. Then, the control unit 13 controls the variable power lens drive unit 31 to move the variable power lens 23 along the optical axis and adjust the imaging magnification. When the imaging magnification is high, the control unit 13 controls the extender drive unit 35 to insert the extender 29 into the optical axis. Accordingly, the imaging magnification is discontinuously shifted and imaging is enabled at high magnification. Even in a state in which the extender 29 is inserted, the magnification may be adjusted by controlling the position of the variable power lens 23.
Thus, the imaging apparatus 1 images an image under control of the control unit 13 and the image is supplied to the signal processing circuit 5. Then, the signal processing circuit 5 performs mask composition as described above. The image is read from or written to the image recording unit 7 under instruction of the control unit 13. The control unit 13 outputs the image after mask composition to the operation terminal 15 and the image recording apparatus 17.
Hereinbefore, the entire operation of the imaging apparatus 1 has been described. Hereinafter, the mask composition operation when the extender 29 is switched will be described. Here, the description focuses on the operation of inserting the extender 29 to increase the magnification.
Before the extender 29 is switched, the extender 29 is extracted from the optical axis. At this time, the magnification instruction unit 41 of the control unit 13 calculates the imaging magnification from the magnification of the variable power lens 23 inputted from the variable power lens magnification sensor 33 and supplies the signal processing circuit 5 with the imaging magnification. In addition, the direction instruction unit 43 supplies the signal processing circuit 5 with the imaging direction information obtained from the rotation mechanism 9.
In the signal processing circuit 5, the magnification acquisition unit 51 acquires the imaging magnification and the direction acquisition unit 53 acquires the imaging direction. As described in
When only the variable power lens 23 is not sufficient for imaging magnification, the control unit 13 inserts the extender 29 into the optical axis. When the extender 29 is switched, the magnification instruction unit 41 of the control unit 13 calculates the imaging magnification after the extender 29 is switched, from the magnification of the variable power lens 23 and the magnification of the extender 29. The imaging magnification after the switching is supplied to the signal processing circuit 5 and is acquired by the magnification acquisition unit 51. The direction instruction unit 43 supplies the direction acquisition unit 53 with the imaging direction information after the switching obtained from the rotation mechanism 9.
Thus, the signal processing circuit 5 acquires the imaging magnification and the imaging direction after the switching. The imaging magnification after the switching is a magnification shifted due to the insertion of the extender 29. The imaging direction after the switching is a current imaging direction changed due to the rotation of the imaging unit 3. The signal processing circuit 5 performs mask composition using the imaging magnification and the imaging direction after the switching. The imaging region calculation unit 61 of the mask composition unit 57 calculates the angle of view from the shifted imaging magnification and calculates the imaging region from the angle of view and the imaging direction. The calculated results are used by the mask region calculation unit 63 to calculate the mask region. Further, the coordinate conversion unit 65 performs coordinate conversion and the mask is composited to the mask region after the coordinate conversion.
Thus, in the present embodiment, when the imaging magnification is shifted due to the switching of the extender 29, mask composition can be performed based on the imaging magnification after shifting. In addition, an imaging direction change due to the rotation of the imaging unit 3 is appropriately reflected on the mask composition.
In an example of
In an example of
In an example of
Hereinbefore, the mask composition when the extender 29 is switched has been described. Hereinafter, as more detailed description of the operation, the operation during switching will be described.
In
The control unit 13 continuously supplies the signal processing circuit 5 with the imaging magnifications during the switching of the extender 29 (t1 to t2) and immediately before the switching (t1) as mask instruction information. Thus, the mask composition is performed using the imaging magnification corresponding to the interpolated image.
Further, the control unit 13 supplies the signal processing circuit 5 with imaging directions during the switching of the extender 29 (t1 to t2) and immediately before the switching (t1). Thus, the mask composition is performed using the imaging direction immediately before the switching (t1).
Thus, the present embodiment can restrict mask movement corresponding to rotation by the rotation mechanism 9 by fixing the imaging direction used for mask composition, thereby preventing mask shift during switching.
The above mask shift prevention effect will be described in more detail. The imaging unit 3 is rotated during switching of the extender 29. If there is no process of fixing the imaging direction to a value immediately before the switching, the control unit 13 continues to change the imaging direction for mask instruction even during switching of the extender 29. However, the outputted interpolated image remains stationary. Therefore, the imaging direction of the interpolated image is different from the imaging direction of the mask process, resulting in mask shift. In contrast to this, in the present embodiment, during switching of the extender 29, the imaging direction when the interpolated image is acquired is continuously used. This can prevent the mask from being shifted from the privacy zone.
Thus, the present embodiment can provide natural images by outputting the recorded interpolated images and can prevent shifting of the mask during switching.
In
In contrast to this, the magnification instruction in
These processes can also avoid an image taken by the extender 29 during insertion from being outputted and thus can output a natural image not providing the user with a feeling of strangeness. In addition, during switching of the extender 29, the imaging direction at the switching starting time t1 (when the interpolated image is acquired) is continuously used. This can prevent the mask from being shifted from the privacy zone.
The processes in
Hereinafter, the rotation speed control according to the present embodiment will be described. The control unit 13 is configured to control the rotation speed of the imaging unit 3 by the rotation mechanism 9. In particular, the control unit 13 is configured such that when the extender 29 is switched during rotation of the imaging unit 3, the rotation speed is changed according to the magnification shift by the switching to maintain the object movement speed in the image before and after the switching of the extender 29. When the angle of view is changed due to the magnification shift, the control unit 13 may change the rotation speed of the imaging unit 3 in proportion to the angle of view, namely, in inverse proportion to magnification. Such control allows the user to feel equally easy to perform a magnification changing operation regardless of the presence or absence of the magnification converting lens.
In more detail, the object movement speed in the image is in inverse proportion to the angle of view and the angle of view is in inverse proportion to the magnification. Therefore, the object movement speed in the image is in proportion to the magnification. In order to maintain a constant object movement speed in the image when the magnification is shifted due to the switching of the variable power lens 23, the actual movement speed needs to be reduced in inverse proportion to the magnification. Thus, the reduction in actual movement speed offsets the speed increase due to the magnification change. In light of this, the control unit 13 sets “the rotation speed after insertion of the extender 29” to “a value obtained by dividing the rotation speed before insertion of the extender 29 by the magnification of the extender 29” (“after-insertion speed=”before-insertion speed/“extender magnification”). The above rotation speed control allows the object movement speed in the image to be maintained before and after the switching.
As illustrated in
Hereinbefore, a preferred appropriate rotation speed control when the extender 29 is switched has been described. Further, the present embodiment appropriately controls the magnification change speed of the zoom by the variable power lens 23. The control unit 13 is configured such that when the extender 29 is switched during magnification change of the variable power lens 23, the magnification change speed of the variable power lens 23 is changed according to the magnification shift to maintain the object size change speed in the image before and after the switching of the extender 29. When the angle of view is changed due to the magnification shift, the control unit 13 may change the magnification change speed in proportion to the angle of view. The above control allows the user to feel equally easy to perform a magnification change operation regardless of the presence or absence of the magnification converting lens.
In more detail, the object size change speed in the image is in inverse proportion to the angle of view and the angle of view is in inverse proportion to the magnification. Therefore, the object size change speed in the image is in direct proportion to the magnification. In order to maintain a constant object size change speed in the image when the magnification is shifted due to the switching of the variable power lens 23, the magnification change speed of the variable power lens needs to be reduced. Thus, the reduction in magnification change speed of the variable power lens offsets the increase in object size change speed due to the magnification change. In light of this, the control unit 13 sets “the magnification change speed after insertion of the extender 29” to “a value obtained by dividing the magnification change speed before insertion of the extender 29 by the magnification of the extender 29” (“after-insertion speed=”before-insertion speed/“extender magnification”). The control allows the object size change speed in the image to be maintained before and after the switching.
Like the rotation speed change illustrated in
Hereinbefore, various operations of the imaging apparatus 1 according to the present embodiment have been described in detail. The above description focuses mainly on the operation when the extender 29 is inserted. The operation when the extender 29 is extracted is opposite to the operation above, and in principle, is the same as the above described operation when the extender 29 is inserted. Thus, the detailed description is omitted. Schematically, when the extender 29 is extracted, the magnification is shifted to a small value. The shifted magnification is used to perform mask composition. During the period when the extender 29 is extracted, an image immediately before the extraction is outputted as the interpolated image and the mask composition is performed using the imaging direction information immediately before the extraction. Further, at the time of extraction, the rotation speed is increased. The rotation speed after extraction is obtained by multiplying the rotation speed before extraction by the magnification of the extender 29. Further, the rotation speed is continuously changed during the period from the start of the extraction to the completion of the extraction.
In addition, the magnification change speed of the variable power lens 23 is also increased. The magnification change speed after extraction is obtained by multiplying the magnification change speed before extraction by the magnification of the extender 29. Further, the magnification change speed is continuously changed during the period from the start of the extraction to the completion of the extraction.
Hereinafter, various modifications and application examples applicable to the imaging apparatus 1 according to the present embodiment will be described.
(1) In the present embodiment, the magnification converting lens is the extender 29 and the extender 29 is an enlarged-type teleconverter. However, the magnification converting lens may be a reduced-type wide-converter.
(2) The rotation mechanism 9 may not be provided. The imaging direction is fixed. The above case can also prevent the mask shift due to the magnification shift and thus can appropriately provide advantages of the present invention.
(3) The control unit 13 may change the mask region size a predetermined transient period earlier or later than the switching timing (switching time) of the magnification converting lens 29 so that the size of the mask region is larger than that of the object region of the privacy zone. In the examples of
When the magnification converting lens is a reduced-type wide-converter, a control contrary to the above may be performed. More specifically, when the magnification converting lens is inserted, the mask region is reduced at a predetermined time after the insertion completes. When the magnification converting lens is extracted, the mask region is enlarged at a predetermined time before the insertion starts. Thus, the size of the mask region is surely larger than the size of the object region of the privacy zone.
(4) The control unit 13 may control at least one of the sensitivity and the directivity of the sound collecting microphone 11 according to switching of the extender 29. The sensitivity may be in direct proportion to the magnification of the extender 29 and the directivity may be in reverse proportion to the magnification of the extender 29. Specifically, when the extender 29 is inserted, the sensitivity is increased and the directivity is reduced. Thus, the relationship between the imaging region and the sound collecting region can be maintained before and after the switching of the extender 29.
(5) During switching of the extender 29, the control unit 13 may suppress at least one of the movement detection function, the error detection function, and the warning output function by the image process. The movement detection function and the error detection function are performed by an image processing function of the signal processing circuit 5. The error detection may be performed based on the movement detection results. The warning may be outputted from the control unit 13 to the operation terminal 15 and like at the time of error detection. An erroneous detection or an erroneous operation can be appropriately prevented by suppressing these functions during switching of the extender 29.
(6) The control unit 13 may perform a process for restricting the recording of an image during switching of the extender 29. Thus, an unwanted image is not recorded during switching of the magnification converting lens and the recorded image can be easily processed.
As the process for restricting the recording of an image, a plurality of processes can be considered as follows. The control unit 13 may prohibit the image from being stored in a recording medium provided in the imaging apparatus 1 during switching of the extender 29. For example, it is assumed that at the time of the movement detection or the error detection, an image is recorded or the image is recorded by a scheduling function. The control unit 13 prohibits the above recording during switching of the extender 29.
In addition, during switching of the extender 29, the control unit 13 may output a signal indicating a period of switching (switching period) to the image recording apparatus 17. During the period when the signal indicating a period of switching is received, the image recording apparatus 17 may prohibit the image recording.
Moreover, the control unit 13 may suppress sending the image to the operation terminal 15 and the image recording apparatus 17 during switching of the extender 29.
Moreover, during switching of the extender 29, instead of the imaging image, the control unit 13 may output the image before switching read from the image recording unit 7 to the operation terminal 15 and the image recording apparatus 17.
Moreover, during switching of the extender 29, instead of the imaging image, the control unit 13 may output the image indicating a period of switching to the operation terminal 15 and the image recording apparatus 17. The image indicating a period of switching is, for example, an image containing a character indicating a period of switching. Information about the image indicating a period of switching may be preliminarily stored.
(7) The control unit 13 may send information indicating that the extender 29 is being switched according to switching of the extender 29, together with the image to the outside, namely, to the operation terminal 15 and the image recording apparatus 17. Information about the image indicating a period of switching may be added to, for example, a header. The above configuration can determine the image during switching of the extender 29 at a receiving side and can appropriately process the image at the receiving side. For example, when an error part search is performed by the image process, the image during switching can be excluded from the search target and thereby an erroneous detection can be prevented.
(8) The control unit 13 may record switching execution of the extender 29. The switching execution is recorded in a recording medium or the like of the imaging apparatus 1. The above configuration can determine an image during switching of the extender 29 from the recorded image and can appropriately process the recorded image. For example, when an error part search is performed by the image process, the image during switching can be excluded from the search target and thereby an erroneous detection can be prevented.
(9) The control unit 13 may control the variable power lens 23 according to switching of the extender 29 and may maintain the imaging magnification when the magnification converting lens 29 is switched. The above configuration can smoothly change the imaging magnification when the magnification converting lens is switched.
By referring to
For example, it is assumed that the magnification of the extender 29 is 10 times. When the extender 29 inserted, the control unit 13 controls the magnification of the variable power lens 23 so as to generate 9 times the magnification reduction. When the extender 29 is extracted, the control unit 13 controls the magnification of the variable power lens 23 so as to generate 9 times the magnification increase. Thus, the imaging magnification is the same immediately before and after the switching of the magnification converting lens, thereby smoothly changing the imaging magnification.
(10) When the imaging magnification reaches a predetermined threshold insertion magnification, the control unit 13 may insert the extender 29. When the imaging magnification reaches a predetermined threshold extraction magnification, the control unit 13 may extract the extender 29. The threshold insertion magnification and the threshold extraction magnification may be set differently. The above configuration can reduce switching frequency of the magnification converting lens. In the present embodiment, an enlarged-type magnification converting lens is used. In this case, the threshold insertion magnification is set higher than the threshold extraction magnification. On the contrary, when a reduced-type magnification converting lens is used, the threshold extraction magnification is set higher than the threshold insertion magnification.
According to
Meanwhile, it is assumed that the magnification is high and the extender 29 remains inserted. When the magnification is reduced and reaches the threshold extraction magnification, the extender 29 is extracted. Even if the magnification is increased a little immediately afterward but the magnification does not reach the threshold insertion magnification, the extender 29 is not inserted. Then, the magnification is adjusted using the variable power lens 23.
Thus, the present embodiment can provide hysteresis by appropriately setting the magnification as the switching criterion for the extender 29 and can appropriately reduce the switching frequency of the magnification converting lens.
(11) The control unit 13 may receive a magnification instruction which instructs the imaging magnification, may switch the extender 29 according to the magnification instruction based on preset switching control information associating the magnification instruction with whether to insert or extract the extender 29, and may further control the magnification of the variable power lens 23 according to the inserted/extracted state of the extender 29 and the magnification instruction.
The above switching control information may be stored in a storage apparatus of the imaging apparatus 1. The switching control information is, for example, a priority table. The priority table is a table in which whether or not to prioritize the use of the extender 29 (whether to insert the extender 29 or to adjust the magnification by only the variable power lens 23) is preliminarily set according to the imaging magnification. The control unit 13 refers to the priority table to determine whether or not to insert the extender 29 according to the magnification instruction. Based on the determined result, the control unit 13 switches the extender 29. Then, the control unit 13 adjusts the magnification of the variable power lens 23. The magnification of the variable power lens 23 depends on the inserted/extracted state of the extender 29. The above control achieves the instructed imaging magnification.
The above control can achieve the magnification instruction in such a manner that when the imaging magnification is instructed, the magnification converting lens is automatically inserted or extracted, and the magnification of the variable power lens is controlled according to the inserted/extracted state of the magnification converting lens. Thus, the operator can easily operate without considering the presence or absence of the magnification converting lens.
(12) The control unit 13 may switch the extender 29 in conjunction with at least one of the movement detection function, the error detection function, and the warning output function by the image process. The above configuration allows the movement detection, the error detection, and the warning output to be performed at an appropriate magnification. For example, movement detection accuracy can be improved by increasing the magnification at movement detection. This can increase detection accuracy and can ensure warning output operation.
(13) The permission to use the extender 29 may be restricted from the point of view of privacy protection. The permission to use the extender 29 may be set in advance by a high-level manager for each imaging apparatus, for each range of the angle of view, for each preset position and for each time schedule. Within the controlled range, the imaging apparatus may be controlled by a lower-level operator using the operation terminal or the like.
In order to restrict the permission to use the extender 29, a management table may be used. The management table may be stored in the imaging apparatus 1 and referred to by the control unit 13. The management table may be stored in the operation terminal 15 and used as operation permission. The management table manages passwords, users, or network clients.
In order to use for privacy protection, the switching timing of the extender 29 may be recorded together with the image. The switching timing is used to restrict the reproduction of an enlarged image using the extender 29. The recorded part of the enlarged image imaged by the extender 29 can be found from the recorded switching timing. In light of this, the record of the switching timing can be used to restrict the reproduction of the enlarged image. The reproduction restriction may be performed for each imaging apparatus, for each range of the angle of view, for each preset position and for each time schedule. As the reproduction restriction, a reproduction operation to the imaging apparatus 1 may be restricted. In addition, the reproduction using an external communication or an external terminal input may be restricted. The setting of the reproduction restriction may also be performed by the operation to the imaging apparatus 1 or may be performed by an external communication or an external terminal input.
Moreover, the management table may be used for the reproduction restriction and further the setting operation of the reproduction restriction may also be restricted by the management table. The management table manages passwords, users, or network clients. The management table may be used to determine the preset user privileges and to determine whether or not to permit the reproduction operation and the setting operation.
Hereinbefore, the imaging apparatus 1 according to the embodiments of the present invention has been described. The present embodiment changes the mask region in the image according to the magnification shift due to the switching of the magnification converting lens and maintains the privacy zone in a masked state even after the switching of the magnification converting lens. Thus, the above configuration can prevent the privacy zone from being shifted from the mask when the magnification converting lens is switched.
In addition, according to the present embodiment, when the magnification converting lens is switched during rotation of the imaging unit 3, the control unit 13 instructs the signal processing unit to change the position and the size of the mask region according to the imaging direction change and the magnification shift and maintain the object region to be masked before and after the switching of the magnification converting lens. According to the above configuration, even if the magnification converting lens is switched during rotation of the imaging unit 3 and the size and the position of the privacy zone are changed, the position and the size of the mask region are appropriately adjusted. Thus, the above configuration can prevent the privacy zone from being shifted from the mask when the magnification converting lens is switched.
Moreover, according to the present embodiment, when the magnification converting lens is switched, the control unit 13 instructs the signal processing unit on the imaging magnification and the imaging direction after the switching of the magnification converting lens, and the signal processing unit calculates, as the mask region, a relative region of the privacy zone to an imaging region after the switching of the magnification converting lens from the imaging magnification and the imaging direction after switching instructed by the control unit 13 and composites the mask to the calculated mask region. The above configuration can prevent the privacy zone from being shifted from the mask by appropriately changing the mask region when the magnification converting lens is switched.
Moreover, according to the present embodiment, during switching of the magnification converting lens, the control unit 13 outputs an image before switching recorded in the image recording unit 7 as an interpolated image and restricts mask movement in the interpolated image according to the rotation of the imaging unit 3 by the rotation mechanism 9. In the above configuration, during switching of the magnification converting lens, an image before switching recorded in the image recording unit 7 is outputted as an interpolated image. This can prevent an image taken by the magnification converting lens from being outputted and thus can output a natural image not providing the user with a feeling of strangeness. Further, during output of the interpolated image, the restriction of the mask movement according to the rotation of the imaging unit 3 can prevent the mask from being shifted from the privacy zone of the interpolated image.
Moreover, according to the present embodiment, the control unit 13 changes a size of the mask region a predetermined transient period earlier or later than the switching timing of the magnification converting lens 29 in such a manner that the size of the mask region is larger than the size of the object region of the privacy zone. The above configuration allows the size of the mask region to be surely larger than the size of the object region of the privacy zone and thus the privacy zone can be surely covered with the mask.
Moreover, according to the present embodiment, the control unit 13 is configured such that when the magnification converting lens is switched during rotation of the imaging unit 3, the rotation speed of the imaging unit 3 by the rotation mechanism 9 is changed according to the magnification shift so as to maintain an object movement speed in the image before and after the magnification converting lens is switched. The above configuration allows the user to feel equally easy to perform an operation of rotating the imaging unit 3 regardless of the presence or absence of the magnification converting lens.
Moreover, according to the present embodiment, the control unit 13 is configured such that when the magnification converting lens is switched during magnification change of the variable power lens 23, a magnification change speed of the variable power lens 23 is changed according to the magnification shift so as to maintain the object size change speed in the image before and after the magnification converting lens is changed. The above configuration allows the user to feel equally easy to perform a magnification change operation regardless of the presence or absence of the magnification converting lens.
Hereinbefore, the currently considered preferred embodiments of the present invention have been described. It is understood that various modifications can be made to the present embodiments and it is intended that the appended claims cover all such modifications as fall within the true spirit and scope of the present invention.
Industrial Applicability
Thus, the imaging apparatus according to the present invention can prevent the privacy zone from being shifted from the mask when the magnification converting lens is switched and is suitable for a security camera and like.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2008-199533 | Aug 2008 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP2009/003638 | 7/31/2009 | WO | 00 | 12/1/2010 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2010/013486 | 2/4/2010 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6067399 | Berger | May 2000 | A |
| 6509926 | Mills et al. | Jan 2003 | B1 |
| 6744461 | Wada | Jun 2004 | B1 |
| 6959099 | Gutta et al. | Oct 2005 | B2 |
| 7423667 | Hayasaka | Sep 2008 | B2 |
| 7847837 | Ootsuna | Dec 2010 | B2 |
| 8300899 | Masuda | Oct 2012 | B2 |
| 20030137589 | Miyata | Jul 2003 | A1 |
| 20040239785 | Nanjo et al. | Dec 2004 | A1 |
| 20050117023 | Seo | Jun 2005 | A1 |
| 20050129272 | Rottman | Jun 2005 | A1 |
| 20050151875 | Idemura | Jul 2005 | A1 |
| 20060045381 | Matsuo et al. | Mar 2006 | A1 |
| 20060056056 | Ahiska | Mar 2006 | A1 |
| 20070085915 | Ootsuna et al. | Apr 2007 | A1 |
| 20070160349 | Hayashi | Jul 2007 | A1 |
| 20080036877 | Arima | Feb 2008 | A1 |
| 20080180538 | Jung et al. | Jul 2008 | A1 |
| 20090207269 | Yoda | Aug 2009 | A1 |
| 20090262987 | Ioffe et al. | Oct 2009 | A1 |
| 20090279798 | Massimino | Nov 2009 | A1 |
| 20110150327 | Yoo et al. | Jun 2011 | A1 |
| Number | Date | Country |
|---|---|---|
| 1 708 494 | Oct 2006 | EP |
| 59-107310 | Jun 1984 | JP |
| 02-237778 | Sep 1990 | JP |
| 06-178183 | Jun 1994 | JP |
| 08051611 | Feb 1996 | JP |
| 10-191306 | Jul 1998 | JP |
| 2001-069494 | Mar 2001 | JP |
| 2003-219414 | Jul 2003 | JP |
| 2005-109724 | Apr 2005 | JP |
| 2005-202263 | Jul 2005 | JP |
| 2006-030680 | Feb 2006 | JP |
| 2006-304122 | Nov 2006 | JP |
| 2007-166042 | Jun 2007 | JP |
| Entry |
|---|
| Extended European Search Report dated Feb. 24, 2012. |
| Number | Date | Country | |
|---|---|---|---|
| 20110074978 A1 | Mar 2011 | US |
