The present invention relates to an optical system used for focusing, and an imaging apparatus and a projection apparatus in which the optical system is used.
In an imaging apparatus that is used for object recognition such as face authentication and iris authentication and that captures an image of an imaging surface in which a subject has depth differences, an image in which the entirety of the subject is in focus is required in order to enhance the accuracy of authentication and recognition.
Also, in a projection apparatus for projecting and displaying an image on a projected surface such as a screen having depth differences, an image in which the entirety of the projected surface is in focus is also required.
However, conventional imaging apparatuses are manufactured so as to focus on a surface orthogonal to an optical axis of an imaging lens. Also, conventional projection apparatuses are manufactured so as to focus on a surface orthogonal to an optical axis of a projection lens. For this reason, with the imaging apparatus and the projection apparatus described above, it is difficult to focus on multiple locations of a surface.
Patent Document 1 discloses a method for focusing on an inclined surface with depth differences. According to a technique disclosed in Patent Document 1, a reflection mirror having a specific aspect is disposed between a document surface (imaging surface) and an imaging element.
Patent Document 2 discloses a method for focusing on an inclined surface with depth differences. According to a technique disclosed in Patent Document 2, a reflection mirror having a specific aspect is disposed between a spatial light modulator such as a liquid crystal and a DMD (Digital Mirror Device) and a projected surface.
Incidentally, in a system used for object recognition such as face authentication and iris authentication as shown in
Also, in a technique disclosed in Patent Document 1, a sculptured surface mirror is generally used for a reflection mirror having a specific aspect, and thus manufacturing cost is high. Accordingly, the optical system is expensive.
Further, it is difficult to manufacture a reflection mirror that forms a plurality of focusing surfaces 3 that focus respectively on the faces of imaged persons 2a and 2b facing different directions as in
Next, in a system used for projection as shown in
Further, in a technique disclosed in Patent Document 2, since a sculptured surface mirror is generally used for a reflection mirror having a specific aspect, the manufacturing cost is high. As such, the optical system is expensive.
Further, as shown in
An aim of an aspect is to provide an optical system capable of focusing on multiple locations, and that is small and inexpensive, and an imaging apparatus and a projection apparatus using the optical system.
In order to achieve the example object described above, an optical system according to an example aspect includes:
Also, in order to achieve the example object described above, an imaging apparatus according to an example aspect includes:
Also, in order to achieve the example object described above, an optical system according to an example aspect includes:
Also, in order to achieve the example object described above, a projection apparatus according to an example aspect includes:
As one aspect, it is possible to focusing on multiple locations, and that is small and inexpensive.
In the following, an example embodiment of the invention will be described with reference to the drawings. In the drawings described below, elements having identical or corresponding functions will be assigned the same reference signs, and redundant descriptions thereof may be omitted.
The configuration of the optical system 10 according to a first example embodiment will be described below with reference to
The optical system 10 shown in
The imaging element 11 is a device for converting light incident from the lens 12 into an electric signal. Examples of the imaging element 11 include a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a CCD (Charge Coupled Device) image sensor, and an InGaAs (Indium gallium arsenide) sensor. However, the imaging element 11 is not limited to the above image sensors.
Regarding the resolution of the imaging element 11, it is conceivable to use a CMOS sensor with horizontal 1920 pixels×vertical 1080 pixels, a pixel pitch of 5 μm, and a frame rate of 60 fps. However, the imaging element 11 is not limited to the above resolution, pixel pitch, and frame rate.
The lens 12 is an optical element that refracts and converges light, and is a transparent body having spherical surfaces on both sides. The lens 12 may be, for example, a convex lens.
The prism 13 is an optical element for dispersing, refracting, totally reflecting, and double-refracting light, and is a polyhedron made of a transparent medium. Specifically, as shown in
The material for the prism 13 is, for example, glass, plastic, or the like. Note that the material for the prism 13 is not limited to glass or plastic, and may be any transparent material having effects similar to glass and plastic.
In the example of
Since the subject is required to be focused on the focusing surface 16, the shape of the prism 13 is formed such that the virtual image 15 of the light-receiving surface 14 of the imaging element 11 is formed in the prism 13 that is in an image forming relationship (conjugate relationship) with the focusing surface 16. That is, a conjugate image distance distribution having an image forming relationship with the focusing surface 16 (predetermined object distance distribution) is obtained, and the shape of the prism 13 that is a transmission optical member is set such that the image distance distribution matches the virtual image 15 of the light receiving surface 14.
Also, when the prism 13a has the shape as shown in
Specifically, the location of the virtual image 15a can be represented by a distance d1 as shown in Expression 1. That is, the distance d1 is a distance from a surface of the prism 13a on the light receiving surface 14 side of the imaging element 11 to the virtual image 15a in the Z direction (the same direction as the optical axis).
Next, in
For example, if the prism 13b has a shape as shown in
Specifically, the position of the virtual image 15b can be represented by the distance d1 (=d2) as shown in Expression 1. Note that in the case of
The method for designing the prism will be described below.
Note that the image forming relationship can be represented by Expression 2 using the object distance s, the image distance s′, and the focal distance f of the lens.
Note that, in this example, according to Expression 1, since the thickness t2 of the prism is three times the distance d2, the apex angle Ang of 10° can be obtained from the inverse function of three times the slope (tangent) of the image distance in the graph shown in
Face authentication and iris authentication will be described below.
The imaging apparatus 100 includes the above-mentioned optical system 10 and the control unit 20. The imaging apparatus 100 is, for example, a camera.
The control unit 20 obtains imaging data (or an imaging signal) output from the imaging element 11 provided in the optical system 10, and transmits the obtained imaging data to the information processing apparatus 200 via the network 300. The control unit 20 is, for example, a programmable device such as a CPU (Central Processing Unit) or an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), or a circuit provided with one or more of those.
The information processing apparatus 200 executes face authentication processing, iris authentication processing, or both types of processing, based on the received imaging data. Note that the information processing apparatus 200 may execute object recognition processing other than face authentication processing and iris authentication processing. The information processing apparatus 200 is, for example, a programmable device such as a CPU or an FPGA, a GPU, or a circuit provided with one or more of the above devices, a server computer, a personal computer, a mobile terminal, or the like.
Note that, in the example of
The network 300 is, for example, a general network built using a communication line such as the Internet, a LAN (Local Area Network), a dedicated line, a telephone line, an in-house network, the mobile communication network, Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity), or the like.
However, when the imaging apparatus including the optical system 10 of the first example embodiment is used, as shown in
Also, in the above conventional imaging apparatus, for example, if there are a plurality of imaged persons, of the two faces shown in
However, in the imaging apparatus including the optical system 10 of the first example embodiment, the faces of the two imaged persons can be focused on as shown in
Other prisms will be described below:
The optical system in
The optical system of
The optical system in
As described above, according to the first example embodiment, the prism is used such that the virtual image 15 of the light receiving surface 14 of the imaging element 11 is formed in the prism 13 that is in an image forming relationship with the focusing surface, and thus the optical system can be reduced in size.
Also, the shape of the prism 13 may be formed such that the surface that is in an image forming relationship with the focusing surface 16 is the virtual image, and thus the prism 13 can be designed using only the above-described Expressions 1 and 2. As such, the design is simple, which can further suppress the cost.
Also, since the optical system can be reduced in size, the imaging apparatus used for object recognition such as face authentication and iris authentication can be reduced in size. Note that the optical system can be applied to an imaging apparatus used for a purpose other than object recognition such as face authentication and iris authentication. Further, it is also possible that a plurality of prisms having different shapes for each purpose are prepared in advance, and the prism may be replaced and used in accordance with the positional relationship between the optical system and the subject.
Further, since the optical system can be reduced in size, the projection apparatus for projecting and displaying an image on a projecting surface can be reduced in size. Further, it is also possible that a plurality of prisms having different shapes for each purpose are prepared in advance, and the prism may be replaced and used in accordance with the positional relationship between the optical system and the projecting surface.
A second example embodiment will be described using
A system shown in
The imaging apparatus 100a includes an optical system 101 and a control unit 102. The imaging apparatus 100a is, for example, a camera.
The optical system 101 has the same configuration as that of the first example embodiment, but the prism portion included in the optical system 101 of the second example embodiment can be changed in shape. The optical system 101 will be described in detail later.
The control unit 102 has the same configuration as that of the first example embodiment. In addition, the control unit 102 of the second example embodiment performs control for changing the shape of the prism. The control unit 102 will be described in detail later.
The optical system of the second example embodiment will be described below.
The prism portion 402 includes a plate portion 403a, a plate portion 403b, a stretchable portion 404, an actuator 405a, and an actuator 405b. The position of the focusing surface of the prism portion 402 can be changed by changing the shape.
The plate portion 403a is provided on the imaging element 11 side of the stretchable portion 404 (on the opposite side to the Z direction) in parallel with the light receiving surface 14 and fixed. A surface of the plate portion 403a on the lens 12 side (Z direction side) is attached to a portion on the image device 11 side (the opposite side to the Z direction) of the stretchable portion 404.
The plate portion 403b is provided on the lens 12 side (Z direction side) of the stretchable portion 404. Also, the surface on the imaging element 11 side (the opposite side to the Z direction) of the plate portion 403b is adhered to the lens 12 side (Z direction side) of the stretchable portion 404.
The material for the plate portions 403a and 403b is, for example, glass or plastic. Note that the material for the plate portions 403a and 403b is not limited to glass and plastic, and may be any transparent material having the same effects as that of glass and plastic.
The stretchable portion 404 is provided between the plate portion 403a and the plate portion 403b, and adhered to the plate portion 403a and the plate portion 403b at predetermined positions. In the stretchable portion 404, a liquid fills a transparent medium (stretchable material) formed in a stretchable bag shape.
The stretchable material is, for example, silicone rubber. Note that the stretchable material is not limited to silicone rubber, and may be any stretchable material that has the same effects as silicone rubber and the like.
The liquid is, for example, water or oil. Note that the liquid is not limited to water or oil, and may be any liquid that has the same effects as water and oil.
Also, the stretchable portion 404 has a refraction index. The refraction indices of the plate portion 403a, the plate portion 403b, and the stretchable portion 404 may be the same or different from each other.
The actuator 405a is provided at one end (predetermined position) on the lens 12 side (z direction side) of the plate portion 403b. Also, the actuator 405a is driven by control of the control unit 102, and moves the one end on the lens 12 side (z direction side) of the flat portion 403b in the Z direction or the direction opposite to the Z direction. Note that the position of the actuator 405a is not limited to the position shown in
The actuator 405b is provided at the other end (predetermined position) on the lens 12 side (Z direction side) of the plate portion 403b. Also, the actuator 405b is driven by control of the control unit 102, and moves the other end of the plate portion 403b on the lens 12 side (Z direction side) in the Z direction or the direction opposite to the Z direction. Note that the position of the actuator 405b is not limited to the position shown in
In the second example embodiment, by controlling the actuators 405a and 405b, the plate portion 403b is tilted to deform the stretchable portion 404. For example, the stretchable portion 404 is deformed to the shape as shown in
In the example shown in
Specifically, the control unit 102 controls the actuators 405a and 405b to tilt the surface of the plate portion 403b, based on the predetermined condition. The condition is that, in the case of
Also, the stretchable portion 404 may be deformed in accordance with the installation condition of the imaging apparatus 100a. Further, the focusing state of the subject may be detected through the image processing, and the stretchable portion 404 may be dynamically deformed in accordance with the detected focusing state.
Note that although the stretchable portion 404 is deformed by controlling the actuators 405a and 405b in the second example embodiment, the plate portions 403a and 403b may be manually moved using threads or the like instead of the actuators 405a and 405b.
As described above, according to the second example embodiment, in addition to achieving the effects of the first example embodiment, the stretchable portion 404 can be automatically deformed.
A third example embodiment will be described below using
A system shown in
The imaging apparatus 100b includes an optical system 111, and a control unit 112. The imaging apparatus 100b is, for example, a camera.
The optical system 111 has the same configuration as the first example embodiment, but the position of the focusing surface can be changed by rotating the prism included in the optical system 111 of the third example embodiment. The detail of the optical system 111 will be described later.
The control unit 112 has the same configuration as the first example embodiment. Note that the control unit 112 of the third example embodiment further performs control for rotating the prism. The detail of the control unit 112 will be described later.
The optical system of the third example embodiment will be described below.
The prism portion 502 includes a hollow shaft motor 503 and a prism 13f. The prism portion 502 can change the position of the focusing surface by rotating the prism 13f using the hollow shaft motor 503.
The hollow shaft motor 503 rotates the prism 13f by the control unit 112 controlling a cylindrical rotation hollow shaft 504 to rotate about a rotational axis of the rotation hollow shaft 504.
In the rotation hollow shaft 504, the prism 13f is attached inside the hollow portion as shown in
For example, by setting the rotation speed of the rotation hollow shaft 504 to 60 rps (3600 rpm), and the frame rate of the imaging element 11 to 600 fps, 10 images of the different focusing surfaces can be obtained every 1/60 second.
Note that the rotational axis shown in
As described above, according to the third example embodiment, in addition to achieving the effects of the first example embodiment, focusing can be automatically performed on multiple locations.
When face authentication and iris authentication were actually performed using the imaging apparatus including the optical system 111 of the third example embodiment, an image in which the face of the imaged person and the left eye and the right eye of the imaged person were in focus was included in the 10 images. In other words, since an image in which the left eye and the right eye of the observed person are in focus can be obtained, accurate face authentication and iris authentication were performed.
Note that in the third example embodiment, the prism 13f may be subjected to rotation or parallel movement according to the installation condition of the imaging apparatus 100b. Further, the focusing state of the subject may be detected through image processing, and the prism 13f may be dynamically subjected to rotation or parallel movement according to the detected state. The prism 13f may also be subjected to parallel movement or parallel reciprocation, in addition to rotation.
A fourth example embodiment will be described using
The optical system 600 shown in
The display element 601 is a device for displaying images. The display element 601 is, for example, various spatial light modulators such as a liquid crystal panel and a DMD. Note that the display element 601 is not limited to the above-described liquid crystal panel and a DMD.
Note that, regarding the resolution of the display element 601, it is conceivable to use a liquid crystal panel having horizontal 1920 pixels×vertical 1080 pixels, a pixel pitch of 10 μm, and a frame rate of 60 fps. However, the display element 601 is not limited to the above resolution, pixel pitch, and frame rate.
Note that since the lens 12 and the prism 13g have been described in the first example embodiment, description thereof will be omitted.
In the example of
Since the projected object is focused on the projected surface 603, the shape of the prism 13g is formed such that the virtual image 602 of the surface of the display element 601 is formed in the prism 13g that is in an image forming relationship with the projected surface 603.
Other prisms will be described.
In other words, the prism 13h as shown in
As shown in
In other words, the prism 13i as shown in
As shown in
In other words, the prism 13j as shown in
Note that in the projection apparatus according to the fourth example embodiment, when the prisms 13 corresponding to the projected surfaces including an inclined projected surface, discontinuous projected surfaces, and a projected surface including a curved surface were disposed on the display surface of the display element and image projection was performed, focused vivid images were observed on all the projected surfaces.
Also, when three display elements, namely red, green, and blue display elements, are used, prisms corresponding to the respective liquid crystals are arranged.
Further, the optical system of the second and third example embodiments may be used for the optical system 600 of the fourth example embodiment.
As described above, according to the fourth example embodiment, a prism capable of forming the virtual image 602 of the display element 601 can be formed in the prism 13 that is in an image forming relationship with the projected surface, the optical system can thus be reduced in size.
Also, the shape of the prism 13 may be formed such that the surface that is in an image forming relationship with the projected surface 603 is the virtual image, the prism 13 can be designed using only the above-described Expressions 1 and 2. Accordingly, the design is simple and costs can be further suppressed.
Further, since the optical system can be reduced in size, the projection apparatus that projects and displays an image on a projecting surface can be reduced in size. Further, it is also possible that a plurality of prisms having different shapes for each purpose are prepared in advance, and the prism may be replaced to be used in accordance with the positional relationship between the optical system and the projecting surface.
Furthermore, the following supplementary notes are disclosed regarding the example embodiments described above. Some portion or all of the example embodiments described above can be realized according to (supplementary note 1) to (supplementary note 12) described below, but the below description does not limit.
An optical system comprising:
The optical system according to Supplementary Note 1,
wherein the prism includes:
The optical system according to Supplementary Note 1, further comprising
a hollow shaft motor configured to rotate a cylindrical rotation hollow shaft;
wherein the hollow shaft motor is configured to rotate the prism inside the rotation hollow shaft.
An imaging apparatus comprising:
The imaging apparatus according to Supplementary Note 4,
wherein the prism includes:
The imaging apparatus according to Supplementary Note 4, further comprising
a hollow shaft motor configured to rotate a cylindrical rotation hollow shaft;
wherein the hollow shaft motor is configured to rotate the prism inside the rotation hollow shaft.
An optical system comprising:
The optical system according to Supplementary Note 7,
wherein the prism includes:
The optical system according to Supplementary Note 7, further comprising
a hollow shaft motor configured to rotate a cylindrical rotation hollow shaft;
wherein the hollow shaft motor is configured to rotate the prism inside the rotation hollow shaft.
A projection apparatus comprising:
The projection apparatus according to Supplementary Note 10,
wherein the prism includes:
The projection apparatus according to Supplementary Note 10, further comprising
a hollow shaft motor configured to rotate a cylindrical rotation hollow shaft:
wherein the hollow shaft motor is configured to rotate the prism inside the rotation hollow shaft.
Although the present invention of this application has been described with reference to example embodiments, the present invention of this application is not limited to the above example embodiments. Within the scope of the present invention of this application, various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention of this application.
As described above, according to the present invention, an optical system capable of focusing on multiple locations, and that is small and inexpensive, and an imaging apparatus and a projection apparatus using the optical system can be provided. The present invention is useful in a field in which object recognition such as face authentication and iris authentication, and image projection are required.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2021/021942 | 6/9/2021 | WO |