The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2022-120942 filed on Jul. 28, 2022. The above application is hereby expressly incorporated by reference, in its entirety, into the present application.
The technology of the present disclosure relates to an image projection device and a control method for an image projection device.
A technology of performing omnidirectional scanning with laser light at 360 degrees (hereinafter, referred to as omnidirectional scanning) is known, and is used in a light detection and ranging (LiDAR) device, a commercial image projection device, and the like. In the related art, for the omnidirectional scanning, a mechanical scanning method of performing omnidirectional scanning with laser light by rotating a laser light source or a light deflection member such as a prism that deflects the laser light with a motor has been used (for example, see JP2008-170500A).
However, since the mechanical scanning method uses a mechanical mechanism such as a motor, the device is large and heavy, and there is a problem in operational reliability and the like. In particular, in an image projection device, since the rotation speed is low in the mechanical scanning method, it is not possible to project an image over a wide range with a sufficient resolution.
An object of the technology of the present disclosure is to provide an image projection device and a control method for an image projection device capable of projecting an image over a wide range with a sufficient resolution.
In order to achieve the above-mentioned object, an image projection device of the present disclosure comprises: a light source that emits light; an optical scanning element that has a movable mirror on which the light is incident and that enables scanning with the light by deflecting the light by changing a deflection angle and a rotation angle of the movable mirror; an optical member that projects the light by deflecting the light with which scanning is performed by the optical scanning element in a circumferential direction; a sensor that detects the deflection angle and the rotation angle at a specific time point or consecutive time points in a specific period; and a processor, in which the processor determines a target scanning trajectory of the movable mirror, which is necessary for projecting a target image, and a target light emission timing in the target scanning trajectory, drives the optical scanning element based on the target scanning trajectory, calculates a trajectory of the movable mirror based on a detection value of the sensor, determines a light emission timing based on the target light emission timing and the trajectory of the movable mirror, and causes the light source to emit the light based on the determined light emission timing.
It is preferable that the target scanning trajectory is a trajectory that passes through the same pixel in the image a plurality of times in one frame period for projecting the image, and that the processor causes the light source to emit the light in a case in which the trajectory of the movable mirror passes through the pixel.
It is preferable that the image includes a plurality of pixels with different numbers of times of passing of the target scanning trajectory.
It is preferable that the target scanning trajectory is represented by the deflection angle and the rotation angle, and that the processor determines a range of the deflection angle according to a width in a vertical direction of the image.
It is preferable that the processor changes an interval of the target scanning trajectory in a direction of the deflection angle according to a resolution of the image.
It is preferable that the sensor is a position detection sensor that receives light for position detection reflected by a back surface of the movable mirror and detects a position of the received light.
A control method for an image projection device of the present disclosure is a control method for an image projection device including a light source that emits light, an optical scanning element that has a movable mirror on which the light is incident and that enables scanning with the light by deflecting the light by changing a deflection angle and a rotation angle of the movable mirror, an optical member that projects the light by deflecting the light with which scanning is performed by the optical scanning element in a circumferential direction, and a sensor that detects the deflection angle and the rotation angle at a specific time point or consecutive time points in a specific period, the control method comprising: determining a target scanning trajectory of the movable mirror, which is necessary for projecting a target image, and a target light emission timing in the target scanning trajectory; driving the optical scanning element based on the target scanning trajectory; calculating a trajectory of the movable mirror based on a detection value of the sensor; determining a light emission timing based on the target light emission timing and the trajectory of the movable mirror; and causing the light source to emit the light based on the determined light emission timing.
According to the technology of the present disclosure, it is to provide an image projection device and a control method for an image projection device capable of projecting an image over a wide range with a sufficient resolution.
Exemplary embodiments according to the technique of the present disclosure will be described in detail based on the following figures, wherein:
An example of an embodiment relating to the technology of the present disclosure will be described with reference to the accompanying drawings.
Although not shown in
The optical member of the present disclosure is not limited to the omnidirectional lens 8 shown in
In the present disclosure, a direction in which the laser light La emitted from the light source 3 is incident on the MMD 2 is defined as a Z direction, one direction orthogonal to the Z direction is defined as an X direction, and a direction orthogonal to the Z direction and the X direction is defined as a Y direction.
The MMD 2 is a piezoelectric biaxial drive type micro electro mechanical systems (MEMS) mirror device that has a movable mirror 20 and enables the movable mirror 20 to swing around a first axis a1 parallel to the X direction and a second axis a2 parallel to the Y direction. The MMD 2 is an example of an “optical scanning element” according to the technology of the present disclosure.
The light source 3 is, for example, a laser diode. The light source 3 makes the laser light La incident perpendicular to a reflecting surface 20A of the movable mirror 20 in a state in which the movable mirror 20 of the MMD 2 is stationary. The MMD2 makes it possible to deflect the laser light La by changing a deflection angle R and a rotation angle θ of the movable mirror 20. The deflection angle R is an angle formed by a normal line N of the reflecting surface 20A and a rotation axis C. The rotation angle θ is an angle of the normal line N about the rotation axis C. The rotation axis C is parallel to the Z direction.
An angle formed by the laser light La incident on the movable mirror 20 and the laser light La reflected by the movable mirror 20 is 2R.
The driving controller 4 outputs a driving signal to the light source 3 and the MMD 2 based on target projection image information. The light source 3 generates the laser light La based on the input driving signal and makes the laser light La incident on the MMD 2. The MMD 2 allows the movable mirror 20 to swing around the first axis a1 and the second axis a2 based on the input driving signal.
As will be described in detail below, the driving controller 4 causes the movable mirror 20 to perform a spiral rotation operation including a period in which a swing amplitude around the first axis a1 and a swing amplitude around the second axis a2 linearly change (that is, a spiral rotation operation in which a radius vector linearly changes). As the movable mirror 20 performs the spiral rotation operation about the rotation axis C, scanning is performed with the laser light La so as to draw a spiral trajectory Os on a horizontal plane (XY plane). The spiral trajectory Os is a spiral activation about the rotation axis C.
As shown in
The omnidirectional lens 8 has a variable magnification characteristic that increases the angle of view in a deflection angle direction such that a change range of the angle Ra is larger than a change range of the optical deflection angle 2R. Accordingly, the angle of view can be made larger than an operating range of the movable mirror 20, and an image can be projected over a wide range. The angle Ra and the rotation angle θa represent coordinates in a projection region on which an image is projected.
The position detection sensor 5 is a sensor for detecting the deflection angle R and the rotation angle θ of the movable mirror 20. The position detection sensor 5 is a two-dimensional position sensitive detector (PSD) that receives laser light Lb for position detection emitted from the sensor light source 6 and reflected by the back surface of the movable mirror 20 and detects a position of the received laser light Lb. The back surface of the movable mirror 20 is a surface opposite to the reflecting surface 20A.
Specifically, a light deflection member 7 is provided at the center of a light-receiving surface 5A of the position detection sensor 5. For example, the light deflection member 7 has a reflecting surface 7A formed by obliquely cutting a cylindrical base material. The laser light Lb emitted from the sensor light source 6 is incident on the reflecting surface 7A. The reflecting surface 7A reflects the laser light Lb and causes the laser light Lb to be incident on the back surface of the movable mirror 20. The laser light Lb incident on the back surface of the movable mirror 20 is reflected and incident on the light-receiving surface 5A of the position detection sensor 5. The laser light Lb is incident on the light-receiving surface 5A while drawing a spiral trajectory by the spiral rotation operation performed by the movable mirror 20. An incident position of the laser light Lb on the light-receiving surface 5A corresponds to the position of the movable mirror 20 represented by the deflection angle R and the rotation angle θ. The position detection sensor 5 transmits a signal (detection value) representing the incident position of the laser light Lb on the light-receiving surface 5A to the driving controller 4.
The position detection sensor 5 enables real-time detection of the position of the movable mirror 20 at substantially all time points during a period in which the MMD 2 operates. That is, it is possible to detect the deflection angle R and the rotation angle θ at consecutive time points in a specific period. The position detection sensor 5 is an example of a “sensor” according to the technology of the present disclosure.
The sensor of the present disclosure is not limited to the position detection sensor 5 shown in
The ROM 41 is a non-volatile storage device and stores a program for the CPU 40 to execute processing and data such as the image information described above. The RAM 42 is a non-volatile storage device that temporarily holds a program and data.
The light source driver 43 causes the light source 3 to emit the laser light La based on a light emission timing supplied from the CPU 40.
The MMD driver 44 is an electric circuit that outputs a driving signal to the MMD 2 under the control of the CPU 40. In the MMD driver 44, the driving signal is a driving voltage for controlling the timing, period, and deflection angle for allowing the movable mirror 20 to swing. As will be described in detail below, the driving signal includes a first driving signal and a second driving signal.
For example, in the MMD driver 44, the driving signal is created as a digital signal and is output via a digital analog converter (DAC) and an amplification amplifier. The driving signal may be output as a stepped waveform based on the number of resolution bits of a digital signal source. In addition, the driving signal can also be created from a pulse signal, a band-pass filter, or the like.
The CPU 40 controls the light source driver 43 and the MMD driver 44 based on the target image information. As will be described in detail below, the CPU 40 functions as a target determination unit 50, a trajectory calculation unit 51, and a light emission timing determination unit 52.
The sensor light source driver 45 causes the sensor light source 6 to emit the laser light Lb under the control of the CPU 40.
Next, an example of a configuration of the MMD 2 will be described with reference to
The movable mirror 20 has a reflecting surface 20A for reflecting incidence light. The reflecting surface 20A is provided on one surface of the movable mirror 20, and is formed of a metal thin film such as gold (Au) and aluminum (Al). The reflecting surface 20A is, for example, circular.
The support frame 23 is disposed to surround the movable mirror 20. The second actuator 22 is disposed to surround the movable mirror 20 and the support frame 23. The first actuator 21 is disposed to surround the movable mirror 20, the support frame 23, and the second actuator 22.
The first support portion 24 connects the movable mirror 20 and the support frame 23 on the first axis a1, and swingably supports the movable mirror 20 around the first axis a1. The first axis a1 is located in a plane including the reflecting surface 20A in a case in which the movable mirror 20 is stationary. For example, the first support portion 24 is a torsion bar stretched along the first axis a1.
The second support portion 25 connects the support frame 23 and the second actuator 22 on the second axis a2, and swingably supports the movable mirror 20 and the support frame 23 around the second axis a2. The second axis a2 is orthogonal to the first axis a1 in the plane including the reflecting surface 20A in a case in which the movable mirror 20 is stationary.
The connecting portion 26 connects the first actuator 21 and the second actuator 22 on the first axis a1. In addition, the connecting portion 26 connects the first actuator 21 and the fixed portion 27 on the first axis a1.
The fixed portion 27 has a rectangular outer shape and surrounds the first actuator 21. Lengths of the fixed portion 27 in the X direction and the Y direction are, for example, about 1 mm to 10 mm, respectively. A thickness of the fixed portion 27 in the Z direction is, for example, about 5 μm to 0.2 mm.
The first actuator 21 and the second actuator 22 are piezoelectric actuators each comprising a piezoelectric element. The first actuator 21 applies rotational torque around the first axis a1 to the movable mirror 20. The second actuator 22 applies rotational torque around the second axis a2 to the movable mirror 20. Thereby, the movable mirror 20 swings around the first axis a1 and around the second axis a2.
The first actuator 21 is an annular thin plate member that surrounds the movable mirror 20, the support frame 23, and the second actuator 22 in the XY plane. The first actuator 21 is composed of a pair of a first movable portion 21A and a second movable portion 21B. Each of the first movable portion 21A and the second movable portion 21B is semi-annular. The first movable portion 21A and the second movable portion 21B have a shape that is line-symmetrical with respect to the first axis a1, and are connected on the first axis a1.
The support frame 23 is an annular thin plate member that surrounds the movable mirror 20 in the XY plane.
The second actuator 22 is an annular thin plate member that surrounds the movable mirror 20 and the support frame 23 in the XY plane. The second actuator 22 is composed of a pair of a first movable portion 22A and a second movable portion 22B. Each of the first movable portion 22A and the second movable portion 22B is semi-annular. The first movable portion 22A and the second movable portion 22B have a shape that is line-symmetrical with respect to the second axis a2, and are connected on the second axis a2.
In the first actuator 21, the first movable portion 21A and the second movable portion 21B are each provided with a piezoelectric element. In addition, in the second actuator 22, the first movable portion 22A and the second movable portion 22B are each provided with a piezoelectric element.
In this example, the first actuator 21 and the second actuator 22 are configured as separate annular structures, but the present invention is not limited to this, and the first actuator 21 and the second actuator 22 may be configured to coexist in one structure. For example, a piezoelectric material is divided and disposed in one annular structure. By providing the first driving signal and the second driving signal to each of two piezoelectric material parts individualized by the division in this way, the mirror swinging around the first axis a1 and around the second axis a2 can be realized.
The mirror swinging around the first axis a1 is controlled by the driving signal (hereinafter, referred to as a first driving signal) given to the first actuator 21 by the driving controller 4. The first driving signal is, for example, a sinusoidal AC voltage. The first driving signal includes a driving voltage waveform V1A(t) applied to the first movable portion 21A and a driving voltage waveform V1B(t) applied to the second movable portion 21B. The driving voltage waveform V1A(t) and the driving voltage waveform V1B(t) are in an anti-phase with each other (that is, the phase difference is 180°).
The mirror swinging around the second axis a2 is controlled by the driving signal (hereinafter, referred to as a second driving signal) given to the second actuator 22 by the driving controller 4. The second driving signal is, for example, a sinusoidal AC voltage. The second driving signal includes a driving voltage waveform V2A(t) applied to the first movable portion 22A and a driving voltage waveform V2B(t) applied to the second movable portion 22B. The driving voltage waveform V2A(t) and the driving voltage waveform V2B(t) are in an anti-phase with each other (that is, the phase difference is 180°).
The driving voltage waveforms V1A(t) and V1B(t) are represented by Equations (1A) and (1B), respectively.
V
1A(t)=A1(t)sin(2πfdt+γ1(t)) (1A)
V
1B(t)=A1(t)sin(2πfdt+γ1(t)+π) (1B)
Here, t is a time. fd is the driving frequency. A1(t) is an amplitude and changes with the time t. γ1(t) is a phase and changes with the time t. A phase difference between the driving voltage waveform V1A(t) and the driving voltage waveform V1B(t) is π (that is, 180°).
That is, the first driving signal is a periodic voltage signal whose amplitude and phase change with time. By applying the driving voltage waveforms V1A(t) and V1B(t) to the first movable portion 21A and the second movable portion 21B, the movable mirror 20 swings around the first axis a1 at a period Td(=1/fd).
The driving voltage waveforms V2A(t) and V2B(t) are represented by Equations (2A) and (2B), respectively.
V
2A(t)=A2(t)sin(2πfdt+γ2(t)+φ) (2A)
V
2B(t)=A2(t)sin(2πfdt+γ2(t)+φ+π) (2B)
Here, t is a time. fd is the driving frequency. A2(t) is an amplitude and changes with the time t. γ2(t) is a phase and changes with the time t. A phase difference between the driving voltage waveform V2A(t) and the driving voltage waveform V2B(t) is π (that is, 180°). In addition, φ is the phase difference between the driving voltage waveforms V1A(t) and V1B(t) and the driving voltage waveforms V2A(t) and V2B(t). In the present embodiment, φ=π/2 (that is, 90°) in order to cause the movable mirror 20 to perform a circular spiral rotation operation. A value of φ may be set to a value other than π/2. In a case in which φ is a value other than π/2, the movable mirror 20 performs an elliptical spiral rotation operation.
That is, the second driving signal is a periodic voltage signal whose amplitude and phase change with time. By applying the driving voltage waveforms V2A(t) and V2B(t) to the first movable portion 22A and the second movable portion 22B, the movable mirror 20 swings around the second axis a2 at a period Td(=1/fd).
The amplitude A1(t) and the phase γ1(t) of the first driving signal are represented by polynomials as shown in Equations (3) and (4), respectively. The amplitude A2(t) and the phase γ2(t) of the second driving signal are represented by polynomials as shown in Equations (5) and (6), respectively. In the present embodiment, the polynomial is a quadratic function, but it may be a cubic or higher function. The order of the polynomial is determined according to the accuracy of the spiral rotation operation required and the computing power of the processor. mkp and nkp are coefficients. Here, k is 0, 1, or 2. p is a or b. In the present embodiment, the phase γ2(t) is represented by a polynomial including the phase difference φ.
A
1(t)=m2at2+m1at+m0a (3)
γ1(t)=n2at2+n1at+n0a (4)
A
2(t)=m2bt2+m1bt+m0b (5)
γ2(t)+φ=n2bt2+n1bt+n0b (6)
The coefficients mkp and nkp are determined such that the swing amplitude around the first axis a1 and the swing amplitude around the second axis a2 of the movable mirror 20 change linearly with respect to the time (that is, a radius vector of the spiral trajectory changes at a constant rate).
For example, the coefficients mkp and nkp are determined by a method in which the driving controller 4 actually inputs the first driving signal and the second driving signal to the MMD 2 and adjustment is performed while confirming the deflection angle R of the movable mirror 20 with a sensor or the like.
Specifically, the target determination unit 50 determines the target scanning trajectory Ts for scanning a range necessary for projecting the target image P1 based on the variable magnification characteristic of the omnidirectional lens 8.
In addition, the target determination unit 50 determines the target light emission timing Tt by converting the image P1 into ON/OFF information of light emission with the angle Ra and the rotation angle θa as parameters.
The target determination unit 50 drives the MMD 2 by supplying the determined target scanning trajectory Ts to the MMD driver 44. The MMD driver 44 generates a first driving signal and a second driving signal for realizing the target scanning trajectory Ts by performing calculation based on the target scanning trajectory Ts supplied from the target determination unit 50.
The movable mirror 20 of the MMD 2 performs the spiral rotation operation by receiving the first driving signal and the second driving signal from the MMD driver 44. The position detection sensor 5 detects the deflection angle R and the rotation angle θ of the movable mirror 20 and outputs a detection value.
The trajectory calculation unit 51 calculates an actual trajectory of the movable mirror 20 based on the detection value output from the position detection sensor 5. Hereinafter, the trajectory calculated by the trajectory calculation unit 51 is referred to as a scanning trajectory calculation value Q.
In a case in which the position detection sensor 5 is a sensor such as a photodiode that detects the position of the movable mirror 20 at a specific time point, the trajectory calculation unit 51 generates the scanning trajectory calculation value Q by estimating a continuous trajectory based on the detection value at the specific time point. The scanning trajectory calculation value Q may include a trigger signal representing a start of one frame period.
The light emission timing determination unit 52 determines a light emission timing Tm based on the target light emission timing Tt determined by the target determination unit 50 and the scanning trajectory calculation value Q calculated by the trajectory calculation unit 51. Specifically, the light emission timing determination unit 52 determines the light emission timing Tm by associating the target light emission timing Tt with the scanning trajectory calculation value Q. In a case in which the scanning trajectory calculation value Q includes the trigger signal representing the start of one frame period, the light emission timing Tm is determined in accordance with the trigger signal. The light emission timing determination unit 52 may determine the light emission timing Tm by detecting an error between the target scanning trajectory Ts and the scanning trajectory calculation value Q and correcting the target light emission timing Tt based on the detected error.
The light emission timing determination unit 52 supplies the determined light emission timing Tm to the light source driver 43 to emit the laser light La to the light source 3 based on the light emission timing Tm. As a result, the image P1 is projected.
As described above, according to the present embodiment, since the omnidirectional lens 8 having the variable magnification characteristic is used, it is possible to project an image over a wide range. In addition, since the laser light La is deflected by the MMD 2 that can be driven at a high speed, it is possible to project an image with a sufficient resolution.
Next, an example of the image projection device 10 will be described. In this example, the image projection device 10 was created, and an image P2 shown in
A red laser was used as the light source 3. In addition, in the MMD 2 used in the example, since both a resonance frequency around the first axis a1 and a resonance frequency around the second axis a2 were about 1400 Hz, the driving frequency fd was set to about 1400 Hz. By utilizing the resonance phenomenon, a fluctuation range of the deflection angle R is expanded, so that the angle of view can be increased.
Therefore, in the cycle of 3≤K≤10, the laser light La is emitted from the light source 3 in a case in which the trajectory of the movable mirror 20 passes through each pixel. In the cycles of 3≤K≤5 and 8≤K≤10, the laser light La is emitted three times in each pixel. In the cycle of 6≤K≤7, the laser light La is emitted once in each pixel.
The image projection device 10 was driven using such a target scanning trajectory Ts and a target light emission timing Tt, and a projection plane was provided around the image projection device 10 for visual inspection. As a result, a projection image having two bright lines in the whole circumferential direction and a thin dark band between the two bright lines could be confirmed.
In this example, the target scanning trajectory Ts is set to pass through the same pixel in the image P2 a plurality of times in one frame period for projecting the image P2. In addition, the laser light La is emitted to the light source 3 in a case in which the trajectory of the movable mirror 20 passes through the pixel. Accordingly, the pixel can be displayed brighter than the other pixels.
In addition, in this example, the image includes a plurality of pixels with different numbers of times of passing of the target scanning trajectory Ts. This makes it possible to add contrast to the projection image.
The hardware configuration of the driving controller 4 described in the above-described embodiment can be variously modified. A processing unit of the driving controller 4 may be configured of one processor, or may be configured of a combination of two or more processors of the same type or different types (for example, a combination of a plurality of field programmable gate arrays (FPGAs) and/or a combination of a CPU and an FPGA).
All documents, patent applications, and technical standards mentioned in this specification are incorporated herein by reference to the same extent as in a case where each document, each patent application, and each technical standard are specifically and individually described by being incorporated by reference.
Number | Date | Country | Kind |
---|---|---|---|
2022-120942 | Jul 2022 | JP | national |