Patent Grant
11755152
This application is a U.S. National Phase of International Patent Application No. PCT/JP2018/005231 filed on Feb. 15, 2018, which claims priority benefit of Japanese Patent Application No. JP 2017-057219 filed in the Japan Patent Office on Mar. 23, 2017. Each of the above-referenced applications is hereby incorporated herein by reference in its entirety.
The present disclosure relates to a projector with a detection function having an image projection function and an object detection function.
In recent years, in a smartphone, a tablet terminal, etc., the use of a touch panel has allowed for touch operation responding to human intuition. In turn, in a projector that projects images on a screen, a technology has been developed that enables the touch operation with the use of LLP (Laser Light Plane) method. The LLP method uses a beam irradiation apparatus including a laser light source to irradiate a projection plane of the projector with a membrane-shaped irradiation beam as illuminating light for detection in a manner of covering the projection plane with a narrow clearance left between. When a detection object such as a finger moves across the membrane-shaped irradiation beam, scattered light is generated at the location that the object moves across. The scattered light is detected as detection light by the use of a camera. This makes it possible to achieve the touch operation on the basis of determination of an object position. In the LLP method, an infrared light beam is typically used to make the illuminating light for detection invisible.
In a case where a touch operation function is achieved using the LLP method, it is quite important that an intensity distribution of the irradiation beam to be used as the illuminating light for detection is stable in terms of the accuracy of touch detection and the stability of a detection signal.
It is desirable to provide a projector with a detection function that allows for stabilizing the intensity distribution of the irradiation beam.
A projector with a detection function according to an embodiment of the present disclosure includes: a projection optical system that projects image light on a projection plane; an irradiation optical system that generates an irradiation beam on the basis of light obtained from a light source, and outputs the irradiation beam, in which the irradiation beam is used for detection of a detection object on the projection plane, and the detection object is configured to be detected; an imaging device that scattered light of the irradiation beam derived from the detection object enters; and an illumination control section that performs temporal light-quantity modulation of the light obtained from the light source to cause coherence of the irradiation beam to be reduced.
In the projector with the detection function according to the embodiment of the present disclosure, the light obtained from the light source that serves as a base of the irradiation beam to be used for detection of the detection object is subjected to the temporal light-quantity modulation to cause the coherence of the irradiation beam to be reduced.
The projector with the detection function according to the embodiment of the present disclosure performs the temporal light-quantity modulation of the light obtained from the light source that serves as a base of the irradiation beam to be used for detection of the detection object to cause the coherence of the irradiation beam to be reduced, which makes it possible to stabilize the intensity distribution of the irradiation beam.
It is to be noted that effects described above are not necessarily limitative, and any of effects described in the present disclosure may be provided.
Hereinafter, some embodiments of the present disclosure will be described in detail with reference to the drawings. It is to be noted that descriptions are given in the following order.
1. First Embodiment
1.1 Overview of Beam Irradiation Apparatus (
1.2 Overview of Projector with Detection Function (
1.3 Description of Technique of Reducing Coherence of Irradiation Beam (
1.4 Effects
2. Other Embodiments
The beam irradiation apparatus includes an infrared light source 200, and an irradiation optical system that outputs an irradiation beam obtained by expanding light obtained from the infrared light source 200 in a one-dimensional direction.
The infrared light source 200 is a laser light source that emits infrared light.
The irradiation optical system includes a plurality of optical elements disposed on an optical path of the light obtained from the infrared light source 200. In a configuration example in
Of the plurality of these optical elements, the lens elements excluding the collimator lens L11 take cylindrical shapes, having no lens actions in the direction orthogonal to the one-dimensional direction in which a beam spreads. The one-dimensional direction in which the beam spreads is a direction in a plane of paper in
In the irradiation optical system illustrated in
The polarization separation element 11 reflects a first polarized component (for example, an S-polarized component) of the light obtained from the infrared light source 200 toward a direction in which the cylindrical lens array L13, the mirror 13, etc. are disposed. The polarization separation element 11 also outputs a second polarized component (for example, a P-polarized component) of the light that is reflected by the mirror 13 to re-enter the cylindrical lens array L13, etc. toward the first irradiation lens L21 and the second irradiation lens L22 through the relay lens L18. The λ/4 plate 12 is provided for conversion between the first polarized component and the second polarized component.
The first irradiation lens L21 and the second irradiation lens L22 are wide-angle lenses each having a negative refractive power in the one-dimensional direction, and a light-expanding action only in the one-dimensional direction. The first irradiation lens L21 and the second irradiation lens L22 expand the light outgoing from the polarization separation element 11 in the one-dimensional direction through the relay lens L18 to output the resulting light as an irradiation beam.
Each of
The projector with the detection function according to the present embodiment has a function of a projector that projects images on a projection plane 30, and a touch detection (a position detection) function to detect the position and movement of an object 71 whose position is to be detected such as a human finger, for example, on the projection plane 30.
It is to be noted that the projection plane 30 may be a screen for projection use. Alternatively, the projection plane 30 may be any of a desktop surface, a floor surface, etc. Further, the projection plane 30 may be any of a wall surface, etc.
As illustrated in
The image projecting illumination section 1 serves as a first illumination section that outputs image projecting illumination light 41 as first illumination light. The light valve 21 is illuminated with the image projecting illumination light 41 that is outputted from the image projecting illumination section 1 through the polarization separation element 23.
The image projecting illumination section 1 includes an illumination optical system and a light source section, both of which are unillustrated. The light source section includes a laser light source that emits light having the spectra of R (red), G (green), and B (blue), for example. The light source section includes, for example, a blue laser to emit B light, a green laser to emit G light, and a red laser to emit R light. The light emission of each of the red laser, the green laser, and the blue laser may be controlled in a field sequential method by an unillustrated light emission control section, for example.
The illumination optical system of the image projecting illumination section 1 generates the image projecting illumination light 41 having the spectra of RGB on the basis of light obtained from the light source section.
The light valve 21 modulates the image projecting illumination light 41 on the basis of image data provided from the display control section 8 to generate image light 44. The light valve 21 is a reflective liquid crystal device such as LCOS (Liquid Crystal On Silicon), for example. The image light 44 that is generated by the light valve 21 is projected on the projection plane 30 through the polarization separation element 23 and the projection optical system 4.
The position detecting illumination section 2 serves as a second illumination section that outputs position detecting illumination light 42 serving as second illumination light to be used for position detection of the object 71 whose position is to be detected on the projection plane 30. The position detecting illumination section 2 is provided, for example, at the bottom of a main unit 100. The position detecting illumination section 2 outputs the position detecting illumination light 42 that is substantially collimated relative to the projection plane 30 in such a manner that a projection area 31 of the image light 44 on the projection plane 30 is at least covered with the position detecting illumination light 42 from a predetermined height. The position detecting illumination section 2 may include the infrared light source 200 and the irradiation optical system in the beam irradiation apparatus illustrated in
The wavelength band of the position detecting illumination light 42 is different from the wavelength band of the image projecting illumination light 41. The wavelength band of the image projecting illumination light 41 is a visible range, and the wavelength band of the position detecting illumination light 42 is a near-infrared range.
The detection image processing section 6 is an image processing section that performs position detection of the object 71 whose position is to be detected on the basis of an imaging result of the imaging section 5. For example, the detection image processing section 6 analyzes a detection signal from the imaging section 5 to acquire positional data (coordinate data) of a detected object. The detection image processing section 6 may have a function to analyze not only the position of the object 71 whose position is to be detected, but also movement such as gesture motion of the object 71 whose position is to be detected.
The illumination control section 7 is set to perform control of switching between On (emission) and Off (non-emission) of the position detecting illumination light 42 to be performed by the position detecting illumination section 2. Further, the illumination control section 7 performs control to perform temporal light-quantity modulation of light obtained from a light source (the infrared light source 200 in
The projection optical system 4 includes a projection lens 24. The projection lens 24 may be an ultrashort focus lens. In addition to a function for projecting images, the projection optical system 4 has a function of an imaging optical system for position detection. The image light 44 generated by the light valve 21 enters the projection optical system 4, and scattered light La of the position detecting illumination light 42 derived from the object 71 whose position is to be detected is taken in the projection optical system 4 from the projection plane 30 side.
The imaging section 5 includes an imaging device 22, an imaging optical system 25, and an exposure control section 26.
The imaging device 22 includes a solid-state imaging device such as CMOS (complementary metal-oxide semiconductor) and CCD (charge-coupled device). The imaging device 22 is disposed at a position that is optically conjugated to the projection plane 30. Further, the imaging device 22 is also disposed at a position that is optically conjugated to the light valve 21. More specifically, in a case where the light valve 21 is a reflective liquid crystal device, a display surface (a liquid crystal surface) for creating images thereon and an imaging surface of the imaging device 22 are disposed at positions that are optically conjugated to each other. The scattered light La of the position detecting illumination light 42 enters the imaging device 22 through the projection optical system 4 and the polarization separation element 23. The imaging device 22 allows for imaging by using at least substantially the same area as a projection area 31 on the projection plane 30 as an imaging area.
The imaging optical system 25 is disposed between an optical-conjugated plane of the light valve 21 and the imaging device 22. The imaging optical system 25 includes, for example, a reducing optical system including a plurality of relay lenses, and a bandpass filter. Disposing the reducing optical system including the relay lenses as the imaging optical system 25 makes it possible to provide a position that is optically conjugated to the light valve 21 at a distance farther away from a conjugated plane. Further, disposing the reducing optical system allows for making the size of the imaging device 22 smaller than the size of the light valve 21, while disposing the imaging device 22 at a position that is optically conjugated to the light valve 21.
The exposure control section 26 controls an exposure period and exposure timing (shutter timing) of the imaging device 22. For example, in a case where the imaging device 22 is CCD, etc., the exposure control section 26 controls exposure of the imaging device 22 in a global shutter method. Alternatively, for example, in a case where the imaging device 22 is CMOS, etc., the exposure control section 26 controls exposure of the imaging device 22 in a rolling shutter method.
The polarization separation element 23 is a polarizing beam splitter having four optical surfaces, for example. The image projecting illumination light 41 from the image projecting illumination section 1 enters a first optical surface of the polarization separation element 23. The light valve 21 is disposed on a second optical surface side of the polarization separation element 23. The imaging section 5 is disposed on a third optical surface side of the polarization separation element 23. The projection optical system 4 is disposed on a fourth optical surface side of the polarization separation element 23.
The polarization separation element 23 separates incoming light into a first polarized component (for example, an S-polarized component) and a second polarized component (for example, a P-polarized component) to output the separated light in a different direction. The polarization separation element 23 causes the specific first polarized component to be selectively reflected, and causes the specific second polarized component to be selectively transmitted. The polarization separation element 23 reflects the first polarized component included in the image projecting illumination light 41 that enters the first optical surface toward the light valve 21. The light that is modulated as the second polarized component by the light valve 21 is outputted from the fourth optical surface side of the polarization separation element 23 to enter the projection optical system 4 as the image light 44.
Further, the scattered light La of the position detecting illumination light 42 enters the fourth optical surface side of the polarization separation element 23 through the projection optical system 4. The polarization separation element 23 reflects the first polarized component included in the scattered light La of the position detecting illumination light 42 toward the imaging section 5 through the third optical surface.
(Operation of Position Detection)
As illustrated in
The projector with the detection function using the LLP method as described above adopts a method that irradiates the projection plane 30, with a narrow clearance left between, with an irradiation beam acting as the position detecting illumination light 42 to detect only the object 71 whose position is to be detected and which cuts across the irradiation beam, and uses a laser light source as the infrared light source 200. Further, the cylindrical lens array L13 is disposed in the irradiation optical system of the beam irradiation apparatus to overlap light fluxes of light obtained from the infrared light source 200, thereby uniformizing light. In this case, the infrared light source 200 is a laser light source, and thus fine strong/weak patterns are generated due to interference between the light fluxes in the process of overlapping the light fluxes. In a state of this non-uniform intensity distribution, a whole detection area of the object 71 whose position is to be detected is irradiated with expanded light as the irradiation beam. Therefore, at a detecting position of the object 71 whose position is to be detected, the positional dependence of object detection can take place in the non-negligible order.
Accordingly, it is desirable that the non-uniformity in the intensity distribution of the irradiation beam be reduced to suppress the positional dependence of object detection.
Here, to achieve stable touch detection, the light quantity of the irradiation beam has to be stable in terms of plane and time. However, in a case where the infrared light source 200 acting as a light source for the irradiation beam is used as a laser light source, a laser beam has high coherence, and thus unevenness of the intensity is likely to be caused in terms of plane and time due to light interference inside the irradiation optical system, etc.
Therefore, in the present embodiment, by varying a drive current of the infrared light source 200 to perform the light-quantity modulation, an oscillating state of the laser beam is intentionally rendered unstable, thereby reducing the coherence. This leads to reduction in the unevenness of the intensity that is caused by interference of the laser beam. The illumination control section 7 (
Here, in a case where the light-quantity modulation is performed, if a global maximum of the light quantity is 100%; a global minimum of the light quantity is x %; and a duty cycle of the global minimum side of the light quantity is y %, the average light quantity is represented by an expression given below.
Average light quantity[%]=100*(100−y)/100+x*y/100
As a matter of course, lowering the global minimum of the light quantity, or raising the duty cycle results in a decrease in the average light quantity. With such a decrease in the average light quantity, a captured image is darkened. To mitigate this negative impact, it is desirable to set the duty cycle at 50%, and the global minimum of the light quantity at 50% or more. In this case, the average light quantity reaches 75% or more, and a decreasing rate of the light quantity in performing the light-quantity modulation remains at 25% or less.
Incidentally, at the time of object detection, the projector with the detection function detects the quantity of return light of the irradiation beam from the object 71 whose position is to be detected such as a finger, and thus, in association with the light-quantity modulation of the light obtained from the infrared light source 200, the modulated light quantity can be detected as the quantity of return light from the object 71 whose position is to be detected. To mitigate this negative impact, it is sufficient to perform the light-quantity modulation at sufficiently faster frequency than an exposure period of the imaging device 22, or reduce a light-quantity modulation width.
However, since an effect of reducing the coherence of the infrared light source 200 to be achieved by the light-quantity modulation relates with a light-quantity modulation frequency and the light-quantity modulation width, the sufficient effect of reducing the coherence is unachievable in some cases if the light-quantity modulation frequency and the light-quantity modulation width are set at any values. Further, because of restrictions in terms of hardware, there can also be a case where the light-quantity modulation is unachievable at sufficiently fast frequency.
Next, the description is provided on workings of a negative impact associated with the light-quantity modulation. Each of
Each of
(Case of Global Shutter Method)
In a case where the imaging device 22 is, for example, CCD or any other device, the exposure control section 26 (
In a case of the global shutter method, as illustrated in
(Case of Rolling Shutter Method)
In a case where the imaging device 22 is, for example, CMOS or any other device, the exposure control section 26 performs the exposure control of the imaging device 22 in a rolling shutter method.
In a case where the imaging device 22 is CMOS or any other device, the rolling shutter method is typically available that releases a shutter sequentially in terms of time for pixels in a vertical direction. In this case, there is no taking in the whole captured image at the simultaneous shutter timing, which disables synchronization.
Therefore, a case is considered where the two-valued light-quantity modulation is performed at a duty cycle of 50% as illustrated in
As seen from the graph, in a case where a relationship given below is established in a case where the exposure period of the imaging device 22 is T, and the light-quantity modulation cycle period is t, the modulation leakage takes a local minimum. In other words, even in a case where the modulation cycle period of the light-quantity modulation and the shutter timing are not synchronized with each other, optimization of a modulation frequency makes it possible to mitigate the negative impact of the light-quantity modulation.
t=T/n
(where, n is a positive integer. n=1, 2, 3, etc.)
This is because, in a case where the exposure period T is an integer multiple of the modulation cycle period t, integral values of the light quantity within the exposure period (portions of halftone dot regions in the drawings) are fixed irrespective of any shutter timing, as seen from
In the above, the description is provided on a case where the light-quantity modulation uses two values, and the duty cycle is 50%. However, even in a case where a light-quantity modulation pattern has multiple values and any value of the duty cycle as illustrated in
As described above, according to the present embodiment, light obtained from a light source that serves as a base of an irradiation beam to be used for detection of a detection object is subjected to temporal light-quantity modulation to cause coherence of the irradiation beam to be reduced, which makes it possible to stabilize the intensity distribution of the irradiation beam. Performing the light-quantity modulation makes it possible to reduce planar and temporal unevenness of the light quantity of the irradiation beam from a laser light source, thereby allowing for stable object detection.
In particular, in a case of the global shutter method, synchronization of the shutter timing with the modulation cycle period makes it also possible to mitigate the negative impact associated with the light-quantity modulation. Further, even in a case where the synchronization of the shutter timing with the modulation cycle period is unattainable, setting a cycle of the light-quantity modulation at an optimal value depending on the exposure period like the rolling shutter method makes it possible to mitigate the negative impact associated with the light-quantity modulation.
It is to be noted that the effects described herein are merely exemplified and non-limiting, and other effects may be further included.
The technology of the present disclosure is not limited to the descriptions of the respective embodiments in the above, but it is possible to make various modifications.
For example, the present technology may also be configured as follows.
(1)
A projector with a detection function, the projector including:
a projection optical system that projects image light on a projection plane;
an irradiation optical system that generates an irradiation beam on the basis of light obtained from a light source, and outputs the irradiation beam, the irradiation beam being used for detection of a detection object on the projection plane, the detection object being configured to be detected;
an imaging device that scattered light of the irradiation beam derived from the detection object enters; and
an illumination control section that performs temporal light-quantity modulation of the light obtained from the light source to cause coherence of the irradiation beam to be reduced.
(2)
The projector with the detection function according to (1), further including an exposure control section that performs exposure control based on a global shutter method for the imaging device to cause an exposure period to be synchronized with a modulation cycle period of the light-quantity modulation.
(3)
The projector with the detection function according to (1), in which, when an exposure period of the imaging device is T, and a modulation cycle period of the light-quantity modulation is t, the illumination control section performs the light-quantity modulation to satisfy t=T/n (where n is a positive integer).
(4)
The projector with the detection function according to any one of (1) to (3), in which the illumination control section performs the light-quantity modulation to cause a global minimum of light quantity to become 50% or more when a duty cycle is 50% and a global maximum of the light quantity is 100%.
(5)
The projector with the detection function according to any one of (1) to (4), in which the irradiation optical system expands the light obtained from the light source in a one-dimensional direction, and outputs light that is substantially collimated relative to the projection plane as the irradiation beam.
(6)
The projector with the detection function according to any one of (1) to (5), further including an image processing section that performs position detection of the detection object on the basis of an imaging result obtained from the imaging device.
This application claims the priority on the basis of Japanese Patent Application No. 2017-057219 filed on Mar. 23, 2017 with Japan Patent Office, the entire contents of which are incorporated in this application by reference.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations, and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| JP2017-057219 | Mar 2017 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2018/005231 | 2/15/2018 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2018/173559 | 9/27/2018 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20020067341 | Kobayashi | Jun 2002 | A1 |
| 20090067459 | Mizuuchi | Mar 2009 | A1 |
| 20090174657 | Miyazaki | Jul 2009 | A1 |
| 20090284713 | Silverstein | Nov 2009 | A1 |
| 20110251905 | Lawrence | Oct 2011 | A1 |
| 20140362052 | McCaughan | Dec 2014 | A1 |
| 20160196005 | Kaneda | Jul 2016 | A1 |
| 20160277719 | Tan et al. | Sep 2016 | A1 |
| 20170123218 | Stigwall | May 2017 | A1 |
| 20170228057 | Kaneda | Aug 2017 | A1 |
| 20180203248 | op 't Root | Jul 2018 | A1 |
| 20180303573 | Trulson | Oct 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 105474092 | Apr 2016 | CN |
| 106415439 | Feb 2017 | CN |
| 106716318 | May 2017 | CN |
| 3039483 | Jul 2016 | EP |
| 3072032 | Sep 2016 | EP |
| 3227766 | Oct 2017 | EP |
| 2014-529925 | Nov 2014 | JP |
| 2015-064550 | Apr 2015 | JP |
| 2015-079214 | Apr 2015 | JP |
| 2016-057426 | Apr 2016 | JP |
| 2016-114991 | Jun 2016 | JP |
| 6372266 | Aug 2018 | JP |
| 201523396 | Jun 2015 | TW |
| 2015029365 | Mar 2015 | WO |
| 2015076811 | May 2015 | WO |
| WO 2015029365 | May 2015 | WO |
| 2016038839 | Mar 2016 | WO |
| 2016067397 | May 2016 | WO |
| 2016125384 | Aug 2016 | WO |
| Entry |
|---|
| Extended European Search Report of EP Application No. 18771652.7, dated Mar. 9, 2020, 08 pages. |
| International Search Report and Written Opinion of PCT Application No. PCT/JP2018/005231, dated Apr. 24, 2018, 10 pages of ISRWO. |
| Office Action for JP Patent Application No. 2019-507434, dated Jul. 27, 2021, 8 pages of Office Action and 4 pages of English Translation. |
| Number | Date | Country | |
|---|---|---|---|
| 20200019277 A1 | Jan 2020 | US |
