The present invention relates to an image projection device.
There have been known image projection devices such as head-mounted displays (HMDs) that directly project an image on the retina of the user by using a light beam emitted from a light source. In such image projection devices, a method referred to as Maxwellian view is used. In Maxwellian view, a light beam forming an image is converged near the pupil, and the image is then projected onto the retina. Because of this, HMDs that use Maxwellian view are expected to achieve focus-free properties.
In a see-through HMD with which an actual image of the outside world and a virtual image formed with a projected image can be viewed as superimposed images, it is known that the position of a lens is moved to change the focal length of the projected image so that the projected image can be clearly seen even in a case where actual images at different distances are viewed (Patent Document 1, for example).
Patent Document 1: Japanese Patent Application Publication No. 2010-139575
With an HMD using Maxwellian view there are cases where it is difficult to acquire focus-free properties, or the resolution that is felt by the user as to a projected image is low. Therefore, it is sometimes difficult for the user to view a high-quality image.
The present invention has been made in view of the above problem, and aims to provide users with high-quality images.
The present invention is an image projection device including: a light source that emits a light beam; an image input unit that inputs image data; a control unit that generates an image light beam based on the input image data, and controls emission of the image light beam from the light source: a scan unit that scans the image light beam emitted from the light source; and a projection optical member that illuminates a retina of an eyeball of a user with the image light beam scanned by the scan unit, and projects an image onto the retina, wherein a diameter of the image light beam at a time when the image light beam enters a cornea of the eyeball is not smaller than 310 μm and not larger than 800 μm.
In the above configuration, the image projection device may further include a diameter adjustment unit that is disposed in a light path for the image light beam, has an opening for blocking part of the image light beam and allowing the other part of the image light beam, and adjusts the diameter of the image light beam at the time when the image light beam enters the cornea.
In the above configuration, the image projection device may further include a collimator that is disposed in a light path for the image light beam between the light source and the scan unit, and collimates the image light beam to form substantially parallel light, and the diameter adjustment unit may be disposed in a light path for the image light beam between the collimator and the scan unit.
In the above configuration, the image light beam at the time of entering the cornea may be substantially parallel light.
In the above configuration, the image data input to the image input unit may be image data along a line of sight of the user, the image data having been captured by a camera.
In the above configuration, a user having an original visual acuity in a range of 0.04 to 1.2 may have an acquired visual acuity of 0.4 or higher, the acquired visual acuity being a visual acuity for the image based on the image data and projected onto the retina.
In the above configuration, the acquired visual acuity is substantially constant for the user having the original visual acuity in the range.
The present invention is an image projection device including: a light source that emits a light beam; an image input unit that inputs image data; a control unit that generates an image light beam based on the input image data, and controls emission of the image light beam from the light source; a scan unit that scans the image light beam emitted from the light source; a projection optical member that illuminates a retina of an eyeball of a user with the image light beam scanned by the scan unit, and projects an image onto the retina; and an adjustment unit that adjusts a numerical aperture of the image light beam at a time when the image light beam enters a cornea of the eyeball.
In the above configuration, the image projection device may further include a collimator that is disposed in a light path for the image light beam between the light source and the scan unit, and collimates the image light beam to form substantially parallel light, and the adjustment unit may adjust the numerical aperture of the image light beam at the time when the image light beam enters the cornea, by moving a position of the collimator in a direction parallel to a traveling direction of the image light beam at a time when the image light beam passes through the collimator.
In the above configuration, the adjustment unit adjusts the numerical aperture of the image light beam at the time when the image light beam enters the cornea, by moving a position of the light source in a direction parallel to a traveling direction of the image light beam.
In the above configuration, the image projection device may further include a collimator that is disposed in a light path for the image light beam between the light source and the scan unit, and collimate the image light beam to form substantially parallel light, and the control unit may control and cause the adjustment unit to change a distance between the light source and the collimator, in accordance with an instruction from the user.
In the above configuration, the image light beam at the time of entering the cornea may be diverging light.
In the above configuration, the image data input to the image input unit may be image data along a line of sight of the user, the image data having been captured by a camera.
In the above configuration, a diameter of the image light beam at the time of entering the cornea of the eyeball may be not smaller than 800 μm and not larger than 3000 μm.
In the above configuration, the user having an original visual acuity that may be not lower than 0.04 but is lower than 1.2 has an acquired visual acuity higher than the original visual acuity, the acquired visual acuity being a visual acuity for the image based on the image data and projected onto the retina.
The present invention can provide users with high-quality images.
The following is a description of embodiments of the present invention with reference to the drawings.
The image projection device 100 of the first embodiment is of an eyeglass type. An eyeglass includes a temple 10 and a lens 12. The temple 10 of the eyeglass is equipped with the light source 20, the collimator lens 22, the diameter adjustment unit 24, the mirror 26, and the scan mirror 28. The lens 12 is equipped with the projection mirror 30. The image input unit 32 and the control unit 34 may not be mounted on the eyeglasses, but may be mounted on an external device (such as a mobile terminal) or on the temple 10 of the eyeglass, for example.
Image data is input to the image input unit 32 from a camera 40 and/or a recorder or the like mounted on a bridge 14 of the eyeglass. In accordance with the input image data, the control unit 34 controls emission of laser light 50 from the light source 20. Under the control of the control unit 34, the light source 20 emits the laser light 50 of a single waveform or a plurality of waveforms, for example. The light source 20 may be a light source formed by integrating laser diode chips of red, green, and blue (RGB) and a tricolor combining device, for example. In this manner, the image data is converted into the laser light 50, which is an image light beam, by the light source 20.
The control unit 34 is a processor such as a central processing unit (CPU), for example. Where the camera 40 is directed along the line of sight of an eyeball 60 and is disposed at an appropriate position in the image projection device 100, line-of-sight image data captured by the camera 40 is input to the image input unit 32, and a line-of-sight image is projected onto a retina 62. Alternatively, an image input from a recorder or the like may be projected, or a camera image and an image from a recorder or the like may be superimposed on each other by the control unit 34 so that a so-called augmented reality (AR) image can be projected.
The collimator lens 22 collimates the laser light 50 emitted from the light source 20, to form substantially parallel laser light 50. Here, substantially parallel light is not necessarily perfectly parallel light, but may be slightly gathered light, for example.
The diameter adjustment unit 24 is disposed in the light path for the laser light 50 between the collimator lens 22 and the scan mirror 28. The laser light 50 collimated to be substantially parallel light by the collimator lens 22 enters the diameter adjustment unit 24. The diameter adjustment unit 24 has an opening 36 that blocks part of the laser light 50 and allows the rest of the laser light 50 to pass. The opening 36 has a substantially circular shape, for example. A substantially circular shape is not necessarily a perfectly circular shape, but may be a circular shape having a slightly deformed portion in its outer periphery or may be an elliptical shape. The center of the opening 36 almost coincides with the optical axis of the laser light 50. The diameter of the opening 36 is designed such that the laser light 50 falls within the range of 350 μm to 700 μm when the laser light 50 enters a cornea 68 of the eyeball 60 of the user. The opening 36 of the diameter adjustment unit 24 may be fixed at a certain size, or may be variable in size. For example, the size of the opening 36 of the diameter adjustment unit 24 may be changed by the control unit 24.
The mirror 26 reflects the laser light 50 that has passed through the diameter adjustment unit 24, toward the scan mirror 28. The scan mirror 28 two-dimensionally scans the laser light 50, to transform the laser light 50 into projection light for projecting an image onto the retina 62 of the eyeball 60 of the user. The scan mirror 28 is a micro electromechanical system (MEMS) mirror, for example, and two-dimensionally scans the laser light 50 in a horizontal direction and a vertical direction. The laser light 50 scanned by the scan mirror 28 enters the projection mirror 30 disposed on the surface of the lens 12 of the eyeglass on the side of the eyeball 60 of the user.
The projection mirror 30 illuminates the retina 62 of the eyeball 60 of the user with the laser light 50 scanned by the scan mirror 28, to project an image onto the retina 62. The user recognizes the image, by virtue of the persistence effect of the laser light 50 projected onto the retina 62. The projection mirror 30 is designed such that the convergence position of the laser light 50 scanned by the scan mirror 28 is near a pupil 64 in a region between the pupil 64 and the cornea 68, inside a crystalline lens 66, or near the pupil 64 in a region between the pupil 64 and the retina 62.
The laser light 50 scanned by the scan mirror 28 may be gathered before the projection mirror 30, and the laser light 50 as diverging light may enter the projection mirror 30. In this case, the laser light 50 is transformed into substantially parallel light and enters the cornea 68, by virtue of the light-gathering power of the projection mirror 30. The laser light 50 is gathered near the retina 62 by the crystalline lens 66.
The laser light 50 scanned by the scan mirror 28 may be gathered before the projection mirror 30, and the laser light 50 as diverging light may enter the projection mirror 30. In this case, the laser light 50 is transformed into substantially parallel light and enters the cornea 68, by virtue of the light-gathering power of the projection mirror 30. The laser light 50 is gathered near the retina 62 by a crystalline lens 66.
The laser light 50 scanned by the scan mirror 28 converges near the pupil 64, and accordingly, passes through a portion close to the center of the crystalline lens 66. Because of this, the laser light 50 is hardly affected by the lens function (or the power of vision) of the crystalline lens 66, and acquisition of focus-free properties is expected. However, the diameter of the laser light 50 passing through the crystalline lens 66 has a finite value, and therefore, is somewhat affected by the lens function of the crystalline lens 66. For this reason, it is considered that focus-free properties may be difficult to acquire, depending on the diameter of the laser light 50.
An experiment conducted with respect to focus-free properties is now described. The experiment was conducted on a plurality of users having different visual acuities of 0.04, 0.5, 0.9, and 1.2, and was carried out by measuring how good each user was able to visually recognize an image projected onto the retina 62 while the diameter of the laser light 50 entering the cornea 68 was varied. The image projected onto the retina 62 is an image that has a horizontal viewing angle of 20 degrees, a screen aspect ratio of 16:9, and a valid vertical resolution of 720. For example, if the length of the eyeball is 24 mm, the size of the image projected onto the retina 62 is 5700 μm in the horizontal direction and 3200 μm in the vertical direction.
As shown in
Next, a simulation performed with respect to focus-free properties is described.
In the simulation, the shape (curvature) of the crystalline lens 66 was varied, so that the focal length was varied, and original visual acuities were set. As for acquired visual acuities, the actual measurement value obtained in the case where the diameter of the laser light 50 entering the cornea 68 was 470 μm as shown in
As shown in
Therefore, in the first embodiment, the diameter adjustment unit 24 is disposed in the light path for the laser light 50 between the collimator lens 22 and the scan mirror 28, so that the diameter of the laser light 50 entering the cornea 68 is adjusted to a value not smaller than 310 μm and not greater than 800 μm by the diameter adjustment unit 24. As can be seen from the actual measurement value results described with reference to
The image data to be input to the image input unit 32 may be image data along the line of sight of the user that is captured by the camera 40. In this case, as a line-of-sight image is projected onto the retina 62, the user can see the line-of-sight image with an acquired visual acuity of 0.4 or higher. It should be noted that the image data along the line of sight of the user that is to be input to the image input unit 32 is not necessarily image data captured by the camera 40, and may be image data captured by a camera of an external device (such as a mobile terminal), for example.
Further, as can be seen from the results shown in
As can be seen from
It is preferable to acquire a high visual acuity, while also acquiring focus-free properties. As shown in
According to the first embodiment, the diameter adjustment unit 24 that adjusts the diameter of the laser light 50 entering the cornea 68 is provided, as shown in
In the example case described in the first embodiment, the diameter of the laser light 50 entering the cornea 68 is adjusted by controlling the opening 36 of the diameter adjustment unit 24. However, the present invention is not limited to this case. For example, the diameter adjustment unit 24 may be disposed at a portion where the laser light 50 is not substantially parallel light, and the diameter adjustment unit 24 may be moved forward and backward relative to the laser light 50, to adjust the diameter of the laser light 50 entering the cornea 68.
As can be seen from the results shown in
An experiment conducted on a plurality of users having different visual acuities is now described. This experiment was conducted to examine how the acquired visual acuity of each user would change, by varying the numerical aperture of the laser light 50 entering the cornea 68. The experiment was conducted on a plurality of users having different visual acuities of 0.04, 0.5, 0.9, and 1.2, and was carried out by measuring how good each user was able to visually recognize an image projected onto the retina 62 while the laser light 50 with a diameter of 1490 mm is entered the cornea 68 and the numerical aperture of the laser light 50 entering the cornea 68 was varied. The image projected onto the retina 62 is an image that has a horizontal viewing angle of 20 degrees, a screen aspect ratio of 16:9, and a valid vertical resolution of 720, as in the first embodiment.
As shown in
In the case where the numerical aperture of the laser light 50 entering the cornea 68 was optimized for the user having the original visual acuity of 0.9, the optimum value of the numerical aperture was −0.0012, and the acquired visual acuity of the user having the original visual acuity of 0.9 was about 1.2. In the case where the numerical aperture of the laser light 50 entering the cornea 68 was optimized for the user having the original visual acuity of 1.2, the optimum value of the numerical aperture was −0.0007, and the acquired visual acuity of the user having the original visual acuity of 1.2 was about 1.2. In the cases where the original visual acuity was 0.9 and 1.2, the graphs of the acquired visual acuity with respect to the original visual acuity became substantially identical. As the original visual acuity became lower than 0.9, the acquired visual acuity became lower than 1.2.
As can be seen from the experiment results shown in
Next, a simulation performed to examine the relationship between original visual acuity and acquired visual acuity in a case where the laser light entering the cornea was varied is described. The simulation was performed with the use of the eyeball model 80 described with reference to
As shown in
As shown in
As shown in
Accordingly, as can also be seen from the simulation results shown in
Therefore, the second embodiment includes the adjustment unit 38 that adjusts the numerical aperture of the laser light 50 entering the cornea 68. With this, the user can acquire a high visual acuity (or a feeling of high resolution) for an image projected onto the retina 62. Thus, the user can be provided with a high-quality image. As can be seen from the results shown in
The image data to be input to the image input unit 32 may be image data along the line of sight of the user that is captured by the camera 40. In this case, as a line-of-sight image is projected onto the retina 62, the user can see the line-of-sight image with a high acquired visual acuity. It should be noted that the image data along the line of sight of the user that is to be input to the image input unit 32 is not necessarily image data captured by the camera 40, and may be image data captured by a camera of an external device (such as a mobile terminal), for example.
Meanwhile, the diameter of the laser light 50 entering the cornea 68 is preferably not smaller than 800 μm and not larger than 3000 μm. This is because, as can be seen from the results shown in
Further, as can be seen from the results shown in
As can be seen from the results shown in
Further, according to the second embodiment, the adjustment unit 38 adjusts the numerical aperture of the laser light 50 entering the cornea 68, by moving the position of the collimator lens 22 in a direction parallel to the traveling direction of the laser light 50 passing through the collimator lens 22 and thus changing the distance between the light source 20 and the collimator lens 22. In this manner, the numerical aperture of the laser light 50 can be easily adjusted. The adjustment unit 38 may adjust the numerical aperture of the laser light 50 entering the cornea 68 by some other technique. For example, the adjustment unit 38 may adjust the numerical aperture of the laser light 50 by moving the position of the light source 20 in a direction parallel to the traveling direction of the laser light 50 and thus changing the distance between the light source 20 and the collimator lens 22, or may adjust the numerical aperture of the laser light 50 by moving both the collimator lens 22 and the light source 20.
The user may directly touch the adjustment unit 38 to move the position of the collimator lens 22. However, fine position adjustment is to be performed, and therefore, it is preferable that the control unit 34 controls and causes the adjustment unit 38 to move the position of the collimator lens 22, in accordance with an instruction from the user.
In the first and second embodiments, the projection mirror 30 may have an adjustable surface, or may be a diffractive element. Alternatively, the projection mirror 30 may be a half mirror capable of transmitting light along the line of sight of the eyeball 60, or may be a total reflection mirror through which light does not pass. If the projection mirror 30 is a half mirror, an actual image along the line of sight can pass through the projection mirror 30, and be visually recognized together with the image formed with the laser light 50. If the projection mirror 30 is a total reflection mirror, only the image formed with the laser light 50 can be visually recognized. A component that has the functions of the projection mirror 30 is not necessarily a mirror but may be a lens that has an optical function of gathering the laser light 50 toward the cornea 68 and projecting the laser light 50 onto the retina 62. In a case where such a lens is used, a mirror that does not gather light is disposed in the position of the projection mirror 30, and a lens is disposed on the mirror on the side of the eyeball 60. Alternatively, the layout of the optical components such as the light source 20 and the scan mirror 28 may be adjusted so that the laser light 50 can be projected onto the retina 62 only by a lens. Likewise, the collimator lens 22 is not necessarily a lens, and may be a mirror or a diffractive element having the optical characteristics of a collimator that collimates the laser light 50 to form substantially parallel light. In this case, an appropriate layout can also be set in accordance with the light path for the laser light 50.
In the examples described in the first and second embodiments, each image projection device is an eyeglass-type HMD. However, an image projection device may not be an HMD. In the above described examples, an image is projected onto the retina 62 of an eyeball 60. However, an image may be projected onto the retinas 62 of both eyeballs 60. Further, in the above described examples, the scan mirror 28 serves as a scan unit (scanner). However, the scan unit (scanner) may be any component capable of scanning light beams. For example, some other component, such as potassium tantalate niobate (KTN) crystals that are an electro-optic material, may be used as the scan unit (scanner). Although laser light has been described as an example of light beams, some other kind of light may be used.
Although embodiments of the present invention have been specifically described, the present invention is not limited to those particular embodiments, and various changes and modifications may be made to them without departing from the scope of the invention disclosed in the claims.
Number | Date | Country | Kind |
---|---|---|---|
JP2017-008460 | Jan 2017 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2017/036314 | 10/5/2017 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2018/135046 | 7/26/2018 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6252565 | Hall | Jun 2001 | B1 |
8403490 | Sugiyama | Mar 2013 | B2 |
20080151185 | Saito | Jun 2008 | A1 |
20100060551 | Sugiyama | Mar 2010 | A1 |
20100091027 | Oyama | Apr 2010 | A1 |
20100097580 | Yamamoto et al. | Apr 2010 | A1 |
20140049831 | Takeda | Feb 2014 | A1 |
20140126033 | Hirata | May 2014 | A1 |
20140139404 | Takeda | May 2014 | A1 |
20140306866 | Miller | Oct 2014 | A1 |
20150062345 | Kusanagi | Mar 2015 | A1 |
20150235435 | Miller | Aug 2015 | A1 |
20150277115 | Inamoto | Oct 2015 | A1 |
20180067326 | Yonekubo | Mar 2018 | A1 |
Number | Date | Country |
---|---|---|
101589329 | Nov 2009 | CN |
101726854 | Jun 2010 | CN |
103597399 | Feb 2014 | CN |
103837985 | Jun 2014 | CN |
2006-251509 | Sep 2006 | JP |
2008-145701 | Jun 2008 | JP |
2009-122550 | Jun 2009 | JP |
2010-134052 | Jun 2010 | JP |
2010-139575 | Jun 2010 | JP |
2014-038239 | Feb 2014 | JP |
2016-522463 | Jul 2016 | JP |
2009041055 | Apr 2009 | WO |
2016143245 | Sep 2016 | WO |
WO-2016143245 | Sep 2016 | WO |
Entry |
---|
Written Opinion of the International Searching Authority for International Application No. PCT/JP2017/036314 dated Jan. 9, 2018 (10 pages translation). |
Extended European Search Report for corresponding European Patent Application No. 17892869.3 dated Dec. 4, 2019 (9 sheets). |
Y. Murai, et al.; “Low Vision Aid through Laser Retina Imaging: Toward Building Eyesightaid”; IEICE Technical Report; vol. 114; No. 512; Mar. 6, 2015; pp. 165-170 (2 cover pages, 6 pages, 4 pages translation, 12 pages total)/Cited in the International Search Report dated Jan. 9, 2018 for Int'l App. No. PCT/JP2017/036314. |
Office Action of Japanese Patent Application No. 2017-008460: Notification of Reasons for Refusal dated Jun. 27, 2017 (5 pages, 4 pages translation, 9 pages total). |
Office Action of Japanese Patent Application No. 2017-008460: Notice of Allowance dated Sep. 12, 2017 3 pages, 2 pages translation, 5 pages total). |
International Search Report of the International Searching Authority for International Application No. PCT/JP2017/036314 dated Jan. 9, 2018 (2 pages, 2 pages translation, 4 pages total). |
Written Opinion of the International Searching Authority for International Application No. PCT/JP2017/036314 dated Jan. 9, 2018 (6 pages). |
Office Action of corresponding Chinese Patent Application No. 201780083486.1: First Notification of Reasons for Refusal dated Dec. 2020 (9 sheets, 5 sheets translation, 14 sheets total). |
Office Action in counterpart Chinese Patent Application No. 201780083486.1 dated Jul. 27, 2021: Second Notification of Reasons for Refusal (7 sheets, 6 sheets translation, 13 sheets total). |
Office Action of corresponding Chinese Patent Application No. 201780083486.1 dated Mar. 28, 2022 (4 sheets, 6 sheets translation, 10 sheets total). |
Number | Date | Country | |
---|---|---|---|
20190353897 A1 | Nov 2019 | US |