Patent Grant
12003898
This application claims the priority benefit of China application serial no. 202111149544.0, filed on Sep. 29, 2021. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
The invention relates to a display device and a display method, and particularly relates to a projector and a projection method applied to the projector.
Regarding a conventional projector, a projection image may have keystone distortion or the projection image may be out of focus due to that a placement position of the projector is shifted relative to a projection surface, and even a part of the content of the projection image may be distorted or shifted due to that the projection surface is in an uneven state. Particularly, if the projector is an ultra-short throw projector, a slight distance error between the projector and the projection surface may cause huge distortion and deformation of the projection image, and therefore a user cannot view a correct projection image.
The information disclosed in this Background section is only for enhancement of understanding of the background of the described technology and therefore it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art. Further, the information disclosed in the Background section does not mean that one or more problems to be resolved by one or more embodiments of the invention was acknowledged by a person of ordinary skill in the art.
The invention is directed to a projector and a projection method adapted to provide a good projection effect.
Other objects and advantages of the invention may be further illustrated by the technical features broadly embodied and described as follows.
In order to achieve one or a portion of or all of the objects or other objects, an embodiment of the invention provides a projector including a control device, a projection optical engine, a distance sensing device, and an image capturing device. The control device is configured to output first image data. The projection optical engine is coupled to the control device, and is configured to receive the first image data to project a first projection image to a projection surface according to the first image data. The distance sensing device is coupled to the control device, and is configured to sense a plurality of distance parameters of a projection area. The first projection image is displayed in the projection area. The image capturing device is coupled to the control device, and is configured to capture the first projection image to obtain a first captured image. The control device performs at least one of a keystone correction operation and a leveling correction operation on the first image data according to at least one of the plurality of distance parameters and the first captured image. The projection optical engine projects a second projection image to the projection surface according to corrected first image data. The control device obtains a second captured image including the second projection image through the image capturing device, and analyzes the second captured image to project current projection image size information in the second projection image.
In an embodiment of the invention, the control device includes an image processor and a microcontroller. The image processor is coupled to the projection optical engine. The microcontroller is coupled to the distance sensing device, the image capturing device, and the image processor, and is configured to generate a correction signal according to at least one of the distance parameters and the first captured image, and output the correction signal to the image processor, and the image processor performs the keystone correction operation and the leveling correction operation on the first image data according to the correction signal.
In an embodiment of the invention, the microcontroller is further configured to analyze the second captured image to generate the current projection image size information, the control device outputs the current projection image size information to the projection optical engine, and the projection optical engine displays the current projection image size information in the second projection image.
In an embodiment of the invention, the keystone correction operation includes performing keystone correction on the first image data in at least one of a horizontal direction and a vertical direction.
In an embodiment of the invention, the control device obtains at least one of a first inclination angle in the vertical direction and a second inclination angle in the horizontal direction between the projector and the projection surface according to at least one of the distance parameters and the first captured image, and performs the keystone correction operation on the first image data according to at least one of the first inclination angle and the second inclination angle.
In an embodiment of the invention, a sensing range of the distance sensing device on the projection surface covers the projection area, and the control device determines whether the projection surface is even in the projection area according to the distance parameters, so as to determine whether to perform the leveling correction operation on the first image data.
In an embodiment of the invention, the distance sensing device includes an infrared light source and at least one time of flight ranging sensor. The infrared light source is coupled to the control device and is configured to emit a plurality of infrared rays toward at least one image area of the first projection image on the projection surface. The at least one time of flight ranging sensor is coupled to the control device for sensing a plurality of reflected infrared rays reflected by the projection surface to output the distance parameters to the control device.
In an embodiment of the invention, the control device is further configured to determine whether the second projection image is clear to output focal length correction data to the projection optical engine, and the projection optical engine automatically adjusts a focal length.
In an embodiment of the invention, the projector is an ultra-short throw projector.
The invention provides a projection method including following steps. First image data is output by a control device; the first image data is received by a projection optical engine to project a first projection image to a projection surface according to the first image data; a plurality of distance parameters of a projection area are sensed by a distance sensing device; a first captured image is obtained by an image capturing device according to the first projection image captured by an image capturing device; at least one of a keystone correction operation and a leveling correction operation is performed on the first image data by the control device according to at least one of the plurality of distance parameters and the first captured image; a second projection image is projected to the projection surface by the projection optical engine according to corrected first image data; and a second captured image including the second projection image is obtained by the control device through the image capturing device, and the second captured image is analyzed to project current projection image size information in the second projection image.
Based on the above description, the projector and the projection method of the invention may automatically perform keystone correction and leveling correction on the projection image, and may also automatically detect a size of the current projection image, so as to display the projection image size information in the projection image.
Other objectives, features and advantages of the present invention will be further understood from the further technological features disclosed by the embodiments of the present invention wherein there are shown and described preferred embodiments of this invention, simply by way of illustration of modes best suited to carry out the invention.
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
It is to be understood that other embodiment may be utilized and structural changes may be made without departing from the scope of the present invention. Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless limited otherwise, the terms “connected,” “coupled,” and “mounted,” and variations thereof herein are used broadly and encompass direct and indirect connections, couplings, and mountings. Moreover, electrical connection means that signals may be transmitted between two components.
In the embodiment, the projection surface S1 may be parallel to a plane formed by extending a first direction D1 and a third direction D3. The first direction D1 and a second direction D2 may be respectively a first horizontal direction and a second horizontal direction. The third direction D3 may be a vertical direction. The first direction D1, the second direction D2, and the third direction D3 may be perpendicular to each other. The projector 100 may be, for example, placed on a plane formed by extending the first direction D1 and the second direction D2.
In the embodiment, the microcontroller (MCU) 111 and the image processor 112 may respectively include a central processing unit (CPU) related to a data calculation function and an image processing function, or other programmable general-purpose or special-purpose microprocessor, a digital signal processor (DSP), an image processing unit (IPU), a graphics processing unit (GPU), a programmable controller, an application specific integrated circuits (ASIC), a programmable logic device (PLD), other similar control devices, or a combination of these devices.
In the embodiment, the control device 110 may also include a memory, where the memory may be, for example, a removable random access memory (RAM), a read-only memory (ROM), or a flash memory, or a similar component or a combination of the above components. The memory may be used to store related image data, keystone correction module, leveling correction module, projection image size analysis module, etc., that may be used to implement related programs and algorithms of the invention, and may be accessed and executed by the microcontroller 111 and the image processor 112.
In the embodiment, the distance sensing device 120 faces the projection surface S1. The distance sensing device 120 may include a time of flight (ToF) ranging sensor and a sensing light source. The sensing light source emits a sensing light beam, and the ToF ranging sensor may obtain distance information, such as a distance between the projector 100 and the projection surface S1, by determining a time difference between an emission time of the sensing light beam and a time of receiving the reflected sensing light beam. For example, the distance sensing device 120 may include an infrared light source and at least one ToF ranging sensor. The infrared light source may be coupled to the microcontroller 111 of the control device 110 and used to emit a plurality of infrared rays to the projection area of the first projection image 101 on the projection surface S1. The at least one ToF ranging sensor may be coupled to the microcontroller 111 of the control device 110 for sensing a plurality of reflected infrared rays reflected by the projection surface S1, so as to output a plurality of distance parameters to the microcontroller 111 of the control device 110. However, the distance sensing device 120 of the invention is not limited to the above device type. In other embodiments of the invention, the distance sensing device 120 may be, for example, a proximity sensor, an ultrasonic sensor, or a similar non-contact distance sensor.
In the embodiment, the image capturing device 130 may be a camera, and may be used to capture an image of the projection surface S1, where the image capturing range 102 of the image capturing device 130 on the projection surface S1102 may be larger than the first projection image 101 (the projection area).
In the embodiment, the projection optical engine 140 may include a projection light source, an optical engine, and an optical system. The projection light source may include a light emitting unit such as a discharge bulb, a light emitting diode, or a laser light source. The optical engine may include a reflective spatial light modulation device or a transmissive spatial light modulation device. The reflective spatial light modulation device may, for example, include reflective liquid crystal on silicon (LCOS) or a digital micro-mirror device (DMD). The transmissive spatial light modulation device may, for example, include a transparent liquid crystal panel. The optical system may include a plurality of lenses, and the plurality of lenses may be arranged on a path of a light beam for transmitting the light beam.
It should be noted that the projector 100 of the embodiment may be an ultra short throw projector, but the invention is not limited thereto. The projector 100 of the embodiment may also be adapted to other types of projectors.
In step S260, the projection optical engine 140 projects a second projection image to the projection surface S1 according to the second image data, i.e., the second projection image is the corrected first projection image 101. In the embodiment, the image processor 112 outputs the second image data to the projection optical engine 140, and the projection optical engine 140 projects the second projection image according to the second image data. In addition, in an embodiment, the microcontroller 111 of the control device 110 may further determine whether the second projection image is clear, and analyze the imaging clarity of the first captured image to determine that a current focus of the projection optical engine is incorrect, so as to generate a focus adjustment signal for providing to the image processor 120, and the image processor 120 outputs focal length correction data corresponding to the focal length adjustment signal to the projection optical engine 140 to automatically adjust a focal length of a projection lens in the projection optical engine 140, so that the second projection image may present a clear image effect.
In step S270, a second captured image including the second projection image is obtained by the image capturing device 130, and the second captured image is analyzed by the control device 110 to project current size information of the second projection image in the second projection image. In the embodiment, the projector 100 may automatically sense a size of the projection image currently on the projection surface S1 and display the size information on the projection image to effectively inform the user of the size of the current projection image. Therefore, the projector 100 and the projection method of the embodiment may provide a good projection effect, and my allow the user to clearly know the size information of the projection image projected by the projector after the automatic image correction, so as to achieve a good user experience.
The control device of the projector 300 obtains a first inclination angle between the projector 300 and the projection surface S2 in the vertical direction according to the plurality of distance parameters, and performs the keystone correction operation on the first image data according to the first inclination angle. The so-called first inclination angle is an angle between a plane of the projector 300 (a plane formed by the first direction D1 and the third direction D3) and the projection surface S2 in the vertical direction (D3).
It is should be noted that if the projector 300 and the projection surface S2 have the first inclination angle there between in the vertical direction, the first projection image 301 may be actually displayed on the projection surface S2 in an effect of a projection image 3011 or a projection image 3012. For example, the control device of the projector 300 may calculate the first inclination angle between the projector 300 and the projection surface S2 in the vertical direction according to changes of the plurality of distance parameters of the plurality of sensing points in the vertical direction in the projection area of the projection surface S2, and automatically perform vertical keystone correction.
When the control device of the projector 300 obtains the first captured image, the control device may analyze an included angle between a boundary of the first projection image in the vertical direction in the first captured image and a normal vertical line, so as to quickly and automatically perform the vertical keystone correction.
Therefore, the projector 300 of the embodiment may automatically perform the vertical keystone correction through one of the distance sensing device and the image capturing device. In addition, in another embodiment, the projector 300 may also obtain the first inclination angle in the vertical direction through a G-sensor, and is not limited to the above-mentioned distance sensing device and image capturing device.
The control device of the projector 400 obtains a second inclination angle between the projector 400 and the projection surface S3 in the horizontal direction according to the plurality of distance parameters, and performs the keystone correction operation on the first image data according to the second inclination angle.
The so-called second inclination angle is an angle between a plane of the projector 400 (a plane formed by the first direction D1 and the third direction D3) and the projection surface S3 in the horizontal direction (D1).
It is should be noted that if the projector 400 and the projection surface S3 have the second inclination angle there between in the horizontal direction, so that the projector 400 is equivalent to project onto a projection surface S31 or a projection surface S32, the first projection image may be actually displayed on the projection surface S3 in an effect of a projection image 4011 or a projection image 4012.
For example, the control device of the projector 400 may calculate the second inclination angle between the projector 400 and the projection surface S3 in the horizontal direction according to changes of the plurality of distance parameters of the plurality of sensing points in the horizontal direction in the projection area of the projection surface S3, and automatically perform horizontal keystone correction. Moreover, when the control device of the projector 400 obtains the first captured image, the control device may analyze an included angle between a boundary of the first projection image in the horizontal direction in the first captured image and a normal horizontal line, so as to quickly and automatically perform the horizontal keystone correction.
Therefore, the projector 400 of the embodiment may automatically perform the horizontal keystone correction through one of the distance sensing device and the image capturing device. Moreover, the horizontal keystone correction of the embodiment may be executed together with the vertical keystone correction described in the embodiment of
In summary, the projector and the projection method of the invention may automatically perform the keystone correction operation and the leveling correction operation on image data, and may also automatically detect a size of the current projection image, so as to display the current projection image size information in the projection image, such that the user may conveniently operate the projector, and adjust a placement position of the projector according to the current projection image size information to achieve a projection image size required by the user.
The foregoing description of the preferred embodiments of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form or to exemplary embodiments disclosed. Accordingly, the foregoing description should be regarded as illustrative rather than restrictive. Obviously, many modifications and variations will be apparent to practitioners skilled in this art. The embodiments are chosen and described in order to best explain the principles of the invention and its best mode practical application, thereby to enable persons skilled in the art to understand the invention for various embodiments and with various modifications as are suited to the particular use or implementation contemplated. It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents in which all terms are meant in their broadest reasonable sense unless otherwise indicated. Therefore, the term “the invention”, “the present invention” or the like does not necessarily limit the claim scope to a specific embodiment, and the reference to particularly preferred exemplary embodiments of the invention does not imply a limitation on the invention, and no such limitation is to be inferred. The invention is limited only by the spirit and scope of the appended claims. Moreover, these claims may refer to use “first”, “second”, etc. following with noun or element. Such terms should be understood as a nomenclature and should not be construed as giving the limitation on the number of the elements modified by such nomenclature unless specific number has been given. The abstract of the disclosure is provided to comply with the rules requiring an abstract, which will allow a searcher to quickly ascertain the subject matter of the technical disclosure of any patent issued from this disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Any advantages and benefits described may not apply to all embodiments of the invention. It should be appreciated that variations may be made in the embodiments described by persons skilled in the art without departing from the scope of the present invention as defined by the following claims. Moreover, no element and component in the present disclosure is intended to be dedicated to the public regardless of whether the element or component is explicitly recited in the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202111149544.0 | Sep 2021 | CN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5070401 | Salvati | Dec 1991 | A |
| 6877863 | Wood | Apr 2005 | B2 |
| 7125122 | Li | Oct 2006 | B2 |
| 8322863 | Cho | Dec 2012 | B1 |
| 8398246 | Rutledge | Mar 2013 | B2 |
| 9071751 | Higashimoto | Jun 2015 | B2 |
| 9749605 | Liu | Aug 2017 | B2 |
| 9762871 | De La Cruz | Sep 2017 | B2 |
| 9872010 | Tran | Jan 2018 | B2 |
| 10027937 | Staton | Jul 2018 | B1 |
| 10051251 | Brown | Aug 2018 | B2 |
| 10074191 | Reome | Sep 2018 | B1 |
| 10080002 | Kasuga | Sep 2018 | B2 |
| 10663844 | Urano | May 2020 | B2 |
| 10904501 | Wu | Jan 2021 | B2 |
| 11336878 | Yoon | May 2022 | B2 |
| 11451688 | Benemann | Sep 2022 | B2 |
| 11528460 | Chen | Dec 2022 | B2 |
| 20050041045 | Plut | Feb 2005 | A1 |
| 20070058136 | Sakai | Mar 2007 | A1 |
| 20090115915 | Steinberg | May 2009 | A1 |
| 20100315601 | Furui | Dec 2010 | A1 |
| 20130063401 | Ouchida | Mar 2013 | A1 |
| 20140043225 | Lai | Feb 2014 | A1 |
| 20140267427 | Hasegawa | Sep 2014 | A1 |
| 20160188195 | Chen | Jun 2016 | A1 |
| 20170090730 | Knodt | Mar 2017 | A1 |
| 20170280120 | Lai | Sep 2017 | A1 |
| 20170374331 | Liu | Dec 2017 | A1 |
| 20180120560 | Wang | May 2018 | A1 |
| 20180125340 | Ishikawa | May 2018 | A1 |
| 20190327457 | Urano | Oct 2019 | A1 |
| 20210364900 | Hsien | Nov 2021 | A1 |
| 20220038668 | Tsui | Feb 2022 | A1 |
| 20220286654 | Zhong | Sep 2022 | A1 |
| 20220295026 | Wu | Sep 2022 | A1 |
| 20220385867 | Kim | Dec 2022 | A1 |
| 20230037686 | Choi | Feb 2023 | A1 |
| 20230230210 | Powell | Jul 2023 | A1 |
| 20230260434 | Kim | Aug 2023 | A1 |
| 20230362339 | Chen | Nov 2023 | A1 |
| 20240015272 | Park | Jan 2024 | A1 |
| Number | Date | Country |
|---|---|---|
| 104062831 | Sep 2014 | CN |
| 106101675 | Nov 2016 | CN |
| 107454373 | Dec 2017 | CN |
| 108141561 | Jun 2018 | CN |
| 112415841 | Feb 2021 | CN |
| 112422939 | Feb 2021 | CN |
| 113395498 | Sep 2021 | CN |
| Entry |
|---|
| “Office Action of China Counterpart Application”, issued on Apr. 10, 2024, pp. 1-21. |
| Number | Date | Country | |
|---|---|---|---|
| 20230102878 A1 | Mar 2023 | US |
