Patent Application
20240355238
The disclosure is related to extended reality (XR) technology, and particularly related to a head-mounted display (HMD) and a method for image processing based on diopter adjustment.
To achieve a more lightweight and comfortable HMD, a diopter adjustment function may be incorporated into the HMD. The diopter adjustment function accommodates users with different diopter values in their unaided vision, thereby reducing internal space of the HMD needed for users wearing corrective lenses. However, after the diopter setting of the HMD has been adjusted, the image processing software for distortion correction of lenses in the HMD would no longer be suitable for the HMD.
The disclosure is directed to an HMD and a method for image processing based on diopter adjustment.
The present invention is directed to a head-mounted display for image processing based on diopter adjustment. The head-mounted display includes a display, an input device for diopter adjustment, a storage medium storing a mapping table, and a processor coupled to the display, the input device, and the storage medium, wherein the processor is configured to: receive a command corresponding to a first diopter setting by the input device; in response to the command, render an image according to the mapping table to generate a rendered image; and display the rendered image by the display.
The present invention is directed to a method for image processing based on diopter adjustment, including: receiving a command corresponding to a first diopter setting; in response to the command, rendering an image according to a mapping table to generate a rendered image; and displaying the rendered image.
Based on the above description, the present invention may calibrate an HMD with diopter adjustment functionality and reduce the distortion caused by changes in the diopter setting of the HMD accordingly.
To make the aforementioned more comprehensible, several embodiments accompanied with drawings are described in detail as follows.
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
The HMD 100 may include a processor 110, a storage medium 120, a display 130, and an input device 140. The processor 110 may be, for example, a central processing unit (CPU), or other programmable general purpose or special purpose micro control unit (MCU), a microprocessor, a digital signal processor (DSP), a programmable controller, an application specific integrated circuit (ASIC), a graphics unit (GPU), an arithmetic logic unit (ALU), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or other similar device or a combination of the above devices. The processor 110 may be coupled to the storage medium 120, the display 130, and the input device 140.
The storage medium 120 may be, for example, any type of fixed or removable random-access memory (RAM), a read-only memory (ROM), a flash memory, a hard disk drive (HDD), a solid-state drive (SSD) or similar element, or a combination thereof. The storage medium 120 may be a non-transitory computer readable storage medium configured to record a plurality of executable computer programs, modules, or applications to be loaded by the processor 110 to perform the functions of the HMD 100.
In one embodiment, the storage medium 120 may record one or more diopter settings 10 (e.g., diopter setting 11 or diopter setting 12), one or more mapping tables 20 (e.g., mapping table 21 or mapping table 22), or one or more transition functions 30 (e.g., transition function 31 or transition function 32).
The display 130 may be used for displaying video data or image data such as an XR scene of the XR environment for the user wearing the HMD 100. The display 130 may include a liquid-crystal display (LCD) or an organic light-emitting diode (OLED) display. The display 130 may provide an image beam to the eyes of the user to form the image on the retinal of the user such that the user may see an XR scene created by the HMD 100. In one embodiment, the display 130 may include a light source 131, lens 132, and a driving component 133. The light source 131 may provide a light passing through the lens 132 to form an image (e.g., an XR scene) for the user wearing the HMD 100. The light source 131 or the driving component 133 may be electrically connected to the processor 110 and may be controlled by the processor 110. The processor 110 may control the driving component 133 to adjust the position of the light source 131 or the position of the lens 132 such that a distance between the light source 131 and the lens 132 may be changed.
The input device 140 may be used for diopter adjustment. The user of the HMD 100 may manipulate the input device 140 so as to transmit a command to the processor 110 for diopter adjustment. For example, the input device 140 may include a physical button electrically connected to the processor 110. If the physical button is pushed by a user, the processor 110 may receive a signal from the physical button and may perform diopter adjustment for the HMD 100 according to the signal. For another example, the input device 140 may include a knob (e.g., a knob with lens 132 embedded in it) with a variable resistor electrically connected to the processor 110. If the knob is manipulated by a user, the know allows the selection of a specific resistor value within the variable resistor. Subsequently, an analog signal corresponding to the selected resistor value may be transmitted to the processor 110. The processor 110 may perform diopter adjustment for the HMD 100 according to the received analog signal.
In step S201, the processor 110 may obtain an image (also referred to as an original image), wherein the image may be displayed by the display 130 for creating a XR scene.
In step S202, the processor 110 may determine to apply a specific diopter setting. Specifically, the processor 110 may receive a command by the input device 140 and determine a specific diopter setting corresponding to the command.
In one embodiment, the processor 110 may apply the specific diopter setting. Specifically, the processor 110 may control the driving component 133 to adjust a distance between the lens 132 and the light source 131 according to the specific diopter setting, wherein the distance (e.g., the distance before the adjustment or the distance after the adjustment) between the lens 132 and the light source 131 may be less than the focal length of the lens 132.
In step S203, the processor 110 may select a mapping table from the plurality of mapping tables 20 according to the command or the specific diopter setting. For example, if the command or the specific diopter setting is corresponded to the mapping table 21, the processor 110 may select the mapping table 21 from the plurality of mapping tables 20 according to the command.
In one embodiment, the storage medium 120 may record a plurality of mapping tables 20, wherein each mapping table 20 may be corresponded to a diopter setting. The processor 110 may determine whether the command (or the specific diopter setting) matches with one of the plurality of mapping tables 20 and may select the mapping table matching with the command accordingly. For example, the processor 110 may determine that the command matches with the mapping table 21 of the plurality of mapping tables 20 and may select the mapping table 21 from the plurality of mapping tables 20 accordingly. After the mapping table 21 corresponding to the command (or the specific diopter setting) is selected, in step S204, the processor 110 may render the image according to the selected mapping table 21 to generate a rendered image. The processor 110 may display the rendered image for the user of the HMD 100 by the display 130. That is, the light source 131 may provide a light passing through the lens 132 to form the rendered image on a virtual plane or on the retinal of the user.
In one embodiment, the storage medium 120 may record one reference mapping table 20 (i.e., a mapping table corresponding to a standard diopter setting) and may record a plurality of transition functions 30, wherein each transition function 30 may be corresponded to a diopter setting, wherein the data amount of one transition function 30 may be less than the data amount of one mapping table 20. The processor 110 may determine whether the command (or the specific diopter setting) matches with one of the plurality of transition functions 30 and may select the transition function matching with the command accordingly. For example, the processor 110 may determine that the command matches with the transition function 31 of the plurality of transition functions 30 and may select the transition function 31 from the plurality of transition functions 30 accordingly. After the transition function 31 corresponding to the command (or the specific diopter setting) is selected, the processor 110 may render the image according to the reference mapping table 20 and the selected transition function 31 to generate a rendered image. For example, the processor 110 may multiply the reference mapping table 20 by the transition function 31 to obtain a mapping table suitable for the specific diopter setting and may render the original image according to the obtained mapping table to generate the rendered image. The processor 110 may display the rendered image for the user of the HMD 100 by the display 130. That is, the light source 131 may provide a light passing through the lens 132 to form the rendered image on a virtual plane or on the retinal of the user. Since only one mapping table 20 (i.e., reference mapping table 20) needs to be recorded in the storage medium 120, significant space saving can be achieved on the storage medium 120.
In one embodiment, a mapping table 20 may include a vector between a pixel of the original image and a corresponding pixel of the rendered image, wherein the vector may compensate the pincushion distortion of the original image with the barrel distortion to generate the rendered image. In one embodiment, the processor 110 may generate the one or more mapping tables 20 based on a Brown-Conrady model.
In one embodiment, a mapping table 20 may further include a scaling factor between the original image and the rendered image, wherein the scaling factor may be associated with the size of the original image and the size of the rendered image. After the sizes of the original image and the rendered image are determined by the processor 110, the processor 110 may update the vector recorded in the mapping table according to the scaling factor. The processor 110 may render the original image according to the updated vector to generate the rendered image.
In summary, the HMD of the present invention may perform diopter adjustment for users with different diopter values according to user's commands. After the diopter setting of the HMD has been changed, the HMD may render the image to be output in a manner suitable for the adjusted diopter setting, thereby correcting the distortion caused by the change in diopter setting.
It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the disclosure covers modifications and variations provided that they fall within the scope of the following claims and their equivalents.
This application claims the priority benefit of U.S. provisional application Ser. No. 63/460,606, filed on Apr. 20, 2023. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
| Number | Date | Country | |
|---|---|---|---|
| 63460606 | Apr 2023 | US |
