The present invention relates to the field of optical characteristic testing of near-eye display, and in particular, to a measurement method and apparatus of a near-eye display.
A near-eye display, also referred to as a head-mounted display or a virtual display, is mainly divided into virtual reality (VR) and augmented reality (AR). The principle of the near-eye display is shown in
Corresponding to
On the other hand, the existing optical axis alignment method is mainly to align the cross center of the imaging system used for measurement with the cross center of the output image of the near-eye display to be measured, that is, it is considered that the optical axis of the measurement device is aligned with the optical axis 3 of the near-eye display to be measured. In fact, when the alignment angle is different, the cross center can still be aligned, therefore the method has a relatively large error.
The operations of the existing method for obtaining the exit pupil 4, the eye point 10 and the optical axis 3 of the near-eye display 1 by means of measuring the region of the eye box 9 are extremely complex, in addition, the measurement of the eye box 9 itself is affected by the moving precision, stepping, alignment precision, and the like, therefore there is a relatively large error, and moreover, the measurement efficiency is low.
In view of the deficiencies of the prior art, the present invention provides a measurement method and apparatus of a near-eye display, which aim to solve the problems in the prior art of a relatively large measurement error of the exit pupil, eye point and optical axis of a near-eye display, complex and expensive devices, complex operations and low efficiency.
In order to achieve the above objective, the technical solution utilized in the present invention is as follows:
The present invention provides a measurement method of a near-eye display, wherein a plane-array photoelectric sensor having no imaging lens or an optical receiving screen, and a transmission mechanism is used to obtain an exit pupil parameter of a near-eye display to be measured. The method specifically includes: the near-eye display to be measured outputs a picture, and the plane-array photoelectric sensor or a optical receiving screen is placed in a human eye viewing region of the near-eye display to be measured, this region is also referred to as an eye box of the near-eye display, and the plane-array photoelectric sensor or optical receiving screen directly receives an optical output signal from the near-eye display to be measured and obtains an illumination image. According to the optical imaging principle of the near-eye display, an exit pupil is a common exit of imaging light beams of various points of the near-eye display, that is, the emergent light of an output image of the near-eye display passes through the exit, and each point on the exit contains light information of various points of the whole output image, therefore the illumination distribution is relatively uniform and has an obvious boundary. If the plane-array photoelectric sensor or optical receiving screen is located on the exit pupil of the near-eye display and the area of sensitive region can completely cover the whole exit pupil, the plane-array photoelectric sensor or the optical receiving screen can receive an exit pupil image of which the illumination distribution is relatively uniform with clear boundaries. The area enclosed by the clearest image boundaries is the minimum compared with the areas of light spot images received at other positions. If the plane-array photoelectric sensor or optical receiving screen deviates from the exit pupil, the illumination image obtained by the plane-array photoelectric sensor becomes larger and the boundary is blurred. Therefore, the relative position of the plane-array photoelectric sensor or optical receiving screen and the near-eye display to be measured is controlled by the transmission mechanism, so that illumination images are obtained at different spatial positions, the illumination images at different spatial positions are analyzed by using an image boundary recognition algorithm, when the obtained image has the clearest boundary and the area of the image is the minimum, the plane-array photoelectric sensor or optical receiving screen is regarded as located on plane of the exit pupil of the near-eye display to be measured. As shown in
It should be noted that, in the above technical solution, the exit pupil parameter contains: spatial position information of the exit pupil, an eye point and the optical axis, and two-dimensional size information of an exit pupil boundary. In order to avoid ambiguity, the exit pupil, the eye point and the optical axis are further illustrated in the present technical solution as follows: the exit pupil is an optical image of an entrance pupil of an optical system of the near-eye display to be measured, and is a common exit of emergent light beams after various points on an object plane (i.e., an original emission surface of a display image) are imaged by the optical system of the near-eye display, and the position and size of the exit pupil of the near-eye display are important parameters of the near-eye display; the eye point is located in a plane where the exit pupil is located and is located at the center of the exit pupil, and is also a foot point of the optical axis and the exit pupil; and the optical axis is a straight line which passes through the eye point and is vertical to the plane where the exit pupil is located.
For ease of expression, all pictures output by the near-eye display below refer to image-space pictures which are output by the object plane of the near-eye display and are imaged by the optical system of the near-eye display.
Further, in the above technical solution, on the basis that the plane of the plane-array photoelectric sensor or optical receiving screen is located on the plane of exit pupil of the near-eye display to be measured, the center of the illumination image captured is obtained by using an image center recognition algorithm, and is regarded as the eye point of the near-eye display to be measured.
Further, in the above technical solution, the optical axis of the near-eye display to be measured is obtained by the following method: drawing a vertical line in a manner of passing through the central position of the exit pupil, wherein a straight line where the vertical line is located is the optical axis of the near-eye display to be measured.
Further, in the above technical solution, the image boundary recognition algorithm includes, but is not limited to, a boundary sharpness recognition algorithm and/or a boundary contrast recognition algorithm. When the image boundary sharpness and/or the contrast reach an extreme value, the clearest boundary is obtained. Further, the algorithm is used for judging the boundary clarity of the illumination distribution image obtained in each direction and position.
Further, in the above technical solution, the image center recognition algorithm includes, but is not limited to, a grayscale gravity center method or a geometric method. The grayscale gravity center method is to calculate the coordinates of a grayscale weight center according to the grayscale distribution of the illumination image obtained by the plane-array photoelectric sensor. The geometric method is to acquire a graph which is enclosed by the boundary of the illumination image obtained by the plane-array photoelectric sensor, and to calculate a geometric center of the graph.
Further, in the above technical solution, when the size of a photosensitive surface of the plane-array photoelectric sensor is less than the size of the exit pupil of the near-eye display to be measured, the plane-array photoelectric sensor cannot acquire a complete illumination pattern, the illumination images received by the plane-array photoelectric sensor at different positions can be acquired step by step, and are proceeded by using the image boundary recognition algorithm, and when the illumination image has the clearest boundary or a relatively minimum area, the plane-array photoelectric sensor is located on the exit pupil of the near-eye display to be measured. By means of the transmission mechanism, the plane-array photoelectric sensor and the near-eye display to be measured translate relative to each other, a complete exit pupil is obtained by splicing, and further, the eye point and the optical axis of the near-eye display to be measured can be obtained according to the central position of the exit pupil.
Further, in the above technical solution, the plane-array photoelectric sensor or the near-eye display to be measured is controlled by the transmission mechanism, so that the plane-array photoelectric sensor and the near-eye display to be measured move relative to each other, the plane-array photoelectric sensor obtains illumination images at different spatial positions, the illumination images at different spatial positions are analyzed by using the image boundary recognition algorithm, the area of the illumination image obtained by the plane-array photoelectric sensor is the minimum compared with those at other positions. Further, in the method, the spatial position of the exit pupil of the near-eye display to be measured and the boundary clarity of the illumination distribution image obtained by the plane-array photoelectric sensor are used as criteria, and the obtained spatial position of the exit pupil of the near-eye display can be mutually verified.
Further, in the above technical solution, the relative motion between the plane-array photoelectric sensor and the near-eye display to be measured includes translation in three directions, that is, upper-lower, left-right and front-rear directions, and rotation along two or more mutually vertical rotating axes, or a multi-degree-of-freedom composite motion.
In some optional embodiments, the picture output by the near-eye display to be measured includes, but is not limited to, a full-white picture or a black-bottom and white-frame picture. According to the optical imaging principle of the near-eye display, the type of the output picture of the near-eye display to be measured does not affect the illumination uniformity and boundary characteristics of the exit pupil.
Further, in the above technical solution, the process of controlling the plane-array photoelectric sensor and the near-eye display to be measured by using the transmission mechanism, so that the plane-array photoelectric sensor and the near-eye display to be measured move relative to each other specifically includes: processing and analyzing the illumination image, so as to obtain corresponding position and posture (referred to as “pose” for short) adjustment information, and adjusting the relative position between the plane-array photoelectric sensor and the near-eye display to be measured by means of the transmission mechanism.
The present invention further discloses a measurement method of a near-eye display, wherein a plane-array photoelectric sensor having no imaging lens, a transmission mechanism and an imaging device are used to obtain an optical axis of a near-eye display to be measured. The method specifically includes:
It should be noted that, in the above technical solution, when the plane-array photoelectric sensor obtains the illumination image with the clearest boundary according to the near-eye display imaging principle, the area enclosed by the boundary of the illumination image is the minimum compared with the areas of light spot received when the plane-array photoelectric sensor is located at other positions. Therefore, for step S4, the boundary clarity of the illumination distribution image can be replaced with the size of the area of the illumination image to serve as a criterion. The results of exit pupil parameters obtained by the two criteria can be mutually verified.
According to the optical imaging principle of the near-eye display, the optical axis of the near-eye display to be measured is vertical to the exit pupil and passing through the eye point, and the optical axis passes through the center of each illumination region parallel to the exit pupil in the eye box. The illumination image obtained by the plane-array photoelectric sensor can be analyzed using the image center recognition algorithm, so as to obtain the center of the illumination image, then the center of the entrance pupil of the imaging device is placed at the central position of the illumination image obtained by the plane-array photoelectric sensor, the near-eye display to be measured is controlled to output the second detection picture, the relative pose between the imaging device and the near-eye display to be measured is adjusted by using the transmission mechanism with the entrance pupil as a rotation center, when the center of the imaging device coincides with the center of the picture of the near-eye display to be measured, and the optical axis position of the imaging apparatus is recorded. At this time, the optical axis of the imaging device substantially coincides with the optical axis of the near-eye display. In order to obtain the optical axis of the near-eye display to be measured more accurately, verification and adjustment are needed, that is, the plane-array photoelectric sensor is placed vertical to the optical axis position of the foregoing imaging device, the center of the illumination distribution image is obtained again, the relative pose between the imaging device and the near-eye display to be measured is adjusted according to the center of the illumination image and the center of the image of the near-eye display to be measured, and the optical axis position of the imaging device is obtained again. The relative pose among the plane-array photoelectric sensor, the near-eye display and the imaging device is adjusted back and forth by means of the transmission mechanism, so as to realize multiple cyclic approximation, until the boundary clarity of the illumination distribution image obtained by the plane-array photoelectric sensor reaches a set tolerance, that is, when all boundaries of the obtained illumination image are the clearest, and the optical axis of the foregoing imaging device is the optical axis of the near-eye display to be measured, the region where the boundary-clear illumination image obtained by the plane-array photoelectric sensor is the exit pupil of the near-eye display, and the center of the illumination image is the eye point.
Further, in the above technical solution, the step S2 of controlling the relative displacement of the imaging device and the near-eye display to be measured by means of the transmission mechanism, has a plurality of implementation modes. For example, the near-eye display remains stationary, and the imaging device is controlled by the transmission mechanism, so as to adjust the poses of the imaging device.
Further, in the above technical solution, the image center recognition algorithm includes, but is not limited to, a grayscale gravity center method or a geometric method. The grayscale gravity center method is to calculate the coordinates of a grayscale weight center according to the grayscale distribution of the image. The geometric method is to recognize and acquire the centers of four sides of the illumination image, and the coordinates of an intersection point of connecting lines of the centers of two opposite sides are the coordinates of the center of the image.
Further, in the step S3, the transmission mechanism controls the imaging device or the near-eye display to be measured, so that the imaging device and the near-eye display to be measured move relative to each other, and generally rotate relative to each other, and the rotation center is located at the center of an entrance pupil position of a lens of the imaging device.
In some optional embodiments, the first detection picture output by the near-eye display to be measured includes, but is not limited to, a full-white board picture or a black-bottom and white-frame picture, and the picture can carry a center mark or not. The second detection image output by the near-eye display to be measured is an image carrying a center mark, including, but not limited to a full-center crosshair picture.
In some optional embodiments, the first detection picture and the second detection picture can be the same.
The present invention further discloses a measurement apparatus of a near-eye display, including a near-eye display to be measured, a sample stage for clamping the near-eye display to be measured, an plane-array photoelectric sensor, a first transmission mechanism and a programmed control system, wherein the plane-array photoelectric sensor is placed facing an output direction of the near-eye display to be measured, the plane-array photoelectric sensor or the sample stage is connected with the first transmission mechanism, and the first transmission mechanism is controlled by the programmed control system, so that the near-eye display to be measured and the plane-array photoelectric sensor move relative to each other; and the programmed control system is electrically connected with the first transmission mechanism and the plane-array photoelectric sensor, respectively. The relative motion between the plane-array photoelectric sensor and the near-eye display to be measured includes translation in three directions, that is, upper-lower, left-right and front-rear directions, and rotation along two or more mutually vertical rotating axes, or a multi-degree-of-freedom composite motion.
In some optional embodiments, the plane-array photoelectric sensor includes, but is not limited to, a CMOS and a CCD, and the plane-array photoelectric sensor has a corresponding data acquisition and transmission circuit. It should be noted that, it is used as an example herein only, and those skilled in the art can make adjustments according to common general knowledge.
In some optional embodiments, the first transmission mechanism includes a rotating mechanism and/or a translation mechanism.
In some optional embodiments, the first transmission mechanism is a robotic apparatus having four or more rotating axes.
Further, in the above technical solution, the measurement apparatus further includes a second transmission mechanism, the second transmission mechanism is connected with the sample stage, and the second transmission mechanism drives the sample stage to move; and the second transmission mechanism includes a rotating mechanism and a translation mechanism. The present invention further discloses another measurement apparatus of a near-eye display, including a sample stage for clamping the near-eye display to be measured, an plane-array photoelectric sensor, an imaging apparatus, a first transmission mechanism and a programmed control system, wherein the plane-array photoelectric sensor and the imaging device are respectively placed facing an output direction of the near-eye display to be measured, the plane-array photoelectric sensor and the imaging device are respectively connected with the first transmission mechanism, and the first transmission mechanism is controlled by the programmed control system, so as to adjust the poses of the plane-array photoelectric sensor and the imaging device. The programmed control system is electrically connected with the first transmission mechanism, the plane-array photoelectric sensor and the imaging device, respectively.
The various measurement methods and apparatus of the near-eye display have the following beneficial effects: the implementation steps of the measurement solution are simple, thereby greatly simplifying the measurement steps of the optical axis and the eye point of the near-eye display, improving the measurement efficiency, and reducing the measurement cost. In addition, in the other measurement method of the near-eye display provided in the present invention, a used measurement device is realized by the mutual cooperation of the plane-array photoelectric sensor and the imaging device, thereby greatly improving the measurement precision and the measurement efficiency, and reducing the measurement cost. In addition, the present invention further provides another near-eye display measurement apparatus, including a sample stage for clamping a near-eye display to be measured, an optical receiving screen, a transmission mechanism and a programmed control system. The optical receiving screen is arranged in a human eye viewing region of the near-eye display to be measured. The near-eye display to be measured outputs a picture, and a light beam of the near-eye display to be measured is directly incident onto the optical receiving screen and forms a illumination image. The transmission mechanism is connected with the sample stage and/or the optical receiving screen and is electrically connected with the programmed control system. The transmission mechanism is controlled by the programmed control system, so that the near-eye display to be measured and the optical receiving screen move relative to each other, and the exit pupil parameters of the near-eye display to be measured are obtained by observing and analyzing the illumination image on the optical receiving screen.
According to the optical imaging principle of the near-eye display for display, an exit pupil is a common exit of imaging light beams of various points of the near-eye display, the emergent light of an output image of the near-eye display passes through the exit, that is, each point on the exit contains light information of various points of the whole output image, and the illumination distribution thereof is relatively uniform and has obvious boundaries. If the optical receiving screen is located on the exit pupil of the near-eye display and the size of a light receiving surface of the optical receiving screen is greater than the size of the exit pupil of the near-eye display to be measured, an exit pupil light spot with uniform illumination distribution and clear boundaries can be formed on the optical receiving screen, and at this time, the area of this relatively clearest light spot is the minimum. If the optical receiving screen deviates from the exit pupil, the light spot (illumination image) obtained by the optical receiving screen becomes larger and the boundary is blurred. The transmission mechanism is controlled by the programmed control system, so that the optical receiving screen and the near-eye display to be measured move relative to each other, the optical receiving screen obtains light spot at different spatial positions, and the exit pupil parameter of the near-eye display to be measured is obtained by means of direct observation or combining an imaging measurement system with an image recognition algorithm. As shown in
As a technical solution, the optical receiving screen can be a diffuse transmission type screen or a diffuse reflection type screen, including, but not limited to, a diffuse transmission thin film and an anti-reflection film. The optical receiving screen should not affect the shape of the light spot, so as to obtain complete light information of the near-eye display to be measured.
When the transmission mechanism enables the optical receiving screen and the near-eye display to be measured to move relative to each other, the boundary of the illumination image can be gradually analyzed by using a tomography method, when the illumination image has the clearest boundary, it is judged that the optical receiving screen is located on a plane where the exit pupil of the near-eye display to be measured is located, and the illumination spot on the optical receiving screen is the exit pupil of the near-eye display to be measured; the central position of the exit pupil is the eye point of the near-eye display to be measured, and a vertical line of an exit pupil plane is drawn in a manner of passing through the central position of the exit pupil plane, so as to obtain the optical axis of the near-eye display to be measured. The exit pupil parameter contains: spatial position information of the exit pupil, the eye point and the optical axis, and two-dimensional size information of an exit pupil boundary. In order to avoid ambiguity, the exit pupil, the eye point and the optical axis are further illustrated in the present technical solution as follows: the exit pupil is an optical image of an entrance pupil of an optical system of the near-eye display to be measured, and is a common exit of emergent light beams from the various points on an object plane (i.e., an original emission surface of a display image), and the position and size of the exit pupil of the near-eye display are important parameters of the near-eye display; the eye point is located at the center of the exit pupil, and is also a foot point of the optical axis and the exit pupil; and the optical axis is a straight line which passes through the eye point and is vertical to the plane where the exit pupil is located. The boundary clarity of the illumination image can also be replaced with the size of the area of the illumination image to serve as a criterion, that is, the optical receiving screen and the near-eye display to be measurement are caused to move relative to each other by means of the transmission mechanism, the optical receiving screen obtains illumination images at different spatial positions, until the area of the image is the minimum compared with those at other positions, at this time, a plane position where the optical receiving screen is located is the plane of the exit pupil of the near-eye display to be measured, and at this time, an illumination region obtained by the optical receiving screen is the exit pupil of the near-eye display to be measured. The results of exit pupil parameters obtained by the two criteria can be mutually verified.
Further, the process in which the transmission mechanism is controlled by the programmed control system, so that the near-eye display to be measured and the optical receiving screen move relative to each other specifically includes: obtaining a corresponding pose according to a light spot obtained at the position where the optical receiving screen is located, and adjusting the relative position between the optical receiving screen and the near-eye display to be measured by means of the transmission mechanism.
Further, as a technical solution, the near-eye display measurement apparatus further includes an imaging measurement unit, and the imaging measurement unit is aligned with the optical receiving screen. The imaging measurement unit acquires a illumination image on the optical receiving screen and measures light distribution information of the image, analyzes the illumination images at different spatial positions by using an image recognition algorithm, and obtains an exit pupil parameter of the near-eye display to be measured by using a tomography method. When the obtained illumination image has the clearest boundary, the area of the image is also the minimum compared with those at other positions, at this time, the plane position where the optical receiving screen is located is the plane where the exit pupil of the near-eye display to be measured is located, and the illumination region obtained by the optical receiving screen is the exit pupil of the near-eye display to be measured. The image recognition algorithm includes an image boundary recognition algorithm and an image center recognition algorithm, the boundary state of the light spot image is analyzed by using the image boundary recognition algorithm, and the center of the illumination image is analyzed by using the image center recognition algorithm. When the image information of the optical receiving screen is acquired by using an imaging measurement unit, it is easier to operate by using a transmissive optical receiving screen. At this time, the imaging measurement unit can be placed behind the optical receiving screen and synchronously moves with the optical receiving screen.
Further, as a technical solution, the near-eye display measurement apparatus further includes an optical tube, and the imaging measurement unit is connected with the optical receiving screen by means of the optical tube. The optical receiving screen is arranged at one end of an optical tube, the imaging measurement unit includes an imaging assembly, and the imaging assembly is arranged in the optical tube and is close to the other end, such that the imaging measurement unit and the optical receiving screen are integrally arranged.
Further, in the above technical solution, the image boundary recognition algorithm includes, but is not limited to, a boundary sharpness recognition algorithm and/or a boundary contrast recognition algorithm. When the image boundary sharpness and/or the contrast reach an extreme value, the clearest boundary is obtained. Further, the algorithm can be used for judging the boundary clarity of the light spot image obtained in each direction and position.
Further, in the above technical solution, the image center recognition algorithm includes, but is not limited to, a grayscale gravity center method or a geometric method. The grayscale gravity center method is to calculate the coordinates of a grayscale weight center according to the grayscale distribution of the light spot image obtained by the optical receiving screen. The geometric method is to acquire a graph which is enclosed by the boundary of the illumination image obtained by the optical receiving screen, and to calculate a geometric center of the graph.
Further, in the above technical solution, the optical axis of the imaging measurement unit passes through the center of the optical receiving screen, thereby simplifying the measurement steps, and improving the measurement efficiency.
Further, in the above technical solution, the near-eye display measurement apparatus further includes a displacement assembly for adjusting the distance between the imaging measurement unit and the optical receiving screen, and the imaging measurement unit is connected with the displacement assembly.
Further, in the above technical solution, the relative motion between the optical receiving screen and the near-eye display to be measured includes translation in three directions, that is, upper-lower, left-right and front-rear directions, and rotation along two or more mutually vertical rotating axes, or the relative motion between the optical receiving screen and the near-eye display to be measured includes a multi-degree-of-freedom composite motion.
Further, the transmission mechanism includes a rotating mechanism and/or a translation mechanism.
Further, the transmission mechanism is a robot mechanism having four or more rotating shafts.
Further, the optical receiving screen is made of a thin diffuse transmission film material, which has a high transmittance and a small thickness.
Further, the optical receiving screen is a diffusing screen with good diffuse transmission, and various points in the plane are uniform and isotropic.
The measurement apparatus of the near-eye display has the following beneficial effects: the present invention provides a near-eye display measurement apparatus, the implementation steps of the measurement solution are simple and feasible, thereby greatly simplifying the measurement steps of the optical axis and the eye point of the near-eye display, improving the measurement efficiency, and reducing the measurement cost.
In
Specific embodiments of the present invention are described below in combination with the accompanying drawings, but it should be understood by those skilled in the art that, the following embodiments are merely for illustration and are not intended to limit the scope of the present invention. It should be understood by those skilled in the art that, modifications can be made to the following embodiments without departing from the scope and spirit of the present invention. The protection scope of the present invention is defined by the appended claims.
The present embodiment discloses a measurement apparatus of a near-eye display, as shown in
The present embodiment discloses a measurement apparatus of a near-eye display, as shown in
The present embodiment discloses a measurement apparatus of a near-eye display, as shown in
The present embodiment discloses a measurement apparatus of a near-eye display, as shown in
The present embodiment further discloses a measurement method of a near-eye display, as shown in
The present embodiment further discloses a measurement method of a near-eye display, as shown in
repeating steps S1 to S4 until the boundary clarity of the illumination distribution image obtained in step S4 reaches a set range, then the optical axis position being the optical axis position of the near-eye display to be measured, the region where the boundary-clear illumination distribution image obtained by the area array photoelectric sensor is located being the exit pupil of the near-eye display, and the center of the illumination distribution image being an eye point.
The present embodiment discloses a near-eye display measurement apparatus, as shown in
The present embodiment discloses a near-eye display measurement apparatus, as shown in
The present embodiment discloses a near-eye display measurement apparatus, as shown in
Number | Date | Country | Kind |
---|---|---|---|
202210205733.3 | Mar 2022 | CN | national |
202321602643.4 | Jun 2023 | CN | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2022/140316 | Dec 2022 | WO |
Child | 18648424 | US |