Patent Application
20240081720
This application claims priority to and the benefit of Korean Patent Application No. 10-2021-0185393, filed on Dec. 22, 2021, the disclosure of which is incorporated herein by reference in its entirety.
The present invention relates to a technology for diagnosing dizziness by testing eye movement (motion) and, more particularly, to a method and apparatus for diagnosing dizziness through eye movement measurement based on virtual reality capable of utilizing a commercialized virtual reality device to measure and test eye movement and transmit resultant data, measuring optokinetic nystagmus through the movement of various gazing points (objects) generated in virtual reality, and diagnosing dizziness through the measurement, a recording medium storing a program for realizing the same, and a computer program stored in the recording medium.
Dizziness refers to all the symptoms of feeling as if a person or surrounding objects are moving even if they are still. It is mainly caused by abnormalities in the peripheral vestibular system or a central vestibular system. Clinically, the dizziness is determined based on whether a vestibular function is abnormal through an interaction between the vestibular system and vision, that is, the vestibular-ocular reflex. The vestibular-ocular reflex refers to the ability to fix gaze regardless of a change in a head position, and when there is the abnormality in the vestibular system, people suffer from dizziness as if the world is moving due to a loss of visual fixation. Although the vestibular-ocular reflex has the ability to fix gaze in response to the rapid change in the head position, but it has been known that the vestibular-ocular reflex does not play a large role in the extremely slow change (rotation) in the head position. Accordingly, an oculomotor function is responsible for visual fixation of the extremely slow change in the head position that the vestibular-ocular reflex is not responsible for. Accordingly, a human body recognizes space and maintains balance through maintaining proper mutual functions of the oculomotor function and the vestibular-ocular reflex.
A video nystagmographynystagmography is commonly used as an apparatus for testing whether there are functional abnormalities in the vestibular-ocular reflex and the oculomotor function. However, the nystagmography is manufactured based on hardware, and therefore, manufactured at a relatively high price. Due to the economic burden caused by the expensive nystagmography, many restrictions are inevitably followed. Therefore, an alternative technology is needed to replace the expensive nystagmography and test whether there are the functional abnormalities in the vestibular-ocular reflex and the oculomotor function.
As an alternative technology to the existing nystagmography, a currently commercialized headset-type virtual reality device may be used. Most virtual reality devices are provided with a function of tracking eye movement. Most of these functions of tracking eye movement are used for game purposes or marketing purposes, and are also partially used for medical purposes with limitation. In addition, since existing medical devices for measuring nystagmus have structures substantially similar to currently commercialized head mounted display (HMD), the existing medical devices can be used as the nystagmography. However, eye trackers attached to most virtual reality devices can track only a vector, and cannot practically transmit eye images to the outside based thereon.
[Patent Document]
An object of the present invention provides an apparatus and method for diagnosing dizziness capable of measuring and testing vestibular-ocular reflex and optokinetic nystagmus by replacing an expensive nystagmography used to test whether there are functional abnormalities in vestibular-ocular reflex and an oculomotor function.
Another object of the present invention provides an apparatus and method for diagnosing dizziness capable of testing vestibular-ocular reflex and optokinetic nystagmus using a virtual reality device.
Another object of the present invention provides an apparatus and method for diagnosing dizziness capable of measuring vestibular-ocular reflex by detecting a position and movement of a head, and testing optokinetic nystagmus by processing raw data acquired through an eye tracking function and an internal camera.
Another object of the present invention provides a recording medium storing a program for realizing the method of diagnosing dizziness is stored and a computer program stored in the recording medium.
In addition, the present invention is not limited to the above-described purpose, and various objects may be additionally provided through technologies described through embodiments and claims to be described later.
In an aspect of the present invention, an apparatus for diagnosing dizziness through eye movement measurement based on virtual reality includes a head movement detection unit configured to receive a signal detected from a head tracker attached to a virtual reality device and detecting a head position and movement of a patient to detect head movement of the patient, an eye movement video acquisition unit configured to receive raw data obtained by capturing eye movement of the patient from an eye tracker attached to the virtual reality device to acquire eye movement video, an eye movement video transmitting unit configured to transmit the eye movement video acquired by the eye movement video acquisition unit, a nystagmus detection unit configured to receive the eye movement video to filter saccadic oscillation in the eye movement video to detect nystagmus and filter meaningless eye movement that is not measured since an eye moves too slow or is covered due to blinking in the detected nystagmus to detect only meaningful nystagmus, and a diagnostic unit configured to diagnose the dizziness of the patient based on the meaningful nystagmus detected by the nystagmus detection unit.
The eye movement video acquisition unit may acquire the eye movement video by processing the raw data of the eye movement captured using an internal camera of the eye tracker using a processing program.
The apparatus may further include an arithmetic unit configured to calculate a relative ratio between the head movement and the eye movement by dividing a movement angle of a head detected by the head movement detection unit in response to a change in the patient's head by the eye movement angle obtained in response to the change in the head.
The diagnostic unit may determine that there is an abnormality in a vestibular function when the relative ratio calculated by the arithmetic unit is not “.”
The apparatus may further include a graph output unit configured to display the nystagmus detected by the nystagmus detection unit in three axes (horizon/vertical/torsional axes).
The apparatus may further include a gaze guidance gazing point providing unit configured to provide a gazing point for gaze guidance through a display installed in the virtual reality device.
The gazing point may have a curtain shape or a point shape.
The apparatus may further include a posture adjustment guide unit configured to provide the patient with an accurate posture required for each test through the virtual reality device.
In another aspect of the present invention, a method of diagnosing dizziness through eye movement measurement based on virtual reality includes (a) receiving a signal detected from a head tracker attached to a virtual reality device and detecting a head position and movement of a patient to detect the head movement of the patient, (b) receiving raw data obtained by capturing the eye movement of the patient from an eye tracker attached to the virtual reality device to acquire and transmit eye movement video, (c) distinguishing saccadic oscillation and nystagmus in the eye movement video and filtering meaningless eye movement that is not measured since an eye moves too slow or is covered due to blinking in the detected nystagmus to detect only meaningful nystagmus, and (d) diagnosing a type of dizziness of the patient based on the detected meaningful nystagmus.
In the operation (b), the eye movement video may be acquired and transmitted by processing the raw data of the eye movement captured using an internal camera of the eye tracker using a processing program.
In the operation (d), a relative ratio between the head movement and the eye movement may be calculated by dividing a movement angle of a head detected in response to the change in the head in the operation (a) by the eye movement angle moving in response to the change in the head, and it may be determined that there is abnormality in a vestibular function when the calculated relative ratio does not reach “I” or a normal value that is predetermined.
The method may further include (e) displaying the nystagmus detected in the operation (c) in three axes (horizon/vertical/torsion axes).
The method may further include, before the operation (b), (f) providing a gazing point for gaze guidance through the virtual reality device.
The gazing point may have a curtain shape or a point shape.
The method may further include, after the operation (a), (g) providing the patient with an accurate posture required for each test through the virtual reality device.
In addition, there is provided a computer-readable recording medium in which a program for realizing the method of diagnosing dizziness through eye movement measurement based on virtual reality according to another embodiment of the present invention in order to achieve the above object is stored.
In addition, there is provided a computer program stored in a computer-readable recording medium storing a program for realizing the method of diagnosing dizziness through eye movement measurement based on virtual reality according to another embodiment of the present invention in order to achieve the above object.
Various advantages and features of the present invention and methods accomplishing them will become apparent from the following description of embodiments with reference to the accompanying drawings. However, the present invention is not limited to embodiments disclosed below, but is embodied in a variety of different forms, and is provided to fully inform those skilled in the art of the scope of the invention to which the present invention belongs, and the present invention is defined by the scope of the claims.
In addition, terms used in the present specification are for explaining exemplary embodiments rather than limiting the present invention. Unless otherwise stated, a singular form includes a plural form in the present specification. For example, the terms “comprises” (or “includes”) and/or “comprising” (or “including”) used in the specification may add the mentioned components and processes. Throughout the specification, like reference numerals denote like elements. The term “and/or”includes each and every combination of one or more of the mentioned items.
Unless defined otherwise, all terms (including technical and scientific terms) used in the present specification have the same meaning as meanings commonly understood by those skilled in the art to which the present invention pertains. In addition, terms defined in commonly used dictionary are not ideally or excessively interpreted unless explicitly defined otherwise.
Referring to
As illustrated in
Referring to
As illustrated in
Referring to
In addition, the apparatus 10 for diagnosing dizziness according to the embodiment of the present invention includes an eye movement video acquisition unit 18 for processing the eye movement tracked by the eye tracker 12.
The eye movement video acquisition unit 18 may be integrated into the eye tracker 12 and operated, and recombine the raw signal data of the eye 1 captured through the internal camera 121 to transmit the eye movement video, that is, the eye movement video to the outside.
An example of the form of the raw signal data transmitted from the internal camera 121 is as follows.
Referring to
As illustrated in
The SDK generates an image transfer function using openCV, divides the eye image captured through the internal camera 121 into image frames, and transmits the divided image frames to the eye prediction module. In this case, the image frame is modified to load image frame data into a PIPE by modifying the openCV function and transmit the image frame data. Then, a receiving end of the PIPE may be implemented at a client side to extract an image frame (raw eye image data).
After receiving signals transmitted from the eye tracker 12, the eye movement video acquisition unit 18 recombines the signals in the same processing method as illustrated in
The nystagmus refers to involuntary movement of the eye. For example, when sitting on a chair that rotates to the right, eyes repeat the movement of turning to the right and then returning to an original state according to a rotating speed of the chair, although we are not aware of it. In this case, the eye movement that usually returns to its original state returns quickly, which is called “fast component.” Thus, the nystagmus is composed of “fast component” and “slow component.” However, although it looks like the nystagmus, there is an eye movement that is not the nystagmus, such as the eye moving quickly to the right and then quickly returning to its original state, or moving slowly to the right and then slowly returning to the left. This is not called the nystagmus but is usually called “saccadic oscillation.” Since the saccadic oscillation is a pathologic finding suggesting abnormality in the central-vestibular-optic pathway, it is very important to distinguish the saccadic oscillation from the nystagmus. Also, even with the nystagmus, when intensity (speed of the eye movement of the slow component) is too weak below 2-3 deg/sec or when an eye is covered due to blinking or the like, the nystagmus may not be properly measured, and the same goes for the saccadic oscillation.
Therefore, the nystagmus detection unit 20 filters the eye movement of the eye movement video transmitted through the eye movement video transmitting unit 19 to detect only the meaningful nystagmus. That is, the nystagmus detection unit 20 may distinguish between the saccadic oscillation and the nystagmus, and includes a function of detecting only nystagmus excluding the meaningless eye movement (movement that is not measured since eyes are blocked due to too slow, blinking, or the like).
In addition, since the nystagmus is the eye movement along a time axis, when the nystagmus is not detected for a specific period of time, such as when a patient closes his or her eyes, the nystagmus also includes a function of performing prediction through a pattern immediately before closing the eyes and after opening the eyes and performing measurement again. Describing an example of the case of navigation used while driving a car, even if GPS does not operate after entering the tunnel, the movement pattern of the nystagmus may be predicted by the same method as the method of displaying a car's route at a speed and location before entering the tunnel. In addition, in the case of the saccadic oscillation, it may include a function of warning to stop the test and recommending videography.
The meaningful nystagmus detected through the nystagmus detection unit 20 is transmitted to the graph output unit 21.
As illustrated in
Meanwhile, as illustrated in
As illustrated in
The gaze guidance gazing point providing unit 22 outputs a gazing point having a certain shape through the display 13 to evoke the optokinetic nystagmus, and the gazing point has a curtain shape (see
As illustrated in
The arithmetic unit 23 calculates a relative ratio obtained by dividing the movement angle of the head detected by the head movement detection unit 17, that is, the movement angle of the head from the reference value by the eye movement angle. Then, the relative ratio calculated by the arithmetic unit 23 is provided to a diagnostic unit 24.
The diagnostic unit 24 determines whether there is the abnormality in the vestibular function using the relative ratio calculated by the arithmetic unit 23. For example, when the head movement detection unit 17 may determine that there is the abnormality in the vestibular function when the value obtained by dividing the movement angle of the head detected in response to the change in the head by the eye movement angle, that is, the calculated relative ratio does not become “1.” For example, when the head moves 20° to the right for 1 second, the eyes normally move 200 for the same time in the opposite direction. For example, when it is assumed that, when the head moves 30° to the right for 1 second, eyes move only 20° during the same time, the arithmetic unit 23 divides the movement angle of the head (20°) by the nystagmus movement angle (30°), and when the divided value does not become “1,” the diagnostic unit 24 determines that there is the abnormality in the vestibular function of the right side. However, this process is a simple example, and the normal value of the calculated relative ratio is not necessarily “1,” which may be determined by experts using it by inputting normal values differently and classifying abnormalities according to the input normal values.
The diagnostic unit 24 may diagnose the type of dizziness of the patient based on the nystagmus detected by the nystagmus detection unit 20. In order to diagnose the type of dizziness of a patient, the information on the dizziness is stored and registered in a database, and the diagnostic unit 24 may compare the currently measured patient's nystagmus with pre-registered dizziness information to diagnose the type of dizziness (symptom).
Meanwhile, the apparatus 10 for diagnosing dizziness according to the embodiment of the present invention further includes a posture adjustment guide unit that provides a test method for an operation of each test and guides a guide in a posture required for an accurate test. The posture adjustment guide unit 25 provides (feedback) a posture required for accurate test to a patient through a speaker (not illustrated).
The feedback provided by the posture adjustment guide unit 25 is shown in Table 2 below.
Referring to
Subsequently, a video for the eye movement is obtained and transmitted (S2). For example, after the raw data is acquired by capturing the eye of the patient through the eye tracker 12 attached to the virtual reality device, the acquired raw data is acquired using, for example, the processing program as illustrated in
Subsequently, the meaningful nystagmus is detected from an eye of a patient with dizziness (S3). That is, the meaningful nystagmus is detected from the acquired eye movement video. For example, in the acquired eye movement video, the saccadic oscillation is filtered and only the nystagmus is detected, and the meaningless eye movement is filtered in the detected nystagmus to detect only actually meaningful nystagmus.
Subsequently, the type of dizziness of the patient is diagnosed based on the detected meaningful nystagmus (S4). For example, in order to diagnose the type of dizziness of a patient, the information on the dizziness is stored and registered in the database, and the diagnostic unit 24 may compare the currently measured patient's nystagmus with pre-registered dizziness information to diagnose the type of dizziness (symptom).
As illustrated in
As illustrated in
Referring to
The method of diagnosing dizziness according to the embodiment of the present invention described above may be implemented in the form of a recording medium (or computer program product) executable by a computer, such as a program module stored in a computer-readable medium and executed by a computer, for example.
Here, the computer-readable medium may include a computer storage medium (e.g., a memory, a hard disk, a magnetic/optical medium, a solid-state drive (SSD), or the like). A computer-readable medium may be any available media that may be accessed by a computer and includes both volatile and nonvolatile media and removable and non-removable media.
In addition, the method of diagnosing dizziness according to the embodiment of the present invention includes instructions executable by a computer in whole or in part, and the computer program includes programmable machine instructions processed by a processor, and may be implemented in a high-level programming language, object-oriented programming language, assembly language, or machine language, and the like.
As described above, according to an apparatus and method for diagnosing dizziness through virtual reality-based eye movement measurement according to embodiments of the present invention, by acquiring and transmitting eye movement videos using commercialized virtual reality devices, it is possible to simply test dizziness using a relatively inexpensive virtual reality device. In addition, it is possible to acquire information on a diagnosis of dizziness in an easy way by diagnosing dizziness through a simple test.
In addition, according to an apparatus and method for diagnosing dizziness through virtual reality-based eye movement measurement according to embodiments of the present invention, by recombining raw signal data (raw signal data for vector tracking) captured through an internal camera of an eye tracker to transmit eye movement video to the outside in real time and measure optokinetic nystagmus, it is possible to replace the role of the existing expensive nystagmography, minimize wasted medical costs due to unnecessary imaging tests in case of dizziness patients, and contribute to public health.
Hereinabove, although exemplary embodiments of the present invention have been described and illustrated using specific terms, such terms are only intended to clarify the present invention. It is obvious that various modifications and changes may be made to the embodiments of the present invention and the described terms without departing from the technical spirit and scope of the following claims. Such modified embodiments should not be individually understood from the spirit and scope of the present invention, and it is to be understood that the embodiments of the present invention fall within the scope of the claims of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2021-0185393 | Dec 2021 | KR | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/KR2022/008044 | 6/8/2022 | WO |
