Patent Application
20200107730
The present disclosure relates to an information processing method, an information processing device, and an information processing system for performing diagnosis by utilizing biometric information of a target person.
Recent years have seen shortages of hospitals and physicians mainly in regions other than urban areas. Remote diagnosis over a network is considered to be promising as measures against the shortages.
In diagnosis of mental disorders, physicians diagnose diseases based on facial expressions, the line-of-sights, and the facial colors of patients through medical interviews. Meanwhile, near-infrared spectroscopy (NIRS) devices, which are devices utilizing NIRS, are used as auxiliary tools for diagnosis. Each NIRS device illuminates a target portion of a target person with light, such as near-infrared light, and detects light that returns from the target portion, to thereby obtain information of blood flow of the target portion.
Use of the NIRS devices makes it possible to non-invasively detect changes in cerebral blood flow of target people. Diagnosis utilizing NIRS is performed, for example, in the following manner. First, a patient performs a task for diagnosis, while wearing an NIRS device. Prior to and subsequent to the task, the NIRS device is used to measure changes over time in light that has propagated in blood of the brain, an intensity distribution of the light, and so on. Based on these pieces of measured information, a physician diagnoses whether or not the target person has a mental disorder and the type of mental disorder.
Japanese Unexamined Patent Application Publication No. 2014-023866 discloses one example of a brain-activity-state analyzing method utilizing an NIRS device.
In one general aspect, the techniques disclosed here feature an information processing method including: obtaining first image data indicating an image of at least one portion of a face of a target person from a first camera connected to or built into a first computer; obtaining cerebral blood flow information indicating a state of cerebral blood flow of the target person from a detector that is connected to or built into the first computer and that detects the cerebral blood flow information; and displaying, on a display connected to or built into a second computer connected to the first computer through a remote network, an output image including a first image based on the first image data and a second image based on the cerebral blood flow information. The first image is a moving image including the at least one portion of the face of the target person; and the second image indicates changes over time in the cerebral blood flow information.
It should be noted that general or specific embodiments may be implemented as a device, a system, a method, or any selective combination thereof.
Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
Traditional medical interviews or diagnoses using NIRS devices need to be performed face-to-face between a diagnosing person (e.g., a physician) and a target person (e.g., a patient). However, owing to a shortage of hospitals or physicians in recent years, as described above, there are demands for remote medical diagnosis. An embodiment of the present disclosure provides an information processing method that is particularly effective for remote diagnosis. The technology disclosed herein can also be applied to cases in which a diagnosing person and a target person are near each other.
The embodiment of the present disclosure includes, for example, an information processing method, an information processing device, and an information processing system described below.
An information processing method according to a first item includes: obtaining first image data indicating an image of at least one portion of the face of a target person from a first camera connected to or built into a first computer; obtaining cerebral blood flow information indicating a state of cerebral blood flow of the target person from a detector that is connected to or built into the first computer and that detects the cerebral blood flow information; and displaying, on a display connected to or built into a second computer connected to the first computer through a remote network, an output image including a first image based on the first image data and a second image based on the cerebral blood flow information. The first image is a moving image including the at least one portion of the face of the target person; and the second image indicates changes over time in the cerebral blood flow information.
In this information processing method, an output image including a moving image of the face of a target person and changes over time in cerebral blood flow information of the target person is transmitted through a remote network and is displayed on the display of the second computer connected to the first computer. This allows a diagnosing person who operates the second computer to effectively perform remote diagnosis of the target person.
In the information processing method according to the first item, the first image may indicate at least one selected from the group consisting of a change in a facial expression of the target person, a change in a line-of-sight of the target person, and a change in facial color of the target person.
This allows the diagnosing person to effectively perform remote diagnosis of the target person.
In the information processing method according to the first or second item, the second image may include a graph indicating changes over time in numerically expressed cerebral blood flow information.
This allows the diagnosing person to effectively perform remote diagnosis of the target person.
The information processing method according to the third item may further include causing an output device connected to or built into the first computer to output task information indicating a task to be performed by the target person. The second image may further include an image indicating a correspondence relationship between the changes over time in the cerebral blood flow information and a period in which the task information is output.
This clarifies the changes over time in the cerebral blood flow information of the target person during execution of the task.
The information processing method according to the fourth item may further include detecting a change that exceeds a reference from at least one piece of data selected from the group consisting of second image data from the first camera, third image data from a second camera connected to or built into the first computer, and audio data from a microphone connected to or built into the first computer. The second image may further include an image indicating a correspondence relationship between the changes over time in the cerebral blood flow information and a period in which the change is detected from the at least one piece of data.
This clarifies influences that an event has on changes over time in the cerebral blood flow information of the target person.
The information processing method according to the third item may further include: selecting part of the cerebral blood flow information indicating cerebral blood flow information related to at least one specific region in a brain of the target person; and expressing the part as a graph.
Expressing the part of the cerebral blood flow information as a graph eliminates the need for extensively checking the cerebral blood flow information of the target person. As a result, the diagnosing person can effectively perform remote diagnosis of the target person.
The information processing method according to the sixth item may further include: causing the display to display an item for determining the at least one specific region; and obtaining input information regarding the item from an input device connected to or built into the second computer. The at least one specific region may be determined according to the input information.
In this information processing method, when a cerebral region that becomes active greatly according to a disease or a symptom is known from statistical data, setting the cerebral region by using the input device makes it possible to easily determine the specific region.
The information processing method according to the sixth item may further include causing an output device connected to or built into to the first computer to output preliminary task information indicating a preliminary task to be performed by the target person. The at least one specific region may be determined according to a change in the cerebral blood flow information with respect to the preliminary task information.
This determination method is effective when the cerebral region that becomes active according to a disease or a symptom is not known.
The information processing method according to the first item may further include: selecting part of the cerebral blood flow information indicating cerebral blood flow information related to at least one specific region in a brain of the target person; and transmitting the part from the first computer to the second computer through the remote network.
This makes it possible to reduce the amount of communication from the first computer to the second computer. As a result, delay in the communication can be suppressed or reduced.
The information processing method according to the ninth item may further include: causing the display to display an item for determining the at least one specific region; and obtaining input information regarding the item from an input device connected to or built into the second computer. The at least one specific region may be determined according to the input information.
In this information processing method, when a cerebral region that becomes active greatly according to a disease or a symptom is known from statistical data, setting the cerebral region by using the input device makes it possible to easily determine the specific region.
The information processing method according to the ninth item may further include causing an output device connected to or built into to the first computer to output preliminary task information indicating a preliminary task to be performed by the target person. The at least one specific region may be determined according to a change in the cerebral blood flow information with respect to the preliminary task information.
This determination method is effective when the cerebral region that becomes active according to a disease or a symptom is not known.
In the information processing method according to one of the first to third items, the output image may be obtained by combining the first image and the second image.
This allows the diagnosing person to effectively perform remote diagnosis while viewing both the face of the target person and the cerebral blood flow information thereof.
In the information processing method according to the 12th item, the detector comprises: at least one light source that illuminates a target portion of a head portion of the target person with emission light; an image sensor that detects reflection light that returns from the target portion; and a processing circuit that generates the cerebral blood flow information for the target portion, based on information of the reflection light detected by the image sensor, and that outputs the cerebral blood flow information. The at least one light source may illuminate a plurality of regions in the target portion with the emission light. The image sensor may output a signal indicating an intensity distribution of the reflection light from the plurality of regions. The processing circuit may generate the cerebral blood flow information, based on the signal, and may output the cerebral blood flow information. The second image may indicate the changes over time in the cerebral blood flow information for the plurality of regions.
In this information processing method, a two-dimensional distribution of the target person's cerebral blood flow detected by the image sensor is combined with the moving image of the face of the target person and is displayed. This allows the diagnosing person to effectively perform remote diagnosis of the target person.
In the information processing method according to the 13th item, the at least one light source may include: a first light source that illuminates the target portion with first emission light having a wavelength that is 650 nm or more and less than 805 nm; and a second light source that illuminates the target portion with second emission light having a wavelength that is larger than 805 nm and is 950 nm or less. The image sensor may output a first electrical signal corresponding to an amount of first reflection light that returns from the target portion as a result of the illumination of the first emission light and a second electrical signal corresponding to an amount of second reflection light that returns from the target portion as a result of the illumination of the second emission light. The processing circuit may generate, as the cerebral blood flow information, information indicating a concentration of oxygenated hemoglobin and a concentration of deoxygenated hemoglobin in cerebral blood in the target portion, based on the first electrical signal and the second electrical signal. The second image may include information indicating changes over time in at least one selected from a group consisting of the concentration of oxygenated hemoglobin in the target portion and the concentration of deoxygenated hemoglobin in the target portion.
In this information processing method, oxygenated hemoglobin and deoxygenated hemoglobin in cerebral blood of the target person can be obtained with the two light sources. This allows the diagnosing person to diagnose the state of the brain activity of the target person in detail.
In the information processing method according to one of the first to 14th items, the second computer may switch an image displayed on the display in response to an operation on the second computer. The information processing method may further include: causing the first image to be displayed on the display; and causing the second image to be displayed on the display in addition to the first image or instead of the first image, in response to the operation.
In this information processing method, for example, when the diagnosing person performs an operation on the second computer, the second image can be displayed on the display in addition to or instead of the face image of the target person. This allows the diagnosing person to effectively perform remote diagnosis of the target person.
In the information processing method according to the first to 15th item, the detector may be built into a head-mounted device connected to the first computer and worn on a head portion of the target person.
This makes it possible to reduce influences of ambient light, even for outdoor use.
The information processing method according to one of the first to 16th items may further include: assessing at least one selected from a group consisting of a psychological state of the target person and a probability of the target person having a disease, based on the cerebral blood flow information; and displaying a result of the assessment on the display.
This allows the diagnosing person to effectively perform remote diagnosis of the target person.
An information processing device according to an 18th item is an information processing device connected to a first computer and a second computer through a network and includes a processing circuit and a memory in which a computer program is stored. The computer program causes the processing circuit to execute: obtaining first image data indicating an image of at least one portion of the face of a target person from a camera connected to or built into the first computer; obtaining cerebral blood flow information indicating a state of cerebral blood flow of the target person from a detector that is connected to or built into the first computer and that detects the cerebral blood flow information; and displaying, on a display connected to or built into the second computer connected to the first computer through a remote network, an output image including a first image based on the first image data and a second image based on the cerebral blood flow information. The first image is a moving image including the at least one portion of the face of the target person; and the second image indicates changes over time in the cerebral blood flow information.
This allows a diagnosing person who operates the second computer to effectively perform remote diagnosis of the target person.
An information processing system according to a 19th item includes the information processing device according to the 18th item and the display.
In this information processing system, by using the information processing device according to the 18th item and the display, the diagnosing person can effectively perform remote diagnosis of the target person.
The information processing system according to the 19th item may further include the detector and the camera.
In this information processing system, by using the information processing device according to the 19th item, the output device, and the camera, the diagnosing person can effectively perform remote diagnosis of the target person.
In the present disclosure, all or a part of any of circuits, units, devices, parts, or portions or any of functional blocks in the block diagrams may be implemented as one or more of electronic circuits including, but not limited to, a semiconductor device, a semiconductor integrated circuit (IC), or a large-scale integration (LSI). The LSI or IC can be integrated into one chip or also can be a combination of a plurality of chips. For example, functional blocks other than a memory may be integrated into one chip. Although the name used here is LSI or IC, it may also be called system LSI, very large scale integration (VLSI), or ultra large scale integration (ULSI) depending on the degree of integration. A field programmable gate array (FPGA) that can be programmed after manufacturing an LSI or a reconfigurable logic device that allows reconfiguration of the connection or setup of circuit cells inside the LSI can also be used for the same purpose.
In addition, the functions or operations of all or a part of the circuits, units, devices, parts, or portions can be implemented by executing software. In such a case, the software is recorded on one or more non-transitory recording media, such as a ROM, an optical disk, or a hard disk drive, and when the software is executed by a processor, the software causes the processor together with peripheral devices to execute the functions specified in the software. A system or a device may include such one or more non-transitory recording media on which the software is recorded and a processor together with necessary hardware devices, such as an interface.
An embodiment of the present disclosure will be described below in detail. However, an overly detailed description may be omitted herein. For example, a detailed description of already well-known things and a redundant description of substantially the same configuration may be omitted herein. This is to avoid the following description becoming overly redundant and to facilitate understanding of those skilled in the art. The accompanying drawings and the following description are provided so as to allow those skilled in the art to fully understand the present disclosure and are not intended to limit the subject matters recited in the claims. In the following description, the same or similar constituent elements are denoted by the same reference numerals.
The present embodiment relates to an information processing method, an information processing device, and an information processing system for a diagnosing person (e.g., a physician) to remotely diagnose, for example, a psychological state of a target person (e.g., a patient). In the present embodiment, the diagnosing person and the target person are assumed to be at two locations (e.g., a hospital and the home of the target person) that are distant from each other. The two locations are connected to each other through a remote network.
The “remote network” means an information network that connects two distant sites. The remote network is, for example, the Internet or a wide area network (WAN), such as a dedicated line, and does not include a network constituted by only a local area network (LAN). The remote network may be implemented by a virtual private network (VPN).
The “psychological state” as used herein refers to a mood (e.g., comfort or discomfort), an emotion (e.g., relief, worry, sadness, or anger), a health condition (e.g., liveliness or fatigue), a thermal sensation (e.g., hot, cold, or muggy), a medical condition (e.g., mania, depression, or schizophrenia), or an index (e.g., the degree of proficiency, the degree of learning, or the degree of concentration) indicating the degree of a brain activity that derives therefrom. The psychological state can be assessed based on changes in a cerebral blood flow rate or changes in a component (e.g., hemoglobin) in blood. For example, when the activity of nerve cells changes in response to a change in the psychological state of a human, the cerebral blood flow rate or a component in blood changes. Accordingly, when a detecting device, such as an NIRS device, is used to measure biometric information, such as changes in a cerebral blood flow rate or changes in a component in blood, the psychological state of the target person can be assessed.
The detecting device 10 is, for example, an NIRS device and detects cerebral blood flow information of a target person 1. The detecting device 10 includes at least one light source 12, a photodetector 14, and a processing circuit 16. The camera 20 photographs the target person 1 to output image data. The image data indicates at least one of, for example, a facial expression, the line-of-sight, and facial color of the target person 1. The information processing device 40 generates information for diagnosing the psychological state of the target person 1, based on the cerebral blood flow information detected by the detecting device 10, and transmits the generated information to the display 30.
The information processing device 40 includes a processing circuit 42 and a memory 44. The memory 44 stores a computer program 46 therein. The computer program 46 causes the processing circuit 42 to execute processes (1) to (4) below:
Processes (1) and (2) described above may be interchanged in order or may be performed at the same time.
In process (4) described above, the image that is displayed on the display 30 may be a combination of a first image based on the first image data, the first image being a face image of the target person, and a second image based on the second image data, the second image being an image indicating changes over time in the cerebral blood flow information. These two images may be displayed at the same time or may be displayed at different timings. Alternatively, one output image obtained by combining the two images together may be displayed. Each image that is displayed is not limited to a still image and may be a moving image. When the image that is displayed is a moving image, the first image may indicate at least one selected from a group consisting of, for example, a change in the facial expression, a change in the line-of-sight, and a change in the facial color of the target person 1. When the image that is displayed is a moving image, the second image may be an image indicating changes over time in numerically expressed cerebral blood flow information.
When a moving image is displayed, the information processing device 40 repeatedly executes processes (1) to (4) described above, for example, at regular time intervals. The regular time intervals depend on the frame rate of the moving image. For example, when a moving image having a frame rate of 30 frames per second (fps) is displayed, the information processing device 40 repeatedly executes processes (1) to (4) at intervals of 1/30 second. When the intervals are sufficiently short, real-time remote diagnosis using a moving image is possible. The repetition intervals depend on throughput of each device and the bandwidth of a network. For example, the intervals may be set to 1 second or less or may be set to 1/30 second or less. The intervals, however, are not limited to the aforementioned range. A camera image that is a moving image based on the first image data and a cerebral blood flow image that is a moving image based on the second image data may be displayed with different frame rates. For example, the camera image may be displayed with a frame rate of 30 fps or more, and the cerebral blood flow image may be displayed with a frame rate of several frames per second or more. Since the cerebral blood flow changes relatively slowly, there is practically no problem with the frame rate of the cerebral blood flow image even when it is lower than the frame rate of the camera image.
The processing circuit 42 in the information processing device 40 may be, for example, a processor, such as a central processing unit (CPU) or a graphics processing unit (GPU). A combination of a processor and a computer program realizes an information processing method in the present embodiment. The processing circuit 42 and the memory 44 may be realized by one integrated circuit. The processing circuit 42 may be realized by, for example, a digital signal processor (DSP) or a programmable logic device (PLD), such as a field programmable gate array (FPGA).
As illustrated in
The “cerebral blood flow information” as used herein refers to arbitrary information indicating the state of blood in the brain. The cerebral blood flow information may be, for example, raw data output from the photodetector 14 or data generated by processing raw data. The raw data output from the photodetector 14 means data indicating the amount of reflection light from at least one region of a target portion. When the photodetector 14 transmits the raw data to the information processing device 40, the processing circuit 16 transfers the raw data to the information processing device 40 without performing any particular processing on the raw data. The processing circuit 16 may generate, as the cerebral blood flow information, information indicating the concentration of at least one of oxygenated hemoglobin and deoxygenated hemoglobin in cerebral blood in the target portion 2. The processing circuit 16 may generate information about the number of pulses as the cerebral blood flow information. The processing circuit 42 in the information processing device 40, instead of the processing circuit 16, may perform processing for generating the cerebral blood flow information.
The photodetector 14 has at least one light-receiving element having sensitivity to light emitted from the light source 12. Typically, the photodetector 14 is an image sensor in which a plurality of light-receiving elements is arranged two-dimensionally. The individual light-receiving elements in the image sensor output electrical signals corresponding to the amounts of received light through photoelectric conversion. The collection of the electrical signals provides image signals.
The light source 12 emits, for example, light having a wavelength of 650 nm or more and 950 nm or less. This wavelength range is included in the wavelength range of red to near-infrared light. This wavelength range is called the biological window and is known to have a low in-vivo absorption rate. Although the light source 12 in the present embodiment is described as emitting light in the above-described wavelength range, it may use light in another wavelength range. Terms for “light” are also used herein not only for visible light but also for infrared light.
In a visible light region that is smaller than a wavelength of 650 nm, the rate of absorption by oxygenated hemoglobin (HbO2) and the rate of absorption by deoxygenated hemoglobin (Hb) in blood are high, and in a wavelength range that is larger than 950 nm, the rate of absorption by water is high. On the other hand, in a wavelength range of 650 nm or more and 950 nm or less, the rates of absorption by oxygenated hemoglobin, deoxygenated hemoglobin, and water are relatively low, and the rates of scattering by oxygenated hemoglobin, deoxygenated hemoglobin, and water are relatively high. For a wavelength of 805 nm, the rate of absorption by oxygenated hemoglobin and the rate of absorption by deoxygenated hemoglobin become equal to each other.
Accordingly, when information on both the oxygenated hemoglobin and the deoxygenated hemoglobin is to be obtained, the light source 12 may be implemented by a first light source that emits light having a first wavelength that is 650 nm or more and is less than 805 nm and a second light source that emits light having a second wavelength that is larger than 805 nm and is 950 nm or less. For example, the first wavelength may be 750 nm, and the second wavelength may be 850 nm.
When light having two wavelengths is used as described above, the photodetector 14 is configured so as to individually detect the light having the wavelengths. For example, the photodetector 14 may include at least one photodiode and a plurality of charge accumulators. In this case, the light source 12 emits the light having two wavelengths at different timings, and in synchronization with the timing at which the light having the two wavelengths returns, signal charges resulting from the light are accumulated in two charge accumulators. This makes it possible to individually detect the light having the two wavelengths. In this case, the photodetector 14 outputs a first electrical signal corresponding to the amount of light having a first wavelength which arrives from the target portion 2 and a second electrical signal corresponding to the amount of light having a second wavelength which arrives from the target portion 2. By performing predetermined arithmetic operations based on the first and second electrical signals, the processing circuit 16 can determine the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin in the target portion 2. In one example, the processing circuit 16 generates information of the concentrations as the cerebral blood flow information.
The processing circuit 42 in the information processing device 40 obtains the cerebral blood flow information from the processing circuit 16 and generates second image data including information for diagnosing the psychological state of the target person 1. The second image data may include, for example, information indicating changes over time in at least one of the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin in the target portion 2. Such information is displayed on the display 30 to thereby allow the diagnosing person to diagnose the state of the brain activity of the target person in detail.
The detecting device 10 and the camera 20 may be connected to or built into a first computer operated by the target person 1. The display 30 may be connected to or built into a second computer operated by the diagnosing person. The first and second computers may be, for example, personal computers (PCs), tablet computers, or information equipment, such as smartphones. The first computer at the target-person side and the second computer at the diagnosing-person side may both have communication functions to connect to each other through a remote network. In such a configuration, the information processing device 40 may be a third computer connected to the first and second computers through a remote network. Alternatively, the second computer at the diagnosing-person side may function as the information processing device 40.
A variety of variations are possible to the configuration of the target-person's computer 50, the detecting device 10, and the camera 20. Some examples of the variations will be described below.
In the example illustrated in
According to each configuration example described above, the information processing device 40 can simultaneously obtain a face image and a cerebral blood flow image of the target person 1 and can cause the images to be displayed on the display 30. This allows accurate diagnosis to be performed even from a remote location, as in a case in which the diagnosing person directly diagnoses the target person 1.
Next, a description will be given of an example of the operation of the information processing system in the present embodiment. In the following description, the configurations illustrated in
The detecting device 10 measures the cerebral blood flow of the target person 1 and transmits raw data of the cerebral blood flow to the target-person's computer 50. The processing circuit 16 in the target-person's computer 50 performs signal processing using raw data output from the detecting device 10, to generate data of the cerebral blood flow based on the raw data. In the signal processing, predetermined arithmetic operations based on the first and second electrical signals are performed to determine the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin. After the signal processing, the target-person's computer 50 transmits a control signal for changing the settings, such as a detection region, exposure, and a lighting intensity, to the detecting device 10, when necessary. Cases in which the transmission of the control signal is necessary include, for example, a case in which the distance between the target person 1 and the detecting device 10 changes from the distance before the measurement and a case in which the amount of ambient light changes from the amount of ambient light before the measurement.
After the signal processing, the processing circuit 16 in the target-person's computer 50 transmits the generated data (i.e., the cerebral blood flow information) of the cerebral blood flow to the information processing device 40 through the network. The processing circuit 42 in the information processing device 40 stores the data in the memory 44. The information processing device 40 performs statistical processing based on the data accumulated up to that point in time, to assess the psychological state (e.g., the presence/absence of a mental disorder and the type thereof) of the target person 1. For example, data of changes over time in cerebral blood flow of a large number of target people and/or data of a spatial distribution of the cerebral blood flow are recorded to a recording medium for respective various races, genders, medical conditions in association with the medical conditions at the respective points in time. The processing circuit 42 in the information processing device 40 can assess the state of the target person 1 by comparing the current data of the cerebral blood flow of the target person 1 with the accumulated past data. A result of this assessment is referred to as a “diagnosis result”. The information processing device 40 transmits the second image data, which is the generated data of the cerebral blood flow, and data indicating the diagnosis result to the diagnosing-person's computer 60. The diagnosing-person's computer 60 causes the display 30 to display the cerebral blood flow information and an image indicating the diagnosis result.
Next, a description will be given of a flow of remote diagnosis performed between a target person and a diagnosing person.
First, the target-person's computer 50 and the detecting device 10 perform baseline measurement (step S101). The baseline measurement refers to measurement for obtaining an initial value of the cerebral blood flow information. The target person 1 performs a simple task, such as calculation, for a certain period of time (e.g., two minutes). During the period of time, the detecting device 10 illuminates the forehead portion of the target person 1 with light and detects reflection light therefrom. Based on a signal output from the photodetector 14 in the detecting device 10, the processing circuit 16 determines the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin.
Next, the processing circuit 16 analyzes data of the determined cerebral blood flow and checks motion of the target person 1 or the presence/absence of noise (step S102). For example, the motion of the target person 1 can be known in a manner described below. In nature, the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin exhibit opposite changes over time. Accordingly, when changes over time in both the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin increase or decrease, it can be determined that the target person 1 is moving.
Based on the analysis result, the processing circuit 16 determines whether or not the data is adequate (step S103). If the data is not adequate, steps S101 to S103 are performed again.
If the data is adequate, remote communication is started between the target person 1 and the diagnosing person. The camera 20 obtains data of a face image of the target person 1, and the detecting device 10 obtains the data of the cerebral blood flow of the target person 1 (step S104). These pieces of data are transmitted to the processing circuit 42 in the information processing device 40. The processing circuit 42 transmits image data based on the pieces of data to the display 30 of the diagnosing-person's computer 60. As a result, the face image of the target person 1 and an image indicating information of the cerebral blood flow are displayed on the display 30 of the diagnosing-person's computer 60. Thus, the diagnosing person performs medical examination on the target person 1 through video calling therewith and acquires information on a symptom and so on through conversation with the target person 1 (step S106).
The processing circuit 16 in the target-person's computer 50 further analyzes the cerebral blood flow data obtained in step S104 and causes the analysis result to be displayed on the display 30 of the diagnosing-person's computer 60 (step S105). Based on the displayed analysis data, the diagnosing person diagnoses the target person 1 (step S107). Based on the analysis data, the diagnosing person determines whether or not more detailed examination on the target person 1 is needed (step S108). If detailed examination on the target person 1 is not needed, the diagnosis ends.
If it is determined that detailed examination on the diagnosing person is needed, the information processing device 40 presents task information, such as a task for diagnosis, to an output device of the target-person's computer 50 (step S110). The output device of the target-person's computer 50 is, for example, a display or a microphone. The task for diagnosis checks changes in a blood flow rate between a state in which the target person 1 is relaxing and a state in which the target person 1 is working on a test.
It is known that the functions of the brain are localized to some degree. Thus, the task for diagnosis is designed depending on what state of the target person 1 is to be known. For example, an N-back task may be used as the task for diagnosis. The N-back task is also called a continuous performance test and is a test in which a target person responds to a stimulus presented N-stimuli earlier. In the N-back test, it is difficult to memorize the test, and a cerebral-blood-flow change reduction due to habituation is less likely to occur. The difficulty increases, as N increases. Thus, the difficulty of the test can be set easily.
After the target person 1 performs the task for diagnosis, the target-person's computer 50 presents diagnosis data and a diagnosis result to the display 30 of the diagnosing-person's computer 60 via the information processing device 40 (step S111). The diagnosis result is obtained by verifying the diagnosis data against a database. This makes it possible to assess the type and the probability of the target person 1 having a disease.
Next, a description will be given of events that are disturbance factors that affect the measurement result of cerebral blood flow of the target person 1 during the diagnosis task.
The events are broadly classified into events caused by the measurement environment of the target person 1 side and events caused the target person 1 himself or herself.
Examples of the events caused by the measurement environment of the target person 1 side include a large ambient sound and a room lighting change due to turning on or off of a light. For diagnosing depression, changes over time in the cerebral blood flow during a diagnosis task are used. When changes over time in the cerebral blood flow vary owing to a measurement environment, there is a possibility that the change affects the diagnosis.
Examples of the events caused by the target person 1 himself or herself include large motion of the body of the target person 1 and a decline in the concentration power of the target person 1 during a diagnosis task. Relative positional displacement between the target person 1 and the photodetector 14 or a decline in the concentration power of the target person 1 can affect the cerebral blood flow measurement.
Each of the events described above can be detected based on at least one of a plurality of pieces of data below. The plurality of pieces of data includes image data from the camera 20 in the target-person's computer 50, image data from another camera connected to or built into the target-person's computer 50, and audio data from a microphone connected to or built into the target-person's computer 50. For example, the above-described events can be detected by a camera for videophone used in remote diagnosis, another camera, or a microphone.
Next, a description will be given of an example of an event determination method.
The events caused by a large ambient sound can be determined in the following manner. When the volume of sound detected by a microphone exceeds a given threshold with reference to the volume of voice in conversation between the target person 1 and the diagnosing person, it is determined that an event has occurred.
The events caused by a room lighting change can be determined in the following manner. When illuminance changes from illuminance in a camera image by a certain amount or more, it is determined that an event has occurred.
The events caused by large motion of the body of the target person 1 can be determined in the following manner. When the relative position between the target person 1 and the photodetector 14 changes in a camera image by a certain amount or more, it is determined that an event has occurred. The certain amount is, for example, ±3 cm.
The events caused by a decline in the concentration power of the target person 1 can be determined in the following manner. When the line-of-sight of the target person 1 changes by a certain amount, it is determined that an event has occurred.
The above-described events may be determined by artificial intelligence (AI) built into the information processing device 40 or the target-person's computer 50.
Next, a description will be given of an example displayed on the display 30 of the diagnosing-person's computer 60.
As illustrated in
As illustrated in
In the example illustrated in
In the present embodiment, images indicating cerebral blood flow information expressed as graphs are displayed in real time, as illustrated in
The following description will be given of an example of a method for determining the specific region.
When a cerebral region that becomes active significantly according to a disease or a symptom is known from statistical data, a specific region pre-expressed as a graph before diagnosis can be selected from candidates. For example, the name of a portion of at least one specific region corresponding to a disease or a symptom is set for a candidate. Herein, the set candidates are referred to as “set items”. The processing circuit 42 causes the display 30 of the diagnosing-person's computer 60 to display the set items. Instead of displaying the set items, at least one specific region surrounded by a line may be displayed, as illustrated in
The diagnosing person inputs input information regarding the set items to an input device connected to or built into the diagnosing-person's computer 60. The input device is, for example, a user interface, such as a keyboard or a mouse. The processing circuit 42 obtains the input information and determines a specific region in accordance with the input information. Only the determined specific region is displayed on the display 30 of the diagnosing-person's computer 60, with the specific region being surrounded by a line. A plurality of cerebral regions that become active according to a disease or a symptom may exist. Accordingly, the number of specific regions that are determined does not necessarily have to be one and may be two or more.
Another possible example of the method for determining the specific region may be a method for checking the specific region by making the target person 1 perform a preliminary task, such as simple calculation, before the task for diagnosis. For example, in step S104 illustrated in
As described above, in the present embodiment, it is not necessary to measure cerebral blood flow in a large range in the brain of the target person 1. Herein, cerebral blood flow information related to at least one specific region in the brain of the target person 1 is referred to as “part of cerebral blood flow information”.
In the present embodiment, the part of cerebral blood flow information may be selected, for example, using the above-described determination method, and the selected part of cerebral blood flow information may be expressed as a graph. Expressing the part of cerebral blood flow information as a graph can enhance the efficiency of the diagnosis.
In the present embodiment, the part of cerebral blood flow information may be selected, for example, using the above-described determination method, and the selected part of cerebral blood flow information may be transmitted from the target-person's computer 50 to the diagnosing-person's computer 60 through a remote network. Transmitting the part of cerebral blood flow information before it is expressed as a graph can reduce the amount of communication. As a result, it is possible to reduce delay in communication.
The target person 1, instead of the diagnosing person, may select the part of cerebral blood flow information. In such a case, the set items may be displayed on the display of the target-person's computer 50.
When the display illustrated in
When a face image of the target person 1 and an image indicating changes in the cerebral blood flow of the target person 1 are displayed at the same time, as illustrated in
In response to an operation of the diagnosing person, the diagnosing-person's computer 60 may switch the image displayed on the display 30. For example, only a face image may be initially displayed and be switched to a cerebral blood flow image or the image illustrated in
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-123223 | Jun 2017 | JP | national |
| 2018-079949 | Apr 2018 | JP | national |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2018/019002 | May 2018 | US |
| Child | 16704135 | US |
