This application is based upon and claims the benefit priority from prior Japanese patent application No. 2020-122965, filed on Jul. 17, 2020, and Japanese patent application No. 2021-112727, filed on Jul. 7, 2021, the entire contents of which are incorporated herein by reference.
The presently disclosed subject matter relates a physiological information acquisition device that acquires physiological information of a subject through a sensor. The presently disclosed subject matter also relates to a processing device that processes the physiological information, and a non-transitory computer-readable medium having stored a computer program that can be executed by a processor of the processing device.
A physiological information acquisition device disclosed in JP-A-2018-102671 receives waveform data corresponding to a measurement waveform of a physiological parameter of a subject, and outputs an alarm indicating abnormality of at least one of a value of the physiological parameter and the measurement waveform thereof based on the waveform data.
An object of the presently disclosed subject matter is to detect a physiological parameter acquired in an acquisition environment low in reliability.
According to an aspect for achieving the aforementioned object, there is provided a processing device configured to process physiological information of a subject, and that can include:
a reception interface configured to receive first data corresponding to a measurement waveform of a first physiological parameter of the subject, and second data related to an acquisition environment of the first physiological parameter;
a predictor configured to predict a first probability of correctly calculating a value of the first physiological parameter, based on the first data; and
a processor configured to identify, of the first data, a part in which the first probability is higher than a first threshold under a circumstance where the first physiological parameter is determined to be abnormally acquired based on the second data.
According to another aspect for achieving the aforementioned object, there is provided a non-transitory computer-readable medium having stored a computer program that can be executed by a processor of a processing device configured to process physiological information of a subject, wherein: the computer program is executed to make the processing device perform the steps of:
receiving first data corresponding to a measurement waveform of a first physiological parameter of the subject, and second data related to an acquisition environment of the first physiological parameter;
predicting a first probability of correctly calculating a value of the first physiological parameter, based on the first data; and
identifying, of the first data, a part in which the first probability is higher than a first threshold under a circumstance where the first physiological parameter is determined to be abnormally acquired based on the second data.
According to a further aspect for achieving the aforementioned object, there is provided a physiological information acquisition device that can include:
a reception interface configured to receive first data corresponding to a measurement waveform of a first physiological parameter of the subject, and second data related to an acquisition environment of the first physiological parameter;
a predictor configured to predict a first probability of correctly calculating a value of the first physiological parameter, based on the first data;
a processor configured to identify, of the first data, a part in which the first probability is higher than a first threshold under a circumstance where the first physiological parameter is determined to be abnormally acquired based on the second data; and
a notifier configured to send notification about information indicating that the first physiological parameter is abnormally acquired when the first data part identified by the processor is present.
When the measurement waveform of the first physiological parameter is affected by noise, the first probability of correctly calculating the first physiological parameter may be determined to be higher than the first threshold though the first physiological parameter is actually abnormally acquired. In such a case, whether the first probability is correctly predicted or not can be verified by referring, to the result of the determination as to whether the first physiological parameter is normally acquired or not based on the data related to the acquisition environment of the first physiological parameter. According to the configuration according to each of the aforementioned aspects, in the case where the first physiological parameter is determined to be abnormally acquired in spite of the first probability higher than the first threshold, the first data related to the first probability is concluded to be abnormally acquired. Accordingly, it is possible to detect the physiological parameter acquired in the acquisition environment low in reliability
All embodiment will be described in detail below by way of example with reference to the accompanying drawings.
The physiological information acquisition device 10 includes a processing device 11. The processing device 11 includes a reception interlace a predictor 112, a processor 113, and an output interface 114.
The reception interface 111 is configured so as to receive first waveform data W1 corresponding to a measurement waveform of a first physiological parameter of the subject 30, and second waveform data W2 corresponding to a measurement waveform of a second physiological parameter of the subject 30 from the sensor 20. Each of the first waveform data W1 and the second waveform data W2 may have an analog data form or may have a digital data form. In the case where the first waveform data W1 and the second waveform data W2 have the analog data form, the reception interface 111 is configured so as to include a suitable conversion circuit including an A/D converter. The predictor 112 and the processor 113 process the first waveform data W1 and the second waveform data W2 which have a digital data form. The first waveform data W1 is an example of first data. The second waveform data W2 is an example of second data.
The predictor 112 is configured so as to predict a first probability P1 of correctly calculating a value of the first physiological parameter, based on the first waveform data W1. The predictor 112 is realized as a trained model or a discriminator generated by machine learning that will be described later.
The processor 113 is configured so as to determine whether the second physiological parameter is normally acquired or not, based on the second waveform data W2. Specifically, in a case where a value of the second physiological parameter that can be acquired from the second waveform data W2 is out of a threshold range, or a case where a feature amount of the second waveform data W2 is out of a threshold range, the processor 113 determines that the second physiological parameter is abnormally acquired. The feature amount of the measurement waveform is appropriately decided according to the type of the acquired second physiological parameter. Since the determination technique itself has been well known, detailed description thereof will be omitted.
The processor 113 can be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor may include a CPU, an MPU, and a GPU. Examples of the general-purpose memory may include an ROM and an RAM. In this case, a computer program executing processing that will be described later can be stored in the ROM. The ROM is an example of a storage medium storing the computer program. The processor designates at least a part of the computer program stored on the ROM, expands the designated part of the computer program on the RAM, and performs the aforementioned processing in cooperation with the RAM. The aforementioned computer program may be pre-installed in the general-purpose memory, or may be downloaded from an external server device through a communication network and installed in the general-purpose memory. In this case, the external server device is another example of the storage medium storing the computer program.
The processor 113 may be realized by a dedicated integrated circuit, such as a microcontroller, ASIC or an FPGA, capable of executing the aforementioned computer program. In this case, the aforementioned computer program is pre-installed in a storage element included in the dedicated integrated circuit. The storage element is a further example of the storage medium storing the computer program. The processor 113 can also be realized by a combination of the general-purpose microprocessor and the dedicated integrated circuit.
A method for generating the predictor 112 capable of predicting a probability of erroneously calculating a heart rate based on a measurement waveform of an electrocardiogram will be described by was of example with reference to
First, a process of acquiring first heart rate data H1 from electrocardiogram waveform data E is performed (STEP 1). The first heart rate data H1 is data indicating a value of a heart rate correctly calculated from the electrocardiogram waveform data E.
The heart rate corresponding to the first heart rate data H1 may be counted by visually observing the electrocardiogram waveform data E, or may be counted using appropriate counting software. As the electrocardiogram waveform data waveform data actually acquired from the subject using an electrocardiogram sensor or the like may be used, or waveform data laid open as a database for performance evaluation of an electrocardiogram monitor may be used.
Subsequently to or in parallel with the STEP 1, a process (STEP 2 in
Of values of the heart rate illustrated in
Subsequently, performed is a process (STEP 3 in
In the case where the first heart rate data H1 illustrated in
In addition, the heart rate corresponding to the first heart rate data H1 and the heart rate corresponding to the second heart rate data H2 do not have to be always completely identical with each other in order to include a teacher label indicating that the heart rate corresponding to the second heart rate data H2 is correct. If an error of the heart rate corresponding to the second heart rate data H2 with respect to the heart rate corresponding to the first heart rate data H1 is within an allowable range, the teacher data T may include the teacher label indicating the heart rate corresponding to the second heart rate data H2 is correct.
That is, the heart rate automatically calculated by the heart rate calculation algorithm is used to be collated with the heart rate known to have been calculated correctly. Therefore, the teacher label obtained as a result of the collation can reflect a tendency or habit that the heart rate calculation algorithm correctly or incorrectly calculates the heart rate with respect to the inputted electrocardiogram waveform data E.
Subsequently, machine learning of the predictor 112 is performed based on the combination of the electrocardiogram waveform data E and the teacher data T (STEP 4 in
In the aforementioned example, the first heart rate data H1 and the second heart rate data H2 are acquired using the shared electrocardiogram waveform data E in order to generate the predictor 112 for predicting the probability of erroneously calculating the heart rate. As described above, the first heart rate data H1 is data indicating the heart rate that was correctly calculated from the electrocardiogram waveform data E. The second heart rate data H2 is data indicating the heart rate that was calculated by the specific heart rate calculation algorithm. There is a possibility that the second heart rate data H2 includes an erroneously calculated heart rate.
As another example, first respiration rate data and second respiration rate data may be acquired using shared capnogram data in order to generate the predictor 112 for predicting a probability of erroneously calculating a respiration rate. The capnogram data is an example of the waveform data. The respiration rate is an example of the physiological parameter. The first respiration rate data is data indicating a respiration rate that was correctly calculated from the capnogram data. The second respiration rate data is data indicating a respiration rate that was calculated by a specific respiration rate calculation algorithm. There is a possibility that the second respiration rate data includes an erroneously calculated respiration rate.
A physiological parameter that is used as a target for estimating an erroneous calculation probability by the predictor 112 may be different from a physiological parameter that is used as a target for outputting an alarm. For example, the predictor 112 for predicting a probability of erroneously calculating a heart rate can be used for a configuration in which an alarm is outputted for abnormality of an ST value, a QT interval, QTc, or the like in the electrocardiogram waveform data. Alternatively, the predictor 112 for predicting a probability of erroneously calculating a respiration rate can be used for a configuration in which an alarm is outputted for abnormality of an end-tidal carbon dioxide (EtCO2) or the like in time capnogram data.
Different types of physiological parameters may be used for generation of the predictor 112. As an example, heart rate data acquired from electrocardiogram waveform data and pulse rate data acquired from invasive arterial blood pressure waveform data can be used in order to generate the predictor 112 for predicting a probability of erroneously calculating a pulse rate. The electrocardiogram waveform data and the invasive arterial blood pressure waveform data need to be acquired from one and the same subject. The heart rate data is data indicating a heart rate that was correctly calculated from the electrocardiogram waveform data. The pulse rate data is data indicating a pulse rate that was calculated by a specific pulse rate calculation algorithm. There is a possibility that the pulse rate data includes an erroneously calculated pulse rate.
The predictor 112 generated in the aforementioned manner can be used for predicting a probability of erroneously calculating invasive arterial blood pressure.
Pulse waveform data may be used in order to obtain the pulse rate data. The pulse waveform data can be acquired by a pulse photometry probe or the like that non-invasively measures a change over time in absorbance of blood. Alternatively, the pulse waveform data can be acquired by a non-invasive arterial blood pressure gauge or the like that measures a change over time in internal pressure of a cuff. In this case, the generated predictor 112 is used for predicting a probability of erroneously calculating non-invasive arterial blood pressure, a pulse rate, or a percutaneous arterial oxygen saturation (SpO2).
As another example, first respiration rate data acquired from impedance respiration waveform data and second respiration rate data acquired from capnogram data can be used in order to generate the predictor 112 for predicting a probability of erroneously calculating a respiration rate. The impedance respiration waveform data and the capnogram data need to be acquired from one and the same subject. The first respiration rate data is data indicating a respiration rate that was correctly calculated from the impedance respiration waveform data. The second respiration rate data is data indicating a respiration rate that was calculated by the specific respiration rate calculation algorithm. There is a possibility that the second respiration rate data includes an erroneously calculated respiration rate.
The processor 113 is configured so as to identify a part of the first waveform data W1 where the first probability P1 predicted by the predictor 112 is higher than a first threshold P1t under a circumstance where the second physiological parameter is determined to be abnormally monitored.
A processing flow executed by the processor 113 configured thus will be described by way of example with reference to
Incidentally, the first waveform data W1 corresponding to the measurement waveform of the impedance respiration and the second waveform data W2 corresponding to the measurement. waveform of the electrocardiogram can be acquired from the shared sensor 20 (electrode).
The processor 113 determines whether the first waveform data W1 in which the first probability P1 of correctly calculating the respiration rate is higher than a first threshold P1t is present or not (STEP 11). The processing is repeated until the first waveform data W1 in which the first probability P1 is higher than the first threshold P1t is identified (NO in STEP 11).
When the first waveform data W1 in which the first probability P1 is higher than the first threshold P1t has been identified (YES in STEP 11), the processor 113 determines whether the second physiological parameter is normally acquired or not (STEP 12).
When determination has been made that the second physiological parameter is normally acquired (YES in STEP 12), the processor 113 ends the processing.
When determination has been made that the second physiological parameter is abnormally acquired (NO in STEP 12), the processor 113 identifies a part of the first waveform data W1 used for the determination, as a waveform data part corresponding to an abnormal measurement waveform (STEP 13).
When the measurement waveform of the respiration rate is affected by noise, there may arise a case where the first probability P1 of correctly calculating the respiration rate is higher than the first threshold P1t though the respiration rate is actually abnormally acquired. In the configuration according to the present example, whether the first probability P1 is correctly predicted or not can be verified by referring to the result of the determination as to whether the heart rate is normally acquired or not in such a case. Specifically, when the heart rate is determined to be abnormally acquired in spite of the first probability P1 higher than the first threshold Pt1, the first waveform data W1 related to the first probability P1 is concluded to be abnormally acquired. Therefore, the respiration rate acquired in an acquisition environment low in reliability can be detected.
From a viewpoint of detecting the physiological parameter acquired in the acquisition environment low in reliability, it is preferable that the first physiological parameter and the second physiological parameter that have a high correlation to each other are appropriately selected. Two parameters that can be acquired through the shared sensor 20, such as the impedance respiration waveform and the electrocardiogram waveform in the present example, tend to have a high correlation to each other.
In particular, the impedance respiration waveform has convenience of being able to be obtained by use of the electrode shared with the electrocardiogram waveform but has a property of being easily affected by noise. However, since the impedance respiration waveform affected by the noise can be accurately identified by referring to the state of the electrocardiogram waveform highly correlated to the impedance respiration waveform, it is easy to enjoy the benefit of the convenience.
As illustrated in
The control data C transmitted to the notifier 12 may have an analog data form, or may have a digital data form. When the control data C has the analog data form, the output interface 114 is configured to include an appropriate conversion circuit including a D/A converter
The notification performed by the notifier 12 can include at least one of visible notification, audible notification, and tactile notification. The notification can be made so that among calculation results of the respiration rate used for display based on the first waveform data W1, a calculation result of the respiration rate calculated based on the part of the first waveform data W1 that was identified as abnormal can be displayed in another color, for example, in a manner similar to or the same as in the example illustrated in
As illustrated in
As an example, the processor 113 can delete the part of the first waveform data W1 that was identified as abnormal. According to such a configuration, it is possible to reduce a burden of reorganizing the information provided by the user, and it is possible to also reduce a processing load related to the presentation of the part of the first waveform data W1 that was identified as abnormal.
As another example, the processor 113 can delete the first waveform data W1 except the part of the first waveform data W1 that was identified as abnormal. According to such a configuration, it is easy to grasp the tendency of the waveform data that is apt to be erroneously calculated by the current algorithm, so that it is possible to acquire information related to an improvement of the algorithm.
In addition to or in place of each of the aforementioned examples, the processor 113 can update the first probability P1 estimated in the part of the first waveform data W1 that was identified as abnormal. For example, the processor 113 can update the first probability P1 to a value not higher than the first threshold P1t. According to such a configuration, the first probability P1 is treated to take an appropriate value in the part of the first waveform data W1 that was identified as abnormal. There is an advantage in such a case that a subsequent process uses the first probability P1.
A process of determination as to whether the second physiological parameter is normally acquired or not can be performed by use of the predictor 112. In this case, the predictor 112 is configured so as to predict a second probability P2 of correctly calculating the value of the second physiological parameter based on the second waveform data W2. In the aforementioned example, the predictor 112 generates teacher data T and performs machine learning so as to output prediction data corresponding to the second probability P2 of correctly calculating the heart rate based on the second waveform data W2 corresponding to the measurement waveform of the inputted electrocardiogram.
Specifically, as illustrated in
In the aforementioned example, the reception interface 111 of the processing device 11 receives the first waveform data W1 corresponding to the measurement waveform of the first physiological parameter and the second waveform data W2 corresponding to the measurement waveform of the second physiological parameter from the shared sensor 20. However, as illustrated in
Alternatively, the reception interface 111 of the processing device 11 can receive measurement value data V2 corresponding to a measurement value of the second physiological parameter from the sensor 21.
In the present example, the first waveform data W1 corresponds to a measurement waveform of invasive arterial blood pressure. As the first physiological parameter, the invasive arterial blood pressure of the subject 30 is acquired. Therefore, the predictor 112 generates teacher data T and performs machine learning so as to output prediction data corresponding to a first probability P1 of correctly calculating the invasive arterial blood pressure, based on the first waveform data W1 corresponding to the measurement waveform of the inputted invasive arterial blood pressure.
In the present example, non-invasive arterial blood pressure of the subject 30 is acquired as the second physiological parameter. That is, the sensor 21 can be realized by a cuff attached to the subject 30. The measurement value data V2 corresponds to a measurement value of the non-invasive arterial blood pressure. The measurement value data V2 is an example of the second data.
The processor 113 determines whether the first waveform data W1 in which a first probability P1 of correctly calculating the invasive arterial blood pressure is higher than a first threshold P1t is present or not (STEP 11). The processing is repeated until the first waveform data W1 in which the first probability P1 is higher than the first threshold P1t is identified (NO in the STEP 11).
When the first waveform data W1 in which the first probability P1 is higher than the first threshold P1t has been identified (YES in the STEP 11), the processor 113 determines whether the non-invasive arterial blood pressure corresponding to the measurement value data V2 is within a threshold range or not (STEP 22).
When determination has been made that the non-invasive arterial blood pressure is within the threshold range (YES in the STEP 22), the processor 113 ends the processing.
When determination has been made that the second physiological parameter is abnormally acquired (NO in the STEP 22), the processor 113 identifies the first waveform data W1 used for the determination, as waveform data corresponding to an abnormal measurement waveform (STEP 13).
When an acquisition environment for the invasive arterial blood pressure is not appropriate, the invasive arterial blood pressure may show an abnormal measurement value while the measurement waveform itself is maintained as it is. When there is abnormality in zero calibration during acquisition of the invasive arterial blood pressure, the invasive arterial blood pressure can show an abnormal value while the measurement waveform itself of the invasive arterial blood pressure remains normal, for example, as illustrated in
In the configuration according to the present example, whether the first probability P1 is correctly predicted or not can be verified by referring to a measurement value of the non-invasive arterial blood pressure in such a case. Specifically, when the measurement value of the non-invasive arterial blood pressure is out of a threshold range in spite of the first probability P1 higher than the first threshold Pt1, the first waveform data W1 related to the first probability P1 is concluded to be abnormally acquired. Therefore, the invasive arterial blood pressure acquired in an acquisition environment low in reliability can be detected.
In a manner similar to or the same as the example described with reference to
Next, an example of processing that can be executed by the processor 113 of the processing device 11 using only first waveform data W1 will be described with reference to
In the present example, the first waveform data W1 corresponds to a measurement waveform of invasive arterial blood pressure. As a first physiological parameter, invasive arterial blood pressure of a subject 30 is acquired. Therefore, the predictor 112 generates teacher data T and performs machine learning so as to output prediction data corresponding to a first probability P1 of correctly calculating the invasive arterial blood pressure based on the first waveform data W1 corresponding to the measurement waveform of the inputted invasive arterial blood pressure.
As illustrated in
The processor 113 determines whether the first waveform data W1 in which a first probability P1 of correctly calculating the invasive arterial blood pressure is higher than a first threshold value P1t is present or not (STEP 11). The processing is repeated until the first waveform data W1 in which the first probability P1 is higher than the first threshold value P1t is identified (NO in the STEP 11).
When the first waveform data W1 in which the first probability P1 is higher than the first threshold value P1t is identified (YES in the STEP 11), the processor 113 determines whether a measurement value of the invasive arterial blood pressure identified from the first waveform data W1 is within the first threshold range or not (STEP 32). The measurement value of the invasive arterial blood pressure is an example of second data.
When determination has been made that the invasive arterial blood pressure is within the first threshold range (YES in the STEP 32), the processor 113 ends the processing.
When determination has been made that the invasive arterial blood pressure is out of the first threshold range (NO in the STEP 32), the processor 113 determines whether the invasive arterial blood pressure calculated from the first waveform data W1 is within a second threshold range or not (STEP 33). The second threshold range is decided to be wider than the first threshold range and to include the first threshold range. The second threshold range can be, for example, set as a range of from 20 mmHg to 300 mmHg. Any value that is out of the second threshold range is a value that cannot be normally taken by invasive arterial blood of the subject 30, but it is a value that can be taken when zero calibration peculiar to measurement of the invasive arterial blood pressure was abnormally performed.
When determination has been made that the invasive arterial blood pressure is out of the first threshold range but within the second threshold range (YES in STEP 33), the processor 113 outputs control data C from the output interface 114 to control the notifier 12 to output the first alarm A1 (STEP 34). As a result, the user is notified of the fact that the invasive arterial blood pressure of the subject 30 is abnormal.
When determination has been made that the invasive arterial blood pressure is out of the second threshold range (NO in STEP 33), the processor 113 identifies a part of the first waveform data W1 used for the determination, as a waveform data part corresponding to an abnormal acquisition state (STEP 13).
When the acquisition state of the invasive arterial blood pressure is abnormal as described with reference to
In the configuration according to the present example, whether the first probability P1 is correctly predicted or not can be verified by referring to the measurement value of the invasive arterial blood pressure in such a case. Specifically, the second threshold range is set to include the first threshold range that can be taken by the invasive arterial blood pressure when the subject is normal, and to be wider than the first threshold range. When the invasive arterial blood pressure is determined to be out of the second threshold range in spite of the first probability P1 higher than the first threshold Pt1, conclusion is made that the part of the first waveform data W1 related to the first probability P1 was acquired under an abnormal state. Therefore, the invasive arterial blood pressure which was acquired in the acquisition environment low in reliability can be detected.
The processor 113 can output control data C from the output interface 114 to control the notifier 12 to output at least the second alarm A2 when the part of the first waveform data W1 identified as having been acquired under the abnormal state is present. As a result, the user is notified of the abnormality of the acquisition state of the invasive arterial blood pressure. Since the invasive arterial blood pressure is out of the first threshold range, the output of the first alarm A1 may be also performed under the situation where the second alarm A2 is outputted.
In addition to or in place of the output of the second alarm A2, notification can be made in a manner similar to or the same as the example of
As illustrated in
In a manner similar to or the same as the example described with reference to
According to such a configuration, an appropriate numerical value range is decided for at least one of the first threshold range and the second threshold range. Accordingly, it is possible to increase detection accuracy of the invasive arterial blood pressure acquired in the acquisition environment low in reliability.
The aforementioned embodiment is merely illustrated in order to make it easy to understand the presently disclosed subject matter. The configuration according to the aforementioned embodiment can be appropriately modified or improved without departing from the spirit of the presently disclosed subject matter.
In the aforementioned embodiment, the data referred to during the verification of the first probability P1 of correctly calculating the value of the first physiological parameter is the measurement waveform or the measurement value of the physiological parameter of the subject 30. However, the data can be acceleration data outputted from an acceleration sensor mounted on the subject 30, or image data obtained by photographing the subject 30. In this case, the acceleration data or the image data is an example of the second data.
Both the acceleration data and the image data can correspond to the body motion of the subject 30. For example, when determination has been made that the body motion of the subject 30 is large from the data in spite of the first probability P1 higher than the first threshold P1, the processor 113 of the processing device 11 concludes that the first waveform data W1 related to the first probability P1 is abnormally acquired. Also according to such a configuration, the first physiological parameter acquired in the acquisition environment low in reliability can be detected.
That is, not only the measurement waveform or the measurement value of the second physiological parameter different from the first physiological parameter of the subject 30 but also the acceleration data or the image data that can represent the body motion of the subject 30 during the acquisition of the first physiological parameter can also be examples of the second data as long as they are data related to the acquisition environment of the first physiological parameter.
In the aforementioned embodiment, both the processing device and the notifier 12 are mounted on the physiological information acquisition device 10. However, the processing device 11 may be mounted on an external server device capable of communicating with the physiological information acquisition device 10 through a communication network. In this case, the processing device 11 executes the aforementioned processing based on the first waveform data W1 and the second waveform data W2 received from the sensor 20 (the sensor 21 if necessary) or the physiological information acquisition device 10 via the communication network. The processing device 11 transmits appropriate control data C through the communication network to control the notifier 12 to execute the notification.
The notifier 12, that executes the notification based on control data C received from the external server device, may be installed in a device that is independent from the physiological information acquisition device 10. For example, the function of the notifier 12 may be implemented by an independent output device that is capable of performing communication with at least one of the physiological information acquisition device 10 and the above external server device via a communication network. In this case, the control data C is transmitted from the output interface 114 of the physiological information acquisition device 10 or the external server device to the output device via the communication network.
Number | Date | Country | Kind |
---|---|---|---|
2020-122965 | Jul 2020 | JP | national |
2021-112727 | Jul 2021 | JP | national |