Patent Grant
12057223
This application is the United States national phase entry of International Application No. PCT/EP2020/071234, filed Jul. 28, 2020, and claims priority to German Application No. 10 2019 120 999.4, filed Aug. 2, 2019. The contents of International Application No. PCT/EP2020/071234 and German Application No. 10 2019 120 999.4 are incorporated by reference herein in their entireties.
The disclosure relates to a method and a device for checking the function of medical apparatuses.
Augmented reality (abbreviated as AR) is the computer-assisted extension of reality perception. This information can address all human sensory modalities. However, augmented reality is often understood to mean only the visual representation of information, i.e. the addition of computer-generated supplementary information or virtual objects to images or videos by means of overlay/superimposition. In soccer broadcasts, augmented reality is the overlay of distances in the case of free kicks using a circle or a line, for example.
A dialysis apparatus/a dialysis machine allows the patient-specific removal of dissolved substances (e.g. urea, creatinine, vitamin B12 or β2-microglobulin) and, if necessary, of a defined water content from the blood in kidney replacement treatments. Dialysis apparatuses are used for both hemodialysis and hemodiafiltration. Basically, dialysis apparatuses can be divided into the following modules: Extracorporeal blood circuit, dialysis fluid circuit, disinfection unit, operating unit and power supply unit. In addition, consumable materials, so-called disposables, are used during the treatment. These disposables are e.g. dialysis fluid cannulae, blood tubing systems, dialyzers, dialysis concentrates, etc.
A disadvantage in the prior art is that caregivers need special user training to use dialysis apparatuses or to properly attach the disposables to the dialysis apparatus. This user training is necessary for each new generation of a dialysis machine.
The object of the disclosure is to allow a fast, efficient and error-free application of the disposables as well as a fast and safe self-test by internal and external information.
The disclosure relates to a method for activating a function of a device, preferably a medical device, comprising the steps of:
In other words, the at least one CPU/computing unit receiving the images from the camera identifies the state/set-up/setting/assembly stage of a medical device, preferably a dialysis machine. In this regard, the camera and, if applicable, also the CPU/computing unit can be housed or integrated in the AR device, preferably on smart glasses. The at least one CPU/computing unit overlays the necessary steps to be carried out by the user, e.g. for correctly connecting disposables to the medical device, into a field of view of the AR device, in particular smart glasses (preferably a projector, which is connected to the CPU, overlays the information).
When the CPU identifies via the camera arranged on the AR device that a setup has been properly completed, the CPU starts the device for a function test via a preferably wireless connection, preferably by means of wireless technology available under the registered trademark BLUETOOTH® or a wireless local area network (W-LAN) available under the registered trademark ZIGBEE®, near-field communication (NFC) or mobile radio.
Alternatively or additionally, the CPU or a data transmission device on the AR device is provided and adapted to transmit the images of the camera to another, second or fixed CPU. Preferably, this CPU is located in a medical device, but it can also be external to the AR device and/or the medical device, e.g. in the form of a PC connected to the medical device. This second or stationary CPU preferably has greater computing power than the first CPU, which, if applicable, is located on the AR device. The second CPU processes the received data and transmits processed data back to the first CPU of the data transmission device to the AR device which then causes the information to be displayed in the field of view of the AR device. In other words, the first CPU on the AR device is used to transmit the data and controls the display of information whereas the second, external or stationary CPU is used as a data processing unit as well as a computing unit for processing the captured images and derives therefrom e.g. action steps, which it returns to the first CPU as concrete information to be displayed, as described above.
Preferably, the device is a medical device and more preferably a dialysis apparatus, a dialysis machine, a syringe pump or the like.
The AR device is preferably a product of the class of wearables (wearable computing). A wearable/wearable computer is attached to the user's body or integrated into the clothing during use. Preferably, the AR device according to the disclosure has an optical display integrated in the field of view of a user as well as a CPU and/or a data transmission unit. More preferably, the AR device is a pair of AR glasses, smart glasses, smartglasses, data glasses, or a head-up display. In this context, smart glasses or smartglasses (or colloquially: data glasses) are preferably a wearable computer on a pair of glasses that adds information to the user's field of view. More preferably, the glasses also include the camera. Additionally or alternatively, the glasses can also have a data transmission unit. The glasses make possible augmented reality or mixed reality.
Preferably, the camera is a digital camera. In addition to discretely displaying information on the display of the AR device, information can also be combined with the captured image of the integrated digital camera. For this purpose, data can be directly obtained from the Internet and transmitted.
Preferably, the camera is in data connection with the first (AR device integrated) CPU and/or the second, stationary or separate CPU, preferably in a wireless fashion, e.g. via wireless technology available under the registered trademark BLUETOOTH®, W-LAN or the like. Alternatively or additionally, the first CPU on the AR device can be in data connection with a second external CPU, preferably in a wireless fashion, e.g. via Bluetooth®, W-LAN or the like. Preferably, the CPU on the AR device is in data connection with the medical device, preferably in a wireless fashion, e.g. via wireless technology available under the registered trademark BLUETOOTH®, W-LAN or the like. The second CPU is preferably a computing unit/CPU already present in the medical device for control purposes thereof.
Preferably, the comparison of the actual state of the device with a desired state of the device is carried out by means of an image analysis algorithm which is stored on a storage medium of the CPU which may be the first CPU on the AR device, or at least an optional second CPU in the medical device or external to the AR device and/or the medical device.
Preferably, the device performs a self-test/function test/pressure self-test or the like in response to the input of the camera. Here, the function test can be activated after a manual confirmation on the medical device itself, or by means of a gesture identified by the camera and the CPU, or simply after a predetermined time. For example, a pressure self-test can be started after connecting the pressure sensors. During the pressure self-test, preferably the connected/mounted disposables on the medical device are pressurized by the medical device. If a predetermined pressure drop is determined by pressure sensors, there is a leakage or a faulty connection and the medical device outputs an error message/signal.
The actual state denotes the current state to what extent the disposables are installed in the medical device at a first time T1. The desired state denotes the finished and correct state of the disposables in the medical device. Preferably, the setting-up process in which the disposables are installed in the medical device is broken down into different sub-steps which are, preferably each individually or as a whole, guided, monitored (comparison between the current actual state and the desired state of the sub-step) and then ‘tested’.
The transmission of a command for starting a function, preferably a function test, from the CPU to the device on the basis of the comparison (or following the comparison) is preferably performed in the case of a positive comparison, i.e. when the actual state corresponds to the desired state. In the case of a negative comparison, i.e. when the actual state does not correspond to the desired state, a corresponding function is activated in response to the command, preferably an error message in the AR device or the medical device.
Preferably, the method is characterized in that it further includes the step of: displaying the function result in the AR device. In other words, the individual installation steps of the disposables are displayed in the AR device depending on the comparison of the actual state with the desired state. Alternatively or additionally, a result of the function test, for example the prevailing pressure in the connected disposables, can be displayed.
Preferably, the method is characterized in that the method further includes the step of: transmitting a function test result to the CPU and/or overlaying the necessary steps, preferably in the form of markings, animations and/or messages, in order to achieve the desired state of the device in the AR device. In other words, the medical device in which, for example, the second or separate or stationary CPU and/or a data transmission unit is present transmits a signal to the first CPU or data transmission unit in the AR device. Analogously, as already explained above, the result of the function (function result/function outcome) is then displayed in response to the signal of the medical device.
Preferably, the method is characterized in that it further comprises the step of: blocking further functions in the case of a negative function (in the case of a function test that turns out to be negative). In other words, if the actual state does not match the desired state, the medical device blocks further functions until the comparison is positive.
The method is preferably characterized in that a function test is a pressure test that measures a (line) pressure built up in disposables for testing purposes.
Preferably, the steps are shown graphically on a display. It is preferred to show in the AR device the required steps by means of pictorial representations which can be fully or partially animated and/or by means of writing in the user's field of view. In other words, markings, animations and/or messages can be projected into the field of view.
Preferably, the medical device is in data contact with the CPU, which can be located in the AR device, the medical device, a PC, or otherwise externally.
The disclosure further relates to a system for activating a device function, preferably a function test, having at least one camera, at least one CPU which is in data connection with the camera, and preferably at least one device, for example a medical device, in particular a dialysis machine, which in turn is or can be brought in data connection with the CPU, the CPU including a storage medium or being able to be brought in data connection with an external CPU on which the following steps are stored:
Preferably, the camera is attached to/in an AR device, which is provided and adapted to display the results of the function test and/or installation instructions, preferably according to the display principle of a head-up display.
The disclosure further preferably relates to a method and a device for activating a function of a device, preferably a medical device, including the steps of: identifying the actual state of the device by means of a camera which is preferably arranged on an AR device; comparing the actual state of the device with a desired state of the device by a CPU which is connected to the camera; transmitting a command for starting a device function, preferably a device function test (from the CPU) to the device when the actual state corresponds or appears to correspond to a predetermined desired state according to visual identification; activating a device function, preferably a device function test, in response (reaction) to the command.
In summary, the disclosure relates to a method for activating or performing a function test of a blood treatment device, preferably a dialysis machine, including the steps of: detecting an actual state of the blood treatment device by means of a camera which is preferably provided or mounted in/on an augmented reality device, preferably augmented reality glasses; comparing the actual state of the blood treatment device with a desired/target state of the blood treatment device by a control unit (CPU) connected to the camera; transmitting, on the basis of the comparison, a command for starting the function test from the control unit (CPU) to the blood treatment device; and activating the function test of the blood treatment device on the basis of the command.
Preferably, the method further comprises the steps of: transmitting a function test result to the control unit (CPU); and displaying the function test result in an augmented reality device.
More preferably, the method further includes the step of: overlaying in the augmented reality device still required steps to be carried out in order to achieve the desired state of the blood treatment device, preferably in the form of markings, animations and/or messages.
It is advantageous for the method to further include the step of: blocking further function tests in the case of a negative function test result.
Advantageously, the function test is a, preferably automated, self-test of the blood treatment device for checking setting-up actions performed by a user during a set-up of the blood treatment device.
Preferably, the function test is a pressure test measuring a pressure temporarily built up for test purposes in disposable products, in particular fluid lines, which are attached or provided to/in the blood treatment device.
Furthermore, the disclosure relates in summary to a system including at least one camera, at least one control unit (CPU) which is or can be brought in data connection with the camera, and at least one blood treatment device, in particular dialysis machine, which in turn is in or can be brought in data connection with the control unit (CPU), the control unit (CPU) being configured to detect an actual state of the blood treatment device by means of the camera, which is preferably provided or arranged in/on an augmented reality device, in particular augmented reality glasses or an augmented reality visual protection pane, to compare the actual state of the blood treatment device with a desired/target state of the blood treatment device, to transmit a command for starting a function test to the blood treatment device on the basis of the comparison, and to activate the function test of the blood treatment device on the basis of the command.
Preferably, the camera is attached or provided to/in an augmented reality device, the augmented reality device being configured to display a function test result and/or further steps to be carried out by a user.
More preferably, the function test is a, preferably automated, self-test of the blood treatment device for checking setting-up actions carried out by a user during a set-up of the blood treatment device.
It is advantageous for the function test to be a pressure test measuring a pressure temporarily built up for test purposes in disposable products, in particular fluid lines, which are attached or provided to/in the blood treatment device.
The present disclosure will be explained in more detail below on the basis of a preferred exemplary embodiment with reference to the accompanying drawings.
In step 112, the camera 4 identifies the actual state of the dialysis machine 8. In other words, the camera 4 captures one or more images that display/document the current actual state.
In step 114, the CPU compares the actual state of the dialysis machine 8 with a desired state of the dialysis machine 8. In other words, the image of the camera 4 from step 112 is compared with a stored image on the CPU and pattern recognition is used to determine whether the actual state corresponds to the desired state. If such a comparison is not possible, for example due to an unsuitable image, step 112 is executed again until an image is obtained that shows the actual state and can be compared with a desired state. This repetition process or the presence of an unsuitable image can be displayed on the AR device e.g. with a preferred message/correction instruction indicating that the viewing angle needs to be changed, for example. If a comparison of the actual state with the desired state is achieved, the next step follows.
In step 116, the CPU transmits a command for starting a function test to the dialysis machine 8. In other words, once the CPU has positively compared and assessed the actual state with the desired state, a command is issued to the medical device/dialysis machine to perform a function/a function test to check whether the assembly was carried out in a functionally correct manner.
In step 118, the dialysis machine 8 performs the function or the function test. In other words, a corresponding action is carried out on the dialysis machine 8 in response to the command from the CPU.
In step 120, the dialysis machine 8 transmits the result of the function test to the CPU or the CPU measures the test result and then graphically displays the result on the AR glasses 2. Here, the result is preferably the pressure/pressure curve that prevails/was induced for test purposes in the disposables/lines.
In step 134, the AR device or the CPU attached thereto identifies that the task “connecting the disposables” has been identified.
In step 136, the medical device is informed that the task “connecting the disposables” has been identified.
In step 138, the medical device prepares for a function test.
In step 140, the user then installs the lines.
In step 142, the AR device identifies that the lines have been connected and can additionally or alternatively check for incorrectly connected lines.
In step 144, the medical device is informed that the disposables have been installed.
In step 146, the medical device performs a function test of the lines.
In step 148, the medical device informs the AR device about the positive test or the result.
In step 150, the result is displayed in the AR device. If the result is negative, the steps from step 142 are repeated.
If all is well, the next step is displayed in the AR device in step 152.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2019 120 999.4 | Aug 2019 | DE | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2020/071234 | 7/28/2020 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2021/023574 | 2/11/2021 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 10617288 | Carlson | Apr 2020 | B2 |
| 20140266983 | Christensen | Sep 2014 | A1 |
| 20160124501 | Lam | May 2016 | A1 |
| 20160206800 | Tanenbaum | Jul 2016 | A1 |
| 20170083671 | Benner et al. | Mar 2017 | A1 |
| 20170172398 | Carlson | Jun 2017 | A1 |
| 20170172695 | Daniel | Jun 2017 | A1 |
| 20190064520 | Christensen | Feb 2019 | A1 |
| 20200294392 | Peesapati | Sep 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 102014217559 | Mar 2016 | DE |
| 102015217838 | Mar 2017 | DE |
| Entry |
|---|
| Written Opinion received in International Application No. PCT/EP2020/071234 dated Oct. 29, 2020, with translation, 14 pages. |
| Search Report received in German Application No. 10 2019 120 999.4 dated Apr. 21, 2020, with translation, 18 pages. |
| Search Report received in International Application No. PCT/EP2020/071234 dated Oct. 29, 2020, with translation, 7 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20220319688 A1 | Oct 2022 | US |
