Patent Grant
11445985
Remote medical assistance, also referred to, inter alia, as remote medicine, telemedicine, telemed, telmed, tel-med, or telehealth, is an at least two-way communication between a healthcare provider or providers, such as a physician or a physical therapist, and a patient using audio and/or audiovisual and/or other sensorial or perceptive (e.g., without limitation, gesture recognition, gesture control, touchless user interfaces (TUls), kinetic user interfaces (KUls), tangible user interfaces, wired gloves, depth-aware cameras, stereo cameras, and gesture-based controllers, tactile, gustatory, haptic, pressure-sensing-based or electromagnetic (e.g., neurostimulation) communications (e.g., via a computer, a smartphone, or a tablet). Telemedicine may aid a patient in performing various aspects of a rehabilitation regimen for a body part. The patient may use a patient interface in communication with an assistant interface for receiving the remote medical assistance via audio, visual, audiovisual, or other communications described elsewhere herein. Any reference herein to any particular sensorial modality shall be understood to include and to disclose by implication a different one or more sensory modalities.
Telemedicine is an option for healthcare providers to communicate with patients and provide patient care when the patients do not want to or cannot easily go to the healthcare providers' offices. Telemedicine, however, has substantive limitations as the healthcare providers cannot conduct physical examinations of the patients. Rather, the healthcare providers must rely on verbal communication and/or limited remote observation of the patients.
An aspect of the disclosed embodiments includes a system for positioning one or more sensors on a user has an apparatus configured to be manipulated by the user to perform an exercise. The system has user sensors associated with the user and apparatus sensors associated with the apparatus. The system has treatment sensors, a processing device and a memory communicatively coupled to the processing device and including computer readable instructions, that when executed by the processing device, cause the processing device to: generate an enhanced environment representative of an environment; receive, from the apparatus sensors, apparatus data representative of a location of the apparatus in the environment; generate, from the apparatus data, an apparatus avatar in the enhanced environment; receive, from the user sensors, user data representative of a location of the user in the environment; generate, from the user data, a user avatar in the enhanced environment; receive, from the treatment sensors, treatment data representative of one or more locations of the treatment sensors in the environment; generate, from the treatment data, treatment sensor avatars in the enhanced environment; calculate, based on one or more of the apparatus data and the user data, a treatment location for each treatment sensor, wherein the treatment location is associated with an anatomical structure of a user; and generate, based on the treatment location and treatment data, instruction data representing an instruction for positioning the treatment sensors at the treatment location.
Another aspect of the disclosed embodiments includes a method for positioning one or more sensors on a user, comprises generating an enhanced environment associated with an environment. The method comprises receiving, from apparatus sensors, apparatus data representative of a location of the apparatus in the environment. The method comprises generating, from the apparatus data, an apparatus avatar in the enhanced environment. The method comprises receiving, from user sensors, user data representative of a location of the user in the environment. The method comprises generating, from the user data, a user avatar in the enhanced environment. The method comprises receiving, from treatment sensors, treatment data representative of a location the treatment sensors in the environment. The method comprises generating, from the treatment data, treatment sensor avatars in the enhanced environment. The method comprises calculating, based on one or more of the environment data, apparatus data, and user data, a treatment location for each treatment sensor. The method comprises generating, based on the treatment location and treatment data, instruction data representative of the treatment sensors relative to the user.
Another aspect of the disclosed embodiments includes a tangible, non-transitory computer-readable medium stores instructions that, when executed, cause a processing device to perform any of the methods, operations, or steps described herein.
Another aspect of the disclosed embodiments includes a system that includes a processing device and a memory communicatively coupled to the processing device and capable of storing instructions. The processing device executes the instructions to perform any of the methods, operations, or steps described herein.
The disclosure is best understood from the following detailed description when read in conjunction with the accompanying drawings. It is emphasized that, according to common practice, the various features of the drawings are not to-scale. On the contrary, the dimensions of the various features are arbitrarily expanded or reduced for clarity.
For a detailed description of example embodiments, reference will now be made to the accompanying drawings in which:
Various terms are used to refer to particular system components. Different companies may refer to a component by different names—this document does not intend to distinguish between components that differ in name but not function. In the following discussion and in the claims, the terms “including” and “comprising” are used in an open-ended fashion, and thus should be interpreted to mean “including, but not limited to . . . .” Also, the term “couple” or “couples” is intended to mean either an indirect or direct connection. Thus, if a first device couples to a second device, that connection may be through a direct connection or through an indirect connection via other devices and connections.
The terminology used herein is for the purpose of describing particular example embodiments only, and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. The method steps, processes, and operations described herein are not to be construed as necessarily requiring their performance in the particular order discussed or illustrated, unless specifically identified as an order of performance. It is also to be understood that additional or alternative steps may be employed.
The terms first, second, third, etc. may be used herein to describe various elements, components, regions, layers and/or sections; however, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms may be only used to distinguish one element, component, region, layer, or section from another region, layer, or section. Terms such as “first,” “second,” and other numerical terms, when used herein, do not imply a sequence or order unless clearly indicated by the context. Thus, a first element, component, region, layer, or section discussed below could be termed a second element, component, region, layer, or section without departing from the teachings of the example embodiments. The phrase “at least one of,” when used with a list of items, means that different combinations of one or more of the listed items may be used, and only one item in the list may be needed. For example, “at least one of: A, B, and C” includes any of the following combinations: A, B, C, A and B, A and C, B and C, and A and B and C. In another example, the phrase “one or more” when used with a list of items means there may be one item or any suitable number of items exceeding one.
Spatially relative terms, such as “inner,” “outer,” “beneath,” “below,” “lower,” “above,” “upper,” “top,” “bottom,” “inside,” “outside,” “contained within,” “superimposing upon,” and the like, may be used herein. These spatially relative terms can be used for ease of description to describe one element's or feature's relationship to another element(s) or feature(s) as illustrated in the figures. The spatially relative terms may also be intended to encompass different orientations of the device in use, or operation, in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, the example term “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptions used herein interpreted accordingly.
A “treatment plan” may include one or more treatment protocols, and each treatment protocol includes one or more treatment sessions. Each treatment session comprises several session periods, with each session period including a particular exercise for treating the body part of the patient. For example, a treatment plan for post-operative rehabilitation after a knee surgery may include an initial treatment protocol with twice daily stretching sessions for the first 3 days after surgery and a more intensive treatment protocol with active exercise sessions performed 4 times per day starting 4 days after surgery. A treatment plan may also include information pertaining to a medical procedure to perform on the patient, a treatment protocol for the patient using a treatment apparatus, a diet regimen for the patient, a medication regimen for the patient, a sleep regimen for the patient, additional regimens, or some combination thereof.
The terms telemedicine, telehealth, telemed, teletherapeutic, etc. may be used interchangeably herein.
The term “optimal treatment plan” may refer to optimizing a treatment plan based on a certain parameter or factors or combinations of more than one parameter or factor, such as, but not limited to, a measure of benefit which one or more exercise regimens provide to users, one or more probabilities of users complying with one or more exercise regimens, an amount, quality or other measure of sleep associated with the user, information pertaining to a diet of the user, information pertaining to an eating schedule of the user, information pertaining to an age of the user, information pertaining to a sex of the user, information pertaining to a gender of the user, an indication of a mental state of the user, information pertaining to a genetic condition of the user, information pertaining to a disease state of the user, an indication of an energy level of the user, information pertaining to a microbiome from one or more locations on or in the user (e.g., skin, scalp, digestive tract, vascular system, etc.), or some combination thereof.
As used herein, the term healthcare professional may include a medical professional (e.g., such as a doctor, a nurse, a therapist, and the like), an exercise professional (e.g., such as a coach, a trainer, a nutritionist, and the like), or another professional sharing at least one of medical and exercise attributes (e.g., such as an exercise physiologist, a physical therapist, an occupational therapist, and the like). As used herein, and without limiting the foregoing, a “healthcare provider” may be a human being, a robot, a virtual assistant, a virtual assistant in virtual and/or augmented reality, or an artificially intelligent entity, such entity including a software program, integrated software and hardware, or hardware alone.
Real-time may refer to less than or equal to 2 seconds. Near real-time may refer to any interaction of a sufficiently short time to enable two individuals to engage in a dialogue via such user interface, and will preferably but not determinatively be less than 10 seconds but greater than 2 seconds.
Any of the systems and methods described in this disclosure may be used in connection with rehabilitation. Rehabilitation may be directed at cardiac rehabilitation, rehabilitation from stroke, multiple sclerosis, Parkinson's disease, myasthenia gravis, Alzheimer's disease, any other neurodegenerative or neuromuscular disease, a brain injury, a spinal cord injury, a spinal cord disease, a joint injury, a joint disease, post-surgical recovery, or the like. Rehabilitation can further involve muscular contraction in order to improve blood flow and lymphatic flow, engage the brain and nervous system to control and affect a traumatized area to increase the speed of healing, reverse or reduce pain (including arthralgias and myalgias), reverse or reduce stiffness, recover range of motion, encourage cardiovascular engagement to stimulate the release of pain-blocking hormones or to encourage highly oxygenated blood flow to aid in an overall feeling of well-being. Rehabilitation may be provided for individuals of average weight in reasonably good physical condition having no substantial deformities, as well as for individuals more typically in need of rehabilitation, such as those who are elderly, obese, subject to disease processes, injured and/or who have a severely limited range of motion. Unless expressly stated otherwise, is to be understood that rehabilitation includes prehabilitation (also referred to as “pre-habilitation” or “prehab”). Prehabilitation may be used as a preventative procedure or as a pre-surgical or pre-treatment procedure. Prehabilitation may include any action performed by or on a patient (or directed to be performed by or on a patient, including, without limitation, remotely or distally through telemedicine) to, without limitation, prevent or reduce a likelihood of injury (e.g., prior to the occurrence of the injury); improve recovery time subsequent to surgery; improve strength subsequent to surgery; or any of the foregoing with respect to any non-surgical clinical treatment plan to be undertaken for the purpose of ameliorating or mitigating injury, dysfunction, or other negative consequence of surgical or non-surgical treatment on any external or internal part of a patient's body. For example, a mastectomy may require prehabilitation to strengthen muscles or muscle groups affected directly or indirectly by the mastectomy. As a further non-limiting example, the removal of an intestinal tumor, the repair of a hernia, open-heart surgery or other procedures performed on internal organs or structures, whether to repair those organs or structures, to excise them or parts of them, to treat them, etc., can require cutting through, dissecting and/or harming numerous muscles and muscle groups in or about, without limitation, the skull or face, the abdomen, the ribs and/or the thoracic cavity, as well as in or about all joints and appendages. Prehabilitation can improve a patient's speed of recovery, measure of quality of life, level of pain, etc. in all the foregoing procedures. In one embodiment of prehabilitation, a pre-surgical procedure or a pre-non-surgical-treatment may include one or more sets of exercises for a patient to perform prior to such procedure or treatment. Performance of the one or more sets of exercises may be required in order to qualify for an elective surgery, such as a knee replacement. The patient may prepare an area of his or her body for the surgical procedure by performing the one or more sets of exercises, thereby strengthening muscle groups, improving existing muscle memory, reducing pain, reducing stiffness, establishing new muscle memory, enhancing mobility (i.e., improve range of motion), improving blood flow, and/or the like.
The phrase, and all permutations of the phrase, “respective measure of benefit with which one or more exercise regimens may provide the user” (e.g., “measure of benefit,” “respective measures of benefit,” “measures of benefit,” “measure of exercise regimen benefit,” “exercise regimen benefit measurement,” etc.) may refer to one or more measures of benefit with which one or more exercise regimens may provide the user.
The term “enhanced reality” or “enhanced environment” may include a user experience comprising one or more of an interaction with a computer, augmented reality, virtual reality, mixed reality, immersive reality, or a combination of the foregoing (e.g., immersive augmented reality, mixed augmented reality, virtual and augmented immersive reality, and the like).
The term “augmented reality” may refer, without limitation, to an interactive user experience that provides an enhanced environment that combines elements of a real-world environment with computer-generated components perceivable by the user.
The term “virtual reality” may refer, without limitation, to a simulated interactive user experience that provides an enhanced environment perceivable by the user and wherein such enhanced environment may be similar to or different from a real-world environment.
The term “mixed reality” may refer to an interactive user experience that combines aspects of augmented reality with aspects of virtual reality to provide a mixed reality environment perceivable by the user.
The term “immersive reality” may refer to a simulated interactive user experienced using virtual and/or augmented reality images, sounds, and other stimuli to immerse the user, to a specific extent possible (e.g., partial immersion or total immersion), in the simulated interactive experience. For example, in some embodiments, to the specific extent possible, the user experiences one or more aspects of the immersive reality as naturally as the user typically experiences corresponding aspects of the real-world. Additionally, or alternatively, an immersive reality experience may include actors, a narrative component, a theme (e.g., an entertainment theme or other suitable theme), and/or other suitable features of components.
The term “body halo” may refer to a hardware component or components, wherein such component or components may include one or more platforms, one or more body supports or cages, one or more chairs or seats, one or more back supports, one or more leg or foot engaging mechanisms, one or more arm or hand engaging mechanisms, one or more neck or head engaging mechanisms, other suitable hardware components, or a combination thereof.
As used herein, the term “enhanced environment” may refer to an enhanced environment in its entirety, at least one aspect of the enhanced environment, more than one aspect of the enhanced environment, or any suitable number of aspects of the enhanced environment.
The following discussion is directed to various embodiments of the present disclosure. Although one or more of these embodiments may be preferred, the embodiments disclosed should not be interpreted, or otherwise used, as limiting the scope of the disclosure, including the claims. In addition, one skilled in the art will understand that the following description has broad application, and the discussion of any embodiment is meant only to be exemplary of that embodiment, and not intended to intimate that the scope of the disclosure, including the claims, is limited to that embodiment.
Determining a treatment plan for a patient having certain characteristics (e.g., vital-sign or other measurements; performance; demographic; psychographic; geographic; diagnostic; measurement- or test-based; medically historic; etiologic; cohort-associative; differentially diagnostic; surgical, physically therapeutic, psychographic, pharmacologic and other treatment(s) recommended; etc.) may be a technically challenging problem. For example, a multitude of information may be considered when determining a treatment plan, which may result in inefficiencies and inaccuracies in the treatment plan selection process. In a rehabilitative setting, some of the multitude of information considered may include characteristics of the patient such as personal information, performance information, and measurement information. The personal information may include, e.g., demographic, psychographic or other information, such as an age, a weight, a gender, a height, a body mass index, a medical condition, a familial medication history, an injury, a medical procedure, a medication prescribed, or some combination thereof. The performance information may include, e.g., an elapsed time of using a treatment apparatus, an amount of force exerted on a portion of the treatment apparatus, a range of motion achieved on the treatment apparatus, a movement speed of a portion of the treatment apparatus, an indication of a plurality of pain levels using the treatment apparatus, or some combination thereof. The measurement information may include, e.g., a vital sign, a respiration rate, a heartrate, a temperature, a blood pressure, or some combination thereof. It may be desirable to process the characteristics of a multitude of patients, the treatment plans performed for those patients, and the results of the treatment plans for those patients.
Further, another technical problem may involve distally treating, via a computing device during a telemedicine session, a patient from a location different than a location at which the patient is located. An additional technical problem is controlling or enabling, from the different location, the control of a treatment apparatus used by the patient's location. Oftentimes, when a patient undergoes rehabilitative surgery (e.g., knee surgery), a healthcare provider or other healthcare professional may prescribe a treatment apparatus to the patient to use to perform a treatment protocol at their residence or at any mobile location or temporary domicile. A healthcare professional may refer to a doctor, physician assistant, nurse, chiropractor, dentist, physical therapist, acupuncturist, physical trainer, or the like. A healthcare professional may refer to any person with a credential, license, degree, or the like in the field of medicine, physical therapy, rehabilitation, or the like.
Since the physical therapist or other healthcare professional is located in a location different from the patient and the treatment apparatus, it may be technically challenging for the physical therapist or other healthcare professional to monitor the patient's actual progress (as opposed to relying on the patient's word about their progress) in using the treatment apparatus, modify the treatment plan according to the patient's progress, adapt the treatment apparatus to the personal characteristics of the patient as the patient performs the treatment plan, and the like.
Accordingly, embodiments of the present disclosure pertain to using artificial intelligence and/or machine learning to assign patients to cohorts and to dynamically control a treatment apparatus based on the assignment during an adaptive telemedical session. In some embodiments, numerous treatment apparatuses may be provided to patients. The treatment apparatuses may be used by the patients to perform treatment plans in their residences, at a gym, at a rehabilitative center, at a hospital, or any suitable location, including permanent or temporary domiciles. In some embodiments, the treatment apparatuses may be communicatively coupled to a server. Characteristics of the patients may be collected before, during, and/or after the patients perform the treatment plans. For example, the personal information, the performance information, and the measurement information may be collected before, during, and/or after the person performs the treatment plans. The results (e.g., improved performance or decreased performance) of performing each exercise may be collected from the treatment apparatus throughout the treatment plan and after the treatment plan is performed. The parameters, settings, configurations, etc. (e.g., position of pedal, amount of resistance, etc.) of the treatment apparatus may be collected before, during, and/or after the treatment plan is performed.
Each characteristic of the patient, each result, and each parameter, setting, configuration, etc. may be timestamped and may be correlated with a particular step in the treatment plan. Such a technique may enable determining which steps in the treatment plan lead to desired results (e.g., improved muscle strength, range of motion, etc.) and which steps lead to diminishing returns (e.g., continuing to exercise after 3 minutes actually delays or harms recovery).
Data may be collected from the treatment apparatuses and/or any suitable computing device (e.g., computing devices where personal information is entered, such as a clinician interface or patient interface) over time as the patients use the treatment apparatuses to perform the various treatment plans. The data that may be collected may include the characteristics of the patients, the treatment plans performed by the patients, and the results of the treatment plans.
In some embodiments, the data may be processed to group certain people into cohorts. The people may be grouped by people having certain or selected similar characteristics, treatment plans, and results of performing the treatment plans. For example, athletic people having no medical conditions who perform a treatment plan (e.g., use the treatment apparatus for 30 minutes a day 5 times a week for 3 weeks) and who fully recover may be grouped into a first cohort. Older people who are classified obese and who perform a treatment plan (e.g., use the treatment plan for 10 minutes a day 3 times a week for 4 weeks) and who improve their range of motion by 75 percent may be grouped into a second cohort.
In some embodiments, an artificial intelligence engine may include one or more machine learning models that are trained using the cohorts. For example, the one or more machine learning models may be trained to receive an input of characteristics of a new patient and to output a treatment plan for the patient that results in a desired result. The machine learning models may match a pattern between the characteristics of the new patient and at least one patient of the patients included in a particular cohort. When a pattern is matched, the machine learning models may assign the new patient to the particular cohort and select the treatment plan associated with the at least one patient. The artificial intelligence engine may be configured to control, distally and based on the treatment plan, the treatment apparatus while the new patient uses the treatment apparatus to perform the treatment plan.
As may be appreciated, the characteristics of the new patient may change as the new patient uses the treatment apparatus to perform the treatment plan. For example, the performance of the patient may improve quicker than expected for people in the cohort to which the new patient is currently assigned. Accordingly, the machine learning models may be trained to dynamically reassign, based on the changed characteristics, the new patient to a different cohort that includes people having characteristics similar to the now-changed characteristics as the new patient. For example, a clinically obese patient may lose weight and no longer meet the weight criterion for the initial cohort, result in the patient's being reassigned to a different cohort with a different weight criterion. A different treatment plan may be selected for the new patient, and the treatment apparatus may be controlled, distally and based on the different treatment plan, the treatment apparatus while the new patient uses the treatment apparatus to perform the treatment plan. Such techniques may provide the technical solution of distally controlling a treatment apparatus. Further, the techniques may lead to faster recovery times and/or better results for the patients because the treatment plan that most accurately fits their characteristics is selected and implemented, in real-time, at any given moment. “Real-time” may also refer to near real-time, which may be less than 10 seconds or any reasonably proximate difference between two different times. As described herein, the term “results” may refer to medical results or medical outcomes. Results and outcomes may refer to responses to medical actions.
Depending on what result is desired, the artificial intelligence engine may be trained to output several treatment plans. For example, one result may include recovering to a threshold level (e.g., 75% range of motion) in a fastest amount of time, while another result may include fully recovering (e.g., 100% range of motion) regardless of the amount of time. The data obtained from the patients and sorted into cohorts may indicate that a first treatment plan provides the first result for people with characteristics similar to the patient's, and that a second treatment plan provides the second result for people with characteristics similar to the patient.
Further, the artificial intelligence engine may also be trained to output treatment plans that are not optimal or sub-optimal or even inappropriate (all referred to, without limitation, as “excluded treatment plans”) for the patient. For example, if a patient has high blood pressure, a particular exercise may not be approved or suitable for the patient as it may put the patient at unnecessary risk or even induce a hypertensive crisis and, accordingly, that exercise may be flagged in the excluded treatment plan for the patient.
In some embodiments, the treatment plans and/or excluded treatment plans may be presented, during a telemedicine or telehealth session, to a healthcare professional. The healthcare professional may select a particular treatment plan for the patient to cause that treatment plan to be transmitted to the patient and/or to control, based on the treatment plan, the treatment apparatus. In some embodiments, to facilitate telehealth or telemedicine applications, including remote diagnoses, determination of treatment plans and rehabilitative and/or pharmacologic prescriptions, the artificial intelligence engine may receive and/or operate distally from the patient and the treatment apparatus. In such cases, the recommended treatment plans and/or excluded treatment plans may be presented simultaneously with a video of the patient in real-time or near real-time during a telemedicine or telehealth session on a user interface of a computing device of a healthcare professional. The video may also be accompanied by audio, text and other multimedia information and/or other sensorial or perceptive (e.g., tactile, gustatory, haptic, pressure-sensing-based or electromagnetic (e.g., neurostimulation). Real-time may refer to less than or equal to 2 seconds. Near real-time may refer to any interaction of a sufficiently short time to enable two individuals to engage in a dialogue via such user interface, and will generally be less than 10 seconds (or any suitable proximate difference between two different times) but greater than 2 seconds.
Presenting the treatment plans generated by the artificial intelligence engine concurrently with a presentation of the patient video may provide an enhanced user interface because the healthcare professional may continue to visually and/or otherwise communicate with the patient while also reviewing the treatment plans on the same user interface. The enhanced user interface may improve the healthcare professional's experience using the computing device and may encourage the healthcare professional to reuse the user interface. Such a technique may also reduce computing resources (e.g., processing, memory, network) because the healthcare professional does not have to switch to another user interface screen to enter a query for a treatment plan to recommend based on the characteristics of the patient. The artificial intelligence engine provides, dynamically on the fly, the treatment plans and excluded treatment plans.
In some embodiments, the treatment apparatus may be adaptive and/or personalized because its properties, configurations, and positions may be adapted to the needs of a particular patient. For example, the pedals may be dynamically adjusted on the fly (e.g., via a telemedicine session or based on programmed configurations in response to certain measurements being detected) to increase or decrease a range of motion to comply with a treatment plan designed for the user. In some embodiments, a healthcare professional may adapt, remotely during a telemedicine session, the treatment apparatus to the needs of the patient by causing a control instruction to be transmitted from a server to treatment apparatus. Such adaptive nature may improve the results of recovery for a patient, furthering the goals of personalized medicine, and enabling personalization of the treatment plan on a per-individual basis.
The system 10 also includes a server 30 configured to store and to provide data related to managing the treatment plan. The server 30 may include one or more computers and may take the form of a distributed and/or virtualized computer or computers. The server 30 also includes a first communication interface 32 configured to communicate with the clinician interface 20 via a first network 34. In some embodiments, the first network 34 may include wired and/or wireless network connections such as Wi-Fi, Bluetooth, ZigBee, Near-Field Communications (NFC), cellular data network, etc. The server 30 includes a first processor 36 and a first machine-readable storage memory 38, which may be called a “memory” for short, holding first instructions 40 for performing the various actions of the server 30 for execution by the first processor 36. The server 30 is configured to store data regarding the treatment plan. For example, the memory 38 includes a system data store 42 configured to hold system data, such as data pertaining to treatment plans for treating one or more patients. The server 30 is also configured to store data regarding performance by a patient in following a treatment plan. For example, the memory 38 includes a patient data store 44 configured to hold patient data, such as data pertaining to the one or more patients, including data representing each patient's performance within the treatment plan.
In addition, the characteristics (e.g., personal, performance, measurement, etc.) of the people, the treatment plans followed by the people, the level of compliance with the treatment plans, and the results of the treatment plans may use correlations and other statistical or probabilistic measures to enable the partitioning of or to partition the treatment plans into different patient cohort-equivalent databases in the patient data store 44. For example, the data for a first cohort of first patients having a first similar injury, a first similar medical condition, a first similar medical procedure performed, a first treatment plan followed by the first patient, and a first result of the treatment plan may be stored in a first patient database. The data for a second cohort of second patients having a second similar injury, a second similar medical condition, a second similar medical procedure performed, a second treatment plan followed by the second patient, and a second result of the treatment plan may be stored in a second patient database. Any single characteristic or any combination of characteristics may be used to separate the cohorts of patients. In some embodiments, the different cohorts of patients may be stored in different partitions or volumes of the same database. There is no specific limit to the number of different cohorts of patients allowed, other than as limited by mathematical combinatoric and/or partition theory.
This characteristic data, treatment plan data, and results data may be obtained from numerous treatment apparatuses and/or computing devices over time and stored in the database 44. The characteristic data, treatment plan data, and results data may be correlated in the patient-cohort databases in the patient data store 44. The characteristics of the people may include personal information, performance information, and/or measurement information.
In addition to the historical information about other people stored in the patient cohort-equivalent databases, real-time or near-real-time information based on the current patient's characteristics about a current patient being treated may be stored in an appropriate patient cohort-equivalent database. The characteristics of the patient may be determined to match or be similar to the characteristics of another person in a particular cohort (e.g., cohort A) and the patient may be assigned to that cohort.
In some embodiments, the server 30 may execute an artificial intelligence (AI) engine 11 that uses one or more machine learning models 13 to perform at least one of the embodiments disclosed herein. The server 30 may include a training engine 9 capable of generating the one or more machine learning models 13. The machine learning models 13 may be trained to assign people to certain cohorts based on their characteristics, select treatment plans using real-time and historical data correlations involving patient cohort-equivalents, and control a treatment apparatus 70, among other things. The one or more machine learning models 13 may be generated by the training engine 9 and may be implemented in computer instructions executable by one or more processing devices of the training engine 9 and/or the servers 30. To generate the one or more machine learning models 13, the training engine 9 may train the one or more machine learning models 13. The one or more machine learning models 13 may be used by the artificial intelligence engine 11.
The training engine 9 may be a rackmount server, a router computer, a personal computer, a portable digital assistant, a smartphone, a laptop computer, a tablet computer, a netbook, a desktop computer, an Internet of Things (IoT) device, any other desired computing device, or any combination of the above. The training engine 9 may be cloud-based or a real-time software platform, and it may include privacy software or protocols, and/or security software or protocols.
To train the one or more machine learning models 13, the training engine 9 may use a training data set of a corpus of the characteristics of the people that used the treatment apparatus 70 to perform treatment plans, the details (e.g., treatment protocol including exercises, amount of time to perform the exercises, how often to perform the exercises, a schedule of exercises, parameters/configurations/settings of the treatment apparatus 70 throughout each step of the treatment plan, etc.) of the treatment plans performed by the people using the treatment apparatus 70, and the results of the treatment plans performed by the people. The one or more machine learning models 13 may be trained to match patterns of characteristics of a patient with characteristics of other people in assigned to a particular cohort. The term “match” may refer to an exact match, a correlative match, a substantial match, etc. The one or more machine learning models 13 may be trained to receive the characteristics of a patient as input, map the characteristics to characteristics of people assigned to a cohort, and select a treatment plan from that cohort. The one or more machine learning models 13 may also be trained to control, based on the treatment plan, the machine learning apparatus 70.
Different machine learning models 13 may be trained to recommend different treatment plans for different desired results. For example, one machine learning model may be trained to recommend treatment plans for most effective recovery, while another machine learning model may be trained to recommend treatment plans based on speed of recovery.
Using training data that includes training inputs and corresponding target outputs, the one or more machine learning models 13 may refer to model artifacts created by the training engine 9. The training engine 9 may find patterns in the training data wherein such patterns map the training input to the target output, and generate the machine learning models 13 that capture these patterns. In some embodiments, the artificial intelligence engine 11, the database 33, and/or the training engine 9 may reside on another component (e.g., assistant interface 94, clinician interface 20, etc.) depicted in
The one or more machine learning models 13 may comprise, e.g., a single level of linear or non-linear operations (e.g., a support vector machine [SVM]) or the machine learning models 13 may be a deep network, i.e., a machine learning model comprising multiple levels of non-linear operations. Examples of deep networks are neural networks including generative adversarial networks, convolutional neural networks, recurrent neural networks with one or more hidden layers, and fully connected neural networks (e.g., each neuron may transmit its output signal to the input of the remaining neurons, as well as to itself). For example, the machine learning model may include numerous layers and/or hidden layers that perform calculations (e.g., dot products) using various neurons.
The system 10 also includes a patient interface 50 configured to communicate information to a patient and to receive feedback from the patient. Specifically, the patient interface includes an input device 52 and an output device 54, which may be collectively called a patient user interface 52, 54. The input device 52 may include one or more devices, such as a keyboard, a mouse, a touch screen input, a gesture sensor, and/or a microphone and processor configured for voice recognition. The output device 54 may take one or more different forms including, for example, a computer monitor or display screen on a tablet, smartphone, or a smart watch. The output device 54 may include other hardware and/or software components such as a projector, virtual reality capability, augmented reality capability, etc. The output device 54 may incorporate various different visual, audio, or other presentation technologies. For example, the output device 54 may include a non-visual display, such as an audio signal, which may include spoken language and/or other sounds such as tones, chimes, and/or melodies, which may signal different conditions and/or directions and/or other sensorial or perceptive (e.g., tactile, gustatory, haptic, pressure-sensing-based or electromagnetic (e.g., neurostimulation) communication devices. The output device 54 may comprise one or more different display screens presenting various data and/or interfaces or controls for use by the patient. The output device 54 may include graphics, which may be presented by a web-based interface and/or by a computer program or application (App.).
As shown in
The patient interface 50 includes a second processor 60 and a second machine-readable storage memory 62 holding second instructions 64 for execution by the second processor 60 for performing various actions of patient interface 50. The second machine-readable storage memory 62 also includes a local data store 66 configured to hold data, such as data pertaining to a treatment plan and/or patient data, such as data representing a patient's performance within a treatment plan. The patient interface 50 also includes a local communication interface 68 configured to communicate with various devices for use by the patient in the vicinity of the patient interface 50. The local communication interface 68 may include wired and/or wireless communications. In some embodiments, the local communication interface 68 may include a local wireless network such as Wi-Fi, Bluetooth, ZigBee, Near-Field Communications (NFC), cellular data network, etc.
The system 10 also includes a treatment apparatus 70 configured to be manipulated by the patient and/or to manipulate a body part of the patient for performing activities according to the treatment plan. In some embodiments, the treatment apparatus 70 may take the form of an exercise and rehabilitation apparatus configured to perform and/or to aid in the performance of a rehabilitation regimen, which may be an orthopedic rehabilitation regimen, and the treatment includes rehabilitation of a body part of the patient, such as a joint or a bone or a muscle group. The treatment apparatus 70 may be any suitable medical, rehabilitative, therapeutic, etc. apparatus configured to be controlled distally via another computing device to treat a patient and/or exercise the patient. The treatment apparatus 70 may be an electromechanical machine including one or more weights, an electromechanical bicycle, an electromechanical spin-wheel, a smart-mirror, a treadmill, or the like. The body part may include, for example, a spine, a hand, a foot, a knee, or a shoulder. The body part may include a part of a joint, a bone, or a muscle group, such as one or more vertebrae, a tendon, or a ligament. As shown in
The internal sensors 76 may measure one or more operating characteristics of the treatment apparatus 70 such as, for example, a force, a position, a speed, and/or a velocity. In some embodiments, the internal sensors 76 may include a position sensor configured to measure at least one of a linear motion or an angular motion of a body part of the patient, and/or a position of the internal sensor 76. For example, an internal sensor 76 in the form of a position sensor may measure a distance that the patient is able to move a part of the treatment apparatus 70, where such distance may correspond to a range of motion that the patient's body part is able to achieve. In some embodiments, the internal sensors 76 may include a force sensor configured to measure a force applied by the patient. For example, an internal sensor 76 in the form of a force sensor may measure a force or weight the patient is able to apply, using a particular body part, to the treatment apparatus 70.
The system 10 shown in
The ambulation, or user, sensor 82 may measure one or more operating characteristics of the user such as, for example, a force, a position, a speed, and/or a velocity. In some embodiments, the ambulation sensor 82 may include a plurality of ambulation sensors 82. In some embodiments, the ambulation sensor 82, or ambulation sensors, may be configured to, or communicate with the local communication interface to, measure at least one of a linear motion or an angular motion of a body part of the patient, and/or a position of the ambulation sensor 82, or ambulation sensors. For example, the ambulation sensors 82 may communicate with the local communication interface cooperating with the server to track a location of at least one ambulation sensor 82, and in turn, a location of the user.
The system 10 shown in
The goniometer 84, or any treatment apparatus, may include one or more treatment sensors (not shown in the FIGS.), configured to measure one or more operating characteristics of the user, such as, for example, a force, a position, a speed, and/or a velocity, of the goniometer 84. In some embodiments, the treatment sensor may include a plurality of treatment sensors. In some embodiments, the treatment sensor may be configured to, or communicate with the local communication interface to, measure at least one of a linear motion, an angular motion of a body part of the patient, and/or a position of the treatment sensor. For example, the treatment sensor may communicate with the local communication interface cooperating with the server to track a location of the plurality of treatment sensors, and in turn a location of the goniometer 84.
The system 10 shown in
The system 10 shown in
The system 10 shown in
The system 10 includes an assistant interface 94 for an assistant, such as a doctor, a nurse, a physical therapist, or a technician, to remotely communicate with the patient interface 50 and/or the treatment apparatus 70. Such remote communications may enable the assistant to provide assistance or guidance to a patient using the system 10. More specifically, the assistant interface 94 is configured to communicate a telemedicine signal 96, 97, 98a, 98b, 99a, 99b with the patient interface 50 via a network connection such as, for example, via the first network 34 and/or the second network 58. The telemedicine signal 96, 97, 98a, 98b, 99a, 99b comprises one of an audio signal 96, an audiovisual signal 97, an interface control signal 98a for controlling a function of the patient interface 50, an interface monitor signal 98b for monitoring a status of the patient interface 50, an apparatus control signal 99a for changing an operating parameter of the treatment apparatus 70, and/or an apparatus monitor signal 99b for monitoring a status of the treatment apparatus 70. In some embodiments, each of the control signals 98a, 99a may be unidirectional, conveying commands from the assistant interface 94 to the patient interface 50. In some embodiments, in response to successfully receiving a control signal 98a, 99a and/or to communicate successful and/or unsuccessful implementation of the requested control action, an acknowledgement message may be sent from the patient interface 50 to the assistant interface 94. In some embodiments, each of the monitor signals 98b, 99b may be unidirectional, status-information commands from the patient interface 50 to the assistant interface 94. In some embodiments, an acknowledgement message may be sent from the assistant interface 94 to the patient interface 50 in response to successfully receiving one of the monitor signals 98b, 99b.
In some embodiments, the patient interface 50 may be configured as a pass-through for the apparatus control signals 99a and the apparatus monitor signals 99b between the treatment apparatus 70 and one or more other devices, such as the assistant interface 94 and/or the server 30. For example, the patient interface 50 may be configured to transmit an apparatus control signal 99a in response to an apparatus control signal 99a within the telemedicine signal 96, 97, 98a, 98b, 99a, 99b from the assistant interface 94.
In some embodiments, the assistant interface 94 may be presented on a shared physical device as the clinician interface 20. For example, the clinician interface 20 may include one or more screens that implement the assistant interface 94. Alternatively or additionally, the clinician interface 20 may include additional hardware components, such as a video camera, a speaker, and/or a microphone, to implement aspects of the assistant interface 94.
In some embodiments, one or more portions of the telemedicine signal 96, 97, 98a, 98b, 99a, 99b may be generated from a prerecorded source (e.g., an audio recording, a video recording, or an animation) for presentation by the output device 54 of the patient interface 50. For example, a tutorial video may be streamed from the server 30 and presented upon the patient interface 50. Content from the prerecorded source may be requested by the patient via the patient interface 50. Alternatively, via a control on the assistant interface 94, the assistant may cause content from the prerecorded source to be played on the patient interface 50.
The assistant interface 94 includes an assistant input device 22 and an assistant display 24, which may be collectively called an assistant user interface 22, 24. The assistant input device 22 may include one or more of a telephone, a keyboard, a mouse, a trackpad, or a touch screen, for example. Alternatively or additionally, the assistant input device 22 may include one or more microphones. In some embodiments, the one or more microphones may take the form of a telephone handset, headset, or wide-area microphone or microphones configured for the assistant to speak to a patient via the patient interface 50. In some embodiments, assistant input device 22 may be configured to provide voice-based functionalities, with hardware and/or software configured to interpret spoken instructions by the assistant by using the one or more microphones. The assistant input device 22 may include functionality provided by or similar to existing voice-based assistants such as Siri by Apple, Alexa by Amazon, Google Assistant, or Bixby by Samsung. The assistant input device 22 may include other hardware and/or software components. The assistant input device 22 may include one or more general purpose devices and/or special-purpose devices.
The assistant display 24 may take one or more different forms including, for example, a computer monitor or display screen on a tablet, a smartphone, or a smart watch. The assistant display 24 may include other hardware and/or software components such as projectors, virtual reality capabilities, or augmented reality capabilities, etc. The assistant display 24 may incorporate various different visual, audio, or other presentation technologies. For example, the assistant display 24 may include a non-visual display, such as an audio signal, which may include spoken language and/or other sounds such as tones, chimes, melodies, and/or compositions, which may signal different conditions and/or directions. The assistant display 24 may comprise one or more different display screens presenting various data and/or interfaces or controls for use by the assistant. The assistant display 24 may include graphics, which may be presented by a web-based interface and/or by a computer program or application (App.).
In some embodiments, the system 10 may provide computer translation of language from the assistant interface 94 to the patient interface 50 and/or vice-versa. The computer translation of language may include computer translation of spoken language and/or computer translation of text. Additionally or alternatively, the system 10 may provide voice recognition and/or spoken pronunciation of text. For example, the system 10 may convert spoken words to printed text and/or the system 10 may audibly speak language from printed text. The system 10 may be configured to recognize spoken words by any or all of the patient, the clinician, and/or the assistant. In some embodiments, the system 10 may be configured to recognize and react to spoken requests or commands by the patient. For example, the system 10 may automatically initiate a telemedicine session in response to a verbal command by the patient (which may be given in any one of several different languages).
In some embodiments, the server 30 may generate aspects of the assistant display 24 for presentation by the assistant interface 94. For example, the server 30 may include a web server configured to generate the display screens for presentation upon the assistant display 24. For example, the artificial intelligence engine 11 may generate recommended treatment plans and/or excluded treatment plans for patients and generate the display screens including those recommended treatment plans and/or external treatment plans for presentation on the assistant display 24 of the assistant interface 94. In some embodiments, the assistant display 24 may be configured to present a virtualized desktop hosted by the server 30. In some embodiments, the server 30 may be configured to communicate with the assistant interface 94 via the first network 34. In some embodiments, the first network 34 may include a local area network (LAN), such as an Ethernet network. In some embodiments, the first network 34 may include the Internet, and communications between the server 30 and the assistant interface 94 may be secured via privacy enhancing technologies, such as, for example, by using encryption over a virtual private network (VPN). Alternatively or additionally, the server 30 may be configured to communicate with the assistant interface 94 via one or more networks independent of the first network 34 and/or other communication means, such as a direct wired or wireless communication channel. In some embodiments, the patient interface 50 and the treatment apparatus 70 may each operate from a patient location geographically separate from a location of the assistant interface 94. For example, the patient interface 50 and the treatment apparatus 70 may be used as part of an in-home rehabilitation system, which may be aided remotely by using the assistant interface 94 at a centralized location, such as a clinic or a call center.
In some embodiments, the assistant interface 94 may be one of several different terminals (e.g., computing devices) that may be grouped together, for example, in one or more call centers or at one or more clinicians' offices. In some embodiments, a plurality of assistant interfaces 94 may be distributed geographically. In some embodiments, a person may work as an assistant remotely from any conventional office infrastructure. Such remote work may be performed, for example, where the assistant interface 94 takes the form of a computer and/or telephone. This remote work functionality may allow for work-from-home arrangements that may include part time and/or flexible work hours for an assistant.
Specifically, the overview display 120 includes a patient profile display 130 presenting biographical information regarding a patient using the treatment apparatus 70. The patient profile display 130 may take the form of a portion or region of the overview display 120, as shown in
In some embodiments, the patient profile display 130 may present information regarding the treatment plan for the patient to follow in using the treatment apparatus 70. Such treatment plan information may be limited to an assistant who is a healthcare professional, such as a doctor or physical therapist. For example, a healthcare professional assisting the patient with an issue regarding the treatment regimen may be provided with treatment plan information, whereas a technician troubleshooting an issue with the treatment apparatus 70 may not be provided with any information regarding the patient's treatment plan.
In some embodiments, one or more recommended treatment plans and/or excluded treatment plans may be presented in the patient profile display 130 to the assistant. The one or more recommended treatment plans and/or excluded treatment plans may be generated by the artificial intelligence engine 11 of the server 30 and received from the server 30 in real-time during, inter alia, a telemedicine or telehealth session. An example of presenting the one or more recommended treatment plans and/or ruled-out treatment plans is described below with reference to
The example overview display 120 shown in
User access controls may be used to limit access, including what data is available to be viewed and/or modified, on any or all of the user interfaces 20, 50, 90, 92, 94 of the system 10. In some embodiments, user access controls may be employed to control what information is available to any given person using the system 10. For example, data presented on the assistant interface 94 may be controlled by user access controls, with permissions set depending on the assistant/user's need for and/or qualifications to view that information.
The example overview display 120 shown in
The example overview display 120 shown in
In some embodiments, the patient interface setting control 154 may include collaborative browsing or co-browsing capability for the assistant to remotely view and/or control the patient interface 50. For example, the patient interface setting control 154 may enable the assistant to remotely enter text to one or more text entry fields on the patient interface 50 and/or to remotely control a cursor on the patient interface 50 using a mouse or touchscreen of the assistant interface 94.
In some embodiments, using the patient interface 50, the patient interface setting control 154 may allow the assistant to change a setting that cannot be changed by the patient. For example, the patient interface 50 may be precluded from accessing a language setting to prevent a patient from inadvertently switching, on the patient interface 50, the language used for the displays, whereas the patient interface setting control 154 may enable the assistant to change the language setting of the patient interface 50. In another example, the patient interface 50 may not be able to change a font size setting to a smaller size in order to prevent a patient from inadvertently switching the font size used for the displays on the patient interface 50 such that the display would become illegible to the patient, whereas the patient interface setting control 154 may provide for the assistant to change the font size setting of the patient interface 50.
The example overview display 120 shown in
The example overview display 120 shown in
The apparatus control 160 may include an apparatus setting control 164 for the assistant to adjust or control one or more aspects of the treatment apparatus 70. The apparatus setting control 164 may cause the assistant interface 94 to generate and/or to transmit an apparatus control signal 99 for changing an operating parameter of the treatment apparatus 70, (e.g., a pedal radius setting, a resistance setting, a target RPM, etc.). The apparatus setting control 164 may include a mode button 166 and a position control 168, which may be used in conjunction for the assistant to place an actuator 78 of the treatment apparatus 70 in a manual mode, after which a setting, such as a position or a speed of the actuator 78, can be changed using the position control 168. The mode button 166 may provide for a setting, such as a position, to be toggled between automatic and manual modes. In some embodiments, one or more settings may be adjustable at any time, and without having an associated auto/manual mode. In some embodiments, the assistant may change an operating parameter of the treatment apparatus 70, such as a pedal radius setting, while the patient is actively using the treatment apparatus 70. Such “on the fly” adjustment may or may not be available to the patient using the patient interface 50. In some embodiments, the apparatus setting control 164 may allow the assistant to change a setting that cannot be changed by the patient using the patient interface 50. For example, the patient interface 50 may be precluded from changing a preconfigured setting, such as a height or a tilt setting of the treatment apparatus 70, whereas the apparatus setting control 164 may provide for the assistant to change the height or tilt setting of the treatment apparatus 70.
The example overview display 120 shown in
In some embodiments, the audio or an audiovisual communications session with the patient interface 50 may take place, at least in part, while the patient is performing the rehabilitation regimen upon the body part. The patient communications control 170 may take the form of a portion or region of the overview display 120, as shown in
The example overview display 120 shown in
As depicted, the data has been assigned to different cohorts. Cohort A includes data for patients having similar first characteristics, first treatment plans, and first results. Cohort B includes data for patients having similar second characteristics, second treatment plans, and second results. For example, cohort A may include first characteristics of patients in their twenties without any medical conditions who underwent surgery for a broken limb; their treatment plans may include a certain treatment protocol (e.g., use the treatment apparatus 70 for 30 minutes 5 times a week for 3 weeks, wherein values for the properties, configurations, and/or settings of the treatment apparatus 70 are set to X (where X is a numerical value) for the first two weeks and to Y (where Y is a numerical value) for the last week).
Cohort A and cohort B may be included in a training dataset used to train the machine learning model 13. The machine learning model 13 may be trained to match a pattern between characteristics for each cohort and output the treatment plan that provides the result. Accordingly, when the data 600 for a new patient is input into the trained machine learning model 13, the trained machine learning model 13 may match the characteristics included in the data 600 with characteristics in either cohort A or cohort B and output the appropriate treatment plan 602. In some embodiments, the machine learning model 13 may be trained to output one or more excluded treatment plans that should not be performed by the new patient.
The assistant (e.g., healthcare professional) using the assistant interface 94 (e.g., computing device) during the telemedicine session may be presented in the self-video 182 in a portion of the overview display 120 (e.g., user interface presented on a display screen 24 of the assistant interface 94) that also presents a video from the patient in the video feed display 180. Further, the video feed display 180 may also include a graphical user interface (GUI) object 700 (e.g., a button) that enables the healthcare professional to share on the patient interface 50, in real-time or near real-time during the telemedicine session, the recommended treatment plans and/or the excluded treatment plan with the patient. The healthcare professional may select the GUI object 700 to share the recommended treatment plans and/or the excluded treatment plans. As depicted, another portion of the overview display 120 includes the patient profile display 130.
The patient profile display 130 is presenting two example recommended treatment plans 600 and one example excluded treatment plan 602. As described herein, the treatment plans may be recommended in view of characteristics of the patient being treated. To generate the recommended treatment plans 600 the patient should follow to achieve a desired result, a pattern between the characteristics of the patient being treated and a cohort of other people who have used the treatment apparatus 70 to perform a treatment plan may be matched by one or more machine learning models 13 of the artificial intelligence engine 11. Each of the recommended treatment plans may be generated based on different desired results.
For example, as depicted, the patient profile display 130 presents “The characteristics of the patient match characteristics of users in Cohort A. The following treatment plans are recommended for the patient based on his characteristics and desired results.” Then, the patient profile display 130 presents recommended treatment plans from cohort A, and each treatment plan provides different results.
As depicted, treatment plan “A” indicates “Patient X should use treatment apparatus for 30 minutes a day for 4 days to achieve an increased range of motion of Y %; Patient X has Type 2 Diabetes; and Patient X should be prescribed medication Z for pain management during the treatment plan (medication Z is approved for people having Type 2 Diabetes).” Accordingly, the treatment plan generated achieves increasing the range of motion of Y %. As may be appreciated, the treatment plan also includes a recommended medication (e.g., medication Z) to prescribe to the patient to manage pain in view of a known medical disease (e.g., Type 2 Diabetes) of the patient. That is, the recommended patient medication not only does not conflict with the medical condition of the patient but thereby improves the probability of a superior patient outcome. This specific example and all such examples elsewhere herein are not intended to limit in any way the generated treatment plan from recommending multiple medications, or from handling the acknowledgement, view, diagnosis and/or treatment of comorbid conditions or diseases.
Recommended treatment plan “B” may specify, based on a different desired result of the treatment plan, a different treatment plan including a different treatment protocol for a treatment apparatus, a different medication regimen, etc.
As depicted, the patient profile display 130 may also present the excluded treatment plans 602. These types of treatment plans are shown to the assistant using the assistant interface 94 to alert the assistant not to recommend certain portions of a treatment plan to the patient. For example, the excluded treatment plan could specify the following: “Patient X should not use treatment apparatus for longer than 30 minutes a day due to a heart condition; Patient X has Type 2 Diabetes; and Patient X should not be prescribed medication M for pain management during the treatment plan (in this scenario, medication M can cause complications for people having Type 2 Diabetes). Specifically, the excluded treatment plan points out a limitation of a treatment protocol where, due to a heart condition, Patient X should not exercise for more than 30 minutes a day. The ruled-out treatment plan also points out that Patient X should not be prescribed medication M because it conflicts with the medical condition Type 2 Diabetes.
The assistant may select the treatment plan for the patient on the overview display 120. For example, the assistant may use an input peripheral (e.g., mouse, touchscreen, microphone, keyboard, etc.) to select from the treatment plans 600 for the patient. In some embodiments, during the telemedicine session, the assistant may discuss the pros and cons of the recommended treatment plans 600 with the patient.
In any event, the assistant may select the treatment plan for the patient to follow to achieve the desired result. The selected treatment plan may be transmitted to the patient interface 50 for presentation. The patient may view the selected treatment plan on the patient interface 50. In some embodiments, the assistant and the patient may discuss during the telemedicine session the details (e.g., treatment protocol using treatment apparatus 70, diet regimen, medication regimen, etc.) in real-time or in near real-time. In some embodiments, the server 30 may control, based on the selected treatment plan and during the telemedicine session, the treatment apparatus 70 as the user uses the treatment apparatus 70.
In one embodiment, the data received at the server 30 may be input into the trained machine learning model 13, which may determine that the characteristics indicate the patient is on track for the current treatment plan. Determining the patient is on track for the current treatment plan may cause the trained machine learning model 13 to adjust a parameter of the treatment apparatus 70. The adjustment may be based on a next step of the treatment plan to further improve the performance of the patient.
In one embodiment, the data received at the server 30 may be input into the trained machine learning model 13, which may determine that the characteristics indicate the patient is not on track (e.g., behind schedule, not able to maintain a speed, not able to achieve a certain range of motion, is in too much pain, etc.) for the current treatment plan or is ahead of schedule (e.g., exceeding a certain speed, exercising longer than specified with no pain, exerting more than a specified force, etc.) for the current treatment plan. The trained machine learning model 13 may determine that the characteristics of the patient no longer match the characteristics of the patients in the cohort to which the patient is assigned. Accordingly, the trained machine learning model 13 may reassign the patient to another cohort that includes qualifying characteristics the patient's characteristics. As such, the trained machine learning model 13 may select a new treatment plan from the new cohort and control, based on the new treatment plan, the treatment apparatus 70.
In some embodiments, prior to controlling the treatment apparatus 70, the server 30 may provide the new treatment plan 800 to the assistant interface 94 for presentation in the patient profile 130. As depicted, the patient profile 130 indicates “The characteristics of the patient have changed and now match characteristics of users in Cohort B. The following treatment plan is recommended for the patient based on his characteristics and desired results.” Then, the patient profile 130 presents the new treatment plan 800 (“Patient X should use treatment apparatus for 10 minutes a day for 3 days to achieve an increased range of motion of L %”. The assistant (healthcare professional) may select the new treatment plan 800, and the server 30 may receive the selection. The server 30 may control the treatment apparatus 70 based on the new treatment plan 800. In some embodiments, the new treatment plan 800 may be transmitted to the patient interface 50 such that the patient may view the details of the new treatment plan 800.
For simplicity of explanation, the method 900 is depicted and described as a series of operations. However, operations in accordance with this disclosure can occur in various orders and/or concurrently, and/or with other operations not presented and described herein. For example, the operations depicted in the method 900 may occur in combination with any other operation of any other method disclosed herein. Furthermore, not all illustrated operations may be required to implement the method 900 in accordance with the disclosed subject matter. In addition, those skilled in the art will understand and appreciate that the method 900 could alternatively be represented as a series of interrelated states via a state diagram or events.
At 902, the processing device may receive first data pertaining to a first user that uses a treatment apparatus 70 to perform a treatment plan. The first data may include characteristics of the first user, the treatment plan, and a result of the treatment plan.
At 904, the processing device may assign, based on the first data, the first user to a first cohort representing people having similarities to at least some of the characteristics of the first user, the treatment plan, and the result of the treatment plan.
At 906, the processing device may receive second data pertaining to a second user. The second data may include characteristics of the second user. The characteristics of the first user and the second user may include personal information, performance information, measurement information, or some combination thereof. In some embodiments, the personal information may include an age, a weight, a gender, a height, a body mass index, a medical condition, a familial medication history, an injury, or a medical procedure. In some embodiments, the performance information may include an elapsed time of using the treatment apparatus, an amount of force exerted on a portion of the treatment apparatus, a range of motion achieved on the treatment apparatus, a movement speed of a portion of the treatment apparatus, an indication of a set of pain levels using the treatment apparatus, or some combination thereof. In some embodiments, the measurement information may include a vital sign, a respiration rate, a heartrate, a temperature, or some combination thereof.
At 908, the processing device may determine whether at least some of the characteristics of the second user match with at least some of the characteristics of the first user assigned to the first cohort. In some embodiments, one or more machine learning models may be trained to determine whether at least the characteristics of the second user match the characteristics of the first user assigned to the first cohort.
At 910, responsive to determining the at least some of the characteristics of the second user match with at least some of the characteristics of the first user, the processing device may assign the second user to the first cohort and select, via a trained machine learning model, the treatment plan for the second user. In some embodiments, the trained machine learning model is trained, using at least the first data, to compare, in real-time or near real-time, the second data of the second user to a set of data stored in a set of cohorts and select the treatment plan that leads to a desired result and that includes characteristics that match the second characteristics of the second user. The set of cohorts may include the first cohort.
The treatment plan may include a treatment protocol that specifies using the treatment apparatus 70 to perform certain exercises for certain lengths of time and a periodicity for performing the exercises. The treatment protocol may also specify parameters of the treatment apparatus 70 for each of the exercises. For example, a two-week treatment protocol for a person having certain characteristics (e.g., respiration, weight, age, injury, current range of motion, heartrate, etc.) may specify the exercises for a first week and a second week. The exercise for the first week may include pedaling a bicycle for a 10-minute time period where the pedals gradually increase or decrease a range of motion every 1 minute throughout the 10-minute time period. The exercise for the second week may include pedaling a bicycle for a 5-minute time period where the pedals aggressively increase or decrease a range of motion every 1 minute throughout the 10-minute time period.
At 912, the processing device may control, based on the treatment plan, the treatment apparatus 70 while the second user uses the treatment apparatus. In some embodiments, the controlling may be performed by the server 30 distal from the treatment apparatus 70 (e.g., during a telemedicine session). Controlling the treatment apparatus 70 distally may include the server 30 transmitting, based on the treatment plan, a control instruction to change a parameter of the treatment apparatus 70 at a particular time to increase a likelihood of a positive effect of continuing to use the treatment apparatus or to decrease a likelihood of a negative effect of continuing to use the treatment apparatus. For example, the treatment plan may include information (based on historical information of people having certain characteristics and performing exercises in the treatment plan) indicating there may be diminishing returns after a certain amount of time of performing a certain exercise. Accordingly, the server 30, executing one or more machine learning models 13, may transmit a control signal to the treatment apparatus 70 to cause the treatment apparatus 70 to change a parameter (e.g., slow down, stop, etc.).
In some embodiments, the treatment apparatus used by the first user and the treatment apparatus used by the second user may be the same, or the treatment apparatus used by the first user and the treatment apparatus used by the second user may be different. For example, if the first user and the second user are members of a family, then they may use the same treatment apparatus. If the first user and the second user live in different residences, then the first user and the second user may use different treatment apparatuses.
In some embodiments, the processing device may continue to receive data while the second user uses the treatment apparatus 70 to perform the treatment plan. The data received may include characteristics of the second user while the second user uses the treatment apparatus 70 to perform the treatment plan. The characteristics may include information pertaining to measurements (e.g., respiration, heartrate, temperature, perspiration) and performance (e.g., range of motion, force exerted on a portion of the treatment apparatus 70, speed of actuating a portion of the treatment apparatus 70, etc.). The data may indicate that the second user is improving (e.g., maintaining a desired speed of the treatment plan, range of motion, and/or force) as expected in view of the treatment plan for a person having similar data. Accordingly, the processing device may adjust, via a trained machine learning model 13, based on the data and the treatment plan, a parameter of the treatment apparatus 70. For example, the data may indicate the second user is pedaling a portion of the treatment apparatus 70 for 3 minutes at a certain speed. Thus, the machine learning model may adjust, based on the data and the treatment plan, an amount of resistance of the pedals to attempt to cause the second user to achieve a certain result (e.g., strengthen one or more muscles). The certain result may have been achieved by other users with similar data (e.g., characteristics including performance, measurements, etc.) exhibited by the second user at a particular point in a treatment plan.
In some embodiments, the processing device may receive, from the treatment apparatus 70, data pertaining to second characteristics of the second user while the second user uses the treatment apparatus 70 to perform the treatment plan. The second characteristics may include information pertaining to measurements (e.g., respiration, heartrate, temperature, perspiration) and performance (e.g., range of motion, force exerted on a portion of the treatment apparatus 70, speed of actuating a portion of the treatment apparatus 70, etc.) of the second user as the second user uses the treatment apparatus 70 to perform the treatment plan. In some embodiments, the processing device may determine, based on the characteristics, that the second user is improving faster than expected for the treatment plan or is not improving (e.g., unable to maintain a desired speed of the treatment plan, range of motion, and/or force) as expected for the treatment plan.
The processing device may determine that the second characteristics of the second user match characteristics of a third user assigned to a second cohort. The second cohort may include data for people having different characteristics than the cohort to which the second user was initially assigned. Responsive to determining the second characteristics of the second user match the characteristics of the third user, the processing device may assign the second user to the second cohort and select, via the trained machine learning model, a second treatment plan for the second user. Accordingly, the treatment plans for a user using the treatment apparatus 70 may be dynamically adjusted, in real-time while the user is using the treatment apparatus 70, to best fit the characteristics of the second user and enhance a likelihood the second user achieves a desired result experienced by other people in a particular cohort to which the second user is assigned. The second treatment plan may have been performed by the third user with similar characteristics to the second user, and as a result of performing the second treatment plan, the third user may have achieved a desired result. The processing device may control, based on the second treatment plan, the treatment apparatus 70 while the second user uses the treatment apparatus.
In some embodiments, responsive to determining the characteristics of the second user do not match the characteristics of the first user, the processing device may determine whether at least the characteristics of the second user match characteristics of a third user assigned to a second cohort. Responsive to determining the characteristics of the second user match the characteristics of the third user, the processing device may assign the second user to the second cohort and select, via the trained machine learning model, a second treatment plan for the second user. The second treatment plan may have been performed by the third user with similar characteristics to the second user, and as a result of performing the second treatment plan, the third user may have achieved a desired result. The processing device may control, based on the second treatment plan, the treatment apparatus 70 while the second user uses the treatment apparatus.
In some embodiments, the method 1000 may occur after 910 and prior to 912 in the method 900 depicted in
Regarding the method 1000, at 1002, prior to controlling the treatment apparatus 70 while the second user uses the treatment apparatus 70, the processing device may provide, during a telemedicine or telehealth session, a recommendation pertaining to the treatment plan to a computing device (e.g., assistant interface 94) of a healthcare professional. The recommendation may be presented on a display screen of the computing device in real-time (e.g., less than 2 seconds) in a portion of the display screen while another portion of the display screen presents video of a user (e.g., patient).
At 1004, the processing device may receive, from the computing device of the healthcare professional, a selection of the treatment plan. The healthcare professional may use any suitable input peripheral (e.g., mouse, keyboard, microphone, touchpad, etc.) to select the recommended treatment plan. The computing device may transmit the selection to the processing device of the server 30, which receives the selection. There may any suitable number of treatment plans presented on the display screen. Each of the treatment plans recommended may provide different results and the healthcare professional may consult, during the telemedicine session, with the user to discuss which result the user desires. In some embodiments, the recommended treatment plans may only be presented on the computing device of the healthcare professional and not on the computing device of the user (patient interface 50). In some embodiments, the healthcare professional may choose an option presented on the assistant interface 94. The option may cause the treatment plans to be transmitted to the patient interface 50 for presentation. In this way, during the telemedicine session, the healthcare professional and the user may view the treatment plans at the same time in real-time or in near real-time, which may provide for an enhanced user experience for the user using the computing device. After the selection of the treatment plan is received at the server 30, at 1006, the processing device may control, based on the selected treatment plan, the treatment apparatus while the second user uses the treatment apparatus 70.
In some embodiments, the processor, or processing device, 36 may generate an enhanced environment representative of an environment. The enhanced environment may be displayed in the patient interface 50. The patient interface 50 may be one of an augmented reality device, a virtual reality device, a mixed reality device, and an immersive reality device configured to present the enhanced environment. The enhanced environment may be any of a selected or predetermined environment, e.g., a template living room or rehabilitation center. The enhanced environment may be selected from a menu displayed in the patient interface 50 and displaying one or more option for the enhanced environment.
In some embodiments, the processor 36 may receive, from the apparatus sensors 76, apparatus data representative of a location of the apparatus in the environment. For example, the apparatus sensors 76 may communicate with the server 30, and in turn, the processors 36, the data associated with a location of the apparatus sensors 76, and in turn, the apparatus 70 in the environment. The processors 36 may also generate, from the apparatus data, an apparatus avatar in the enhanced environment.
In some embodiments, the processor 36 may also receive, from the user sensors 82, user data representative of a location of the user in the environment. For example, the user sensors 82 may communicate with the server 30. In turn, the processors 36 may receive, from the server 30, the data associated with a location of the user sensors 82, and in turn, the apparatus 70 in the environment. The processors 36 may generate, from the user data, a user avatar in the enhanced environment.
In some embodiments, the processor 36 may also receive, from the treatment sensors (not illustrated), treatment data representative of one or more locations of the treatment sensors in the environment. For example, the user sensors 82 may communicate with the server 30, and in turn, the processors 36, the data associated with a location of the user sensors 82, and in turn, the apparatus 70 in the environment. In some embodiments, the processors 36 may generate, from the treatment data, treatment sensor avatars in the enhanced environment.
In some embodiments, the processor 36 may calculate, based on one or more of the apparatus data and the user data, a treatment location for each treatment sensor, wherein the treatment location is associated with an anatomical structure of a user. The processor 36 may further generate, based on the treatment location and treatment data, instruction data representing an instruction for positioning the treatment sensors at the treatment location. The instruction data may represent instructions capable of altering the location of the treatment sensor to be one of adjacent to, at, and near the treatment location. The instruction data may represent instruction confirming that the location of the treatment sensor is one of adjacent to, at, and near the treatment location. For example, when the goniometer is located at an ideal location on the user, the instruction data represents instruction confirming the goniometer is in an optimal position on the user for rehabilitation. In another example, when the goniometer is not in an optimal position on the user for rehabilitation, the instruction data represents instruction confirming the goniometer is out of place and needs to be moved. The instruction may represent one or more of arrows, a color-coded indicator, an audible indication and a textual message. The instruction can be any medium suitable for communicating with a user. The instruction may be one or more of a color-coded indication, audible indication, a textual message, and/or other sensorial or perceptive (e.g., tactile, gustatory, haptic, pressure-sensing-based or electromagnetic (e.g., neurostimulation) communication indication.
In some embodiments, the processor 36 may output, to the patient (or user) interface 50 and based on the environment data, an image representative of the enhanced environment. Further, the processors 36 may output, to the patient interface 50 (or any other interface, such as: the assistance interface 94, reporting interface 92, supervisory interface 90, clinician interface 20), an image representing the user, apparatus and treatment sensor avatars. The avatars can be of any shape or form sufficient to communicate with a user the relative location of object in the enhanced environment. The processor 36 may also generate, based on the treatment location, a treatment location avatar. The processors 36 may output, to the patient interface 50, an image representing the treatment location avatar. The treatment location avatar may be one of overlaid on and transposed with a portion of the user avatar. For example, the treatment location avatar would display as if on the user avatar and represent a location where the goniometer is to be placed. The processors 36 is may output, to the patient interface 5050, the treatment location avatar in a frequency, or pattern, configured to cause the avatar to flash and wherein the frequency of flashing is one or more of: variable (e.g. the treatment location avatar blinks); static (e.g., the treatment avatar does not blink but presented as a shaded object or an object outlined by a solid line); and based on the instruction data.
The processor 36 may output, to the patient interface 50, instructions confirming that the location of the treatment sensor is one of adjacent to, at, and near the treatment location. The processor 36 may output, to the patient interface 50, instructions to move the location of the treatment sensor to the treatment location. The instruction can be any one of the instruction discussed above, or in any other form sufficient to communicate with a user.
In some embodiments, the processor 36 may receive, during a telemedicine-enabled appointment between the user and a healthcare professional, medical instruction data representative of instructions from the healthcare professional. The processor 36 may output, to the user interface 50 and based on the medical instruction data, instructions from the healthcare professional. The medical instruction data refers to a recommended treatment location. A medical interface remote from the user and associated with the healthcare professional, and wherein the processing device is further configured to output, to the medical interface, a user response to the medical instruction.
The computer system 1100 includes a processing device 1102, a main memory 1104 (e.g., read-only memory (ROM), flash memory, solid state drives (SSDs), dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM)), a static memory 1106 (e.g., flash memory, solid state drives (SSDs), static random access memory (SRAM)), and a data storage device 1108, which communicate with each other via a bus 1110.
Processing device 1102 represents one or more general-purpose processing devices such as a microprocessor, central processing unit, or the like. More particularly, the processing device 1102 may be a complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, or a processor implementing other instruction sets or processors implementing a combination of instruction sets. The processing device 1402 may also be one or more special-purpose processing devices such as an application specific integrated circuit (ASIC), a system on a chip, a field programmable gate array (FPGA), a digital signal processor (DSP), network processor, or the like. The processing device 1402 is configured to execute instructions for performing any of the operations and steps discussed herein.
The computer system 1100 may further include a network interface device 1112. The computer system 1100 also may include a video display 1114 (e.g., a liquid crystal display (LCD), a light-emitting diode (LED), an organic light-emitting diode (OLED), a quantum LED, a cathode ray tube (CRT), a shadow mask CRT, an aperture grille CRT, a monochrome CRT), one or more input devices 1116 (e.g., a keyboard and/or a mouse or a gaming-like control), and one or more speakers 1118 (e.g., a speaker). In one illustrative example, the video display 1114 and the input device(s) 1116 may be combined into a single component or device (e.g., an LCD touch screen).
The data storage device 1116 may include a computer-readable medium 1120 on which the instructions 1122 embodying any one or more of the methods, operations, or functions described herein is stored. The instructions 1122 may also reside, completely or at least partially, within the main memory 1104 and/or within the processing device 1102 during execution thereof by the computer system 1100. As such, the main memory 1104 and the processing device 1102 also constitute computer-readable media. The instructions 1122 may further be transmitted or received over a network via the network interface device 1112.
While the computer-readable storage medium 1120 is shown in the illustrative examples to be a single medium, the term “computer-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “computer-readable storage medium” shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present disclosure. The term “computer-readable storage medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical media, and magnetic media.
Clause 1. A system for positioning one or more sensors on a user, the system comprising:
an apparatus configured to be manipulated by the user to perform an exercise;
user sensors associated with the user;
apparatus sensors associated with the apparatus;
treatment sensors;
a processing device;
a memory communicatively coupled to the processing device and including computer readable instructions, that when executed by the processing device, cause the processing device to:
generate an enhanced environment representative of an environment;
receive, from the apparatus sensors, apparatus data representative of a location of the apparatus in the environment;
generate, from the apparatus data, an apparatus avatar in the enhanced environment;
receive, from the user sensors, user data representative of a location of the user in the environment;
generate, from the user data, a user avatar in the enhanced environment;
receive, from the treatment sensors, treatment data representative of one or more locations of the treatment sensors in the environment;
generate, from the treatment data, treatment sensor avatars in the enhanced environment;
calculate, based on one or more of the apparatus data and the user data, a treatment location for each treatment sensor, wherein the treatment location is associated with an anatomical structure of a user; and
generate, based on the treatment location and treatment data, instruction data representing an instruction for positioning the treatment sensors at the treatment location.
Clause 2. The system of any clause herein, further comprising an interface and wherein the processing device is further configured to:
output, to the interface and based on the environment data, an image representative of the enhanced environment; and
output, to the interface, an image representing the user, apparatus and treatment sensor avatars.
Clause 3. The system of any clause herein, wherein the processing device is further configured to:
generate, based on the treatment location, a treatment location avatar;
output, to the interface, an image representing the treatment location avatar.
Clause 4. The system of any clause herein, wherein the treatment location avatar is one of overlaid on and transposed with a portion of the user avatar.
Clause 5. The system of any clause herein, wherein the processing device is further configured to output, to the interface, the treatment location avatar in a frequency configured to cause the avatar to flash and wherein the frequency of flashing is one or more of:
variable;
static; and
based on the instruction data.
Clause 6. The system of any clause herein, wherein the instruction data represents instruction confirming that the location of the treatment sensor is one of adjacent to, at, and near the treatment location.
Clause 7. The system of any clause herein, wherein the processing device is further configured to output, to the interface, instructions confirming that the location of the treatment sensor is one of adjacent to, at, and near the treatment location.
Clause 8. The system of any clause herein, wherein the instructions are one or more of a color-coded indication, audible indication, and a textual message.
Clause 9. The system of any clause herein, wherein the instruction data represents instructions capable of altering the location of the treatment sensor to be one of adjacent to, at, and near the treatment location.
Clause 10. The system of any clause herein, wherein the processing device is further configured to output, to the interface, instructions to move the location of the treatment sensor to the treatment location.
Clause 11. The system of any clause herein, wherein the instructions are defined as one or more of arrows, a color-coded indicator, an audible indication and a textual message.
Clause 12. The system of any clause herein, wherein the processing device is further configured to receive, during a telemedicine-enabled appointment between the user and a healthcare professional, medical instruction data representative of instructions from the healthcare professional.
Clause 13. The system of any clause herein, wherein the processing device is further configured to output, to the interface and based on the medical instruction data, instructions from the healthcare professional.
Clause 14. The system of any clause herein, wherein the medical instruction data refers to a recommended treatment location.
Clause 15. The system of any clause herein, further comprising a medical interface remote from the user and associated with the healthcare professional, and wherein the processing device is further configured to output, to the medical interface, a user response to the medical instruction.
Clause 16. A method for positioning one or more sensors on a user, the method comprising:
generating an enhanced environment associated with an environment;
receiving, from apparatus sensors, apparatus data representative of a location of an apparatus in the environment;
generating, from the apparatus data, an apparatus avatar in the enhanced environment;
receiving, from user sensors, user data representative of a location of the user in the environment;
generating, from the user data, a user avatar in the enhanced environment;
receiving, from treatment sensors, treatment data representative of a location the treatment sensors in the environment;
generating, from the treatment data, treatment sensor avatars in the enhanced environment;
calculating, based on one or more of the environment data, the apparatus data, and the user data, a treatment location for each treatment sensor; and
generating, based on the treatment location and the treatment data, instruction data representative of the treatment sensors relative to the user.
Clause 17. The method of any clause herein, further comprising:
displaying, in an interface and based on the environment data, an image representative of the enhanced environment; and
displaying, with the interface, an image representative of the user, apparatus and treatment sensor avatars.
Clause 18. The method of any clause herein, further comprising:
generating, based on the treatment location, a treatment location avatar;
displaying, with the interface, an image representative of the treatment location avatar.
Clause 19. The method of any clause herein, wherein the treatment location avatar is further defined as being one of overlaid on and transposed with a portion of the user avatar.
Clause 20. The method of any clause herein, further comprising displaying, with the interface, the treatment location avatar in a flashing pattern wherein, the flashing pattern is based on the instruction data.
Clause 21. The method of any clause herein, wherein the instruction data represents instructions confirming that the location of the treatment sensor is one of adjacent to, at, and near the treatment location.
Clause 22. The method of any clause herein, further comprised of displaying, with the interface, instructions confirming that the location of the treatment sensor is one of adjacent to, at, and near the treatment location.
Clause 23. The method of any clause herein, wherein the instructions are one or more of a color-coded indication, audible indication, and a textual message.
Clause 24. The method of any clause herein, wherein the instruction data represents instructions to alter the location of the treatment sensor to be one of adjacent to, at, and near the treatment location.
Clause 25. The method of any clause herein, further comprising displaying, with the interface, instructions to move the location of the treatment sensor to the treatment location.
Clause 26. The method of any clause herein, wherein the instructions are defined as one or more of arrows, a color-coded indicator, an audible or tactile indication and a textual message.
Clause 27. The method of any clause herein, further comprising receiving, during a telemedicine-enabled appointment between the user and a healthcare professional, medical instruction data representative of instructions from the healthcare professional.
Clause 28. The method of any clause herein, wherein the processing device is further configured to output, to the interface and based on the medical instruction data, instruction from the healthcare professional.
Clause 29. The method of any clause herein, wherein the medical instruction data is representative of a recommended treatment location.
Clause 30. The method of any clause herein, further comprising displaying, with a medical interface remote from the user and associated with the healthcare professional, a user response to the medical instruction.
The above discussion is meant to be illustrative of the principles and various embodiments of the present disclosure. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.
The various aspects, embodiments, implementations, or features of the described embodiments can be used separately or in any combination. The embodiments disclosed herein are modular in nature and can be used in conjunction with or coupled to other embodiments.
Consistent with the above disclosure, the examples of assemblies enumerated in the following clauses are specifically contemplated and are intended as a non-limiting set of examples.
This application is a continuation of U.S. patent application Ser. No. 17/148,047, filed Jan. 13, 2021, titled “Augmented Reality Placement of Goniometer or Other Sensors,” which is a continuation-in-part of U.S. patent application Ser. No. 17/021,895, filed Sep. 15, 2020, titled “Telemedicine for Orthopedic Treatment,” which claims priority to and the benefit of U.S. Provisional Patent Application Ser. No. 62/910,232, filed Oct. 3, 2019, titled “Telemedicine for Orthopedic Treatment,” the entire disclosures of which are hereby incorporated by reference for all purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 59915 | Lallement | Nov 1866 | A |
| 363522 | Knous | May 1887 | A |
| 446671 | Elliot | Feb 1891 | A |
| 610157 | Campbell | Aug 1898 | A |
| 631276 | Bulova | Aug 1899 | A |
| 823712 | Uhlmann | Jun 1906 | A |
| 1149029 | Clark | Aug 1915 | A |
| 1227743 | Burgedorfp | May 1917 | A |
| 1784230 | Freeman | Dec 1930 | A |
| 3081645 | Bergfors | Mar 1963 | A |
| 3100640 | Weitzel | Aug 1963 | A |
| 3137014 | Meucci | Jun 1964 | A |
| 3143316 | Shapiro | Aug 1964 | A |
| 3713438 | Knutsen | Jan 1973 | A |
| 3744480 | Gause et al. | Jul 1973 | A |
| 3888136 | Lapeyre | Jun 1975 | A |
| 4079957 | Blease | Mar 1978 | A |
| 4408613 | Relyea | Oct 1983 | A |
| 4436097 | Cunningham | Mar 1984 | A |
| 4446753 | Nagano | May 1984 | A |
| 4477072 | DeCloux | Oct 1984 | A |
| 4499900 | Petrofsky et al. | Feb 1985 | A |
| 4509742 | Cones | Apr 1985 | A |
| 4606241 | Fredriksson | Aug 1986 | A |
| 4611807 | Castillo | Sep 1986 | A |
| 4616823 | Yang | Oct 1986 | A |
| 4648287 | Preskitt | Mar 1987 | A |
| 4673178 | Dwight | Jun 1987 | A |
| 4822032 | Whitmore et al. | Apr 1989 | A |
| 4824104 | Bloch | Apr 1989 | A |
| 4850245 | Feamster et al. | Jul 1989 | A |
| 4858942 | Rodriguez | Aug 1989 | A |
| 4869497 | Stewart et al. | Sep 1989 | A |
| 4915374 | Watkins | Apr 1990 | A |
| 4930768 | Lapcevic | Jun 1990 | A |
| 4961570 | Chang | Oct 1990 | A |
| 5161430 | Febey | Nov 1992 | A |
| 5202794 | Schnee et al. | Apr 1993 | A |
| 5240417 | Smithson et al. | Aug 1993 | A |
| 5247853 | Dalebout | Sep 1993 | A |
| 5256117 | Potts et al. | Oct 1993 | A |
| D342299 | Birrell et al. | Dec 1993 | S |
| 5282748 | Little | Feb 1994 | A |
| 5284131 | Gray | Feb 1994 | A |
| 5316532 | Butler | May 1994 | A |
| 5324241 | Artigues et al. | Jun 1994 | A |
| 5336147 | Sweeney, III | Aug 1994 | A |
| 5338272 | Sweeney, III | Aug 1994 | A |
| 5361649 | Slocum, Jr. | Nov 1994 | A |
| 5429140 | Burdea et al. | Jul 1995 | A |
| 5458022 | Mattfeld et al. | Oct 1995 | A |
| 5487713 | Butler | Jan 1996 | A |
| 5566589 | Buck | Oct 1996 | A |
| 5580338 | Scelta et al. | Dec 1996 | A |
| 5676349 | Wilson | Oct 1997 | A |
| 5685804 | Whan-Tong et al. | Nov 1997 | A |
| 5860941 | Saringer et al. | Jan 1999 | A |
| 5950813 | Hoskins et al. | Sep 1999 | A |
| 6053847 | Stearns et al. | Apr 2000 | A |
| 6077201 | Cheng | Jun 2000 | A |
| 6102834 | Chen | Aug 2000 | A |
| 6155958 | Goldberg | Dec 2000 | A |
| 6182029 | Friedman | Jan 2001 | B1 |
| D438580 | Shaw | Mar 2001 | S |
| 6253638 | Bermudez | Jul 2001 | B1 |
| 6267735 | Blanchard et al. | Jul 2001 | B1 |
| 6273863 | Avni et al. | Aug 2001 | B1 |
| D450100 | Hsu | Nov 2001 | S |
| D450101 | Hsu | Nov 2001 | S |
| D451972 | Easley | Dec 2001 | S |
| D452285 | Easley | Dec 2001 | S |
| D454605 | Lee | Mar 2002 | S |
| 6371891 | Speas | Apr 2002 | B1 |
| D459776 | Lee | Jul 2002 | S |
| 6413190 | Wood et al. | Jul 2002 | B1 |
| 6430436 | Richter | Aug 2002 | B1 |
| 6436058 | Krahner et al. | Aug 2002 | B1 |
| 6474193 | Farney | Nov 2002 | B1 |
| 6491649 | Ombrellaro | Dec 2002 | B1 |
| 6535861 | OConnor et al. | Mar 2003 | B1 |
| 6543309 | Heim | Apr 2003 | B2 |
| 6589139 | Butterworth | Jul 2003 | B1 |
| 6602191 | Quy | Aug 2003 | B2 |
| 6626805 | Lightbody | Sep 2003 | B1 |
| 6640662 | Baxter | Nov 2003 | B1 |
| 6820517 | Farney | Nov 2004 | B1 |
| 6865969 | Stevens | Mar 2005 | B2 |
| 6890312 | Priester et al. | May 2005 | B1 |
| 6895834 | Baatz | May 2005 | B1 |
| 7156665 | OConnor et al. | Jan 2007 | B1 |
| 7169085 | Killin et al. | Jan 2007 | B1 |
| 7204788 | Andrews | Apr 2007 | B2 |
| 7209886 | Kimmel | Apr 2007 | B2 |
| 7226394 | Johnson | Jun 2007 | B2 |
| 7507188 | Nurre | Mar 2009 | B2 |
| 7594879 | Johnson | Sep 2009 | B2 |
| 7778851 | Schoenberg et al. | Aug 2010 | B2 |
| 7809601 | Shaya et al. | Oct 2010 | B2 |
| 7833135 | Radow et al. | Nov 2010 | B2 |
| 7974689 | Volpe et al. | Jul 2011 | B2 |
| 8079937 | Bedell et al. | Dec 2011 | B2 |
| 8287434 | Zavadsky et al. | Oct 2012 | B2 |
| 8506458 | Dugan | Aug 2013 | B2 |
| 8540515 | Williams et al. | Sep 2013 | B2 |
| 8540516 | Williams et al. | Sep 2013 | B2 |
| 8556778 | Dugan | Oct 2013 | B1 |
| 8672812 | Dugan | Mar 2014 | B2 |
| 8751264 | Beraja et al. | Jun 2014 | B2 |
| 8784273 | Dugan | Jul 2014 | B2 |
| 8823448 | Shen | Sep 2014 | B1 |
| 8979711 | Dugan | Mar 2015 | B2 |
| 9167281 | Petrov et al. | Oct 2015 | B2 |
| D744050 | Colburn | Nov 2015 | S |
| 9248071 | Benda et al. | Feb 2016 | B1 |
| 9272185 | Dugan | Mar 2016 | B2 |
| 9283434 | Wu | Mar 2016 | B1 |
| 9311789 | Gwin | Apr 2016 | B1 |
| 9409054 | Dugan | Aug 2016 | B2 |
| 9443205 | Wall | Sep 2016 | B2 |
| 9480873 | Chuang | Nov 2016 | B2 |
| 9481428 | Gros et al. | Nov 2016 | B2 |
| 9566472 | Dugan | Feb 2017 | B2 |
| 9579056 | Rosenbek et al. | Feb 2017 | B2 |
| 9629558 | Yuen et al. | Apr 2017 | B2 |
| D794142 | Zhou | Aug 2017 | S |
| 9717947 | Lin | Aug 2017 | B2 |
| 9737761 | Govindarajan | Aug 2017 | B1 |
| 9872087 | DelloStritto et al. | Jan 2018 | B2 |
| 9872637 | Kording et al. | Jan 2018 | B2 |
| 9914053 | Dugan | Mar 2018 | B2 |
| 9919198 | Romeo et al. | Mar 2018 | B2 |
| 9937382 | Dugan | Apr 2018 | B2 |
| 9939784 | Berardinelli | Apr 2018 | B1 |
| 10074148 | Cashman et al. | Sep 2018 | B2 |
| 10130298 | Mokaya et al. | Nov 2018 | B2 |
| 10155134 | Dugan | Dec 2018 | B2 |
| 10159872 | Sasaki et al. | Dec 2018 | B2 |
| 10173094 | Gomberg et al. | Jan 2019 | B2 |
| 10173095 | Gomberg et al. | Jan 2019 | B2 |
| 10173096 | Gomberg et al. | Jan 2019 | B2 |
| 10173097 | Gomberg et al. | Jan 2019 | B2 |
| 10226663 | Gomberg et al. | Mar 2019 | B2 |
| 10325070 | Beale et al. | Jun 2019 | B2 |
| 10327697 | Stein et al. | Jun 2019 | B1 |
| 10424033 | Romeo | Sep 2019 | B2 |
| 10430552 | Mihai | Oct 2019 | B2 |
| 10542914 | Forth et al. | Jan 2020 | B2 |
| 10546467 | Luciano, Jr. et al. | Jan 2020 | B1 |
| 10569122 | Johnson | Feb 2020 | B2 |
| 10572626 | Balram | Feb 2020 | B2 |
| 10576331 | Kuo | Mar 2020 | B2 |
| 10625114 | Ercanbrack | Apr 2020 | B2 |
| 10646746 | Gomberg et al. | May 2020 | B1 |
| 10660534 | Lee et al. | May 2020 | B2 |
| 10678890 | Bitran et al. | Jun 2020 | B2 |
| 10685092 | Paparella et al. | Jun 2020 | B2 |
| 10777200 | Will et al. | Sep 2020 | B2 |
| 10792495 | Izvorski et al. | Oct 2020 | B2 |
| 10874905 | Belson et al. | Dec 2020 | B2 |
| D907143 | Ach et al. | Jan 2021 | S |
| 10931643 | Neumann | Feb 2021 | B1 |
| 11000735 | Orady et al. | May 2021 | B2 |
| 11045709 | Putnam | Jun 2021 | B2 |
| 11065527 | Putnam | Jul 2021 | B2 |
| 11069436 | Mason et al. | Jul 2021 | B2 |
| 11071597 | Posnack et al. | Jul 2021 | B2 |
| 11075000 | Mason et al. | Jul 2021 | B2 |
| D928635 | Hacking et al. | Aug 2021 | S |
| 11087865 | Mason et al. | Aug 2021 | B2 |
| 11101028 | Mason et al. | Aug 2021 | B2 |
| 11107591 | Mason | Aug 2021 | B1 |
| 11139060 | Mason et al. | Oct 2021 | B2 |
| 11185735 | Arn et al. | Nov 2021 | B2 |
| D939644 | Ach et al. | Dec 2021 | S |
| D940797 | Ach et al. | Jan 2022 | S |
| 11229727 | Tatonetti | Jan 2022 | B2 |
| 11270795 | Mason et al. | Mar 2022 | B2 |
| 11282599 | Mason et al. | Mar 2022 | B2 |
| 11282604 | Mason et al. | Mar 2022 | B2 |
| 11282608 | Mason et al. | Mar 2022 | B2 |
| 11284797 | Mason et al. | Mar 2022 | B2 |
| D948639 | Ach et al. | Apr 2022 | S |
| 11295848 | Mason et al. | Apr 2022 | B2 |
| 11309085 | Mason et al. | Apr 2022 | B2 |
| 11317975 | Mason et al. | May 2022 | B2 |
| 11325005 | Mason et al. | May 2022 | B2 |
| 11328807 | Mason et al. | May 2022 | B2 |
| 11337648 | Mason | May 2022 | B2 |
| 11348683 | Guaneri et al. | May 2022 | B2 |
| 20020072452 | Torkelson | Jun 2002 | A1 |
| 20020160883 | Dugan | Oct 2002 | A1 |
| 20030036683 | Kehr et al. | Feb 2003 | A1 |
| 20030064863 | Chen | Apr 2003 | A1 |
| 20030092536 | Romanelli et al. | May 2003 | A1 |
| 20030109814 | Rummerfield | Jun 2003 | A1 |
| 20040102931 | Ellis et al. | May 2004 | A1 |
| 20040106502 | Sher | Jun 2004 | A1 |
| 20040147969 | Mann et al. | Jul 2004 | A1 |
| 20040172093 | Rummerfield | Sep 2004 | A1 |
| 20040194572 | Kim | Oct 2004 | A1 |
| 20050020411 | Andrews | Jan 2005 | A1 |
| 20050043153 | Krietzman | Feb 2005 | A1 |
| 20050049122 | Vallone et al. | Mar 2005 | A1 |
| 20050085346 | Johnson | Apr 2005 | A1 |
| 20050085353 | Johnson | Apr 2005 | A1 |
| 20050274220 | Reboullet | Dec 2005 | A1 |
| 20060003871 | Houghton | Jan 2006 | A1 |
| 20060064329 | Abolfathi et al. | Mar 2006 | A1 |
| 20060247095 | Rummerfield | Nov 2006 | A1 |
| 20070042868 | Fisher et al. | Feb 2007 | A1 |
| 20070137307 | Gruben et al. | Jun 2007 | A1 |
| 20070173392 | Stanford | Jul 2007 | A1 |
| 20070287597 | Cameron | Dec 2007 | A1 |
| 20080021834 | Holla et al. | Jan 2008 | A1 |
| 20080153592 | James-Herbert | Jun 2008 | A1 |
| 20080161166 | Lo | Jul 2008 | A1 |
| 20080300914 | Karkanias et al. | Dec 2008 | A1 |
| 20090011907 | Radow et al. | Jan 2009 | A1 |
| 20090058635 | LaLonde et al. | Mar 2009 | A1 |
| 20090070138 | Langheier et al. | Mar 2009 | A1 |
| 20090211395 | Mul'e | Aug 2009 | A1 |
| 20090270227 | Ashby et al. | Oct 2009 | A1 |
| 20100048358 | Tchao et al. | Feb 2010 | A1 |
| 20100173747 | Chen et al. | Jul 2010 | A1 |
| 20100248899 | Bedell et al. | Sep 2010 | A1 |
| 20100248905 | Lu | Sep 2010 | A1 |
| 20100268304 | Matos | Oct 2010 | A1 |
| 20110047108 | Chakrabarty et al. | Feb 2011 | A1 |
| 20110172059 | Watterson et al. | Jul 2011 | A1 |
| 20110218814 | Coats | Sep 2011 | A1 |
| 20110275483 | Dugan | Nov 2011 | A1 |
| 20120065987 | Farooq et al. | Mar 2012 | A1 |
| 20120167709 | Chen et al. | Jul 2012 | A1 |
| 20120183939 | Aragones | Jul 2012 | A1 |
| 20120190502 | Paulus et al. | Jul 2012 | A1 |
| 20120295240 | Walker et al. | Nov 2012 | A1 |
| 20120310667 | Altman et al. | Dec 2012 | A1 |
| 20130123071 | Rhea | May 2013 | A1 |
| 20130123667 | Komatireddy et al. | May 2013 | A1 |
| 20130137550 | Skinner et al. | May 2013 | A1 |
| 20130178334 | Brammer | Jul 2013 | A1 |
| 20130296987 | Rogers et al. | Nov 2013 | A1 |
| 20130318027 | Almogy et al. | Nov 2013 | A1 |
| 20140006042 | Keefe et al. | Jan 2014 | A1 |
| 20140011640 | Dugan | Jan 2014 | A1 |
| 20140155129 | Dugan | Jun 2014 | A1 |
| 20140172460 | Kohli | Jun 2014 | A1 |
| 20140188009 | Lange et al. | Jul 2014 | A1 |
| 20140194250 | Reich et al. | Jul 2014 | A1 |
| 20140194251 | Reich et al. | Jul 2014 | A1 |
| 20140207264 | Quy | Jul 2014 | A1 |
| 20140246499 | Proud et al. | Sep 2014 | A1 |
| 20140256511 | Smith | Sep 2014 | A1 |
| 20140257837 | Walker et al. | Sep 2014 | A1 |
| 20140274622 | Leonhard | Sep 2014 | A1 |
| 20140309083 | Dugan | Oct 2014 | A1 |
| 20140315689 | Vauquelin et al. | Oct 2014 | A1 |
| 20140322686 | Kang | Oct 2014 | A1 |
| 20150088544 | Goldberg | Mar 2015 | A1 |
| 20150151162 | Dugan | Jun 2015 | A1 |
| 20150158549 | Gros et al. | Jun 2015 | A1 |
| 20150161331 | Oleynik | Jun 2015 | A1 |
| 20150290061 | Stafford et al. | Oct 2015 | A1 |
| 20150339442 | Oleynik | Nov 2015 | A1 |
| 20150341812 | Dion et al. | Nov 2015 | A1 |
| 20150379232 | Mainwaring et al. | Dec 2015 | A1 |
| 20160007885 | Basta et al. | Jan 2016 | A1 |
| 20160023081 | Popa-Simil | Jan 2016 | A1 |
| 20160117471 | Belt et al. | Apr 2016 | A1 |
| 20160140319 | Stark et al. | May 2016 | A1 |
| 20160151670 | Dugan | Jun 2016 | A1 |
| 20160166881 | Ridgel et al. | Jun 2016 | A1 |
| 20160275259 | Nolan et al. | Sep 2016 | A1 |
| 20160302721 | Wiedenhoefer et al. | Oct 2016 | A1 |
| 20160317869 | Dugan | Nov 2016 | A1 |
| 20160322078 | Bose et al. | Nov 2016 | A1 |
| 20160325140 | Wu | Nov 2016 | A1 |
| 20160332028 | Melnik | Nov 2016 | A1 |
| 20170004260 | Moturu et al. | Jan 2017 | A1 |
| 20170033375 | Ohmori et al. | Feb 2017 | A1 |
| 20170046488 | Pereira | Feb 2017 | A1 |
| 20170065851 | Deluca et al. | Mar 2017 | A1 |
| 20170080320 | Smith | Mar 2017 | A1 |
| 20170095670 | Ghaffari et al. | Apr 2017 | A1 |
| 20170095692 | Chang et al. | Apr 2017 | A1 |
| 20170095693 | Chang et al. | Apr 2017 | A1 |
| 20170106242 | Dugan | Apr 2017 | A1 |
| 20170113092 | Johnson | Apr 2017 | A1 |
| 20170128769 | Long et al. | May 2017 | A1 |
| 20170132947 | Maeda et al. | May 2017 | A1 |
| 20170136296 | Barrera et al. | May 2017 | A1 |
| 20170143261 | Wiedenhoefer et al. | May 2017 | A1 |
| 20170147789 | Wiedenhoefer et al. | May 2017 | A1 |
| 20170168555 | Munoz et al. | Jun 2017 | A1 |
| 20170181698 | Wiedenhoefer et al. | Jun 2017 | A1 |
| 20170190052 | Jaekel et al. | Jul 2017 | A1 |
| 20170209766 | Riley et al. | Jul 2017 | A1 |
| 20170243028 | LaFever et al. | Aug 2017 | A1 |
| 20170266501 | Sanders et al. | Sep 2017 | A1 |
| 20170278209 | Olsen et al. | Sep 2017 | A1 |
| 20170282015 | Wicks et al. | Oct 2017 | A1 |
| 20170300654 | Stein et al. | Oct 2017 | A1 |
| 20170312614 | Tran et al. | Nov 2017 | A1 |
| 20170329917 | McRaith et al. | Nov 2017 | A1 |
| 20170333755 | Rider | Nov 2017 | A1 |
| 20170337033 | Duyan et al. | Nov 2017 | A1 |
| 20170337334 | Stanczak | Nov 2017 | A1 |
| 20170344726 | Duffy et al. | Nov 2017 | A1 |
| 20170360586 | Dempers et al. | Dec 2017 | A1 |
| 20170368413 | Shavit | Dec 2017 | A1 |
| 20180017806 | Wang et al. | Jan 2018 | A1 |
| 20180052962 | Van Der Koijk et al. | Feb 2018 | A1 |
| 20180056104 | Cromie et al. | Mar 2018 | A1 |
| 20180071565 | Gomberg et al. | Mar 2018 | A1 |
| 20180071566 | Gomberg et al. | Mar 2018 | A1 |
| 20180071569 | Gomberg et al. | Mar 2018 | A1 |
| 20180071570 | Gomberg et al. | Mar 2018 | A1 |
| 20180071571 | Gomberg et al. | Mar 2018 | A1 |
| 20180071572 | Gomberg et al. | Mar 2018 | A1 |
| 20180075205 | Moturu et al. | Mar 2018 | A1 |
| 20180078843 | Tran et al. | Mar 2018 | A1 |
| 20180085615 | Astolfi et al. | Mar 2018 | A1 |
| 20180102190 | Hogue et al. | Apr 2018 | A1 |
| 20180178061 | O'larte et al. | Jun 2018 | A1 |
| 20180199855 | Odame et al. | Jul 2018 | A1 |
| 20180200577 | Dugan | Jul 2018 | A1 |
| 20180220935 | Tadano et al. | Aug 2018 | A1 |
| 20180228682 | Bayerlein et al. | Aug 2018 | A1 |
| 20180240552 | Tuyl et al. | Aug 2018 | A1 |
| 20180253991 | Tang et al. | Sep 2018 | A1 |
| 20180263530 | Jung | Sep 2018 | A1 |
| 20180271432 | Auchinleck et al. | Sep 2018 | A1 |
| 20180280784 | Romeo et al. | Oct 2018 | A1 |
| 20180296157 | Bleich et al. | Oct 2018 | A1 |
| 20180330058 | Bates | Nov 2018 | A1 |
| 20180330824 | Athey et al. | Nov 2018 | A1 |
| 20180360340 | Rehse et al. | Dec 2018 | A1 |
| 20180373844 | Ferrandez-Escamez et al. | Dec 2018 | A1 |
| 20190019578 | Vaccaro | Jan 2019 | A1 |
| 20190030415 | Volpe, Jr. | Jan 2019 | A1 |
| 20190031284 | Fuchs | Jan 2019 | A1 |
| 20190060708 | Fung | Feb 2019 | A1 |
| 20190065970 | Bonutti et al. | Feb 2019 | A1 |
| 20190066832 | Kang et al. | Feb 2019 | A1 |
| 20190076701 | Dugan | Mar 2019 | A1 |
| 20190088356 | Oliver et al. | Mar 2019 | A1 |
| 20190111299 | Radcliffe et al. | Apr 2019 | A1 |
| 20190115097 | Macoviak et al. | Apr 2019 | A1 |
| 20190117128 | Chen et al. | Apr 2019 | A1 |
| 20190126099 | Hoang | May 2019 | A1 |
| 20190132948 | Longinotti-Buitoni et al. | May 2019 | A1 |
| 20190134454 | Mahoney et al. | May 2019 | A1 |
| 20190137988 | Celia et al. | May 2019 | A1 |
| 20190167988 | Shahriari et al. | Jun 2019 | A1 |
| 20190172587 | Park et al. | Jun 2019 | A1 |
| 20190175988 | Volterrani et al. | Jun 2019 | A1 |
| 20190200920 | Tien et al. | Jul 2019 | A1 |
| 20190209891 | Fung | Jul 2019 | A1 |
| 20190240541 | Denton et al. | Aug 2019 | A1 |
| 20190244540 | Errante et al. | Aug 2019 | A1 |
| 20190269343 | Ramos Murguialday et al. | Sep 2019 | A1 |
| 20190274523 | Bates | Sep 2019 | A1 |
| 20190290964 | Oren | Sep 2019 | A1 |
| 20190304584 | Savolainen | Oct 2019 | A1 |
| 20190307983 | Goldman | Oct 2019 | A1 |
| 20190354632 | Mital et al. | Nov 2019 | A1 |
| 20190366146 | Tong et al. | Dec 2019 | A1 |
| 20190388728 | Wang et al. | Dec 2019 | A1 |
| 20200005928 | Daniel | Jan 2020 | A1 |
| 20200051446 | Rubinstein et al. | Feb 2020 | A1 |
| 20200066390 | Svendrys et al. | Feb 2020 | A1 |
| 20200093418 | Kluger et al. | Mar 2020 | A1 |
| 20200143922 | Chekroud et al. | May 2020 | A1 |
| 20200151595 | Jayalath et al. | May 2020 | A1 |
| 20200151646 | De La Fuente Sanchez | May 2020 | A1 |
| 20200152339 | Pulitzer et al. | May 2020 | A1 |
| 20200160198 | Reeves et al. | May 2020 | A1 |
| 20200170876 | Kapure et al. | Jun 2020 | A1 |
| 20200176098 | Lucas et al. | Jun 2020 | A1 |
| 20200197744 | Schweighofer | Jun 2020 | A1 |
| 20200221975 | Basta et al. | Jul 2020 | A1 |
| 20200267487 | Siva | Aug 2020 | A1 |
| 20200275886 | Mason | Sep 2020 | A1 |
| 20200289045 | Hacking et al. | Sep 2020 | A1 |
| 20200289046 | Hacking et al. | Sep 2020 | A1 |
| 20200289879 | Hacking et al. | Sep 2020 | A1 |
| 20200289880 | Hacking et al. | Sep 2020 | A1 |
| 20200289881 | Hacking et al. | Sep 2020 | A1 |
| 20200289889 | Hacking et al. | Sep 2020 | A1 |
| 20200293712 | Potts et al. | Sep 2020 | A1 |
| 20200334972 | Gopalakrishnan | Oct 2020 | A1 |
| 20200357299 | Patel et al. | Nov 2020 | A1 |
| 20200395112 | Ronner | Dec 2020 | A1 |
| 20200401224 | Cotton | Dec 2020 | A1 |
| 20210074178 | Ilan et al. | Mar 2021 | A1 |
| 20210076981 | Hacking et al. | Mar 2021 | A1 |
| 20210077860 | Posnack et al. | Mar 2021 | A1 |
| 20210098129 | Neumann | Apr 2021 | A1 |
| 20210101051 | Posnack et al. | Apr 2021 | A1 |
| 20210113890 | Posnack et al. | Apr 2021 | A1 |
| 20210127974 | Mason et al. | May 2021 | A1 |
| 20210128080 | Mason et al. | May 2021 | A1 |
| 20210128255 | Mason et al. | May 2021 | A1 |
| 20210128978 | Gilstrom et al. | May 2021 | A1 |
| 20210134412 | Guaneri et al. | May 2021 | A1 |
| 20210134425 | Mason et al. | May 2021 | A1 |
| 20210134428 | Mason et al. | May 2021 | A1 |
| 20210134430 | Mason et al. | May 2021 | A1 |
| 20210134432 | Mason et al. | May 2021 | A1 |
| 20210134456 | Posnack et al. | May 2021 | A1 |
| 20210134457 | Mason et al. | May 2021 | A1 |
| 20210134458 | Mason et al. | May 2021 | A1 |
| 20210134463 | Mason et al. | May 2021 | A1 |
| 20210138304 | Mason et al. | May 2021 | A1 |
| 20210142875 | Mason et al. | May 2021 | A1 |
| 20210142893 | Guaneri et al. | May 2021 | A1 |
| 20210142898 | Mason et al. | May 2021 | A1 |
| 20210142903 | Mason et al. | May 2021 | A1 |
| 20210144074 | Guaneri et al. | May 2021 | A1 |
| 20210186419 | Van Ee et al. | Jun 2021 | A1 |
| 20210202090 | ODonovan et al. | Jul 2021 | A1 |
| 20210202103 | Bostic et al. | Jul 2021 | A1 |
| 20210244998 | Hacking et al. | Aug 2021 | A1 |
| 20210345879 | Mason et al. | Nov 2021 | A1 |
| 20210350888 | Guaneri et al. | Nov 2021 | A1 |
| 20210350898 | Mason et al. | Nov 2021 | A1 |
| 20210350899 | Mason et al. | Nov 2021 | A1 |
| 20210350901 | Mason et al. | Nov 2021 | A1 |
| 20210350902 | Mason et al. | Nov 2021 | A1 |
| 20210350914 | Guaneri et al. | Nov 2021 | A1 |
| 20210350926 | Mason et al. | Nov 2021 | A1 |
| 20210366587 | Mason et al. | Nov 2021 | A1 |
| 20210383909 | Mason et al. | Dec 2021 | A1 |
| 20210391091 | Mason | Dec 2021 | A1 |
| 20210407670 | Mason et al. | Dec 2021 | A1 |
| 20210407681 | Mason et al. | Dec 2021 | A1 |
| 20220015838 | Posnack et al. | Jan 2022 | A1 |
| 20220047921 | Bissonnette et al. | Feb 2022 | A1 |
| 20220079690 | Mason et al. | Mar 2022 | A1 |
| 20220080256 | Arn et al. | Mar 2022 | A1 |
| 20220105384 | Hacking et al. | Apr 2022 | A1 |
| 20220105385 | Hacking et al. | Apr 2022 | A1 |
| 20220115133 | Mason et al. | Apr 2022 | A1 |
| 20220126169 | Mason | Apr 2022 | A1 |
| 20220148725 | Mason et al. | May 2022 | A1 |
| 20220158916 | Mason et al. | May 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 2698078 | Mar 2010 | CA |
| 112603295 | Feb 2003 | CN |
| 202220794 | May 2012 | CN |
| 103488880 | Jan 2014 | CN |
| 104335211 | Feb 2015 | CN |
| 105620643 | Jun 2016 | CN |
| 105894088 | Aug 2016 | CN |
| 105930668 | Sep 2016 | CN |
| 106127646 | Nov 2016 | CN |
| 106510985 | Mar 2017 | CN |
| 107430641 | Dec 2017 | CN |
| 107736982 | Feb 2018 | CN |
| 207220817 | Apr 2018 | CN |
| 108078737 | May 2018 | CN |
| 208573971 | Mar 2019 | CN |
| 112603295 | Apr 2021 | CN |
| 95019 | Jan 1897 | DE |
| 7628633 | Dec 1977 | DE |
| 8519150 | Oct 1985 | DE |
| 3732905 | Jul 1988 | DE |
| 19619820 | Dec 1996 | DE |
| 29620008 | Feb 1997 | DE |
| 19947926 | Apr 2001 | DE |
| 102018202497 | Aug 2018 | DE |
| 102018211212 | Jan 2019 | DE |
| 102019108425 | Aug 2020 | DE |
| 199600 | Oct 1986 | EP |
| 634319 | Oct 1999 | EP |
| 1034817 | Sep 2000 | EP |
| 2564904 | Mar 2013 | EP |
| 3264303 | Jan 2018 | EP |
| 3323473 | May 2018 | EP |
| 3688537 | Aug 2020 | EP |
| 3731733 | Nov 2020 | EP |
| 2527541 | Dec 1983 | FR |
| 141664 | Nov 1920 | GB |
| 2336140 | Oct 1999 | GB |
| 2372459 | Aug 2002 | GB |
| 2003225875 | Aug 2003 | JP |
| 3198173 | Jun 2015 | JP |
| 6659831 | Oct 2017 | JP |
| 2019134909 | Aug 2019 | JP |
| 6573739 | Sep 2019 | JP |
| 6710357 | Jun 2020 | JP |
| 6775757 | Oct 2020 | JP |
| 2021026768 | Feb 2021 | JP |
| 2021027917 | Feb 2021 | JP |
| 20020009724 | Feb 2002 | KR |
| 20020065253 | Aug 2002 | KR |
| 20110099953 | Sep 2011 | KR |
| 20160093990 | Aug 2016 | KR |
| 20170038837 | Apr 2017 | KR |
| 20190011885 | Feb 2019 | KR |
| 20190056116 | May 2019 | KR |
| 101988167 | Jun 2019 | KR |
| 102116664 | Jul 2019 | KR |
| 102116968 | Mar 2020 | KR |
| 20200025290 | Mar 2020 | KR |
| 102162522 | Apr 2020 | KR |
| 102142713 | May 2020 | KR |
| 20200056233 | May 2020 | KR |
| 102120828 | Jun 2020 | KR |
| 102173553 | Nov 2020 | KR |
| 102180079 | Nov 2020 | KR |
| 102224618 | Nov 2020 | KR |
| 102188766 | Dec 2020 | KR |
| 102196793 | Dec 2020 | KR |
| 20210006212 | Jan 2021 | KR |
| 102224188 | Mar 2021 | KR |
| 102264498 | Jun 2021 | KR |
| 442956 | Jul 2014 | TW |
| 1998009687 | Mar 1998 | WO |
| 2001050387 | Jul 2001 | WO |
| 2003043494 | May 2003 | WO |
| 2005018453 | Mar 2005 | WO |
| 2006004430 | Jan 2006 | WO |
| 2006012694 | Feb 2006 | WO |
| 2008114291 | Sep 2008 | WO |
| 2014178077 | Nov 2014 | WO |
| 2016154318 | Sep 2016 | WO |
| 2018171853 | Sep 2018 | WO |
| 2019204876 | Apr 2019 | WO |
| 2019083450 | May 2019 | WO |
| 2020185769 | Mar 2020 | WO |
| 2020075190 | Apr 2020 | WO |
| 2020130979 | Jun 2020 | WO |
| 2020149815 | Jul 2020 | WO |
| 2020245727 | Dec 2020 | WO |
| 2020249855 | Dec 2020 | WO |
| 2020252599 | Dec 2020 | WO |
| 2020256577 | Dec 2020 | WO |
| 2021021447 | Feb 2021 | WO |
| 2021038980 | Mar 2021 | WO |
| 2021055427 | Mar 2021 | WO |
| 2021055491 | Mar 2021 | WO |
| 2021061061 | Apr 2021 | WO |
| 2021081094 | Apr 2021 | WO |
| 2021138620 | Jul 2021 | WO |
| 2021216881 | Oct 2021 | WO |
| 2021236542 | Nov 2021 | WO |
| 2021236961 | Nov 2021 | WO |
| 2021262809 | Dec 2021 | WO |
| Entry |
|---|
| International Searching Authority, Search Report and Written Opinion for International Application No. PCT/US2021/038617, dated Oct. 15, 2021, 12 pages. |
| International Search Report and Written Opinion for International Application No. PCT/US2021/032807, dated Sep. 6, 2021, 11 pages. |
| International Searching Authority, Search Report and Written Opinion for International Application No. PCT/US20/51008, dated Dec. 10, 2020; 8 pages. |
| Claris Healthcare Inc.; Claris Reflex Patient Rehabilitation System Brochure, https://clarisreflex.com/, retrieved from internet on Oct. 2, 2019; 5 pages. |
| International Searching Authority, Search Report and Written Opinion for PCT/US2020/021876, dated May 28, 2020; 7 pages. |
| FYSIOMED, “16983—Vario adjustable pedal arms”, <https://www.fysiomed.com/en/products/16983-vario-adjustable-pedal-arms>, pulled from webpage on Aug. 4, 2020; 1 page. |
| Matrix, “R3xm Recumbent Cycle”, <https://www.matrixfitness.com/en/cardio/cycles/r3xm-recumbent>, pulled from webpage on Aug. 4, 2020; 1 page. |
| Stephen R. Crow, Authorized Officer, PCT Notification of Transmittal of International Preliminary Report on Patentability, dated Dec. 11, 2018, PCT/US2017/50895, Alexandria, Virginia USA; 52 pages. |
| PCT International Search Report and Written Opinion, PCT/US17/50895 dated Jan. 12, 2018; 18 pages. |
| “ROMTech the Modern Techology of Rehabilitation” [retrieved Aug. 19, 2021]. Retrieved from the Internet: <https://https://www.romtech.com>. |
| HCI Fitness physio trainer, announced 2017 [online], [site visited Nov. 10, 2020]. Available from internet, URL: https://www.amazon.com/HCI-Fitness-Physio Trainer-Electronically-Controlled/dp/B0759YMW78/ (Year: 2017). |
| “HCI Fitness physio trainer, announced 2009 [online], [site visited Nov. 10, 2020]. Available from internet, URL: https://www.amazon.com/HCI-Fitness-PhysioTrainer-Upper-Ergonometer/dp/B001 P5GUGM (Year: 2009)”. |
| International Searching Authority, Search Report and Written Opinion for PCT/US20/56661, dated Feb. 12, 2021; 11 pages. |
| Dor-Haim, “A Novel Digital Platform for a Monitored Home-based Cardiac Rehabilitation Program”. Journal of Visualized Experiments. Webpage <https://www.jove.com/video/59019>. Apr. 19, 2019; Entire Document.; 30 pages. |
| Kobsar, et al., 2018, “Wearable Sensor Data to Track Subject-Specific Movement Patterns Related to Clinical Outcomes Using a Machine Learning Approach”; 12 pages. |
| Jennifer Bresnick, “What is the Role of Natural Language Processing in Healthcare?”, pp. 1-7, published Aug. 18, 2016, retrieved on Feb. 1, 2022 from https://healthitanalytics.com/ featu res/what-is-the-role-of-natural-language-processing-in-healthcare. |
| Alex Bellec, “Part-of-Speech tagging tutorial with the Keras Deep Learning library,” pp. 1-16, published Mar. 27, 2018, retrieved on Feb. 1, 2022 from https://becominghuman.ai/part-of-speech-tagging-tutorial-with-the-keras-deep-learning-library-d7f93fa05537. |
| Kavita Ganesan, All you need to know about text preprocessing for NLP and Machine Learning, pp. 1-14, published Feb. 23, 2019, retrieved on Feb. 1, 2022 from https:// towardsdatascience.com/all-you-need-to-know-about-text-preprocessing-for-nlp-and-machine-learning-bcl c5765ff67. |
| Badreesh Shetty, “Natural Language Processing (NPL) for Machine Learning,” pp. 1-13, published Nov. 24, 2018, retrieved on Feb. 1, 2022 from https://towardsdatascience. com/natural-language-processing-nlp-for-machine-learning-d44498845d5b. |
| Davenport et al., “The Potential For Artificial Intelligence In Healthcare”, 2019, Future Healthcare Journal 2019, vol. 6, No. 2: Year: 2019, pp. 1-5. |
| Ahmed et al., “Artificial Intelligence With Multi-Functional Machine Learning Platform Development For Better Healthcare And Precision Medicine”, 2020, Database (Oxford), 2020:baaa010. doi: 10.1093/database/baaa010 (Year: 2020), pp. 1-35. |
| Ruiz Ivan et al., “Towards a physical rehabilitation system using a telemedicine approach”, Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, vol. 8, No. 6, Jul. 28, 2020, pp. 671-680, XP055914810. |
| De Canniere Helene et al., “Wearable Monitoring and Interpretable Machine Learning Can Objectively Track Progression in Patients during Cardiac Rehabilitation”, Sensors, vol. 20, No. 12, Jun. 26, 2020, XP055914617, pp. 1-15. |
| Boulanger Pierre et al., “A Low-cost Virtual Reality Bike for Remote Cardiac Rehabilitation”, Dec. 7, 2017, Advances in Biometrics: International Conference, ICB 2007, Seoul, Korea, pp. 155-166. |
| Yin Chieh et al., “A Virtual Reality-Cycling Training System for Lower Limb Balance Improvement”, BioMed Research International, vol. 2016, pp. 1-10. |
| Number | Date | Country | |
|---|---|---|---|
| 20210345975 A1 | Nov 2021 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62910232 | Oct 2019 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17148047 | Jan 2021 | US |
| Child | 17379681 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17021895 | Sep 2020 | US |
| Child | 17148047 | US |
