The present technology pertains to systems and methods for predictive environmental fall risk identification.
In some embodiments the present disclosure is directed to a system of one or more computers which can be configured to perform particular operations or actions by virtue of having software, firmware, hardware, or a combination thereof installed on the system that in operation causes or cause the system to perform actions and/or method steps as described herein.
In various embodiments the present technology is methods for predictive environmental fall risk identification for a user. In some embodiments the method comprises: (a) receiving dynamic observations of an environmental map using a sensor; (b) determining the environmental map; (c) collecting a set of risk factors for the environmental map using the sensor; (d) assessing the set of risk factors for the environmental map for the user; (e) creating a first training set comprising the collected set of risk factors; (f) training an artificial neural network in a first stage using the first training set; (g) creating a second training set for a second stage of training comprising the first training set and the dynamic observations of the environmental map; (h) training the artificial neural network in the second stage using the second training set; (i) predicting a fall risk of the user using the artificial neural network; and (j) sending an alert to the user based on the dynamic observations of the environmental map and the fall risk of the user.
In various exemplary embodiments the sensor includes but is not limited to a visual sensor. In some embodiments the sensor includes a Radio Frequency (RF) sensor, light detection and ranging sensor (“LiDAR”), an audio sensor, a temperature sensor, a light sensor, and the like.
Certain embodiments of the present technology are illustrated by the accompanying figures. It will be understood that the figures are not necessarily to scale. It will be understood that the technology is not necessarily limited to the particular embodiments illustrated herein.
The detailed embodiments of the present technology are disclosed here. It should be understood, that the disclosed embodiments are merely exemplary of the invention, which may be embodied in multiple forms. Those details disclosed herein are not to be interpreted in any form as limiting, but as the basis for the claims.
To prevent falls, home-health care systems combine services like emergency alerts, with an initial fall hazard assessment of the home by a hired person. Some potential hazards are not pre-defined and pre-existing. Therefore, visual inspection for comparison to common safety standards, as an identification technique, cannot quantitatively predict risks not specifically standardized. The integration of health data standardization into Machine Learning (ML) is necessary for an accurate method of detecting hazards, which improves risk identification as it detects hazards. Embodiments of the present technology have not been previously been pursued for various reasons including because data sets were not available to train ML models to recognize risks. Additionally, the infrastructure to deploy the present technology, as well as an infrastructure to gather the training data, was either absent or unavailable. ML and deep learning are newly utilized tools in camera technology that are applied to embodiments of the present technology.
Various embodiments of the present technology use ML in the context of camera technology and home-health as a solution to increase safety in the home environment. For example, the type of ML that uses Reinforced Learning (RL) to produce the Environmental Fall Risks (EFR™) associated, which is dependent upon the individual (i.e., a user) and (changes in) time and notifies at-risk individuals.
Some embodiments of the present technology are a solution that reduces the high cost of home-health-care monitoring while decreasing hazards and preventing falls, and maintaining a user's safety and independence. Embodiments of the present technology are environment assessment systems and methods that identify risks that human interpretation is unable to anticipate, notice risks quickly, and alert the user. Embodiments of the present technology include a simulated environment that incorporates near-real-time technology to predict and detect risks.
Some embodiments of the present technology use simulations and visual sensors to produce Reinforced Learning (RL) models that accurately predict potential and existing EFR™, as well as identify newly developed EFR™ in near-real time. Potential and existing factors include furniture placement, room-dependent risk, user's individual fall risk, and the progression of time. Each room in an environment has a calculated EFR™ from contributing factors. Exemplary contributing factors include floor changes (e.g. traveling from rug to carpet, tile to rug, etc.), uneven floors (i.e. uneven tiles), room-dependent baseline (bathrooms have high fall risk), and furniture placement. Additional exemplary contributing factors of environmental fall risks are not physical textures/obstructions and include causalities of non-physical attributes (i.e. temperature, light conditions, ambient audio levels, and the like) Changes in the environment lead to newly developed risks (e.g. as a puddle of water forming). Time progression calculates in near-real time changing EFR™ for room-dependent risk and individual fall risk factors combined.
According to various embodiments of the present technology, to assess furniture placement and room-dependent risks, predefined factors and initial risk values improve as the model performs additional sequences. For example, risk values for suggested furniture rearrangement may be defined as potential and existing risks, which are high (low) if an initial value is greater than or equal to sixty percent (less than thirty percent), becomes high (low) for greater than fifty percent (less than ten percent) after a sequence.
In various embodiments of the present technology, these models are produced with training data gathered and analyzed by systems of the present technology to include all factors listed changing in time and output new fall risks. For the change in time, the RL model of the user and the EFR™ is integrated with visual sensors. For example, a person with 75 percent individual fall risk is in a room with 0 percent, their total does not change. Now, the same person in a room with 21.3 percent risk, then the total risk is increased. There is also a dependent relationship on time. The longer the person is in a room, the higher the risk (i.e., total risk includes individual, room, and time). For example, this baseline may be established for an equation that depends on time (see equation 1 below):
Fall risk=f(t)=0.75t+0.213*t2 (Equation 1),
where 0.213 represents the room's baseline progressing in time and 0.75 t represents the person's individual risk in time. The factor 0.213—Bedroom fall risk is from fall analysis associated with rugs or carpets. See Rosen, et. al. in US National Library of Medicine (2013), refer to
In some embodiments of the present technology, for newly detected risks (puddle forming), the same visual sensors that detected the time someone remained in a room have also been placed to maximize square-feet covered. If the shower has 1 major risk, it has a score of fifty risk units. If the living room area with a view of the kitchen has several medium and minor risks with a score of two-hundred risk units, a sensor is placed there instead of in the bathroom.
Embodiments of the present technology use a trained model to automatically identify hazards and notify at-risk individuals of RL-identified falling hazards and EFR™. Using depth cameras and on-board neural network processing, this RL technique; identifies common and ambiguous Environmental Fall Risks (EFR) in real time, incorporates individual variables, and reduce health costs by preventing falls.
In various embodiments the agent is a self-driving car that creates an environmental map (e.g., a map of a home). For example, small computers connected to sensors with ML models deployed to them assess and identify fall risks. The agent (e.g., a self-driving car) produces a baseline of the environment and environment optimization recommendations (e.g., rearranging furniture, lighting adjustments, etc.), as well as the baseline of the RL that the sensors use to detect changes.
According to various exemplary embodiments the agent starts the initial sequence on the left by the front door, goes into the bedroom, and finishes the last sequence after going through the kitchen. As the agent composes the map and assesses corresponding risks, both become better defined with each sequence. For example, at the starting point by the front door, initial sequence xi+1=x0+1=x1 with f1(x) and g1(f(x)) for input of the state. At the next sequential point (i=1) the agent has interacted, detected what should be included in the next environmental state x2, mapped them, and identified associated risks. This equation is provided as an example and its accuracy improves using ML as additional data is collected. For example, in general, by increasing solidity as the agent establishes the model, for low-to-no risk by check marks (✓), and for medium-to-high risks by cross marks (X). The light and dark percentages represent unfinished and finished models of risk, respectively. Once the bedroom is reached, as depicted here, the EFR™ assessment from the front door through the living room is finished. At this point, the model has improved its evaluation of high-risks to have a baseline of 50% instead of 60% for those areas. The initial 60% is from different room factors, e.g. 21.3% for the bedroom, combined with user's individual fall risk. This decrease to 50% is from evaluating furniture placement and factoring that in. Risks from the sliding glass door through hallway to kitchen (where it ends) are still unfinished here because additional directions through pathways have yet to be considered (but will be when it ends). The equation is provided as an example and is non-limiting.
In various exemplary embodiments of the present technology the agent needs to figure out the map and identify if the agent is in a bedroom or bathroom, and so on, while simultaneously identifying and mapping risks (e.g. from furniture or rug placement). An individual user is notified of specific risks and furniture rearrangement(s) is suggested with associated changes in risks. For example, bedroom is high-risk from the room itself (21.3%) and dresser position (35%), combining (0.213+035=0.563) for total baseline risk of over fifty percent (56.3%). If the chair and couch are switched, this decreases to 21.3%. Also, one should be careful walking into the kitchen from the hall, the change of tile yields a high-risk for falls. Last, the agent includes user's individual fall risk and time progression. For example, say a user with a constant fall risk of seventy-five percent (75%) walks into the bedroom (21.3%), their risk, f(t), is now f(t) 0.75+0.213*t, the factor of time scales differently for different rooms. See Rosen, T., Mack, K. A., & Noonan, R. K. (2013), “Slipping and tripping: fall injuries in adults associated with rugs and carpets,” Journal of injury &violence research, 5(1), 61-69. doi:10.5249/jivr.v5i1.177. In various embodiments, all these factors are included in EFR™ assessment and integrated into the visual sensors to be able to detect newly developed risks in near-real-time.
Results for different furniture arrangements will output options in terms of priority based off the corresponding change in EFR percentages. Those risks are based on a room by room basis combined into overall improvement. From the method explained in
Using PCA to span this in the form r=r(xi, yi, zi), for outputting the normal vector for a two-dimensional plane, or direction vector for a line, and a point on that plane or line in three-dimension space. In other words, finds β0 and β1 to minimize the average distance squared from a point to that line, h(x), and that vector is used as path length, h(x), in the Isolation Forest algorithm. It is an anomaly detection method that provides a rank, or score s(x, n), reflecting the degree of anomaly(s).
s(x,n)=2−E(h(x))/c(n); c(n)=2H(n−1)−(2(n−1)/n)
E(h(x))→c(n); s(x,n)→0.5
E(h(x))→0; s(x,n)→1
E(h(x))→n−1; s(x,n)→0
Where h(x)—Path length, c(n)—Measure of convergence, s(x,n)—Anomaly score of an instance x, H(i)—Harmonic number, estimated by ln(i)+0.5772156649, and E(h(x))—Average of h(x) averaged over a forest of random trees. The algorithm would use individual room factors as the coefficients for the linear regression, from before, f(t)=0.75+0.213*t (the example of a person with 75% individual fall risk being in the bedroom with its 21.3% risk).
Many different numerical methods can be employed to accomplish the results of this invention, one component of which is to yield multiple options for different furniture arrangements that are safer in terms of EFRs. For example, the individual rooms have rearrangements that decrease the EFR (Table 1) for those rooms individually and are contributing factors to the options outputted for the whole environment. This can be seen in the following table, Table 2, and
The combinations with their respective risks in the table are presented by percentages, here all positive percentages represented a decrease in EFR. Notice in option 1, depicted on the bottom-left in
The example computer system 1 includes a processor or multiple processor(s) 5 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both), and a main memory 10 and static memory 15, which communicate with each other via a bus 20. The computer system 1 may further include a video display 35 (e.g., a liquid crystal display (LCD)). The computer system 1 may also include an alpha-numeric input device(s) 30 (e.g., a keyboard), a cursor control device (e.g., a mouse), a voice recognition or biometric verification unit (not shown), a drive unit 37 (also referred to as disk drive unit), a signal generation device 40 (e.g., a speaker), and a network interface device 45. The computer system 1 may further include a data encryption module (not shown) to encrypt data.
The disk drive unit 37 includes a computer or machine-readable medium 50 on which is stored one or more sets of instructions and data structures (e.g., instructions 55) embodying or utilizing any one or more of the methodologies or functions described herein. The instructions 55 may also reside, completely or at least partially, within the main memory 10 and/or within the processor(s) 5 during execution thereof by the computer system 1. The main memory 10 and the processor(s) 5 may also constitute machine-readable media.
The instructions 55 may further be transmitted or received over a network via the network interface device 45 utilizing any one of a number of well-known transfer protocols (e.g., Hyper Text Transfer Protocol (HTTP)). While the machine-readable medium 50 is shown in an example embodiment to be a single medium, the term “computer-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database and/or associated caches and servers) that store the one or more sets of instructions. The term “computer-readable medium” shall also be taken to include any medium that is capable of storing, encoding, or carrying a set of instructions for execution by the machine and that causes the machine to perform any one or more of the methodologies of the present application, or that is capable of storing, encoding, or carrying data structures utilized by or associated with such a set of instructions. The term “computer-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media, and carrier wave signals. Such media may also include, without limitation, hard disks, floppy disks, flash memory cards, digital video disks, random access memory (RAM), read only memory (ROM), and the like. The example embodiments described herein may be implemented in an operating environment comprising software installed on a computer, in hardware, or in a combination of software and hardware.
One skilled in the art will recognize that the Internet service may be configured to provide Internet access to one or more computing devices that are coupled to the Internet service, and that the computing devices may include one or more processors, buses, memory devices, display devices, input/output devices, and the like. Furthermore, those skilled in the art may appreciate that the Internet service may be coupled to one or more databases, repositories, servers, and the like, which may be utilized in order to implement any of the embodiments of the disclosure as described herein.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
In the description, for purposes of explanation and not limitation, specific details are set forth, such as particular embodiments, procedures, techniques, etc. in order to provide a thorough understanding of the present technology. However, it will be apparent to one skilled in the art that the present technology may be practiced in other embodiments that depart from these specific details.
While specific embodiments of, and examples for, the system are described above for illustrative purposes, various equivalent modifications are possible within the scope of the system, as those skilled in the relevant art will recognize. For example, while processes or steps are presented in a given order, alternative embodiments may perform routines having steps in a different order, and some processes or steps may be deleted, moved, added, subdivided, combined, and/or modified to provide alternative or sub-combinations. Each of these processes or steps may be implemented in a variety of different ways. Also, while processes or steps are at times shown as being performed in series, these processes or steps may instead be performed in parallel, or may be performed at different times.
While various embodiments have been described above, it should be understood that they have been presented by way of example only, and not limitation. The descriptions are not intended to limit the scope of the present technology to the particular forms set forth herein. To the contrary, the present descriptions are intended to cover such alternatives, modifications, and equivalents as may be included within the spirit and scope of the present technology as appreciated by one of ordinary skill in the art. Thus, the breadth and scope of a preferred embodiment should not be limited by any of the above-described exemplary embodiments.
The present continuation application claims the priority benefit of U.S. Non-Provisional patent application Ser. No. 16/866,194 filed on May 4, 2020 titled “Systems and Methods for Predictive Environmental Fall Risk Identification,” which claims the priority benefit of U.S. Provisional Application Ser. No. 62/844,661 filed on May 7, 2019 titled “Systems and Methods for Predictive Environmental Fall Risk Identification,” which are all hereby incorporated by reference in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
5211642 | Clendenning | May 1993 | A |
5475953 | Greenfield | Dec 1995 | A |
5601910 | Murphy | Feb 1997 | A |
6665647 | Haudenschild | Dec 2003 | B1 |
7233872 | Shibasaki et al. | Jun 2007 | B2 |
7445086 | Sizemore | Nov 2008 | B1 |
7612681 | Azzaro et al. | Nov 2009 | B2 |
7971141 | Quinn et al. | Jun 2011 | B1 |
8206325 | Najafi et al. | Jun 2012 | B1 |
8771206 | Gettelman et al. | Jul 2014 | B2 |
9317916 | Hanina et al. | Apr 2016 | B1 |
9414222 | Dixon | Aug 2016 | B1 |
9591996 | Chang et al. | Mar 2017 | B2 |
9972187 | Srinivasan et al. | May 2018 | B1 |
10387963 | Leise et al. | Aug 2019 | B1 |
10628635 | Carpenter, II et al. | Apr 2020 | B1 |
10692011 | Pathak | Jun 2020 | B2 |
10761691 | Anzures et al. | Sep 2020 | B2 |
10813572 | Dohrmann et al. | Oct 2020 | B2 |
10825318 | Williams | Nov 2020 | B1 |
11113943 | Wright et al. | Sep 2021 | B2 |
11213224 | Dohrmann et al. | Jan 2022 | B2 |
20020062342 | Sidles | May 2002 | A1 |
20020196944 | Davis et al. | Dec 2002 | A1 |
20040109470 | Derechin et al. | Jun 2004 | A1 |
20050035862 | Wildman et al. | Feb 2005 | A1 |
20050055942 | Maelzer et al. | Mar 2005 | A1 |
20060001545 | Wolf | Jan 2006 | A1 |
20070238936 | Becker | Oct 2007 | A1 |
20080010293 | Zpevak et al. | Jan 2008 | A1 |
20080186189 | Azzaro et al. | Aug 2008 | A1 |
20090094285 | Mackle et al. | Apr 2009 | A1 |
20100124737 | Panzer | May 2010 | A1 |
20110126207 | Wipfel et al. | May 2011 | A1 |
20110145018 | Fotsch et al. | Jun 2011 | A1 |
20110232708 | Kemp | Sep 2011 | A1 |
20120025989 | Cuddihy et al. | Feb 2012 | A1 |
20120075464 | Derenne et al. | Mar 2012 | A1 |
20120120184 | Fornell et al. | May 2012 | A1 |
20120121849 | Nojima | May 2012 | A1 |
20120154582 | Johnson et al. | Jun 2012 | A1 |
20120165618 | Algoo et al. | Jun 2012 | A1 |
20120179067 | Wekell | Jul 2012 | A1 |
20120179916 | Staker et al. | Jul 2012 | A1 |
20120229634 | Laett et al. | Sep 2012 | A1 |
20120253233 | Greene | Oct 2012 | A1 |
20130000228 | Ovaert | Jan 2013 | A1 |
20130127620 | Siebers et al. | May 2013 | A1 |
20130145449 | Busser et al. | Jun 2013 | A1 |
20130167025 | Patri et al. | Jun 2013 | A1 |
20130204545 | Solinsky | Aug 2013 | A1 |
20130212501 | Anderson et al. | Aug 2013 | A1 |
20130237395 | Hjelt et al. | Sep 2013 | A1 |
20130289449 | Stone et al. | Oct 2013 | A1 |
20130303860 | Bender et al. | Nov 2013 | A1 |
20140128691 | Olivier | May 2014 | A1 |
20140148733 | Stone et al. | May 2014 | A1 |
20140171039 | Bjontegard | Jun 2014 | A1 |
20140171834 | DeGoede et al. | Jun 2014 | A1 |
20140232600 | Larose et al. | Aug 2014 | A1 |
20140243686 | Kimmel | Aug 2014 | A1 |
20140257852 | Walker et al. | Sep 2014 | A1 |
20140267582 | Beutter et al. | Sep 2014 | A1 |
20140267625 | Clark | Sep 2014 | A1 |
20140278605 | Borucki et al. | Sep 2014 | A1 |
20140330172 | Jovanov et al. | Nov 2014 | A1 |
20140337048 | Brown et al. | Nov 2014 | A1 |
20140358828 | Phillipps et al. | Dec 2014 | A1 |
20140368601 | deCharms | Dec 2014 | A1 |
20150019250 | Goodman et al. | Jan 2015 | A1 |
20150109442 | Derenne et al. | Apr 2015 | A1 |
20150169835 | Hamdan et al. | Jun 2015 | A1 |
20150359467 | Tran | Dec 2015 | A1 |
20160026354 | McIntosh | Jan 2016 | A1 |
20160117470 | Welsh et al. | Apr 2016 | A1 |
20160117484 | Hanina et al. | Apr 2016 | A1 |
20160154977 | Jagadish et al. | Jun 2016 | A1 |
20160217264 | Sanford | Jul 2016 | A1 |
20160253890 | Rabinowitz et al. | Sep 2016 | A1 |
20160267327 | Franz et al. | Sep 2016 | A1 |
20160314255 | Cook | Oct 2016 | A1 |
20160379092 | Kutliroff | Dec 2016 | A1 |
20170000387 | Forth | Jan 2017 | A1 |
20170000422 | Moturu et al. | Jan 2017 | A1 |
20170024531 | Malaviya | Jan 2017 | A1 |
20170055917 | Stone et al. | Mar 2017 | A1 |
20170140631 | Pietrocola et al. | May 2017 | A1 |
20170147154 | Steiner et al. | May 2017 | A1 |
20170161614 | Mehta | Jun 2017 | A1 |
20170192950 | Gaither et al. | Jul 2017 | A1 |
20170193163 | Melle et al. | Jul 2017 | A1 |
20170197115 | Cook et al. | Jul 2017 | A1 |
20170213145 | Pathak | Jul 2017 | A1 |
20170273601 | Wang et al. | Sep 2017 | A1 |
20170337274 | Ly et al. | Nov 2017 | A1 |
20170344706 | Torres et al. | Nov 2017 | A1 |
20170344832 | Leung | Nov 2017 | A1 |
20180005448 | Choukroun et al. | Jan 2018 | A1 |
20180075558 | Hill, Sr. et al. | Mar 2018 | A1 |
20180129276 | Nguyen | May 2018 | A1 |
20180154514 | Angle et al. | Jun 2018 | A1 |
20180165938 | Honda | Jun 2018 | A1 |
20180182472 | Preston | Jun 2018 | A1 |
20180189756 | Purves et al. | Jul 2018 | A1 |
20180233018 | Burwinkel | Aug 2018 | A1 |
20180302403 | Souders | Oct 2018 | A1 |
20180322045 | Sakui | Nov 2018 | A1 |
20180322405 | Fadell et al. | Nov 2018 | A1 |
20180342081 | Kim | Nov 2018 | A1 |
20180360349 | Dohrmann et al. | Dec 2018 | A9 |
20180368780 | Bruno | Dec 2018 | A1 |
20190029900 | Walton et al. | Jan 2019 | A1 |
20190042700 | Alotaibi | Feb 2019 | A1 |
20190057320 | Docherty et al. | Feb 2019 | A1 |
20190090786 | Kim | Mar 2019 | A1 |
20190116212 | Spinella-Mamo | Apr 2019 | A1 |
20190130110 | Lee et al. | May 2019 | A1 |
20190164015 | Jones, Jr. et al. | May 2019 | A1 |
20190164261 | Sunkavalli | May 2019 | A1 |
20190196888 | Anderson et al. | Jun 2019 | A1 |
20190197861 | Tunnell | Jun 2019 | A1 |
20190220003 | Sharma | Jul 2019 | A1 |
20190220727 | Dohrmann et al. | Jul 2019 | A1 |
20190259475 | Dohrmann et al. | Aug 2019 | A1 |
20190282130 | Dohrmann et al. | Sep 2019 | A1 |
20190286942 | Abhiram et al. | Sep 2019 | A1 |
20190311792 | Dohrmann et al. | Oct 2019 | A1 |
20190318165 | Shah | Oct 2019 | A1 |
20190385749 | Dohrmann et al. | Dec 2019 | A1 |
20200012549 | Johnsson | Jan 2020 | A1 |
20200101969 | Natroshvili et al. | Apr 2020 | A1 |
20200201648 | Memon | Jun 2020 | A1 |
20200219372 | Kwatra | Jul 2020 | A1 |
20200251220 | Chasko | Aug 2020 | A1 |
20200327367 | Ma | Oct 2020 | A1 |
20200357256 | Wright et al. | Nov 2020 | A1 |
20200357511 | Sanford | Nov 2020 | A1 |
20210007631 | Dohrmann et al. | Jan 2021 | A1 |
20210273962 | Dohrmann et al. | Sep 2021 | A1 |
20210358202 | Tveito et al. | Nov 2021 | A1 |
20220022760 | Salcido et al. | Jan 2022 | A1 |
Number | Date | Country |
---|---|---|
2949449 | Nov 2015 | CA |
104361321 | Feb 2015 | CN |
106056035 | Oct 2016 | CN |
107411515 | Dec 2017 | CN |
111801645 | Oct 2020 | CN |
111801939 | Oct 2020 | CN |
111867467 | Oct 2020 | CN |
113795808 | Dec 2021 | CN |
3740856 | Nov 2020 | EP |
3756344 | Dec 2020 | EP |
3768164 | Jan 2021 | EP |
3773174 | Feb 2021 | EP |
3815108 | May 2021 | EP |
3920797 | Dec 2021 | EP |
3944258 | Jan 2022 | EP |
202027033318 | Oct 2020 | IN |
202027035634 | Oct 2020 | IN |
2002304362 | Oct 2002 | JP |
2005228305 | Aug 2005 | JP |
2016525383 | Aug 2016 | JP |
1020160040078 | Apr 2016 | KR |
1020200105519 | Sep 2020 | KR |
1020200121832 | Oct 2020 | KR |
1020200130713 | Nov 2020 | KR |
WO2000005639 | Feb 2000 | WO |
WO2014043757 | Mar 2014 | WO |
WO2018032089 | Feb 2018 | WO |
WO2019143397 | Jul 2019 | WO |
WO2019164585 | Aug 2019 | WO |
WO2019182792 | Sep 2019 | WO |
WO2019199549 | Oct 2019 | WO |
WO2019245713 | Dec 2019 | WO |
WO2020163180 | Aug 2020 | WO |
WO2020227303 | Nov 2020 | WO |
Entry |
---|
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2018/057814, Jan. 11, 2019, 9 pages. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2018/068210, Apr. 12, 2019, 9 pages. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2019/021678, May 24, 2019, 12 pages. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2019/025652, Jul. 18, 2019, 11 pages. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2019/034206, Aug. 1, 2019, 11 pages. |
Rosen et al., “Slipping and Tripping: Fall Injuries in Adults Associated with Rugs and Carpets,” Journal of Injury & Violence Research, 5(1), (2013), pp. 61-69. |
Bajaj, Prateek, “Reinforcement Learning”, GeeksForGeeks.org [online], [retrieved on Mar. 4, 2020], Retrieved from the Internet :<URL:https://www.geeksforgeeks.org/what-is-reinforcement-learning/>, 7 pages. |
Kung-Hsiang, Huang (Steeve), “Introduction to Various RL Algorithms. Part I (Q-Learning, SARSA, DQN, DDPG)”, Towards Data Science, [online], [retrieved on Mar. 4, 2020], Retrieved from the Internet :<URL:https://towardsdatascience.com/introduction-to-various-reinforcement-learning-algorithms-i-q-learning-sarsa-dqn-ddpg-72a5e0cb6287>, 5 pages. |
Bellemare et al., A Distributional Perspective on Reinforcement Learning:, Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia, Jul. 21, 2017, 19 pages. |
Friston et al., “Reinforcement Learning or Active Inference?” Jul. 29, 2009, [online], [retrieved on Mar. 4, 2020], Retrieved from the Internet :<URL:https://doi.org/10.1371/journal.pone.0006421 PLoS ONE 4(7): e6421>, 13 pages. |
Zhang et al., “DQ Scheduler: Deep Reinforcement Learning Based Controller Synchronization in Distributed SDN” ICC 2019—2019 IEEE International Conference on Communications (ICC), Shanghai, China, doi: 10.1109/ICC.2019.8761183, pp. 1-7. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2020/031486, Aug. 3, 2020, 7 pages. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2020/016248, May 11, 2020, 7 pages. |
“Office Action”, Australia Patent Application No. 2019240484, Nov. 13, 2020, 4 pages. |
“Office Action”, Australia Patent Application No. 2018403182, Feb. 5, 2021, 5 pages. |
“Office Action”, Australia Patent Application No. 2018409860, Feb. 10, 2021, 4 pages. |
Leber, Jessica, “The Avatar Will See You Now”, MIT Technology Review, Sep. 17, 2013, 4 pages. |
“Office Action”, India Patent Application No. 202027035634, Jun. 30, 2021, 10 pages. |
“Office Action”, India Patent Application No. 202027033121, Jul. 29, 2021, 7 pages. |
“Office Action”, Canada Patent Application No. 3088396, Aug. 6, 2021, 7 pages. |
“Office Action”, China Patent Application No. 201880089608.2, Aug. 3, 2021, 8 pages [17 pages with translation]. |
“Office Action”, Japan Patent Application No. 2020-543924, Jul. 27, 2021, 3 pages [6 pages with translation]. |
“Office Action”, Australia Patent Application No. 2019240484, Aug. 2, 2021, 3 pages. |
“Office Action”, Canada Patent Application No. 3089312, Aug. 19, 2021, 3 pages. |
“Extended European Search Report”, European Patent Application No. 18901139.8, Sep. 9, 2021, 6 pages. |
“Office Action”, Canada Patent Application No. 3091957, Sep. 14, 2021, 4 pages. |
“Office Action”, Japan Patent Application No. 2020-540382, Aug. 24, 2021, 7 pages [13 pages with translation]. |
“Extended European Search Report”, European Patent Application No. 18907032.9, Oct. 15, 2021, 12 pages. |
Marston et al., “The design of a purpose-built exergame for fall prediction and prevention for older people”, European Review of Aging and Physical Activity 12:13, <URL:https://eurapa.biomedcentral.com/track/pdf/10.1186/s11556-015-0157-4.pdf>, Dec. 8, 2015, 12 pages. |
Ejupi et al., “Kinect-Based Five-Times-Sit-to-Stand Test for Clinical and In-Home Assessment of Fall Risk in Older People”, Gerontology (vol. 62), (May 28, 2015), <URL:https://www.karger.com/Article/PDF/381804>, May 28, 2015, 7 pages. |
Festl et al., “iStoppFalls: A Tutorial Concept and prototype Contents”, <URL:https://hcisiegen.de/wp-uploads/2014/05/isCtutoriaLdoku.pdf>, Mar. 30, 2013, 36 pages. |
“Notice of Allowance”, Australia Patent Application No. 2019240484, Oct. 27, 2021, 4 pages. |
“Extended European Search Report”, European Patent Application No. 19772545.0, Nov. 16, 2021, 8 pages. |
“Office Action”, India Patent Application No. 202027033318, Nov. 18, 2021, 6 pages. |
“Office Action”, Australia Patent Application No. 2018409860, Nov. 30, 2021, 4 pages. |
“Office Action”, Australia Patent Application No. 2018403182, Dec. 1, 2021, 3 pages. |
“Office Action”, Korea Patent Application No. 10-2020-7028606, Oct. 29, 2021, 7 pages [14 pages with translation]. |
“Office Action”, Japan Patent Application No. 2020-543924, Nov. 24, 2021, 3 pages [6 pages with translation]. |
“Extended European Search Report”, European Patent Application No. EP19785057, Dec. 6, 2021, 8 pages. |
“Office Action”, Australia Patent Application No. 2020218172, Dec. 21, 2021, 4 pages. |
“Extended European Search Report”, European Patent Application No. 21187314.6, Dec. 10, 2021, 10 pages. |
“Notice of Allowance”, Australia Patent Application No. 2018403182, Jan. 20, 2022, 4 pages. |
“Office Action”, Australla Patent Application No. 2018409860, Jan. 24, 2022, 5 pages. |
“Office Action”, China Patent Application No. 201880089608.2, Feb. 8, 2022, 6 pages. |
“International Search Report” and “Written Opinion of the International Searching Authority,” Patent Cooperation Treaty Application No. PCT/US2021/056060, Jan. 28, 2022, 8 pages. |
Number | Date | Country | |
---|---|---|---|
20210398410 A1 | Dec 2021 | US |
Number | Date | Country | |
---|---|---|---|
62844661 | May 2019 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16866194 | May 2020 | US |
Child | 17463270 | US |