Autonomous wearable leg devices (AWLDs), which include autonomous transfemoral and transtibial prostheses, exoskeletons, and orthotics, must be designed to mimic biological behavior in order to be effective. However, currently there are deficiencies in both the control and mechanical design of such devices that prevent them from being biomimetic. Lower limb amputees experience several clinical problems while wearing conventional prostheses. These difficulties include deficient stability during standing and walking across a variety of terrains, asymmetric gait, slower walking speed, and increased metabolic rates when compared to people without amputations. Separately, individuals with lower limb pathologies or healthy individuals carrying heavy loads over extended distances often suffer from physical or mental fatigue. These difficulties have motivated the development of lower limb exoskeletons and orthoses to assist gait. [1] Recently, the development of autonomous exoskeletons has introduced the issue of control. In particular, an autonomous exoskeleton must effectively recognize the movement intent of its user and subsequently actuate a biomimetic control trajectory for the desired movement. However, despite the need for biomimetic control strategies and mechanical designs of AWLDs, the state of the art of such devices suffers from a lack of biomimicry across different terrains, gait events, and gait activities. Thus we present in this invention two novel control methods for autonomous wearable leg devices as well as a novel mechanical design of such a device.
The design and implementation of control strategies is a significant obstacle in the development of effective AWLDs. [2] An AWLD control system (including sensors, control algorithms, and device actuators) must respond biomimetically to gait events, changes in gait activity, or changes in ground terrain, and it must do so regardless of the device user. One system currently employed on the commercialized BiOM T2 powered ankle foot prosthesis, relies mainly on integrated ankle torque estimation to both determine the gait phase and modulate control variables within each phase (for example power output during powered plantarflexion). The system allows for automatic, accurate, and punctual transitions between gait modes; it is integrated in that all sensors are contained within the ankle-foot enclosure; and it is generalizable across users, walking speeds, many ambient environmental factors, and, to a degree, terrain slope. [3] [4]
Control strategies for bipedal systems generally rely on the knowledge of the ground reaction force (GRF) (i.e. force of interaction between the foot and the ground) and zero moment point or, more broadly, the center of pressure (COP) [5]. In biomechanics, several control methods are available that emphasize the ankle-foot joint behavior to understand the dynamics of human balance have been proposed [6] [7] [8]. For these control schemes, ankle-foot movements are actively controlled to reposition the COP beneath the foot. By modulating the COP location, the ground reaction force can effectively be controlled, hence obtaining dynamic balance stability [8] [9]. In legged robotics, GRF and COP are generally measured with a series of sensors embedded in a robot's feet. In human biomechanics, standard measuring techniques for the GRF and COP have been restricted to a laboratory setting, where analysis tools, such as video motion capture and calibrated force platform systems, are available. Wearable gait analysis tools have been enabled that accurately estimate the GRF components and COP [10] [11] [12] [13]. Moreover, sensing technologies have also been implemented in prosthetic devices for gait studies and prosthetic assessment [14] [15] [16] [17].
Walking, the most common form of gait activity, includes tasks that can largely be classified by different types of walking surface geometry (terrain), and in particular flat ground walking and stair and ramp ascent and descent. It is well known that natural human lower limb biomechanics change significantly in response to varying terrains and thus deviate from level ground ambulatory control. [18][19] These changes can manifest during both the swing and stance phases of walking. Thus to ensure biomimetic performance, AWLDs must be adaptive to gait events, activities, and terrains.
Broadly, adaptation can be divided into two components: prediction or estimation of the desired gait activity or terrain, and actuation in response to this prediction or estimation. To-date, predicting gait activity or terrain in lower limb prostheses typically has employed sensor fusion techniques, in which information from a variety of sensing modalities (including inertial measurement, kinetic, optical or sonar distance measurement, and surface electromyography) has been extracted using pattern recognition to classify terrain [20] [21] [22] [23]. Inertial, kinetic, optical, or sonar measurement relies on sensors that do not directly communicate with the human. These sensors are thus more applicable to a user independent control system than surface electromyography, which exhibits significant variability depending on electrode positioning and both physiological state and constitution.
The application of positive work to the environment is what enables locomotion. In human gait this comes in the form of torque applied about the joints, and their net energy is applied to the ground through the ankle and foot. A normative bodied human ankle applies 1.6±0.2 Nm/Kg of torque with 3±1 W/kg of power to the environment in normal walking [25]. A passive lower limb prosthesis is only able to provide as much energy as is stored during controlled dorsiflexion and knee flexion, leaving a deficit of roughly 0.2 J/kg of net work per step. This energy deficit at the ankle is compensated by increased work from other joints, such as increased swing from the hip. This puts additional load on these remaining joints, possibly leading to accelerated onset of osteoarthritis. Powered prosthetic devices have been shown the ability to return a more biologically accurate motion to a wearer's gait by applying torque at the knee [24] and also devices that apply torque at the ankle [26]. The powered prosthesis is able to control energy flow by absorbing negative work during dorsiflexion and applying positive work to the environment by converting stored electrical energy into plantarflexion torque at the powered joint.
Some work has begun in understanding how the foot and subtalar joints affect gait and stability. Level, flat ground walking requires primarily sagittal plane motion of knee and ankle joints, and inversion-eversion motions are generally afforded simply by compliance inherent in split-spring designed prosthetic foot devices. Powered inversion-eversion about the subtalar joint, however, may increase user stability in uneven terrain and in the presence of moving ground platforms such as the motions felt when standing on a subway or bus. Two other devices are known to have begun investigating the behavior of powered inversion-eversion devices, on a mobile system [27] and one a simulator system for experimentation [28]. Similarly, most prosthetic foot devices operate as a passive springs [29] or clutched passive devices [30]. A powered foot, or metatarsophalangeal may contribute to not only biological accuracy in gait as is defined by the LLTE [29], but also stabilization.
This invention is directed toward novel control algorithms and mechanical designs of autonomous wearable leg devices, which include autonomous transfemoral or transtibial prostheses, exoskeletons, and orthotics. More specifically, inventions include novel methods of detecting gait events, activities, and terrains in autonomous wearable leg devices in real time using kinetic or non-contact sensing modalities, and novel mechanical designs of autonomous leg prostheses with multiple degrees of freedom.
The invention generally is directed to an autonomous wearable leg device for integrated, real-time, and kinetic sensing, and to a method for controlling an autonomous wearable leg device.
In one embodiment, the invention is an autonomous leg device for integrated, real-time, kinetic sensing, including a prosthetic, orthotic or exoskeletal component that includes a support area. An array of sensors is embedded along the support area, and a controller is in communication with the array, whereby the sensors of the array can collectively sense and transmit spatially-dependent pressure signals to the controller, and whereby the controller can generate a controlling command and send the controlling command to the prosthetic, orthotic or exoskeletal component, and thereby control the prosthetic, orthotic, or exoskeletal component.
In another embodiment, the invention is a method for controlling an autonomous wearable device, including collecting kinetic signals from an array of sensors embedded in a prosthetic, orthotic or exoskeletal component of the autonomous wearable device worn by a subject during a portion of a gate cycle. Raw values of at least one feature are extracted from the collected kinetic signals, and then the feature is applied to a controller. A controlling command is generated by the controller. The controlling command is then sent to the prosthetic, orthotic or exoskeletal component to thereby control the prosthetic, orthotic or exoskeletal component during the portion of the gait cycle.
In still another embodiment, the invention is directed to an autonomous prosthetic, orthotic, or exoskeletal device that includes: an ankle frame; a pair of actuators, each actuator being mounted on the ankle frame and connectable to a power source and a control signal, wherein the actuators are independently controllable; a foot interface connected to the actuators, whereby actuation of either of the actuators transmits force to the foot interface; and at least one hinge at the frame linking the ankle frame to the foot interface, whereby synchronous movement of the actuators causes plantar flexion or dorsiflexion of the foot interface, and differential movement of the actuators causes eversion or inversion of the foot interface.
In another embodiment, the invention is a prosthetic foot that functions as a powered metatarsophalangeal joint. A mounting plate serves as a foot frame, and an actuator is mounted on the foot frame and connectable to a power source and a control signal. A hinge is linked to the foot frame, and a toe component is linked to the actuator, whereby the actuator causes the toe component to move relative to the hinge joint, thereby functioning as a powered metatarsophalangeal joint of the prosthetic foot.
In another embodiment, the invention is an autonomous prosthesis that includes an actuated knee component with a single actuated degree of freedom, an ankle component with two actuated degrees of freedom and linked to the actuated knee component, and a foot component with a single actuated degree of freedom linked to the ankle component.
In still another embodiment, the invention is an autonomous prosthesis that includes an actuated knee component with a single actuated degree of freedom, an ankle component with two actuated degrees of freedom and linked to the actuated knee component, and a passive foot component.
In another embodiment, the invention is an autonomous prosthesis that includes a passive knee component, an ankle component with two actuated degrees of freedom and linked to the passive knee component, and a foot component with a single actuated degree of freedom and linked to the ankle component.
In another embodiment, the invention is an autonomous prosthesis that includes a passive knee component, an ankle component with two actuated degrees of freedom and linked to the passive knee component, and a passive foot component linked to the ankle component.
In still another embodiment, the invention is a method for controlling an autonomous wearable leg device. The method includes using non-contact sensors integrated into a foot covering to detect or characterize obstacles or terrain changes in real time, and using the detection or characterization of obstacles or terrains to modulate a control algorithm of the autonomous wearable leg device in real time.
In yet another embodiment, the invention is a prosthetic device that functions as a powered metatarsophalangeal joint. In this embodiment, the invention includes a mounting plate that is a frame, an actuator mounted on the frame and connectable to a power source and a control signal, wherein the actuator is independently controllable. A hinge is linked to the frame, and an appendage is linked to the actuator, whereby the actuator causes the appendage to move relative to the hinge.
In another embodiment, the invention is an autonomous prosthesis that includes an ankle component with two actuated degrees of freedom, and a foot component with a single actuated degree of freedom and linked to the ankle component.
Consistent with the advantages conferred by the natural biomechanics of terrain transitions, integrated terrain-specific control methodologies in lower limb prostheses, according to the invention, can significantly reduce fall risk, the metabolic cost of walking, and the pain experienced at the residual limb.
More specifically, the invention enables punctuality (as the majority of information is available during stance), integration (e.g., into a prosthetic foot, foot cover, or transtibial load cell), and generalizability (e.g., since embodiments can rely on the emergent biomechanics of terrain transitions and signal quality does not vary depending on constitutive or state properties of the user). Pattern recognition on GRF and COP by the device and method of the invention, estimated from signals available during the stance phase of walking, also enables autonomy by introducing automaticity in combination with accuracy.
The foregoing will be apparent from the following more particular description of example embodiments, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments.
The inventions described here are directed toward both the control methods and mechanical design of autonomous wearable leg devices (AWLDs) including autonomous transtibial or transfemoral prostheses, exoskeletons, and orthotics.
These inventions include methods of actuating AWLDs by modulating force or torque, power, position, velocity, work, or other control variables or provide feedback to the user in the form of mechanical or electrical stimuli. The methods of the invention are performed in real time and employ integrated, autonomous sensing, microprocessing, and actuation systems.
In one embodiment, the invention is a method for controlling an AWLD that incorporates integrated, real-time, kinetic sensing. Kinetic sensors are embedded either on an area for ground support belonging to the AWLD or as one or a plurality of load cells within a prosthetic thigh or shank. A controller is in communication with the sensors, whereby the sensors can collectively sense and transmit spatially-dependent pressure signals or localized forces and moments to the controller, and whereby the controller can generate a controlling command and send the controlling command to AWLD, and thereby control the AWLD.
In one embodiment, the controller of the AWLD uses the spatially varying pressure signals to estimate ground reaction force (GRF) and center of pressure (COP), and extracts features on these signals within the time window when the support area is in the ground, and inputs these features into a machine learning classifier to predict gait activity, gait event, or terrain of the next step. In this embodiment, the vertical component FZ of the GRF is estimated as:
where pi is the strain at each sensor i and Nis then total number of sensels. Furthermore, COP components G and G can be estimated as:
where xi and yi are the positions of each sensor i. Additionally, signals from individual sensors can also be used as input into the controller, whether for actuation in a particular gait state or for detecting and triggering state, task, or mode transitions.
In the case of a transtibial load cell within a prosthesis, a static model can be used to estimate the GRF vector and location of the COP using three-dimensional moments and forces measured by such a load cell. The estimation contemplates only single stance support and the coordinate system employed for the model is Cartesian. The sign convention for the ground reaction force is positive upward and forward. The reference frames, shown in
Here the left superscripts represent the reference frame and the right subscripts represent the coordinate direction. The values employed are defined in the following way: SMYS, SFYS are the moment and force, respectively, around the Ys axis of frame {S}; SMXS, SFXS are the moment and force, respectively, around the XS axis of frame {S}; SFZS is the force in the ZS direction of frame {S}; rTZS is the distance in ZS to the COP. For an active prosthesis system this value can be computed as Z0 cos γ where Z0 is the load cell height at zero degrees of ankle flexion and γ is the shank angle in {G}. This assumes only rotation in the sagittal plane with no adduction or abduction in the joint. Assuming negligible inversion-eversion of the foot-ankle joint system, we can assume that the rotation matrix that relates frames {S} relative to {P} can be represented by this single sagittal angle γ. Given the COP location, the forces that interact with the ground, relative to the COP frame {P}, can then be expressed as:
P
F
X
=SFX
P
F
Y
=SFY
P
F
Z
=SFY
In the case of a transfemoral load cell, estimation of COP and GRF can be performed using knowledge of knee state and spatial transformations similar to those used for the transtibial load cell.
In another embodiment, a machine learning classifier can be used on the kinetic signals to predict upcoming gait events or terrains based on features extracted from these signals in real time. The classifier could include a heuristic method, a Naive Bayesian classifier; a decision tree classifier; a linear or quadratic discriminant classifier; a neural network classifier; and a logistic regression classifier.
In an embodiment of the invention, a method includes application of kinetic sensing and control to obtain biomimetic control strategies for AWLDs to define a hierarchical control architecture. One level of such a hierarchy is mode, which includes such general activities as walking, running, sitting, or standing. Another level is task, the categories of which vary depending on activity. For example, walking tasks include walking on different terrains such as flat ground, stairs, or inclines. Finally, each task can be composed of a next hierarchical level, namely sequential states which are, typically, periodic. For example, walking on flat ground can be divided into swing phase, controlled plantarflexion, controlled dorsiflexion, and powered plantarflexion at the end of stance. Various modes, tasks, and states along with relevant transitions are visualized in
In one specific version of this device, an array of kinetic sensors can be embedded along the support area of a standard prosthetic foot cover and used to transmit spatially dependent pressure signals to the prosthesis controller. An example of such a configuration is exhibited in
Alternatively, an array of such sensors can be embedded within the support area of the prosthetic foot itself, as illustrated in
In yet another embodiment (not shown), an array of sensors is embedded within a transtibial or transfemoral prosthetic socket, or embedded within the sole of a shoe, or embedded within a sock.
In still another embodiment, the invention includes real-time provision of mechanical or electrical feedback to the user of an AWLD. Kinetic state variables, as described herein can be employed to provide feedback to the AWLD user in the form of mechanical or electrical stimuli. Mechanical stimuli can include vibration, application of normal pressure to the skin, skin pinching or strain application, or skin surface temperature variation. Electrical stimuli include electrical stimulation of muscles or nerves.
In another embodiment of the invention, one or more contact-free sensors can be employed within the foot covering of either a biological foot or prosthetic foot, either in addition or as an alternative to contact or pressure sensors. Examples of suitable contact-free sensors include cameras, distance-measuring sensors, and laser scanners. Such sensors, when employed, can be placed in communication with an AWLD controller that uses signals from these sensors to predict and respond to gait events and terrain changes by actuating AWLD in real time. The contact-free sensors can be aligned in any orientation or position either interior or exterior to an associated sock, foot cover, or shoe. With respect to powered exoskeletons and orthosis controllers, contact-free sensors can be aligned in any orientation or position either exterior or interior to an associated exoskeleton or orthosis.
In one embodiment, at least one non-contact sensor is positioned in a forward orientation at a toe area of a shoe, whereby it is used to predict that the user will ascend stairs or clear an obstacle, as visualized in
Another embodiment of the invention includes real-time statistical or diagnostic monitoring in AWLDs using kinetic or non-contact sensors. Signals generated using these sensors can be monitored to provide statistical or diagnostic information about the AWLD. Statistical information can include, for example, statistics, step counts, information about power or force output, time spent, and electrical or metabolic work done in various modes, tasks, or states. This can be used to collect information from one user or across many users. Diagnostic information concerns any data regarding intended operation of the device or deviation from intended operation.
Another embodiment of the invention includes an autonomous multi-degree of freedom lower limb prosthesis, orthotic, exoskeleton, or wearable system that relies on signals, features, and pattern recognition on kinetic signals for control, such as an autonomous knee-ankle-foot, transfemoral prosthesis system with four powered/actuated degrees of freedom (DOFs) or powered axes of motion. The embodiment of the four DOF system shown in
In this embodiment, an open-source FlexSEA bionic control architecture is utilized. This electronics architecture integrates high powered electronics 292 with flexible, high-fidelity sensing. In one embodiment, each actuated degree of freedom include power electronics 292 and high fidelity sensing electronics (referred to as “Execute boards”) controlled by Cypress Semiconductor PSOC microprocessors. Digital and analog input-output (I/O) functionality on the Execute board include native inertial measurement units, strain gage amplifiers, and expandable generic I/O. Generally, all DOFs are simultaneously connected and controlled with a single high level controller (Management board) 293, based on the STMicrosystems STM32 microprocessor, that fuses all sensors and state information. In this embodiment, the Management board 293 performs the high-level control that includes mode, task, state identification and operations as shown in
In a specific embodiment, the invention is an ankle-foot prosthesis, having two DOFs. A passive foot prosthesis is shown in
As that term is understood herein, the term “linkage” means a mechanical component that transmits bidirectional force with a push-pull action such as push-rod or flexure, a unidirectional tensile component such as a belt, cable, or chain, or a torsional component transmitting rotary motion directly through a rotary element, or a combination of elements such as a roller-cam element.
In detail, in this embodiment one actuator as shown in
In the embodiment shown, high-torque, brushless, and direct current (BLDC) split phase sector motors (also referred to as “outrunner” motors) 291, for example, can be utilized as torque generators. In this embodiment, each actuator consists of one motor controlled by an Execute electronic control board 292, their synchronization controlled by a Manage microprocessor based high-level controller 293. Due to their torque-density, these split phase sector motors enable reduced transmission ratios from those of typically-available prosthetics. The lower reflected inertia and frictional losses of the reduced transmission ratio results in a higher bandwidth, more dynamic, efficient and quiet system, and also enables a more accurate observation of output torque by way of current sensing at the motor power electronics, reducing the need for additional load-cells, specific series compliance and displacement measurement systems.
In this embodiment, homodirectional or synchronous motion between the left and right push-rods 288 affect ankle rotation for dorsiflexion and plantarflexion (plantarflexion is shown in
For this embodiment,
The embodiment of the gimbal as described is more clearly visible in
In still another embodiment, the invention includes a single DOF foot device (
In yet another embodiment, in
In
One embodiment of the invention is an autonomous four DOF knee-ankle-foot prosthesis system comprising a knee joint with a single actuated DOF, ankle-foot-prosthesis with two actuated DOFs, and prosthetic foot with single actuated DOF. Another embodiment includes: an autonomous three DOF knee-ankle-foot prosthesis system comprising a knee with a single actuated DOF; an ankle-foot prosthesis with two actuated DOFs; and a passive prosthetic foot. Still another embodiment of the invention is an autonomous single DOF knee-ankle-foot prosthesis that includes: a knee with a single actuated DOF; a passive ankle-foot prosthesis; and a passive prosthetic foot. Yet another embodiment of the invention is an autonomous three DOF knee-ankle-foot prosthesis that includes: a passive knee joint; an ankle-foot prosthesis with two actuated DOFs; and a prosthetic foot with one actuated DOF. Still another embodiment of the invention is an autonomous two DOF knee-ankle-foot prosthesis that includes: a passive knee joint; an ankle-foot prosthesis with two actuated DOFs; and a passive prosthetic foot. In another embodiment, the invention is an autonomous three DOF ankle-foot prosthesis that includes: an ankle-foot prosthesis with two actuated DOFs; and a prosthetic foot with one actuated DOF. Another embodiment is an autonomous two DOF ankle-foot prosthesis that includes: an ankle-foot prosthesis with two actuated DOFs and a passive prosthetic foot.
The following is a description of a demonstration of select embodiments of the invention, and is not intended to be limiting in any way.
We performed a preliminary study in which we asked six subjects with unilateral transtibial amputations (ages ranged between 28 and 66, heights 1.68 m and 1.90 m, and weights between 130 and 229 lbs, all K4 ambulators) to traverse various terrains while signals were collected from an array of kinetic sensors embedded in an insole on the side of the prosthetic device.
Data for each subject was collected in several trials each involving between eight and twelve circuits. In each trial, subjects were asked to undergo several circuits involving transitions to and from a staircase and flat ground while wearing a powered transtibial prosthesis aligned to a custom fitted socket via a pylon of appropriate length. Each circuit comprised one complete ascent, turn-around maneuver, descent, and subsequent turn-around, allowing for transitions to and from the terrain in either direction. Stairs terminated in a platform allowing for approximately one complete gait cycle completion after exiting the staircase and before turning around.
Each trial was conducted such that the subject was visible by at least four motion capture cameras at all times, which were set to a capture rate of 100 Hz. Data were collected from the prosthesis sensors (including an inertial measurement unit and motor and ankle joint encoders) and from resistive pressure sensing insoles developed by Tekscan. All subjects wore a rubber cosmesis over their carbon fiber foot, with pressure sensing insoles positioned between the cosmesis and shoe insole and taped to the latter. Pressure sensors were cut by hand to match the size of the shoe's insole.
Subjects were asked to begin each trial with a quiet period of static, bilateral stance to establish a reference pressure distribution on the sensor. Additionally, sensors were calibrated using a proprietary method provided by Tekscan software that involved collecting a short trial of unilateral (one-legged) stance on the instrumented leg. All subjects were physically labeled by a full lower body marker set (described in a further section).
Subjects used the BiOM ankle-foot prosthesis (
Pressure sensing insoles were part of the F-Scan In-Shoe Analysis System developed by Tekscan. The sensors were originally size 14 (US) and trimmed in accordance with the foot size of each subject. Sensor technology was resistive, with 0.15 mm thickness, 25 sensel per in2 resolution, and 862 KPa pressure range. An example is displayed in
For each trial, various time varying signals were extracted from the frame data including the centers of pressures, integrated pressures across the ball, heel, and whole foot, and derivatives of these signals. All integrated pressure signals were normalized by the mean maximum value achieved across all flat ground to flat ground steps. Next, all stance phase periods within the trial were identified using a threshold on total integrated force, and the boundaries of each stance window were used to identify foot contact and foot off, respectively. For each stance period, a terrain (either flat ground, upstairs, or downstairs) was defined using motion capture data, which included data about subject and staircase position.
We then extracted various features for each signal from only the stance phase, including mean, maximum, minimum, range, standard deviation, and initial and final values. Additionally, the initial length of stance was used as a feature. All features were then standardized to zero mean and unit variance across the entire dataset.
Finally, we employed pattern recognition on the features of each step to predict the labeled terrain of the next step correctly. We were able to attain an accuracy of approximately 86% using a 20-fold cross-validated linear discriminant analysis classifier with empirical prior probabilities on data containing transitions among flat ground, upstairs, and downstairs steps. Complete data for all feature subsets using empirical priors are presented in the
The relevant teachings of all patents, published applications and references cited herein are incorporated by reference in their entirety.
This application is a continuation of U.S. application Ser. No. 16/347,666, filed May 6, 2019, which is the U.S. National Stage of International Application No. PCT/US2017/060710, filed Nov. 8, 2017, which designates the U.S., published in English, and claims the benefit of U.S. Provisional Application No. 62/419,192, filed Nov. 8, 2016. The entire teachings of the above applications are incorporated herein by reference.
This invention was made with government support under W81XWH-14-C-0111 awarded by the U.S. Army Medical Research and Material Command. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
62419192 | Nov 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16347666 | May 2019 | US |
Child | 17647320 | US |