This invention relates in general to elements and devices with piezoelectric properties, such sensitive elements and devices for use, generally, when interacting with an operator or the environment, such as with assist devices or robots.
Present technology for machined apparatus, such as assist devices and robots, use discrete load cells for sensing and to interact with a human operator. So-called skins have been identified for use with these apparatus, but none have yet been commercialized; those under investigation have sensitivities based on infrared, radio frequency or organic field-effect transistor (FET) arrays. None are wireless or self-powered.
Based on the above-mentioned inadequacies, herein are described, in one or more embodiments, small sensitive elements and devices with improvements that unexpectedly overcome one or more of the inadequacies.
Sensitive elements and devices described generally comprise piezoelectric materials and a non-rigid substrate. When desired, the substrate further comprises elastomeric properties to lend flexibility without affecting sensitivity therein to the elements and devices. Piezoelectrics provides multisensory and energy harvesting features to elements and devices herein. Sensitive elements/devices are in operable communication with a controller and incorporate wireless, self-powered features. A sensitive element or device as described is preferably in communication with, manipulated or controlled through a real-time feedback control system. Interaction with the environment relies on output from the sensitive element/device and/or the control system.
As described, each sensitive element or device may include one or more piezoelectric materials and as many as tens of thousands of units, each of which is preferably self-contained and self-powered. Each piezoelectric unit is small and compact, making it easy to use and of low-cost. When provided in a sensitive element or device herein, the one or more piezoelectric units define functionality of the element or device. A piezoelectric unit may impart one or a number of functions to the sensitive element/device described. When desired, it may also drive a sensitive element or device
In practice, a sensitive element or device may stand alone or incorporate any number of sensitive elements (e.g., in to a device). Each sensitive element in a device may have the same or offer one or more different functions.
In one or more embodiments, one or more sensitive elements are fitted with an adhesive material and/or removable strip to provide easy contact and/or removal. A sensitive element may be further provided with added sensors and/or materials, such as materials that affect material properties of the compliant substrate or functionality of the sensitive element.
In several embodiments, sensitive elements are adapted to new and/or to retrofit legacy robots and intelligent assist devices (IADs). IADs as described herein include those provided in a manufacturing line, entertainment industry, household products, automobiles, as examples. Sensitive elements may also be fitted to loads carried by IADs/robots to provide contact information with the environment (e.g., other objects). Such sensitive elements are particularly suitable to prevent injuries as well as improve sensitivity/dexterity/rotation/motion of an apparatus or machine in which they are incorporated. Multisensing and processing of sensitive elements/devices and/or LADS fitted with sensitive elements are coordinated with supervisory decision-making controller. Such control allows multisensory processing and hence provides multifunctioning (e.g., in the form of microbalance, micromovement, and ultra fine focusing) to a sensitive element/device and/or LAD.
The ease and adaptability of sensitive elements and devices provided herein allow them to be modified for given requirements. Ease and adaptability are provided by virtue of the unexpected flexibility of the sensitive elements/devices as invented herein. The previously undisclosed combination without undue experimentation. Sensitive elements may be fitted for one or more particular functions with additional features described herein. Consequently, sensitive elements may be modified in a predetermined fashion without affecting overall design, while allowing tuning of functional parameters as needed (e.g., size, weight, number, arrangement, electrical connections, power storage scheme, power production, degree of response, and overall layout and packaging). Sensitive elements and devices herein are not only adaptive, they are also cost-effectiveness and easy to assemble.
Those skilled in the art will further appreciate the above-noted features and advantages of the invention together with other important aspects thereof upon reading the detailed description that follows and in conjunction with the drawings.
For a more complete understanding of the present invention and the advantages thereof, reference is now made to a description, taken in connection with the accompanying figures, wherein:
Although making and using various embodiments are discussed in detail below, it should be appreciated that the present invention provides many inventive concepts that may be embodied in a wide variety of contexts. The specific aspects and embodiments discussed herein are merely illustrative of ways to make and use the invention, and do not limit the scope of the invention.
In the description which follows like parts may be marked throughout the specification and drawing with the same reference numerals, respectively. The drawing figures are not necessarily to scale and certain features may be shown exaggerated in scale or in somewhat generalized or schematic form in the interest of clarity and conciseness.
As described herein are sensitive elements, each comprising at least one piezo material with a non-rigid substrate, energy harvesting capabilities and wireless communication features. In some embodiment, one or more piezoelectric units with a substrate further comprise a micro electrical mechanical systems (MEMS) drive and control circuit. Sensitive elements may be very small, such as 1 mm2 or less, and may reach sizes greater than 1 cm2. Generally, there are no size restrictions because functionality and use will factor into size decisions. Such decisions will be readily apparent as they are preferably based on overall design features and will require no undue experimentation.
The substrate herein comprises generally any non-rigid material or a compliant material. Compliance does not require flexibility; however, in some embodiments, the substrate is an elastomeric material or elastomeric polymer with good elongation and/or high performance property. The polymer may behave as an electret, which may or may not offer additional advantages to the sensitive element or device herein. In one or more embodiments the substrate is a silicone elastomer or silastic elastomer. Other suitable elastomeric materials include but are not limited to silicone rubber, natural rubber, organic rubbers, and elastomers of neoprene, fluorocarbon, urethane, polyacrylate, ethylene/acrylate, butyl, ethylene-propylene-diene monomer, copolymer of styrene and butadiene, and nitrile,
In some embodiments the substrate is porous. When desired, the substrate may serve as an outer layer or surface feature, such as when provided as a surface sensor. Suitable substrates are transparent or colored and may further include performance-related properties, such as a wide temperature range, high tear strength, abrasion resistance, air permeability, steam permeability, resistance to weathering and/or high tensile strength. Such properties do not have to reside in the same substrate, such that multiple substrates may be combined or layered to offer any number of desired properties. Additional features that are useful with sensitive elements/devices herein may also reside in a single substrate or in multiple substrates, provided as layers. Such added features include electrical interconnects or components, antenna for wireless communication, controller, additional sensors (e.g., for temperature, proximity, sound as examples), insulation and/or hydrophobicity.
The antenna is configured for predictable frequency output. Electrical interconnects/components may address one or a number or sensitive elements and may be for signal conditioning and/or wireless transmission and/or serve as an electrical source/driver. When desired, electrical insulation or hydrophobicity may be imparted by one or more suitable substrates. In addition and when suited, a hierarchical arrangement of one or more heterogeneous layers may provide multiple functionalities to sensitive elements and devices described herein.
A piezoelectric unit as described herein is typically one or more piezoelectric materials in a configuration optimized and preferably calibrated for a particular application (e.g., force, pressure, deformation/displacement, acceleration, vibration, sound, strain, as examples). A piezoelectric material provides an element/device with sensitivity, such as to force, pressure, deformation, displacement, acceleration, vibration, sound, strain, motion, heat, voltage, chemicals, as examples. A piezoelectric material provides interaction cues between a sensitive element/device and its environment and measurement/details about the environment.
In one or more embodiments, a piezoelectric unit may further comprise an active region and an inactive region (e.g., layers, fibers, surfaces). Examples of preferred piezoelectrics are piezoelectric fiber composites (or active fiber composites), piezoelectric multilayer composites, and unimorphs. The active region comprises a useful piezoelectric material, such as those known to one of ordinary skill in the art. The piezoelectric unit may be further provided/configured/associated with an actuator (voltage), switch (pressure), motor, ultrasonic device (proximity), or other sensor (heat, chemical, color, linear, pressure, force, load, vibration, as examples). Thus, a sensitive element responds, detects, predicts, and/or generates output. Output is typically communicated to an antenna.
Piezoelectric units are typically provided as part of the compliant substrate and may be positioned as desired and where function is of most value. The architecture and material properties of the substrate and piezoelectric units provide sensitive elements and devices herein with an ability to stretch and/or move without degradation in functionality. Piezoelectric units need not be identical; however, calibration of the one or more portions is typically performed in order for proper functionality.
Functionality helps determine not only a size of a sensitive element, also how many piezoelectric units will be provided with a substrate. As few as one piezoelectric unit and as many as tens of thousands of piezoelectric units may be incorporated in a sensitive element and the compliant substrate thereof. The compliant substrate and overall functionality of the sensitive element may each and/or both help suggest a number and/or size of one or more piezoelectric units. In one or more embodiments, piezoelectric units are very small, and may be as small as 1 mm3. In several preferred embodiments, a piezoelectric unit is less than or about 10 mm in diameter and 0.1 mm thick. Generally, piezoelectric units are not thicker than the compliant substrate.
In one or more embodiments, a sensitive element/device described herein comprises a compliant substrate, novel MEMS sensors, an antenna and controller. Examples of a fabricated sensitive element are shown in
Referring still to
Piezoelectric units as depicted in
Characterization of a sensing action of a sensitive element of
For understanding responsiveness and functionality of the sensitive element of
A representative response under loading and unloading conditions is shown in
In response to hand touch, a representative output signal is illustrated in
When suitable, a sensitive element comprises a substrate that mimics skin. As depicted in
In some embodiments, sensitive elements described herein behave similar to cutaneous and subcutaneous mechanoreceptors. When provided with a digital signaling processing chip, a sensitive element will identify/respond to one or more specific functionalities, such as touch and shock, as previously shown. When one or more sensitive elements are configured to form a sensitive device, actuation of particular anchor points are driven by actuators, such as ultrasonic motors.
A program for wireless control for sensitive devices and/or IADs comprising sensitive elements was created by the inventors to process signals from the sensitive element and to interact with sensitive element on the device. In some forms, sensing is a combination of force and proximity sensing as well as force estimation via piezoelectrics. In addition, or as alternatives, sensing may include a variety of capabilities, including proximity, thermal changes, color and chemical recognition, as examples. Piezoelectrics may, in part, provide accurate and measurable quantifications of such modalities.
In one or more embodiments, interaction of a sensitive element with an operator is provided through use of a Kalman filter and impedance controller. Work path plans are provided directly to a device/LAD/robot through a simple operator interface adapted to a sensitive element described herein. An example is provided in
Using force as an example and referring to a robot as depicted in
where j is the robot link where the force is applied, qi's are joint coordinates, and ξi's are the link twists given by Equation 2:
where ωiε3 is a unit vector in the direction of the twist axis and viε3 is a point on the axis.
For an robot of
where di, is the link length of the ith joint. The transformation between base and virtual end-effector frames at q=0 is given by Equation 3:
if point p is close to the base of the robot wrist, and therefore j=3.
In general, a base to virtual end-effector transformation matrix is Equation 4:
At the same time, the relationship between Jacobian expressed in base frame and Jacobian expressed in virtual end-effector frame is Equation 5:
where jth frame is a virtual end-effector frame. Therefore the Jacobian expressed in the virtual end-effector frame may be obtained from Equation 6:
where Je(q) is a Jacobian expressed in the virtual end-effector frame. Because forces acting on the manipulator are measured in the end-effector frame, Je(p,q) is used in manipulator dynamics.
A dynamical model of a manipulator of
where qεn is a vector of generalized joint coordinates, n is a number of joints, M(q)εn×n is a symmetric positive definite mass (inertia) matrix, C(q,{dot over (q)}){dot over (q)}εn is a vector of Coriolis and centripetal forces, G(q)εn is a vector of gravitational torques, Dεn×n is a positive semi definite diagonal matrix for joint viscous friction coefficient, fc({dot over (q)})εn is a Coulomb friction term, τεn is a vector of generalized torques acting at the joints, Je(p,q)ε3×n is a conventional Jacobian to the virtual end-effector P expressed in the end-effector frame and fhε3 is an operator-robot interaction force at the virtual end-effector represented in its frame.
Assuming that force measurement at the end-effector or the virtual end-effector (where a sensitive element herein is positioned) is available only in one dimension or less (no measurement at all). An Extended Kalman Filter, as a way to estimate torques acting at the joints due to pushing force at the virtual end-effector, is applied. For a case when interaction occurs on a 3rd link, j=3, a dynamical model of the manipulator only from the base to the end-effector is Equation 8:
M(q){umlaut over (q)}+N(q,{dot over (q)})=τm+τu (8),
where qεj, N(q,{dot over (q)})=C(q,{dot over (q)}){dot over (q)}+D{dot over (q)}+fe({dot over (q)})+G(q), and τm=τ+JeT(q)fmε3 is a known torque acting at a joint (either through direct measurement or from control input), τu=JeT(q)fuε3 is a unknown torque to be estimated (due to pushing force in directions that cannot be measured). Since a sensitive element is used to measure force perpendicular to the manipulator, it is assumed that fm=[fmx,0,0]T, i.e., only a force element in x direction may be measured.
The state-space model of Equation 8 is Equation 9:
To include unknown torque vector into the estimation, a new extended state x is used and includes the unknown torque vector τu, provided as Equation 10:
x=[q
T
{dot over (q)}
T
τ
u
T]TεR2j+3 (10).
From Equation 8, τu may be referenced using Equation 11:
τu=M(q){umlaut over (q)}+N(q,{dot over (q)})−τm (11).
Since τu is a time-varying function, the first order time derivative {dot over (τ)}u are Equations 12/13:
A new augmented state-space model is Equation 14:
f(x,τm) is a nonlinear representation of the new augmented state-space model (Equations 15/16/17),
In order to convert a continuous augmented state-space model into a discrete model, Equation 14 needs to be discretized. A first order discretization of Equation 14 with sampling time T leads to Equation 18:
where fT(xk,τmk)=xk+{dot over (x)}(xk,τmk)T, vkε2j is process white noise, and ηkεj is also process white noise associated with unknown torque. Note that a process noise ηk is used to introduce measurement noise from the sensor portion of the sensitive element. An overall state covariance matrix is now Equation 19:
Observation equation from the robot joint encoders is given by Equation 20:
y
k
=Cx
k
+w
k (20), where
C=└I2j 0j×j┘, wkε2j is a measurement white noise with covariance (Equation 21):
to be a Jacobian matrix of fT(x,τm) with respect to [qT {dot over (q)}T τuT]T. Instead of a signum function in a fc Coulomb friction term, a smooth hyperbolic tangent function tan h( ) is applied, so a partial derivative of Equation 220 is well defined (e=Equation 23):
f
c({dot over (q)})=μ tan h(α{dot over (q)}), (23). Where
μ is a friction coefficient, α is a design constant chosen to be larger than a desired HRI force bandwidth. An Extended Kalman Filter is now used to estimate a state of a linearized system in two steps (Equations 24 and 25 followed by Equations 26, 27 and 28:
(a) Time Update: {circumflex over (x)}k+1−=f({circumflex over (x)}k,τmk) (24);
P
k+1
−
=F
x
P
k
F
x
T
+Q (25).
(b) Measurement Update: Kk+1=Pk+1−CT[CPk+1−CT+R]−1 (26);
P
k+1
=P
k+1
−
−K
k+1
CP
k+1
− (27);
{circumflex over (x)}
k+1
={circumflex over (x)}
k+1
−
+K
k+1(yk+1−C{circumflex over (x)}k+1−) (28),
where Pk+1−ε2j+3)×(2j+3) is a covariance matrix of a prediction error, Pk+1ε(2j+3)×(2j+3) is a covariance matrix of an estimation error.
Assuming a pushing force may be estimated by a Kalman Filter, it is desirable to make use of it in order to guide motion of a manipulator. An impedance control scheme is implemented to program robot compliance. This specifies a desired compliance characteristic of a manipulator of the robot so that when an operator applies force to the robot, it feels as if the robot has certain mass and viscous coefficient. Define the desired impedance of an robot manipulator from its base to link j as Equation 29: Md{umlaut over (q)}cd+Bd{dot over (q)}cd+Kdqcd=τi (29), where τiεj is a total torque due to pushing force. τi is written as Equation 30:
τi=JeT(q)fm+JeT(q)fu, (30),
where JeT(q) is defined in Equation 6, fm and fu are defined in Equation 8, Mdεj×j is a desired Mass (Inertia) matrix, Bdεj×j is a desired Damping matrix, Kdεj×j is a desired stiffness matrix, and qcd is a desired angular position of the manipulator.
The relationship between desired angular, position, velocity and acceleration and Md, Bd and Kd may be written in matrix form as shown in Equation 31:
Equation (31) can be solved numerically to find qcd, {dot over (q)}cd and {umlaut over (q)}cd.
A straightforward/standard computed-torque controller to provided track the desired manipulator trajectory qcd with an overall scheme shown in
τ=M({umlaut over (q)}cd−u)+N−JeT(fm+{circumflex over (f)}u), (33), where
u=−K
v({dot over (q)}cd−{dot over (q)})−Kp(qd−q), (34), and Kv
and Kp are PD controller gains.
An example of raw unfiltered signal measured from a sensitive element configured similar to that shown in
As another example, one or more sensitive elements described herein are provided with new IAD/robot platforms in a cooperative manipulation system. Such a platform is mobile and/or humanoid. The system is modular and scalable, capable of being scaled up, for example, as a large device for carrying heavy loads by using multiple basic working groups together (like a crew) or scaled down, for example, for intricate/articulated performance, such as surgical procedures. The system may further comprise enhanced dexterity/multifunctional end-effectors (e.g., snake/robotic arm for complex operations/surgery, including grippers, manipulators, vacuum cup tooling, pneumatic/electric motors, deburring tools, peripheral tools). Such a system will preferably include variable stiffness levels accomplished by a combination of bracing and reconfiguration to carry out accurate/precision tasks. Interaction with an operator is provided via direct touch, simple path planning interfaces. Consequently, a sensitive element and device herein will endow a sensitive device/LAD/robot or other suitable device or subject having the sensitive element with one or more qualities considered humanistic, such as a sense of caution and awareness of surroundings.
For example, an LAD/device/robot may now, with sensitive elements described herein, have improved performance features, such as an enhanced safety mode, a precision assist mode, as well as a large motion guided mode.
In yet another example, a macro fiber composite (MFC) comprising uniaxially aligned fibers surrounded by a polymer matrix with an interdigital electrode pattern was embedded in an RTV silicone compliant substrate, Output for various normal load forces on a flat plate (as described with
MFCs used herein are typically machined from low-cost piezoelectric ceramic wafers and can be operated in either d33-mode or d31-mode by designing two different electrode patterns. MFC operating in d33-mode have a higher energy conversion rate but lower electrical current as compared to operation in a d31-mode. Due to its high d33 constant, a large strain value as high as 4500 ppm may be obtained. MFCs, as transducers, have been shown to have a reliability of over 109 cycles operating at maximum strain. MFCs offer similar advantages as previously described by having a low profile, light weight and flexibility.
By incorporating multiple sensitive elements with desired functionalities, an augmented controller adapted to such sensitive elements will create desired interactive behaviors between the subject/device/IAD having the sensitive elements and its environment and/or between the subject/device/IAD having the sensitive elements and an operator. Importantly, a sensitive element and sensitive device will detect and avoid damaging contact with an operator or environmental obstacles.
As described, a controller provides multisensor processing of a robot/LAD/device having one or more sensitive elements. Real time processing, decisions and complex events are performed. A control system herein will allow one or more behaviors/operations to be programmed into the robot/IAD/device and selected based on readings obtained from sensitive elements incorporated on the robot/IAD/device. The controller, in a manner similar to a programmable logic controller, has multiple input and output arrangements, among other favorable features. However, as described, the controller is typically not as simple. It generally requires an algorithm, especially with very high speed and precision controls. The controller may be in operable communication with additional external input/output modules and/or a computer or computer network.
Actuation of sensitive elements described are selected, in part on function, size, and condition of use. For example, when a sensitive element is sensing force, selection is dependent, in part, on a force-displacement requirement. Additional factors that influence actuation selection are weight, size, driving and control circuitry, mounting mechanism, and cost. Conformal actuators or motors are further selected based on capabilities under dynamic stresses, temperature and pressure, and linearity.
Micro actuators are preferred, preferably those offering finite anchor-control at a low voltage (e.g., typically not more than 30 V), high strain, high power density, robustness and durability, and support of fully developed adjunct technology (fasteners, drivers, etc.). Additionally, the actuator must have longevity (in a range of 105 cycles or greater), a sufficient force generation (e.g., up to or greater than 15 times the weight of the actuator), up to 200 grams or better at low power levels (50-100 mW), and have a short response time (e.g., preferably about 1 millisecond, with a speed of actuation at least about 5 cm/sec or 2 in/sec). The actuators should also preferably be dry and/or thoroughly sealed and inexpensive.
Current actuators based on electromagnetic control will not satisfy these requirements. On the other hand, piezoelectric actuators have fast response time, high generated force per unit area and high resolution in displacement. They may be miniaturized and still provide excellent control over motion. Other advantages associate with a piezoelectric motor includes a large energy storage, no electromagnetic noise generation, high efficiency, non flammable nature, and safe in overload and short circuit conditions. Compared with others, such as magnetostrictive actuators and shape memory alloys, piezoelectrics have further advantages as a two-way drive, not requiring magnetic shielding or a heat source and maintaining stable operation over a prolonged period of time. Preferred piezoelectric actuators/motors offer high precision and combine unlimited stroke with high resolution in a compact dimension and provide a linear response to input voltage.
As described, sensitive elements and devices herein are self-powered and communicate wirelessly. With fusion of multiple elements and a control module, a sensitive element/device may readily interact with one or more operators, humans, or obstacles (its environment). Sensitive elements and devices include additional advantageous features such as adhesive or insulation properties, flexibility, simplistic fabrication, self powered sensing (no need of external voltage), natural look, and low profile.
Sensitive elements may reside on any surface, including gloves, clothing, outerwear, an assist device/robot/IAD, as examples. In addition, communication from one or more sensitive element may be transferred from a sensitive element to a second device (e.g., operator, assist device/robot/IAD). In one example, one or more sensitive elements are specifically calibrated to one or more particular design features, such as environmental features (e.g., weight, height, etc.). When a stimuli provided to the sensing element is outside the calibration range, the sensitive element provides output via the antenna to a controller that submits output to a second device. The second device is then designed and capable of responding to the sensitive element. This may serve usefully, for example, for safety measures when working with large or heavy objects, such that a second device carrying or moving the large or heavy object is, in a sense, made capable of knowing when in contact with an operator that has one or more sensitive devices when the sensitive devices comes in contact with the large or heavy object.
Sensitive elements herein provide an operator and/or intelligent system with a functional ability to sense, respond, as well as interact with an operator/human/environment/device. In a predetermined manner, a plurality of elements of one or a variety of sensor types form a network with smart actuation and/or efficient control algorithms/instructions to identify types and strengths of stimuli and to initiate response and action.
Additional objects, advantages and novel features of the invention as set forth in the description, will be apparent to one skilled in the art after reading the foregoing detailed description or may be learned by practice of the invention. The objects and advantages of the invention may be realized and attained by means of the instruments and combinations particularly pointed out here.