1. Field of the Invention
This invention generally relates to robotics, specifically to deformable robotic surfaces.
2. Description of the Related Art
In the field of robotics, robotic toys and prosthetics, deformable surfaces have been created in the past. However, most of the current designs lack the control necessary to describe detailed deformable surfaces throughout a wide range of motion. This is because the robotic industry has focused more on function, rather than form.
In U.S. Pat. No. 7,113,848, David Hanson of Hanson Robotics, attempted to re-create realistic human facial movement in his robotic faces. His invention comes short in reproducing realistic facial movement, since the method he uses to move the skin lacks the level of control necessary to reach the full range of motion in human facial expression.
Professor Hiroshi Ishiguro, of Osaka University, built two humanoid robots called Repliee Q1Expo and Geminoid. Both of these androids could pass as human, from a distance, but when the android moves, the illusion is shattered. This happens because the underlying muscles of the organism are not being reflected in the android's skin. His work would be improved, if he were to re-create the humans' full range of motion by using a method that would allow all of the appropriate deformations to be made.
Deformable robotic surface could be used to create surfaces for, but are not limited to: artificial organisms, robotic toys, surfaces for prosthetics, ability to morph one surface to another, deformable objects.
In this specification where reference has been made to patent specifications, other external documents, or other sources of information, this is generally for the purpose of providing a context for discussing the features of the invention. Unless specifically stated otherwise, reference to such external documents or such sources of information is not to be construed as an admission that such documents or such sources of information, in any jurisdiction, are prior art or form part of the common general knowledge in the art.
An object of at least preferred embodiments of the invention is to provide a deformable robotic surface that is capable of mimicking an organism's surface deformations throughout its range of motion, or to at least provide the public with a useful choice.
In accordance with a first aspect of the present invention, there is provided a deformable robotic surface comprising: a plurality of control points, the control points being moveable relative to each other; and a covering extending between the plurality of control points; wherein movement of the control points relative to each other causes a corresponding movement of the covering.
Preferably, the deformable robotic surface further comprises a plurality of connectors extending between the control points, wherein movement of the control points relative to each other causes a corresponding movement of the control point connectors.
Preferably, at least a portion of the plurality of connectors comprise flexible connectors.
Preferably, at least a portion of the plurality of connectors comprise resilient connectors.
Preferably, at least a portion of the plurality of connectors comprise rigid connectors.
Preferably, the rigid connectors comprise telescopic connectors.
Preferably, at least a portion of the control point connectors are generally straight components.
Preferably, at least a portion of the control point connectors are generally curved components.
Preferably, the covering comprises a flexible covering.
Preferably, the covering comprises a resilient covering.
Preferably, the covering extends over the control points and the plurality of control point connectors.
Preferably, the control points are generally arranged in rows and columns to form a grid of control points.
Preferably, the control points connectors extend between adjacent control points to form a grid of control points and control point connectors.
Preferably, the deformable robotic surface further comprises at least one actuator for moving at least one of the control points relative to the other control points.
Preferably, the control point connectors comprise actuator(s) that are adapted to move the control points relative to each other.
Preferably, the actuator(s) comprises biasing means. More preferably, the biasing means comprises a spring. Alternatively, the actuator(s) comprises electroactive polymers. Alternatively, the actuator(s) comprises pneumatic actuator(s).
Preferably, the actuator(s) are attached to the covering, control points, or control point connectors at attachment points.
Preferably, the control points comprise actuator(s) that are adapted to move the control points relative to each other.
Preferably, the actuator(s) comprise biasing means. More preferably, the biasing means comprises a spring. Alternatively, the actuator(s) comprises electroactive polymers.
Preferably, the deformable robotic surface further comprises at least one flexible support extending from a control point towards the covering to form a relatively smooth surface in the covering.
Preferably, at least a portion of the control point connectors are embedded in the covering.
Preferably, at least a portion of the control points are embedded in the covering.
Preferably, the control points are rotatable relative to the covering.
Preferably, the deformable robotic surface has a neutral configuration in which at least a majority of the covering is generally non-planar. More preferably, the deformable robotic surface has a neutral configuration in which at least a portion of the covering is generally curved. Alternatively, the deformable robotic surface has a neutral configuration in which at least a majority of the covering is generally planar.
Preferably, the deformable robotic surface further comprises at least one additional layer or skin. More preferably, the additional layer or skin covers at least a portion of the covering.
Preferably, the deformable robotic surface further comprises sensors and wiring to transfer data or energy.
Preferably, the control points are integrally formed with the covering.
Preferably, the control point connectors are integrally formed with the covering.
Preferably, the location of at least a portion of the control points and at least a portion of the control point connectors is printed on the covering.
Preferably, the control points are integrally formed with the control point connectors as an expandable and contractible web.
Preferably, the control points correspond to vertices of a computer representation, the covering corresponds to a face or series of faces of the computer representation.
Preferably, the control points correspond to vertices of a computer representation, the control point connectors correspond to edges of the computer representation, the covering, additional layer, or exterior surface corresponds to a face or series of faces of the computer representation.
Preferably, the expandable and contractible web correspond to edges of the computer representation.
Preferably, the attachment point(s) of the actuators correspond to vertices of a computer representation.
Preferably, the movement of the control points or attachment points through time generally correspond to a computer represented movement of the vertices of the computer representation throughout time.
Preferably, the movement of the control points connectors or expandable and contractible web through time generally correspond to a computer represented movement of the edges of the computer representation throughout time.
Preferably, the movement of the covering, additional layer, or exterior surface through time generally correspond to a computer represented movement of the faces of the computer representation throughout time.
In accordance with a second aspect of the present invention, there is provided a combination of a deformable robotic surface as described in relation to the first aspect attached to at least one other deformable robotic surface as described in relation to the first aspect.
In accordance with a third aspect of the present invention, there is provided a combination of a deformable robotic surface as described in relation to the first aspect attached to at least one other item.
Preferably, the other item is part of a robot. More preferably, the deformable robotic surface forms the exterior surface or artificial skin of the robot.
In accordance with a third aspect of the present invention, there is provided an artificial muscle comprising a deformable robotic surface as described in relation to the first aspect.
Preferably, the artificial muscle further comprises an artificial muscle core wherein the deformable surface at least partially surrounds the artificial muscle core.
The term “comprising” as used in this specification means “consisting at least in part of”; that is to say when interpreting statements in this specification which include “comprising”, the features prefaced by this term in each statement all need to be present but other features can also be present. Related terms such as “comprise” and “comprised” are to be interpreted in a similar manner.
To those skilled in the art to which the invention relates, many changes in construction and widely differing embodiments and applications of the invention will suggest themselves without departing from the scope of the invention as defined in the appended claims. The disclosures and the descriptions herein are purely illustrative and are not intended to be in any sense limiting. Where specific integers are mentioned herein which have known equivalents in the art to which this invention relates, such known equivalents are deemed to be incorporated herein as if individually set forth.
As used herein the term “(s)” following a noun means the plural and/or singular form of that noun.
As used herein the term “and/or” means “and” or “or”, or where the context allows both.
The invention consists in the foregoing and also envisages constructions of which the following gives examples only.
The present invention will now be described with reference to the accompanying drawings in which:
a is a front view of an organism's face;
b is a front view of the organism's face of
c is the layout of control points and control point connectors of
a is a perspective view of a 3d computer representation of polygons;
b is a perspective view of a deformable robotic surface corresponding to the computer representation of
c is a perspective view of the computer representation of
d is a perspective view of a deformable robotic surface corresponding to the computer representation of
a is a schematic of a human being;
b shows the layout of a human being's muscular system;
c is the layout of control points, control point connectors, and coverings corresponding to the muscular system shown in
a shows the pneumatic actuator in a deflated configuration;
b is a side view of a pneumatic actuator of
a is a perspective view of an alternative embodiment deformable robotic surface having an electroactive polymer actuator in an undeformed state;
b is a perspective view of the alternative embodiment deformable robotic surface of
a is a perspective view of an actuating surface support in relaxed configuration;
b is a perspective view of an actuating surface support in deformed or actuated configuration;
c is a perspective view of an embedded bendable wire connector;
a is a perspective view of deformable robotic surfaces detached;
b is a perspective view of the deformable robotic surfaces attached
a is a perspective view of locking control points
b is a perspective view of re-attachable edges of a covering
a is a perspective view of electroactive polymer in a relaxed state;
b illustrates the electroactive polymer of
a is a perspective view of another alternative embodiment of the deformable robotic surface having curved rigid control point connectors in an unexpanded configuration;
b is a perspective view of another alternative embodiment of the deformable robotic surface having curved rigid control point connectors of
a is a perspective view of alternative curved rigid control point connectors in an unexpanded configuration;
b is a perspective view of the curved rigid control point connectors of
a is a perspective view of the curved rigid control point connectors in an expanded configuration;
b is a perspective view of alternative curved rigid control point connectors of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which the control points are embedded into a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which the control points attached to a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which the control points and control point connectors are embedded into a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which the control points and control point connectors attached to a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which an expanding and contracting web embedded into a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which an expanding and contracting web attached to a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which the control points are embedded into an expanding and contracting web;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which the control points are attached to an expanding and contracting web;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which an actuation system is embedded into a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which an actuation system is attached to a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which an actuation system and an expanding and contracting web embedded into a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
a is a perspective view of an alternative embodiment of the deformable robotic surface in which an actuation system and an expanding and contracting web are attached to a covering, additional layer or external surface;
b is a side view of the deformable robotic surface of
Details of a first preferred embodiment of the present invention are illustrated in
Movement of the control points 102 relative to each other causes a corresponding movement of the covering 106. Movement of the control points 102 relative to each other causes a corresponding movement of the control point connectors 104. The control points 102 are spaced apart from each other generally in rows and columns. However, this arrangement of rows and columns may be altered depending on the intended shape and use of the robotic surface, as described later in this specification. The control point connectors extend between adjacent control points to from a generally grid shaped pattern.
The use of the reference number 102, 104, 106 are used as a generic reference numbers to describe various control points 102, control point connectors 104, and coverings 106 designs listed in this specification, since various designs for each of these parts can be used to create various deformable robotic surfaces.
The control points 102 are objects or elements in which an actuation/artificial muscle system can be attached to in order to deform the deformable robotic surface. The control points can perform many other functions, which are listed throughout this specification. The control points are generally block shaped components as shown in
In the preferred embodiment of the invention, the control points 102 are attached underneath the covering such that movement of the control points relative to each other causes a corresponding movement of the covering.
The deformable robotic surface can require different control point 102 designs depending on the actuation system used and the type of surface desired. Sometimes, it can be useful to use multiple types of control points 102 to build a single deformable robotic surface. Many factors can determine which type control point 102 is most effective for a specific location of the deformable robotic surface, some determining factors can be, but are not limited to: size, strength, flexibility, type of connector needed to connect to the actuation system, cost, range of motion desired, attachments needed for connectors and covering, attachment of electrical wires, attachments for sensors, the actuation system used to deform the deformable robotic surface, (the type of deformation desired, whether or not the control points and control point connectors form a networked web, the desired function of the control point.
The control point designs shown in
This alternative rotational control point design has a control point head 4508 with apertures or slots 112 for receiving the ends of control point connectors. The rotational head pivot is supported by a rotational head platform 4522 and is rotatably mounted to the rotational head platform 4522 by a rotational head pivot in the form of a uniball 4520. One or more actuators 418 are operatively connected to the control point via bearings and rotational arms. In the embodiment shown, each actuator is connected to the control point by a first rotational arm 4510 and a second rotational arm 4514. The rotational arms are pivotally connected together via a bearing pivot 4512. The first rotational arm 4510 is connected to the rotational head platform 4522 via a central spindle 4602. Arrows in
The or each actuator 418 is insertable in an actuation connector 4516 or control point connector fastener 4518 for connecting the actuator to the second rotational arm 4514.
This alternative rotational control point design has a control point head 4508 with apertures or slots 112 for receiving the control point connector ends 108. The rotational head pivot is supported by a control point base 5204 and is fixed to the control point base. One or more actuators 418 are connected to the control point base. In the embodiment shown, each actuator is insertable and securable in corresponding artificial muscle connectors 5304. The circular arrows represent the allowable movement of the various components of the rotational control point.
The control point design in
The rotational control point shown in
Each actuator 418 is insertable in an actuation connector 4516 for connecting the actuator to the second rotational arm 4514. The actuation connector 4516 is connected to the second rotational arm 4514 via a bearing connector 4506 a bearing 4504.
The control point design in
The control points 102 can be made out of variety of materials which can include, but are not limited to: metals, plastics, rubber, wood, or carbon fibre, for example.
Additional Actuation from Control Points
An alternative embodiment actuator is shown in
Additional actuation could be created from many other types of actuators, as well, which can include but is not limited to: pneumatic actuation, hydraulic actuation, magnetic actuation, mechanical actuation, piezoelectric actuation, electro-mechanical actuation, and fiber reinforced rubber actuators driven hydraulically or pneumatically, for example.
Electroactive polymers are polymers whose shape is modified when a voltage is applied to the polymer. Electroactive polymers can be used as actuators or sensors. As actuators, electroactive polymers are able to undergo a large amount of deformation while sustaining large forces.
In the embodiment shown, the electroactive polymer 6602 has an attachment point 6604 that is located on top of the electroactive polymer 6602 adjacent the exterior surface 704, that can be used to bind the covering 106 to the electroactive polymer 6602. Products that could attach the surfaces together could be, but should not be limited to: super glue, epoxies, elastomer adhesives, other adhesives, alternative methods of actuation could be used to create a similar effect.
The control point connectors 104 are flexible or rigid parts that attach to the control points 102 together to form a connected control point web. The control point connectors are elongate components and extend between adjacent control points to form a generally grid shaped arrangement having rows and columns.
In the preferred embodiment shown in
The control point connectors 104 can be used in many different ways to enhance the robotic surface's deformability and functionality; these enhancements can include, but are not limited to:
The control point connectors 104 can be attached to the control points 102 and the covering 106 in many ways. Since there are different control points 102 and control point connectors 104 and coverings 106 that can be used to create various deformable robotic surfaces with, the method of attachment depends on what type of control point 102 control point connectors 104 and covering 106 are being used to create the deformable robotic surface with. For example, adhesives could be added to the covering 106 to adhere the covering 106 to the control points 102 and control point connectors 104. Alternative products that could used to attach the control points 102 and control point connectors 104 to the covering 106 could be, but should not be limited to: various glues epoxies, elastomer adhesives, other suitable adhesives, hook and loop fasteners, threaded stitches, for example.
In the preferred embodiment shown in
Alternatively, the control point expander 110 may be directly connected to the control point. The male end of the control point connector ends 108 could be made from a plastic wire connector. However, many other alternative embodiments of the control point connector ends 108 could be created as well. The preferred connector will be determined by, but is not limited to, these factors: type of control point used, type of control point expander used 110 what kind of energy, actuation, or data needs to be transferred through the network.
The flexible control point connectors 104 can aid in limiting the distance the control points 102 move by providing an elastic, flexible tension between the control points 102. These flexible control point connectors 104 can also aid in supporting the covering 106 and defining the coverings 106 surface by adding structure to a control point 102/control point connector 104 web, which the surface gets attached to. The flexible, elastic qualities needed for each control point connector 104 can vary, since each connection may need to be unique in that particular region of the deformable robotic surface. Some factors that can determine the elastic qualities needed of the control point connector 104 can be, but are not limited to the distance that the control points 102 need to travel, and the resistance created by the connected parts, for example.
Once these factors have been taken into consideration, the appropriate flexible control point connector 104 can be determined and used for that particular group of control points 102. Flexible control point connectors can be made out of a variety of materials which can include, but are not limited to spring, strips of elastic, or fiber mesh, for example.
The control point connectors 104 may be rigid components. These rigid connectors are useful when stiff or solid edges are needed. Also, electrical wires, sensors, and data cables can run through these connectors or be attached to the connectors.
Alternatively, the rigid control point connector can be made out of various materials which can include but are not limited, expanding or sliding pieces of rigid materials, hollow tubes, shape memory alloy such as Nickel titanium (NiTi) or Nitinol Tubing, Micro coils, Stents, memory wire, and rotational pivots 408, for example.
By using curved control point connectors, the number of control points 102 needed to deform a curved surface may be reduced compared to the generally straight connectors described above. When expanded and contracted, these curved connectors create curved edges that support the covering 106 or surface. However, many additional alterations and methods could be applied to create a variety of curved designs. For example,
a and 47b illustrates an alternative embodiment of the deformable robotic surface having curved rigid control point connectors to create a curved deformable robotic surface. In this embodiment, the control point connectors comprise curved rigid control point connector bases 6702 that are slidably mounted to a rigid control point expander 6704, and straight rigid control point connector bases 6708 that are slidably mounted to a rigid straight control point expander 6709. These components form a curved rigid control point connector cage that is able to contract and expand in the directions shown by the arrows. When actuation is applied to the control points 102, the curved rigid control point connector base 6702 slides along the path determined by the rigid control point expander 6704, which causes the curved rigid control point connector cage to expand from a position similar to that shown in
Also, a control point connector expander covering support 6712 may be attached to the rigid control point expander 6704 to aid in supporting the surface when the surfaces are expanded. The expander covering support 6712 may be used as a connection point to attach the surface to. Many different combinations of curved and straight control point connectors could be created to make several different shapes.
The curved rigid control point connector connection point 6710 can perform similar functions as a control point. For example, its uses could include, but are not limited to:
a is a perspective view of alternative curved rigid control point connectors in an unexpanded configuration and
a is a perspective view of a single curved rigid control point connectors in an expanded configuration and
In the preferred embodiment, a covering 106 is attached to the control points 102 and the control point connectors 104 to create an external surface or covering of the deformable robotic surface. In the preferred embodiment shown in
The covering is preferably a unitary component. Alternatively, the covering may be formed by one or more pieces of covering.
The covering 106 may be used:
The covering may be formed from a stretchable, elastic, or resilient material so that it stretches as the control points and control point connectors move. In an alternative embodiment, the covering may be formed from a flexible material so that it flexes as the control points and control point connectors move. In a further alternative embodiment, the covering may comprise a substantially non-stretch material. The covering 106 can be made out of a variety of materials which can include, but is not limited to rubber, elastic fibers, spandex, nylon, polyesters, silicon, latex, polyurethanes, metal fibers, mesh fibers, springs, and sliding metal plates, for example.
The best method to adhere the covering 106 to the control points 102 and control point connectors 106 or the expanding and contracting web 7602 can be determined by, but is not limited to: the materials that being attached, the desired range of motion, desired elasticity, and compatibility of the adhesion with the surfaces that are being attached.
Products that could attach the surfaces together could be, but should not be limited to, super glue, epoxies, hook and loop fasteners, elastomer adhesives, other suitable adhesives, for example.
As illustrated in
a is a perspective view of a preferred embodiment actuating surface support 6202 in a relaxed state. This actuating surface support can be created using electro active polymers. The support surface has portions of dielectric elastomer film 6210. When voltage is applied, the electro active polymers expand 6204, which moves the control points 102 to new locations, shown in
c illustrates how the control point 102 can be attached to the electroactive polymer via an embedded bendable wire connector 6212. This embedded bendable wire connector 6212 can bend with many degrees of freedom (indicated by the arrows in
b, illustrates that electrical wires, data transfer wires, sensors, transmitters and various electrical components and devices can be attached to or embedded into a networked web of control points 102 and control point connectors 104 (or an expanding and contracting web 7602) to relay energy, transfer data, transfer actuation, and attach sensors throughout the deformable robotic surface and to the rest of the robot. The covering 106, the additional surface 702 and the exterior surface 704 can also contain this functionality as well.
These networked capabilities could include, but are not limited to:
b, illustrates an embodiment in which electrical wires, data transfer wires, sensors and transmitters, and various other electronic components are attached to or embedded into a covering to relay energy, transfer data, transfer actuation, and/or attach sensors throughout the robotic surface and to the rest of the robot. Additionally or alternatively, the additional surface 702 and the exterior surface 704 may contain this functionality as well. Various combinations of these components and additional components may be used to create various robotic surfaces. These networked capabilities can include, but are not limited to the following examples:
In the embodiment shown, the individual linking deformable robotic surface polygons 6402 and/or strips of linking deformable robotic surface polygons 6404 have locking control points 6414. The locking control points are preferably spaced along the edges of the individual deformable robotic surface parts. The locking control points have corresponding snap fasteners to combine these independent parts or the locking control point 6414 together. For example, 6408 and 6410 illustrates that the male and female ends of snap fasteners can be used to snap these locking control points 6414 together. These locking control points 6414 can be made from a variety of materials, utilizing various techniques to lock them together, which can include but is not limited to magnetic attachment ends, a variety of metal and plastic fasteners, or interlocking clips, for example.
In addition, the individual parts also have re-attachable edges 6412 on the covering 106 or on the control point connector 104. These re-attachable edges of the deformable robotic surface can be made out of a variety of different materials which can include, but are not limited to, hook and loop fasteners, strips of adhesive material, stitching, adhesives, or slide fasteners for example.
Since the computer is capable of designing objects that are extremely small and/or extremely large, creating a deformable robotic surface that matches the scale of the object in the computer may not always be possible. However, if the computerized scale of the objects surface cannot be created in the physical world, alternative scales can be used to create an object that deforms “relatively” proportionately the same.
An actuation system that is used to deform a deformable robotic surface can also be referred to as an artificial muscle system. The deformable robotic surface's adaptability to multiple actuation/artificial muscles systems is a flexible aspect of its design. Almost any actuation system can be used to deform a deformable robotic surface, as long as the control points 102 can be actuated to the proper space in time, throughout the range of motion desired. The actuation systems used to the drive the deformable robotic surface could include, but is not limited to: pneumatic actuation, electro active polymers actuation, hydraulic actuation, magnetic actuation, mechanical actuation, piezoelectric actuation, electro-mechanical actuation, and fiber reinforced rubber actuators driven hydraulically or pneumatically, for example. The following list the preferred actuation method and two alternative actuation methods to demonstrate the flexibility of the deformable robotic surface to adapt to multiple types of actuation/artificial muscle systems.
a is a three-dimensional computer representation of the deformable robotic surface.
(A) the control point 102 is represented as a vertex 402
(B) the control point connector 104 is represented as an edge 404
(C) the covering 106 is represented as a face or series of faces 406.
b shows a deformable robotic surface corresponding to the three-dimensional computer representation shown in
The deformable robotic surface shown in
c shows the three-dimensional computer representation of
b and
Each actuators is preferably attached to a support surface 420 via a rotational pivot.
Various types of rotational pivots could be used, as long as the appropriate degrees of freedom can be achieved. The rotational pivot can be made by various methods, which can include, but are not limited to rod bearings, multiple rotational hinges, for example.
a-
a and 8b, and
b shows a pneumatic actuator having a bladder 1408 in an inflated configuration and
a and 9b show an actuator in the form of an electroactive polymer 1506. In this alternative embodiment, the control points 102 and control point connectors 104 are connected to the electroactive polymer 1506. When a voltage is applied to the electroactive polymer, the electroactive polymer will change position. The change in position is shown by comparing the actuator with the voltage off, indicated by reference number 1502 to the actuator with voltage on, indicated by reference number 1504. The actuator moves the control points 102 to the new positions in space, since the control points 102 are connected to the actuator. Electroactive polymer actuators can be used in many other ways to manipulate the position of the control points as well. For example, the electroactive polymers may be designed to mimic the flow of an organism muscle structure to which, control points can be attached to. The electroactive polymers can be created in curved, flat, or coiled shapes, for example, to which control points may be attached to.
For the deformable robotic surface to be actuated by various actuation systems, sometimes it is necessary to change the binders, fasteners and connectors 1402 that bind the actuation system to the deformable robotic surface. Various binders, fasteners, and connectors 1402 may be used since the design is largely dependent on the type of control point and actuation system used. Preferably, the actuation system may be attached directly to the control points.
Flexible bases 6302 can be added to the actuation system to act as shock absorbers for the actuation system.
The flexible bases may be attached to one or more of the actuators of the deformable robotic surface. Alternatively, the flexible bases may be attached to only some of the actuators of the deformable robotic surface.
These flexible bases can cushion impacts that are created from external forces, which could potentially break the actuation system. These flexible bases can be made out of a variety of materials, which can include, but should not be limited to: springs, rubber, silicon, plastic, for example.
Blending the Deformable Robotic Surface with Non-Deformable Robotic Surface Parts
The robotic surface may be attached to a non-deformable robotic surface and/or be attached to additional layers or artificial skins, for example.
In the preferred embodiment shown in
The exterior surface 704 and/or the additional layer 702 is preferably bonded to the deformable robotic surface using an adhesive 706 or a wide variety of other materials which can attach these surfaces together. The best method to adhere these surfaces together can be determined by, but is not limited to: the materials that being attached, the desired range of motion, desired elasticity, compatibility of the adhesion with the surfaces that are being attached, products that could attach the surfaces together could be, but should not be limited to: super glue, epoxies, hook and loop fasteners, elastomer adhesives, other adhesives, for example.
a to 61b show alternative embodiment of the deformable robotic surface. Unless described below, the features and operation should be considered to be the same as those described above in relation and like numerals are used to indicate like parts. The alternative embodiments can include, but are not limited to:
a and 50b illustrates an alternative embodiment in which control points 102 are embedded into a covering 106. Alternatively, the control points 102 may be embedded into the additional layer 702, or the exterior surface 704. In this alternative embodiment, the control points are substantially flush with a lower surface of the covering.
a and 51b illustrates an alternative embodiment in which control points 102 are attached to a covering 106. Alternatively, the control points 102 may be attached to the additional layer 702 or exterior surface 704. In this alternative embodiment, the control points are attached to a lower surface of the covering and extend away from the covering.
a and 52b illustrates an alternative embodiment in which control points 102 and control point connectors 104 are embedded into a covering 106. Alternatively, the control points 102 may be embedded into the additional layer 702 or exterior surface 704. In this alternative embodiment, the control points are substantially flush with a lower surface of the covering.
a and 53b illustrates an alternative embodiment in which control points 102 and control point connectors 104 are attached to a covering 106. Alternatively, the control points 102 may be attached to the, additional layer 702 or exterior surface 704. In this alternative embodiment, the control points and control point connectors are attached to a lower surface of the covering and extend away from the covering.
a and 54b illustrates an alternative embodiment in which an expanding and contracting web 7602 is embedded into a covering 106. Alternatively, the expanding and contracting web 7602 may be embedded into the additional layer 702 or exterior surface 704. In this alternative embodiment, the expanding and contracting web 7602 is substantially flush with a lower surface of the covering.
a and 55b illustrates that an expanding and contracting web 7602 is attached to a covering 106. Alternatively, the expanding and contracting web 7602 may be attached to the additional layer 702 or exterior surface 704. In this alternative embodiment, the expanding and contracting web 7602 is attached to a lower surface of the covering and extends away from the covering.
a and 56b illustrates an alternative embodiment in which control points 102 are embedded into an expanding and contracting web 7602. In this alternative embodiment, the control points are substantially flush with the expanding and contracting web 7602.
a and 57b illustrates an alternative embodiment in which the control points 102 are attached to an expanding and contracting web 7602. In this alternative embodiment, the control points are attached to a lower surface of the expanding and contracting web and extend away from the expanding and contracting web.
a and 58b illustrates an alternative embodiment in which an actuation system 7604 is embedded into the covering 106. Alternatively, an actuation system 7604 may be embedded into the additional layer 702 or exterior surface 704. In this alternative embodiment, the control points of the deformable robotic surface are effectively integrally formed with the covering, additional layer or exterior surface rather than being separately formed components as shown and described in relation to
a and 59b illustrates that an actuation system 7604 can be attached to the covering 106. Alternatively, an actuation system 7604 may be attached to the additional layer 702 or exterior surface 704. In this alternative embodiment, the control points of the deformable robotic surface are effectively integrally formed with the covering, additional layer or exterior surface rather than being separately formed components as shown and described in relation to
a and 60b illustrates that an actuation system 7604 and an expanding and contracting web 7602 can be embedded into the covering 106. Alternatively, an actuation system 7604 may be embedded to the additional layer 702 or exterior surface 704. In this alternative embodiment, the control points of the deformable robotic surface are effectively integrally formed with either the covering, additional layer, exterior surface, or the expanding and contracting web rather than being separately formed components as shown and described in relation to
a and 61b illustrates that an actuation system 7604 and an expanding and contracting web 7602 can be attached to the covering 106. Alternatively, an expanding and contracting web 7602 may be attached to the additional layer 702 or exterior surface 704. In this alternative embodiment, the control points of the deformable robotic surface are integrally formed with either the covering, additional layer, exterior surface, or the expanding and contracting web rather than being separately formed components as shown and described in relation to
Computer simulations are useful when designing and testing a robot or a deformable robotic surface. Simulations created in 3d software, can test the design of a robot or deformable robotic surface, in movement, to ensure that everything works within the 3d simulation first. Once a working simulation has been created, the parts can be built and assembled and then the animation can be exported to the assembled robot. Methods that may be used to aid the design process can be, but are not limited to: mapping motion, 3d animation, testing the artificial muscle system, designing the deformable robotic surface, for example.
Determining Actuator Movement from 3d Simulations
The movement of the physical actuation/muscle system can be created in 3d programs by using the animated vertex information to drive a computer generated actuation system that resembles the physical actuation system. This can be done by constraining the 3d actuation system to a vertex to one side of a 3d computer generated actuator and constraining a connection point to the opposite side of the 3d actuator. When the vertex moves, the 3d actuators are actuated in time and space to expand as necessary to match the vertex positions throughout time. Adjustments may need to be made to the 3d actuation system for this to work.
Once the 3d actuation system can match the vertex positions, the constrained motion can be baked onto the animated channels of the 3d actuators. Now that 3d actuators have animation curves applied to them, they can animate without the aid of the constraints. Once this has been achieved, the animation can be exported on to the physical actuation devices that are attached to the robot. Now, the corresponding points can be moved to the same space and time as the 3d actuation system, if the physical system matches the computer simulation.
The embodiments described in this specification illustrate ways in which the deformable robotic surface can be designed to create a deformable robotic surface for an artificial organism which is based on an actual organism. In the embodiments described, a well designed deformable robotic surface with a proper actuation/artificial muscle system can mimic an organism's superficial skin volume, throughout its range of motion, thus creating a deformable surface that mimics or the organisms' surface volume and deformations throughout its range of motion.
The placement of the control points 102 can be determined by the organisms' bone, muscle, fat and skin structure, which makes the ideal control point layout for each organism. The placement may be improved by taking into consideration which of the fore-mentioned factors is most dominant in the superficial skin deformations in a particular part of the body throughout its range of motion. In a human face; the skin, fat and bones are the primary considerations. In the hands and feet; the bones and folds of the skin are the primary considerations. The rest of the body is primarily determined by muscle, fat, and bone structure. These control point layouts are further explored in the following paragraphs.
A dark outer outline along the border of the control point connectors 104 helps to illustrate the similarities between the organism muscle and the deformable robotic surface design. Additionally, there is an inner row of control points 214. This deformable robotic surface is designed in such a way that to flex the artificial muscle, the inner set of control point 214 are raised in a direction towards the cover 106 and the outer set of control points 212 can be depressed or withdrawn in a direction away from the cover 106. The push and pull of these points by the actuators allows these deformations to express the similar kind of volume change that takes place on the organism's Sartorius muscle, throughout its range of motion.
There are many alternative control point 102 layouts that could be used create similar results. For example, an alternative layout 206 of the control points 102 and control point connectors is shown in
a is a front view of an organism's face 302 and
In a human's face, the muscles weave in and out so intricately that it is very difficult to mimic all of the superficial muscles of a human face. Therefore, the best way to determine the layout of the control points 102 is to determine the range of expressions the face makes and arrange the control points 102 in a manner that they can best describe all of these expressions. The Facial Action Coding System (FACS), designed by Paul Ekman, describes a fairly complete range of facial expression. When placing these control points 102, each FACS pose should be carefully considered so that most of the details in the face can be re-created with the control points 102 by repositioning the control points 102, to match the organism FACS range of expression with the deformable robotic surface. There are many other control point configurations that can be used, however 304 and 306, illustrate a preferred layout for this organism's face. Each organism has a unique range of facial expressions; therefore the placement of the control points is best determined from each organism's facial range of motion (expression).
If the actuated deformable robotic surface can repeat all of the FACS poses of the organism, then these poses can be combined/blended to create almost any facial expression that the organism can make. However, even though the FACS poses give a fairly wide range of expression, at times, it may be necessary to add more poses to encompass a wider range of expression. This is because there are many subtleties of facial expression that are difficult to capture in static poses with isolated muscle movements.
There are multiple methods commonly used in 3D computer graphics to solve data captured from an organism, into these FACS expressions. This solved data or animation can be applied to the actuators to move the control points 102 to the desired locations in space and time, to match an organism facial expressions.
a, 6b, and 6c illustrate the relationship between an organism 604, an organism's musculoskeletal system 606 and a deformable robotic surface 602.
In the embodiments described above, the deformable robotic surface has been presented primarily as a method to deform an exterior surface 704. However, the deformable robotic surface can also be used to create internal muscles. Therefore, an artificial organism's robotic surface can be classified into two primary types: external deformable robotic surfaces 508 and an internal deformable robotic surface 504. External deformable robotic surfaces 508 are deformable robotic surfaces that directly affect the exterior surfaces 704 deformations. Internal deformable robotic surfaces 504 are deformable robotic surfaces which can be used to create internal surfaces, which may resemble the organism's internal structure.
Internal deformable robotic surfaces 504 may be similar in shape and size to the organism's muscles. It is not necessary that every corresponding muscle of the organism's muscle system is re-created in the internal deformable robotic surfaces. A grouping or simplification can be done; as long as the external deformable robotic surface 508 can mimic the organisms' superficial volume, throughout its desired range of motion.
Additionally,
Control points 102 attached to the internal deformable robotic surfaces 504 can be connected to the control points 102 of the external deformable robotic surface 508, therefore transferring the actuation from the actuation system, to the internal deformable robotic surface 504, to the external deformable robotic surface 508. If desired, the internal deformable robotic surfaces 504 and the external deformable robotic surfaces 508 may be connected to one another. These shared or connected control points 102 can be useful in reducing the number of control points 102 needed to create the actuation.
The covering 106 may be attached to the interior or exterior of the control points 102 and the control point connectors 104. For the external surfaces, like the skin, the covering 106 can be applied on the side closest to the skin. When creating some internal deformable robotic surfaces, it may be more desirable to place the covering internally.
In addition, the deformable robotic surfaces may be filled with fluids and/or other materials 512 that mimic the weight and flexibly of the organic muscles and fat, thus creating an artificial muscle and fat volume that more closely resembles organism. These materials may be, but are not limited to, water, hydraulic fluid, silicon, or air, for example.
The design of the deformable robotic surface may be altered to be different to the organism to create many different effects. However, when creating an altered artificial organism, the organism can still be referenced during the design process. Alterations can include, but are not limited to: characterizations, morphing, different organisms combined together to make a single deformable robotic surface, for example.
(B) Non-proportional scales applied to exaggerate the organism's features 1804 and 1806
(C) Changes in the physical structure of the artificial organism that differs from that of the organism 1802.
Mixing body parts of different organisms together can create many unique deformable robotic surfaces.
Once the artificial skin/exterior surface 704 has been added, attaching additional levels of detail can aid in making the artificial organism more believable. Some example detailing can include, but is not limited to, cloned hair, transplanted hair, wigs—artificial hair, other synthetic hair, fake nails, special effects makeup, and cosmetics, for example.
By surveying an organism with various methods, information can be gathered and calculated in ways to aid in design of an artificial organism. This data can be used to calibrate the artificial muscle/actuation system, to improve the deformable robotic surface design and in general improve the accuracy and overall design of the robot by matching the surface of the robot to the captured data. In the following paragraphs, there will be several methods listed to do this; however there are other methods that could be applied to further improve results.
When surveying an organism, it is generally a good idea to survey as broad of a range of motion as the surveying devices allows. A broad range of motion can include; but is not limited to:
(A) each of the organisms muscles contracted individually, when possible
(B) each of the muscles relaxed
(C) groups of muscles flexed together
(D) the organisms muscles in motion
(E) the organisms muscles in motion with forces acting upon them
(F) dynamics of the skin and muscle in motion
When surveying the organism, it is a good idea to capture a neutral pose. The neutral pose can be defined as the rest pose from which all other deformations are base off of. The neutral pose for a human subject could be a standing position with an upright posture, feet directly underneath the shoulders, the head facing forward and the arms perpendicular to the body with the hands facing down. There are different variations to the neutral pose that can be used to.
The accuracy of the mapping from the organism, to the 3d generated character, to the deformable robotic surface, can be improved when the organism skin and musculoskeletal system are surveyed. Each technology used to survey the organism can provide different information. The data collected from each device can be combined to create a fairly accurate picture of the internal and external workings of the organism. When possible, devices can be used to scan the entire body, throughout the entire range of motion, to collect as much information about the internal and external structure of the organism as possible.
Once all the data has been collected from all of the multiple methods listed above, the data can be mathematically solved to a 3d character that mimics the physical artificial organism that is being created. Once a good simulation is created in the computer, this design can be used for a deformable robotic surface.
Motion capture technologies can be used to collect data from an organism throughout space and time. The captured data can be used to determine how the control points 102 of the deformable robotic surface should move in order to match that of the organism. Motion capturing devices could include, but are not limited too are Optical, Magnetic, GPS, and 3D scanning.
Once the data has been collected, mathematical predictions can be made to determine where the deformable robotic surface's control points 102 should be in space and time to match that of the organism. For best results, the placement of these motion capture markers should be located on the organism in the same relative location that the corresponding control points are located on the deformable robotic surface. This direct mapping will provide a relatively precise location throughout time, that each of the deformable robotic surface's control points need to be at, in order to match the movement of the organism. If there is not an exact mapping between the motion capture markers and the deformable robotic surface, retargeting methods can be used.
There are various kinds of motion capture devices and software that can be used to capture the organism's movement and retarget it to the deformable robotic surface. When retargeting the movement of an organism's performance to an artificial organism, there can be a one to one mapping, if there is a corresponding motion capture marker, for each of the control points 102. When retargeting an organism motion to a characterized deformable robotic surface several retargeting methods can be used. These retargeting methods can include, but are not limited to: GLOBAL Optimization, Least Square Optimization, AutoDesk Motionbuilder's actor solving method, various other optimization techniques, EVA Real-time solver.
The control point's 102 range of motion can also be determined by the range of motion captured in the survey. For example, to determine the range of motion of the organism's bicep, three 3D scans can be used. The neutral scan, a scan with the tricep fully contracted and a scan with the bicep fully contracted. These scans provide a simplified version of the superficial volume of the organism's bicep in motion. Therefore the deformable robotic surface and actuation system can be adjusted to match this superficial volume in motion. If more scans are used to define the organism's bicep range of motion the more accurate the surface volume can be defined.
Surveyed data can be fitted to the neutral pose. This can be more precisely accomplished by using mathematical optimization algorithms, such as, but not limited to, least squares and global optimization, and iterative closest point, for example. The goal is to minimize the difference in the data between the neutral pose and the range of motion data. However, before the sets of data are fitted together, it is important to define the surface area that you would like to fit to. It is best to use relaxed regions of each of the range of motion data sets and fit that area to a corresponding surface area of the neutral data set. Areas of the data that have flexed muscles can be filtered out. The surfaces can be matched by comparing the difference of between the two relaxed surfaces and aligning them, by translating, rotating and scaling the range of motion data until the best fit is found that corresponds to the regions of the neutral data set.
Once the data is fitted to the neutral pose, a computer representation of the deformable robotic surface is created manually or procedurally from the neutral and the surveyed data. This computerized representation of the deformable robotic surface should be able to match the surfaces of each of the fitted pieces of data, throughout the range of motion by moving the vertices or control points of the computerized deformable robotic surface to the corresponding surface of the fitted data. If this is not possible, the deformable robotic surface can be redesigned until this is possible.
Mathematical optimization techniques, which can include, but are not limited to, least squares and global optimization, can aid in determining the range of motion needed by the actuation system to reach the range of motion in the surveyed data. In the 3d simulation, the 3d muscle actuation system, that mimics the robotic actuation system, can be automatically adjusted (solved) to reach the full range of the organisms muscle contractions by comparing the surrounding muscle deformations and solving the 3D muscles to best fit the surface of the surveyed data. If the 3D computer generated muscle system does not match that of the scans, an amount of error is returned that can inform the designer that more adjustments need to be made to the computer muscle system, in order that the muscle system reaches the desired location. This should be done until an acceptable amount of error has been created. Once an acceptable 3d muscle system is created, then the artificial muscles can be placed from this information and applied to the robot.
Optimization techniques can also be used to adjust attributes that modify the 3d characters skeletal system. This solved skeleton can be used as a design guide to build the robotic equivalents.
Thus the reader will see that the invention provides an integral or modular suit which can be deformed by an actuation/artificial muscle system, to create deformations that can be used to create physical deformable surfaces. This invention can create a surface which has been originally designed in the computer. In addition, this invention can form a network that can contain sensors and transfer and transmit energy, information, and actuation throughout the deformable robotic surface and to other parts of the robot or external devices.
While the above description contains many specificities, these should not be construed as limitations on the scope of the invention, but as exemplifications of the presently preferred embodiments thereof. Many other ramifications and variations are possible within the teachings of the invention. For example, DNA, from an organism, can be used to create computer simulations of the organism that show what an organism would look and behave like under different circumstance of their life. These circumstances could be but are not limited to: Age, lifestyle, weight, physical issues, and personality.
Once these predictions were made, the result could be calculated to make an estimated visual look of what the organism would have looked and behaved like. Then the deformable robotic surface can be designed based off of this information. In addition, the DNA of the organism could be altered for a different effect.
Preferred embodiments of the invention have been described by way of example only and modifications may be made thereto without departing from the scope of the invention.
For example, the cross section of the control point connectors are shown and described as being generally rectangular. The cross section of the control point connectors may be any other suitable shape, such as circular, square, or oval for example. Additionally or alternatively, the cross section of the control point connectors may vary along the length of the control point connector.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/NZ08/00245 | 9/19/2008 | WO | 00 | 9/15/2010 |
Number | Date | Country | |
---|---|---|---|
60973457 | Sep 2007 | US | |
60988795 | Nov 2007 | US | |
61020106 | Jan 2008 | US | |
61025914 | Feb 2008 | US | |
61086167 | Aug 2008 | US | |
61043276 | Apr 2008 | US | |
61033145 | Mar 2008 | US | |
61073765 | Jun 2008 | US |