The present invention relates to a three dimensional structure with sensor capability and devices incorporating such structure. It is particularly, but not exclusively, concerned with structures for artificial limbs which provide for sensor capability on those limbs.
Conventionally, to provide a structure such as a robotic hand with sensor capability so as to allow it to obtain information about the environment or object that it comes into contact with, discrete sensors and/or sensor electronics on rigid or flexible substrates are placed on the exterior of the structure.
An existing technology that takes a different approach to sensors on robotic hands is the BioTac®, produced by SynTouch LLC of Los Angeles, Calif. and described in, for example, U.S. Pat. Nos. 7,658,119B and 7,878,075B.
As shown in
An object of the present invention is to provide structures having sensor capability which allow sensing of the environment around the structure by detectors which are remote from the location being sensed.
A further object of the present invention is to provide structures with sensor capability which have reduced requirements for wiring and electrical connections on or within the structure.
A further object of the present invention is to provide methods of manufacturing three dimensional devices having sensor capability.
At its broadest, aspects of the present invention provide a sensor having a plurality of channels which provide communication pathways between the point of interaction of the sensor and the detectors and robot arms and prosthetics incorporating such devices.
A first aspect of the present invention provides a device for sensing interaction with its surrounding environment, the device including: a plurality of sensing points; a plurality of detectors, each associated with one of said sensing points and located remotely therefrom; a plurality of channels which connect said sensing points to said detectors and provide a communication pathway there-between; and communication media filling the channels, wherein each detector is in communication with the associated sensing point or points through one of said channels and the medium in said channel is arranged to transmit, transfer or transduce an interaction of the sensing point with its surrounding environment to the detector through the channel.
Devices according to the present aspect integrate sensing points and sensors within the structure of the device (rather than adding an extra sensing layer to the structure).
In embodiments of the first aspect, the plurality of channels can be realized within 3D printed structures, and the channels can be filled with communication media which transduce the information from a sensing point to the point/region where the detector and/or embedded electronics are located.
The arrangement of the device of the present aspect can also help overcome the traditional problems associated with the wiring when providing sensors on a robot arm or prosthetic which is the number of wires required to convey information from a plurality of sensors and the need to accommodate those wires within a “skin” that conforms to the surface.
By providing the actual detectors remotely from the sensing point, the size of the detectors is less important (for example because it does not interfere with or affect the sensing functions), which means that cheaper and/or more sensitive detectors can be used.
Therefore, when enabling the device of the present aspect, the complexity of the wiring and the electronics can be reduced compared to existing arrangements.
In preferred embodiments of the present aspect, the communication media in at least one of the channels, and optionally more, including all the channels, are fluids (preferably liquids, but they may also be gases such as air). However, the media may also be solids, including gels, elastomers and other polymer materials such as Polydimethylsiloxane (PDMS) or composites or silica based waveguides or fibre optics, which can transduce through light.
The device may also have reservoirs associated with one or more (preferably each) of the sensing points to provide a store of the communication medium. The channels may then link the reservoirs to the detectors. In certain embodiments the reservoir may simply be a region at the end of the channel closest to the sensing point.
By using distributed interfaces, devices according to the present aspect may be able to obtain a precise localised point of tactile input (or other sensed interaction). It may also be possible to carry out frequency domain analysis to determine, for example, the texture of a surface which is contacted by the device
Preferably the interaction of the sensing point with its surrounding environment causes a change in a property of the communication medium in said reservoir and/or channel, and the detectors are arranged to detect changes in said property of the medium.
In certain embodiments there are at least two types of said detectors, each type of detector being arranged to detect a different change in a property of the medium. Thus the device can detect different interactions with the environment at different ones of the sensing points, providing a range of different information.
In a particularly preferred selection of embodiments, the interaction for at least one of said sensing points is touch, and the detector associated with said at least one sensing point is a pressure sensor arranged to detect a change in pressure of the communication medium. Touch sensitivity is particularly important for robot arms and prosthetics.
In certain embodiments of the device, the channels have a larger cross section where they connect to the sensing point than they do where they connect to the detectors. This arrangement is particularly relevant to touch sensing as it allows the interaction of the sensing point to be magnified at the detector due to the narrowing of the channel between the sensing point and the detector.
Preferably the communication medium in the channels is substantially incompressible. This allows the fluid to accurately transduce the interaction at a sensing point to a detector.
In certain embodiments at least one of the detectors is arranged to detect at least one of the following in or passing through the communication medium: electromagnetic radiation, including infra-red, visible and ultra-violet radiation; electrical properties, including changes in electrical potential and conductivity; magnetic properties; radioactivity and changes resulting from radioactive interactions. Such detectors allow a wide range of interactions with the environment surrounding the sensing points to be detected or monitored.
In certain embodiments the device includes a transmitter which is arranged to transmit radiation to the surrounding environment of the device, wherein at least one of the detectors is arranged to detect the interaction of said transmitted radiation with the surrounding environment in the vicinity of an associated sensing point.
In particular, the transmitter may be arranged to transmit said radiation through the communication medium in one of said channels.
Preferably the sensing points are arranged in a regular pattern on one surface of the device.
In certain embodiments the sensing points may be arranged on a first surface of the device and the detectors may be arranged on a surface substantially opposite said first surface. For example the sensing points may be on the “front” of the “hand” of a prosthetic and the detectors arranged on the “back”.
The device may further include a processor, wherein the processor is arranged to process signals from said detectors. The processor is preferably arranged to process the signals from at least two of said detectors and use said processed signals in combination in order to determine information about the surrounding environment. The processor may be adapted to use hardware or software neural networks for pattern recognition or neuronal sensing, or to interact with such networks.
The device of the present aspect may include any combination of some, all or none of the above described preferred and optional features.
Further aspects of the present invention provide a robotic arm having a device according to the above first aspect, including some, any or all of the optional or preferred features of that aspect and a prosthetic having a device according to the above first aspect, including some, any or all of the optional or preferred features of that aspect.
The use of bio-inspired devices such as those in the first aspect above may give an effective tactile feedback for robotic manipulators and prosthetics.
A further aspect of the present invention provides a method of manufacturing a structure for a sensing device, the method including the steps of: forming, by an additive manufacturing process, a device having: a body; a plurality of reservoirs within said body designed to accommodate a communication medium and having at least one side located on the exterior of the finished device, said at least one side being formed from a different material to the body; and a plurality of channels connected to said reservoirs and passing at least partly through the body, and filling said reservoirs and said channels with a communication medium.
The structure for the sensing device may be a device according to the above described first aspect, including some, any or all of the optional or preferred features of that aspect.
The device of the first aspect is particularly suitable for manufacturing by an additive manufacturing process as this allows the channels to be formed in the device when it is constructed as well as allowing the different materials of the body and the at least one side to be co-formed.
The reservoirs may provide a store of the communication medium. In certain embodiments the reservoir may simply be a region at the end of the channel closest to the sensing point.
Preferably the at least one side is a flexible material once formed and the body is a rigid material once formed. The flexible material may then form the sensing point for, for example, a touch sensor.
In preferred embodiments of the present aspect, the communication medium is a fluid (preferably a liquid, but may also be a gas such as air). However, the medium may also be a solid, including a gel, elastomer and other polymer material.
The method of the present aspect may include any combination of some, all or none of the above described preferred and optional features.
A further aspect of the present invention provides an apparatus for manufacturing a structure for a sensing device, the apparatus having: an additive manufacturing unit which has: a supply of raw material; a moveable forming head for depositing raw material in a shape to be formed; a conduit for passing raw material from the supply to the forming head; and a curing device for curing the raw material into a final form, and a media-filling unit which has: a supply of a communication medium; a moveable filler head; and a conduit for passing the medium from the supply to the filler head, and a processor arranged to control the movement of said forming head and said filler head and to control the supply of raw material and communication medium.
The apparatus may be operated in accordance with a method according to the above described aspect, including some, any or all of the optional or preferred features of that aspect.
In certain embodiments, the apparatus has two supplies of raw material and/or two supplies of communication media and the processor is arranged to control which of said raw materials and/or said communication media is supplied. Thus different materials in the structure can be co-formed as part of the same additive manufacturing process, and parts of the sensing device which are going to form sensors can be filled with different fluids depending on the type of sensor desired.
In preferred embodiments of the present aspect, the communication medium or media are fluids (preferably liquids, but they may also be gases such as air). However, the media may also be solids, including gels, elastomers and other polymer materials.
The apparatus of the present aspect may include any combination of some, all or none of the above described preferred and optional features.
Embodiments of the invention will now be described by way of example with reference to the accompanying drawings in which:
Each finger 20 has a plurality of sensory protrusions 21 at the edge of the finger, each formed of an elastomeric material and enclosing a fluid reservoir (not visible in
The images in
The distributed embedded fluidic channels 24 inside the structure act as a medium to carry or transfer the physical parameters of interest such as pressure, temperature, ambient light etc. from the sensory protrusions 21 to the sensing region(s) 25 which is at a different location within the structure of the device.
In the embodiment shown in
Although an obvious use for the devices of the above embodiments is to sense touch through transmission of pressure through fluid in the channels, many other arrangements are possible both to detect other interactions of the device, and also to measure or monitor touch.
For example, in addition to using electronic sensing of pressure, visual imaging techniques could be used to determine or measure the amount of contact force and/or the area of contact with the sensory protrusion. This can be done by having a resilient membrane at the sensor end of the channel (remote from the sensing point) and video recording the change in the size of the liquid “bubble” at that position.
In this (and other embodiments), the optical sensing/probing electronics at the detector side could be a single photodetector, or 1D/2D array of optical sensors acting as a camera and/or with digital micromirror devices (DMD) and/or with other photonic devices.
Further embodiments of the invention use material in the channels which has an inherent sensing property such as change in its optical, electrical or any other physical parameters.
In particular, different channels within the same device may be used to measure different contact parameters. This can make the device effectively start to mimic human skin, which is able to measure multiple parameters.
However, in the embodiments of the present invention, it is possible to go beyond the abilities of human skin as some of the channels could be used to measure parameters that are not possible with human skin and this may result in much wider scope of sensing devices according to embodiments of the present invention. For example, liquid sensitive to radiation or light could be used to measure additional parameters.
Further, the channel structure itself can be designed depending on the interaction that is being sensed and the fluid(s) and sensor(s) used.
For example, as shown in the embodiment illustrated in
One advantage of this approach is that it can relax constraints on the sensors and associated electronics in terms of amplification, which may further simplify the electronics and/or make the sensors or electronics cheaper.
Table 1 below sets out a wide range of materials which can be used in the channels of devices according to embodiments of the invention, depending on the target application. For some sensing mechanisms it may be desirable to have heterogeneous integration of two or more materials of different types.
An example of such a configuration is where a 3D printed fluidic/flexible interface such as optic material within the finger can be used as a pathway for laser or LED light guided through the channel containing that material via total internal reflection or scattering/reflection. The light may then hit the object being touched (or in near proximity) and then collected, either through the same pathway or using a different channel.
This configuration can result in infrared sensing or composition detection sensors positioned at the tip of the robotic hand's “finger”. This configuration can also be used to detect the type of material contacted by artificial finger as frequency shifts (which vary with contact materials) may be used as a “signature” of the material in contact with the finger and by comparison with a reference database, then the type of material determined.
Further embodiments of the present invention relate to methods of manufacturing a sensing device and apparatuses for manufacturing sensing devices. Examples of these embodiments will now be described with reference to
Using an additive manufacturing process such as 3D printing the body of the device and the embedded fluidic interfaces can be co-printed/co-fabricated using a flexible/fluidic material while printing the rigid body. Alternatively, the device could be fabricated in a two-step process by first making the rigid body then filling it with the fluidic/flexible material.
The structural materials for the device may be, for example, metals and metal alloys (e.g. Titanium, Stainless Steel etc.) or plastics (e.g. ABS, PLA etc.). All of these can be fabricated using a 3D printing process. However, they may also be thermoformed or made through other conventional fabrication methods.
The printing head 31 and syringe 32 are movable and controlled in multi-dimension space by a controller (not shown) driving precision motors on a support frame 33 to position them correctly at all times during the manufacturing process.
The printing head 31 is connected via a multi-material extruder (which is also controlled by the controller) 34 to a plurality of material sources 35. The materials contained in the material sources 35 may have different colours, but may also have different properties when extruded or laid. For example, at least one of the materials may be elastomeric when printed and thus can be used to form the surface of a sensory protrusion on a device, whilst another of the materials may form a strong rigid structure and be used for the framework of the device.
The syringe 32 is connected to a plurality of fluid reservoirs 37 through a motorized syringe pump 36 (also controlled by the controller). The fluid reservoirs contain fluids which are to be filled into the channels in the device and may have different sensory properties, for example as described in Table 1 above.
The apparatus may also have a laser head (not shown) for localized annealing wherever necessary.
When manufacturing a device according to an embodiment of the present invention, the controller positions the printing head 31 in three-dimensional space according to a pre-programmed design for the device and extrudes material from the material sources 35. The printing head 31 moves to form the body of the device (including the channels within that structure). Complex 3D structures (e.g. channels of varying cross-section) can be readily achieved using 3D printing (or other additive manufacturing techniques).
The printing head may also form the sensory protrusions (or other configurations of the sensing points) from a different material to that of the body of the device, for example from an elastomeric material or from a material that is transparent to certain radiation. Thus the sensing points can be co-formed with the body of the device and the possibility of fluid leakage from the channels substantially reduced or eliminated.
Once channels within the body of the device have been formed by the printing head 31, the syringe 32 is moved into a position where it can fill the channels. This may be by leaving a small hole in the end of the channel through which the fluid is injected, or by allowing gravity fill of the channel by the orientation in which the device is manufactured. The controller controls the position of the syringe and the selection of fluid such that each channel can be filled with a selected fluid from the fluid reservoirs 37 according to the intended sensing function of the channel. The channel may then be sealed (at least temporarily) by further deposition from the printing head 31.
Whilst the above embodiments have been described in relation to a prosthetic hand 10, and prosthetics are important embodiments of the present invention, it will be appreciated that the sensing device need not have an anthropomorphic shape and configuration and embodiments of the invention include robots and sensing devices on robots, which could be formed on any part of the robot and in any shape or configuration. Devices of this nature can be used in a wide range of applications including aerospace, marine/wind turbines, nuclear energy, environment monitoring etc.
In the case of prostheses, the parameters of interest related to tactile sensing are pressure, temperature and humidity etc. However, for robotic applications, this may go beyond the requirement of prosthetics where the robotic limbs will be useful for applications such as fruit sorting, or material/structural defect identification in an industrial environment etc. Various conventional fabrication materials as well as smart materials could be useful for such applications.
While the invention has been described in conjunction with the exemplary embodiments described above, many equivalent modifications and variations will be apparent to those skilled in the art when given this disclosure. Accordingly, the exemplary embodiments of the invention set forth above are considered to be illustrative and not limiting. Various changes to the described embodiments may be made without departing from the spirit and scope of the invention.
Techniques such as injection moulding or metal casting could be used as an alternative manufacturing technique to produce a sensing structure made up of flexible and rigid polymers. These methods may be suitable for manufacturing the sensing device (e.g. as described in the above embodiments) in view of their higher volume (mass production) compared to 3D printing techniques. A metallic mould (cavity) is prepared as per the required design specification which is used for the production process. This mould is filled with the required plastic or metal material depending on the type of fabrication. The same mould could be used to produce thousands of pieces of the sensing structure. The channels and reservoirs can then be filled with the sensory materials in the second step.
All references referred to above are hereby incorporated by reference.
Number | Date | Country | Kind |
---|---|---|---|
1707743.9 | May 2017 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2018/062346 | 5/14/2018 | WO | 00 |