The present disclosure generally relates to visual-tactile sensing devices, and more particularly, but not exclusively, to robotic grippers that incorporate visual-tactile sensing devices.
Providing tactile information of a work piece derived from image data generated with a visual-tactile sensing pad along with proximity information of a work piece prior to engagement with the pad remains an area of interest. Some existing systems have various shortcomings relative to certain applications. Accordingly, there remains a need for further contributions in this area of technology.
One embodiment of the present disclosure is a unique visual-tactile sensing pad. Other embodiments include apparatuses, systems, devices, hardware, methods, and combinations for determining tactile information and proximity of work piece to a sensing device. Further embodiments, forms, features, aspects, benefits, and advantages of the present application shall become apparent from the description and figures provided herewith.
For the purposes of promoting an understanding of the principles of the invention, reference will now be made to the embodiments illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended. Any alterations and further modifications in the described embodiments, and any further applications of the principles of the invention as described herein are contemplated as would normally occur to one skilled in the art to which the invention relates.
With reference to
In more specific details, the present application provides for the use of a tactile sensor possessing a deformable surface structure wherein the deformation of the surface structure by contacting objects may be imaged by a proximate camera and wherein images may also be obtained through this surface structure to observe objects and features which are not in contact with the surface layer. Typically the deformable surface structure (e.g. the pad 54) will be substantially transparent and possess a coating at or near its surface which is reflective and possesses known optical characteristics so that the shape of this surface layer may be imaged directly without complication from unknown optical characteristics. This provides the system the ability to both sense objects in contact with the sensing surface and forces resulting therefrom and also the ability to sense objects and features that are beyond the surface of the sensor body. This enables enhanced sensing for applications such as robotic manipulation, metrology and surface measurement and characterization.
In the embodiments disclosed herein a sensor can be constructed utilizing a layer of deformable material possessing a top-coat which is substantially reflective for incident lighting with certain properties and substantially light-transmitting for incident lighting with different properties and a camera and lighting system which is placed behind this layer. When objects (e.g. the work piece 52) come into contact with the top of the pad 54 it causes deformation to the deformable material and top-coat of the pad 54 which is in turn imaged by the camera 56 and lighting system 58 using reflected light and optical features of objects both in direct contact with said structure and beyond said structure are imaged using transmitted light. Deformable materials include various materials such as are known in the art including siloxanes such as PDMS, soft polyurethanes, etc.
The performance of the pad 58 to control optical properties which return light to the camera system enable the computer imaging system (e.g. the controller 64) to more effectively image and calculate the geometric features corresponding to the surface deformation. In the present application the surface layer is constructed to return some of the light to the camera system from the surface layer and to let some light through in such a way that the light which is returned from the surface reflective layer can be substantially differentiated from light that that is transmitted through the surface layer.
In one or more of the embodiments herein such differentially distinguishable light signals can be created through a variety of mechanisms. For instance:
Turning now to
In embodiments disclosed herein, a layer may be included on top of the wavelength-selective reflective layer which acts to absorb some portion of the optical wavelengths which are reflected by the interference-reflective layer (e.g. a layer of dye dissolved in polymer) while allowing other wavelength spectra to pass through. This acts to enhance the spectral selectivity of such embodiments.
Embodiments disclosed herein include a rigid base 66, elastic layer 68, light layer 70, and spectrally absorbing layer 72. Although the camera 56 in
As will be understood, the term “camera” can refer to a variety of devices capable of detecting electromagnetic radiation, whether in the visible range, infrared range, etc. Such “cameras” can also refer to 2D and/or 3D cameras.
In some cases these lighting conditions are provided as a sequential series of illumination (e.g. blinking) provided from alternating lighting sources so that multiple lighting conditions can be utilized to maximize the processable information and the camera can obtain distinguishing light information in both spectral and temporal channels. Thus, the lights can be activated in an ON-OFF sequence which, in some forms, are coordinated with each other. To set forth just one non-limiting example, a first light can be activated to the ON condition while the second light is deactivated to the OFF condition, whereupon after an interval of time (which can be predetermined or determined as a result of system processing) the condition reversed with the first light deactivated to OFF while the second light is activated to ON. The above-described process can be repeated with the same or different interval. Such alternating can be sequences which results in a blinkering of lights.
The lighting system 58 (either a single light source or multiple light sources) can be structured to emit light (electromagnetic radiation) at a single wavelength or a range of wavelengths. As used herein the term “emit” or “emitting” or “emanate” or “emanating” is used to describe a process by which a material can either reflect light produced from another source, can produce light itself (e.g. infrared radiation if heated), or can be excited to produce light (e.g. fluorescence). To set forth just one example, a light source can be structured to emit light at a wavelength visible to a human eye (e.g. “visible light”), at infrared or near-infrared wavelengths, a combination of the same, or any other suitable wavelength(s). In some forms the lighting system can include a single light source capable of emitting any of the aforementioned wavelengths and/or ranges. In other forms multiple light sources can be used to emit light at any of the aforementioned wavelengths and/or ranges (which sources can emit at the same wavelengths and/or ranges or can overlap in at least some of the wavelengths and/or ranges). In some forms the lighting system can include an artificial light directly coupled with the imaging system described herein, as well as ambient sunlight, or any other source of light that may not be directly coupled to the imaging system described herein.
As discussed elsewhere in the present disclosure, variations of the lighting system 58 discussed with respect to
In another embodiment,
In another embodiment,
In yet another embodiment,
One aspect of the present application includes an apparatus comprising:
A feature of the present application includes wherein the light layer is structured to reflect the first electromagnetic wavelength.
Another feature of the present application includes wherein the light layer is structured to fluoresce upon receipt of the first electromagnetic wavelength and produce a fluorescent wavelength as a result, and wherein the spectrally absorbing layer is structured to absorb the fluorescent wavelength.
Still another feature of the present application includes wherein the light system includes two light sources.
Yet feature of the present application includes wherein the two light sources are disposed on opposite sides of the camera.
Still another feature of the present application further includes a controller, and wherein the controller is structured to activate the two light sources in an alternating manner such that when a first light source of the two light sources is ON then a second light source of the two light sources is OFF, and vice versa.
Yet still another feature of the present application includes wherein the rigid base is made of a polycarbonate material, wherein the elastic layer is polydimethylsiloxane (PDMS).
Still yet another feature of the present application includes wherein the light layer is layer of PDMS with entrained flakes of Xirallic T60-24 SW Stellar Green.
A further feature of the present application includes wherein the flakes are oriented substantially aligned to the plane of the surface of the elastic layer.
A still further feature of the present application includes wherein the spectrally absorbing layer is a dye layer, and the light layer includes non-selective optically scattering particles arranged in a morphological density so that the layer provides both back-reflection and allows transmission of the second wavelength.
Another aspect of the present application includes method of operating a visual tactile sensing device, comprising: emitting a light from a lighting system toward a visual-tactile contact pad of a robotic system, the robotic system including a camera for imaging a work piece and contact of the work piece with the visual-tactile contact pad; passing the light through a rigid base and an elastic layer coupled to the rigid base of the visual-tactile contact pad; emitting a first electromagnetic wavelength from a light layer which is attached to the elastic layer and in a direction toward the camera; absorbing the first electromagnetic wavelength in a spectrally absorbing layer attached to the light layer; passing a second electromagnetic wavelength through the spectrally absorbing layer toward the camera; deforming the elastic layer, light layer, and spectrally absorbing layer upon engagement of the work piece with the visual-tactile contact pad.
A feature of the present application includes wherein the emitting includes emitting light from a first light source of the lighting system and emitting light from a second light source of the lighting system.
Another feature of the present application includes wherein the emitting a first electromagnetic wavelength is from reflecting the first electromagnetic wavelength.
Still another feature of the present application includes wherein the emitting a first electromagnetic wavelength is from fluorescing the light layer as a result of excitation wavelength from the lighting system.
Yet another feature of the present application further includes controlling the light system to selectively activate and deactivate a plurality of light sources.
Yet another aspect of the present application includes an apparatus comprising: a visual tactile sensing device structured to develop data associated with an image of a work piece and tactile contours of the work piece, the visual tactile sensing device having: a camera structured to image a first electromagnetic wavelength and a second electromagnetic wavelength; a lighting system structured to produce light at the first electromagnetic wavelength and the second electromagnetic wavelength; a visual-tactile contact pad having a layered construction and structured to deform through at least some of the layers of the layered construction when in contact with the work piece, the visual-tactile contact pad having: a rigid base; an elastic layer coupled to the rigid base; a light layer coupled to the elastic layer such that the elastic layer is between the rigid base and the light layer, the light layer structured to emanate light as a result of the first electromagnetic wavelength and according to deformations in the light layer associated with the tactile contours of the work piece when the work piece engages the visual-tactile contact pad; and a spectrally absorbing layer coupled to the light layer such that the light layer is between the elastic layer and the spectrally absorbing layer, the spectrally absorbing layer structured to pass the second electromagnetic wavelength.
A feature of the present application includes wherein the light system includes two light sources.
Another feature of the present application further includes a controller configured to alternate light emanating from the two light sources.
Yet another feature of the present application includes wherein the elastic layer contacts the rigid base and the light layer, and wherein the rigid base is made of a transparent polycarbonate material.
Still another feature of the present application includes wherein the spectrally absorbing layer is a dye layer, and wherein the spectrally absorbing layer contacts the light layer.
Yet still another feature of the present application includes wherein the light layer is entrained with flakes of Xirallic Stellar Green, and wherein the spectrally absorbing layer includes an absorption maximum substantially overlapping the reflected light spectrum of the Xirallic Stellar Green flakes and includes a transmission characteristic in the spectrum which is not reflected by the Xirallic Stellar Green flakes.
Still yet another feature of the present application includes wherein the light layer includes nickel microparticles.
While the invention has been illustrated and described in detail in the drawings and foregoing description, the same is to be considered as illustrative and not restrictive in character, it being understood that only the preferred embodiments have been shown and described and that all changes and modifications that come within the spirit of the inventions are desired to be protected. It should be understood that while the use of words such as preferable, preferably, preferred or more preferred utilized in the description above indicate that the feature so described may be more desirable, it nonetheless may not be necessary and embodiments lacking the same may be contemplated as within the scope of the invention, the scope being defined by the claims that follow. In reading the claims, it is intended that when words such as “a,” “an,” “at least one,” or “at least one portion” are used there is no intention to limit the claim to only one item unless specifically stated to the contrary in the claim. When the language “at least a portion” and/or “a portion” is used the item can include a portion and/or the entire item unless specifically stated to the contrary. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2020/044213 | 7/30/2020 | WO |