The present invention refers to a robot having a movable, multi-membered robot structure that can be driven by means of actuators, in particular a robot arm, wherein the robot is adapted and designed in such a way that the robot, in an input mode, learns positions, poses and/or movement sequences of the movable robot structure by moving the robot structure through a user, within a work space of the robot. The learning process is also identified as a so called “teach-in” process.
In particular in modern robots, which interact with humans, positions, poses and/or motion sequences of movable, multi-membered robot structures are often provided to the robot by means of a “teach-in” process. During the “teach-in” process, the actuators of the driven robot structure are typically controlled in such a way that the robot structure is subject to a gravitational force compensation and the robot structure in an associated work space is otherwise essentially freely movable by a human. This typically occurs by means of torque regulation, force regulation or intrinsic driving back capacity of the robot.
In so called “teach-in” processes, a drawback is the limited speed and precision when learning positions, poses and motion sequences of a drivable movable robot structure.
The object of the invention is to provide a robot, which allows an improved “teach-in” process.
The invention is obtained from the characteristics of the independent claims. Advantageous developments and embodiments are defined in the dependent claims. Further characteristics, possible applications and advantages of the invention are provided in the following description, as well as by the explanation of exemplary embodiments of the invention, which are shown in the FIGURES.
A first aspect of the invention refers to a robot having a movable, multi-membered robot structure, which may be driven by actuators, wherein on the movable robot structure at least one marked structure element S with at least one point PS marked on the structure element S is defined.
The robot is adapted and designed in such a way that the robot, in an input mode, learns positions POSPS of point PS and/or poses of the structure element S within a work space of the robot, wherein the user, in order to move the structure element S, exerts an input force {right arrow over (F)}EING, which is conveyed to the point PS as {right arrow over (F)}EING,PS and/or which to the structure element S as torque {right arrow over (M)}EING,S.
Presently, the term “pose” is intended according to DIN EN ISO 8373. The pose of the structural element S is thus the combination of position and orientation of the structural element S in three-dimensional space.
The robot also has a control device, which is designed and adapted in such a way that in the input mode, the actuators are controlled on the basis of a predefined virtual 3D grid, at least partially filling the work space, in such a way that the structural element S is moved with a predefined force {right arrow over (F)}GRID(POSPS) according to the current position POSPS of point PS in the 3D grid to the adjacent grid point or into a volume of grid points defined around the adjacent grid point in the 3D grid, wherein the point PS of structural element S remains on said adjacent grid point or in said grid point space if the following holds true: |{right arrow over (F)}EING,PS|<|{right arrow over (F)}GRID(POSPS)|. The virtual 3D grid may, for instance, be fixed in space or time variable. The definition of the virtual 3D grid may vary autonomously, for example, due to switching conditions or due to an input by the user.
The current position POSPS of point PS relative to the 3D grid may for example be determined by means of a sensor system for detecting a current pose of the mobile robot structure or by evaluating the control parameters for controlling the actuators. Corresponding devices and methods are known in the art. The current position POSPS of point PS relative to the 3D grid is determined by a sensor system for determining the current pose of the mobile robot structure and a CAD data set of the robot structure and/or a surface model of the robot structure.
The current position POSPS of point PS in the 3D grid may be, according to the manual movement of the structural element S by the user, a position, which is between the grid points of the 3D grid, so that the force {right arrow over (F)}GRID(POSPS) predetermined for the 3D grid advantageously leads to an almost “raster” translational input of positions POSPS,Eing of point PS in work space, whenever the current position POSPS of point PS does not correspond to a grid point of the 3D grid or lies within a volume of grid points of the 3D grid, the actuators of the robot structure are controlled in such a way that the point PS is moved to the adjacent grid point or into the adjacent volume of grid points.
As an alternative, when the current position POSPS of point PS is set at the center of a symmetrical potential, wherein the forces {right arrow over (F)}GRID(POSPS) compensate each other, the point PS will remain in this position. By manual input by the user, the point PS may then be displaced in the direction of the adjacent grid point.
The storage of a position POSPS,Eing of point PS in a “teach-in” process advantageously only occurs when the position POSPS of point PS corresponds to a grid point of the 3D grid or the position POSPS of point PS is within a previously defined grid volume. The point PS almost locks into the grid points of the 3D grid or into the grid volumes of the 3D grid. Thus, the input or storage of positions POSPS,Eing of point PS is advantageously only possible with a spatial resolution corresponding to the predetermined 3D grid.
The storage or input of a position POSPS,Eing of point PS in a “teach-in” process advantageously occurs, even when the point PS is at a grid point or within a grid volume of the 3D grid, only when an input means connectable or connected to the robot is actuated by the user. This input means may be a key, for example.
If the value of force |{right arrow over (F)}EING,PS| which is transmitted by a user to point PS when moving the robot structure, is larger than the value of the predetermined force |{right arrow over (F)}GRID(POSPS)|, then the structural element or the robot structure may be moved in a translational way. If the value of force |{right arrow over (F)}EING,PS|, which is transmitted by a user to point PS in case of a movement of the robot structure, is smaller than the value of the predetermined force |{right arrow over (F)}GRID(POSPS)|, then the structural element S or the robot structure cannot be moved, or only within a predetermined area, and point PS remains at the adjacent grid point or within the corresponding grid volume of the 3D grid.
The term “3D grid” refers, in this case, to any 3D grid. The 3D grid may in particular be structured or unstructured, regular or irregular, orthogonal or non-orthogonal. In particular, the density of grid points of the 3D grid may vary spatially. The grid points of the 3D grid may vary with time t, i.e. the 3D grid is time variable.
As an alternative or additionally, the control device is designed and adapted in such a way that, in the input mode, the actuators are controlled according to a predetermined virtual discrete 3D-orientation space O, wherein the 3D orientation space O=: (αi, βj, γk) wherein i=1, 2, . . . , I, j=1, 2, . . . J, k=1, 2, . . . , K is or may be defined by predetermined angles αi, βj, γk such that the structural element S is moved by means of a torque {right arrow over (M)}o({right arrow over (O)}RS) predetermined by the current orientation {right arrow over (O)}RS of the structural element to the adjacent discrete orientation of the 3D orientation space O=: (αi, βj, γk), wherein the structural element S remains in this adjacent discrete orientation of the 3D orientation space O, if the following relationship is fulfilled: |{right arrow over (M)}EING,S|<|{right arrow over (M)}o({right arrow over (O)}RS)|.
The predetermined orientation space O=: (αi, βj, γk) is characterized in that it sets discrete orientations, which are defined or may be defined for example by predetermined discrete angles αi, βj, γk or angular combinations. The current orientation {right arrow over (O)}RS=α, β, γ of structural element S is typically an orientation between the predetermined discrete orientations of the 3D orientation space O=: (αi, βj, γk).
The torque {right arrow over (M)}o({right arrow over (O)}RS) generates no translation of the structural element S, but a new orientation of the structural element S. In other words, the torque {right arrow over (M)}o({right arrow over (O)}RS) causes a new orientation from any orientation {right arrow over (O)}RS=α, β, γ of structural element S to the adjacent discrete orientation {right arrow over (O)}N({right arrow over (O)}RS)=(αi, βj, γk) of orientation space O. The metric used as a base, which in the present case defines the “adjacency”, may be freely selected and may for example vary according to the orientation representation.
The current orientation {right arrow over (O)}RS of the structural element S with respect to the discrete 3D orientation space O may for example be determined by a sensor system for detecting a current orientation of structural element S or by evaluation of control parameters for controlling the actuators of the robot element. Corresponding devices and methods are known in the art.
The current orientation {right arrow over (O)}RS of structural element S relative to discrete 3D orientation space O may be, according to the manual movement of the structural element S by a user, an orientation, which lies between the discrete orientations of the 3D orientation space O, so that the torque {right arrow over (M)}O({right arrow over (O)}RS) advantageously gives rise to an almost “raster” orientation input in the work space, whenever the current orientation {right arrow over (O)}RS of structural element S does not correspond to a discrete orientation of the 3D orientation space, the actuators of the robot structure are controlled in such a way that the structure element S is moved or is oriented into the adjacent discrete orientation {right arrow over (O)}N({right arrow over (O)}RS) of the 3D orientation space O=: (αi, βj, γk).
In an advantageous embodiment, a plurality of structural elements Si of the movable robot structure and/or correspondingly associated points PS,i are defined, which are taken into account by the control device according to above said circumstances. This allows in particular a discrete input of poses and motion sequences of the entire movable robot structure.
All in all, the proposed robot allows, in the context of a “teach-in” process, a discrete and thus accurate input of positions, translations and/or rotations of the structural element or poses and/or movements of the structural element in an associated frame of reference. In particular a haptic feedback is provided to the “inputting” person (user), which advantageously emulates a linear or non-linear spring effect with a linear or non-linear damping effect which may be adjusted depending on needs, between the structural element S or point PS and the adjacent 3D grid point or the adjacent discrete orientation {right arrow over (O)}N({right arrow over (O)}RS) of the 3D orientation space. In absence of external forces or torques acting on the robot element or the structural element S, point PS or structural element S “snaps” into the adjacent 3D grid point or in the adjacent 3D grid point volume or in the adjacent discrete orientation {right arrow over (O)}N({right arrow over (O)}RS) of the 3D orientation space O.
Advantageously, the increments (step width) for the discrete input of translations and/or rotations/orientations may be set variably. In other words, the grid distances in the 3D grid or the discrete angles αi, βj, γk of the 3D orientation space O may advantageously be set variably.
Such a robot allows in particular a fast, precise and repetitive input of positions, poses or sequences of movements of the movable robot structure.
The robot structure is advantageously a robot arm, in particular a multi-member robot arm. The structural element S may essentially be a part of the robot arm. Advantageously, the structural element S is an end effector of a robot arm. The robot structure may comprise branching movable elements, such as a robot hand. The robot structure may comprise non-actuating driven structural members.
In an embodiment of the proposed robot, the structural element S is the end effector of a robot arm and point PS is the so called “tool center” point TCP of the end effector. In this embodiment, a discrete and thus accurate input of positions and translations of “tool center” point TCP is thus possible.
The predetermined force {right arrow over (F)}GRID(POSPS) varies periodically within the 3D grid. The force {right arrow over (F)}GRID(POSPS) virtually engages position PS of structural element S and depends, in particular, on the current position POSPS of point PS in the 3D grid. Obviously, the predetermined force {right arrow over (F)}GRID(POSPS) in the 3D grid may also be set, according to requirements and application, in an aperiodic way or in a mixed form (periodic and aperiodic) in the work space of the robot.
Advantageously, a maximum value |{right arrow over (F)}GRID|max and/or a minimum value |{right arrow over (F)}GRID|min of force {right arrow over (F)}GRID(POSPS) is set for the entire 3D grid or selected regions thereof, so that the following holds: |{right arrow over (F)}GRID|min<|{right arrow over (F)}GRID(POSPS)|<|{right arrow over (F)}GRID|max. The maximum value |{right arrow over (F)}GRID|max and/or the minimum value |{right arrow over (F)}GRID|min are chosen such that an involuntary or unmotivated input or movement of point PS may be avoided, and at the same time the value |FEING,PS| of the input force {right arrow over (F)}EING(PS) required for moving point PS by the user is perceived as comfortable, wherein a movement of point PS always requires that: |{right arrow over (F)}EING,PS|>|{right arrow over (F)}GRID(POSPS)|.
Advantageously, the grid points of the 3D grid and/or the distances of grid points in the 3D grid may be variably set by means of an input device of the robot, for example individually or for regions of the work space of the robot. In particular, spatial regions of the work space of the robot may be provided, for achieving a higher resolution, in individual spatial regions, with a denser 3D grid (i.e. more grid points per volume unit) than in other regions. The robot advantageously comprises an input device with access to a storage unit, in which the various 3D grids are stored, which may be selected through the input device.
Advantageously, the force {right arrow over (F)}GRID(POSPS) may be set in a variable way by means of an input device. For example, the force {right arrow over (F)}GRID(POSPS) may be set for positions POSPS within a unit cell of the 3D grid and may be transferred to the 3D grid or partial regions of the work space.
The control device is advantageously configured and designed so that if at least two adjacent grid points or grid point volumes of the 3D grid are positioned at the same distance from the current position POSPS of point PS in the 3D grid, one of these grid points/volumes is selected as the adjacent grid point/volume according to a predefined method. Such a decision may occur based on a random algorithm, i.e. in a statistical way. Obviously, different selection algorithms may be used according to the specific application.
Advantageously, the control device is embodied and set up in such a way that a virtual 3D potential field is defined in the work space whose local minima are identical to the grid points of the 3D grid, wherein the force {right arrow over (F)}GRID(POSPS) is determined resulting from the negative gradient of this potential field. The potential field can be specified according to task and application.
Advantageously, the local minima of the 3D potential field have a constant potential around each grid point of the 3D grid in a given spatial area, wherein the predetermined spatial area has a greatest extent that is smaller than the grid spacing between two adjacent grid points of the 3D grid.
Advantageously, a maximum amount |{right arrow over (M)}O|max and/or a minimum amount |{right arrow over (M)}O|min of the predetermined torque {right arrow over (M)}O({right arrow over (O)}RS) is set for the 3D orientation space O or selected ranges thereof, so that: |{right arrow over (M)}O|min<|{right arrow over (M)}O({right arrow over (O)}RS)|<|{right arrow over (M)}O|max. The maximum amount |{right arrow over (M)}O|max and/or the minimum amount |{right arrow over (M)}O|min of torque {right arrow over (M)}O({right arrow over (O)}RS) can advantageously be variably predetermined by the respective user via an input means of the robot. Advantageous |{right arrow over (M)}O|max and/or |{right arrow over (M)}O|min are such that accidental or unmotivated reorientations of the structure element S are avoided, and at the same time the value |{right arrow over (M)}EING({right arrow over (O)}RS)| of the required torque {right arrow over (M)}EING({right arrow over (O)}RS) for a reorientation of the structural element S is perceived by the user to be pleasant, wherein a reorientation of the structural element S always requires: |{right arrow over (M)}EING({right arrow over (O)}RS)|>|{right arrow over (M)}O({right arrow over (O)}RS)|.
In an embodiment of the robot, the orientation space O=: (αi, βj, γk) is defined as a function of the current position POSPS of the point PS:
O=O(POSPS)=(αi(POSPS),βj(POSPS),γk(POSPS)).
This allows the specification different discrete orientation spaces depending on the position POSPS of the point PS in the work space.
Advantageously, the robot comprises an input device by means of which distances of the grid points of the 3D grid can be variably predetermined.
Advantageously, the robot comprises an input device by means of which discrete angles αi, βj, γk of the orientation space O can be variably predetermined.
Advantageously, the control device is embodied and configured such that, in the event that at least two adjacent orientations O=: (αi, βj, γk) have the same differences from the current orientation {right arrow over (O)}RS of the structural element S, one of these orientations O=: (αi, βj, γk) is selected according to a predetermined method.
A further aspect of the invention relates to a method for controlling a robot so which has a movable, multi-membered, robot structure, which may be driven by actuators, wherein at least one marked structural element S with at least one point PS marked on the structural element is defined on the movable robot structure, and the robot learns, in an input mode, positions POSPS of the point PS and/or poses of the structural element S in a work space of the robot, wherein the user, for moving the structural element S, exerts an input force {right arrow over (F)}EING on the movable robot structure, which is conveyed to the point PS as {right arrow over (F)}EING,PS and/or to the structural element S as a torque {right arrow over (M)}EING,S.
In the proposed method, the actuators are actuated in the input mode on the basis of a predetermined virtual 3D grid which at least partially fills the work space such that the structural element S is moved by a force {right arrow over (F)}GRID(POSPS) depending on the current position POSPS of the point PS in the 3D grid to the adjacent grid point of the 3D grid, or into a volume of grid points defined around the adjacent grid point of the 3D grid, wherein the point PS of the structural element S remains in this adjacent grid point or in this grid point volume in the case where: |{right arrow over (F)}EING,PS|<|{right arrow over (F)}GRID (POSPS)|.
Alternatively or additionally, the actuators in the input mode are controlled based on a predetermined virtual discrete 3D orientation space O, wherein the 3D orientation space O=: (αi, βj, γk) with i=1, 2, . . . , I, j=1, 2, . . . J, k=1, 2, . . . , K is defined or definable by predetermined angles αi, βj, γk, controlled in such a way that the structural element S is moved by a predetermined torque {right arrow over (M)}O({right arrow over (O)}RS) depending on the current orientation {right arrow over (O)}RS of structural element S to the adjacent discrete orientation of the 3D orientation space O=: (αi, βj, γk), wherein the structural element S remains in this adjacent discrete orientation of the 3D orientation space O in the case where: |{right arrow over (M)}EING,S|<{right arrow over (M)}O({right arrow over (O)}RS).
In the proposed method, a virtual 3D potential field is advantageously defined in the work space, whose local minima are identical to the grid points of the 3D grid, wherein the force {right arrow over (F)}GRID(POSPS) is determined from the negative gradient of this potential field.
In a further development of the method, the local minima of the 3D potential field have a constant potential in a predetermined space region around each grid point of the 3D grid, wherein the spatial area has a greatest extent, which is smaller than the grid spacing between two adjacent grid points.
In a development of the method, if at least two adjacent orientations O=: (αi, βj, γk) have the same differences from the current orientation {right arrow over (O)}RS of the structural element S, one of these orientations O=: (αi, βj, γk) is selected according to a predetermined method.
Further developments of the proposed method and the resulting advantages result from an analogous and corresponding transfer of the statements made above for the proposed robot.
Another aspect of the invention relates to a robot controller, wherein the robot controller is configured such that a method as described above is performed on a data processing device.
Another aspect of the invention relates to a computer system having a data processing device, wherein the data processing device is configured such that a method as described above is executed on the data processing device.
A further aspect of the invention relates to a regulation device for controlling a robot, which has a movable, multi-membered robot structure, which may be actuated by means of actuators, wherein on the movable robot structure at least one marked structural element S with at least one point PS marked on the structural element S is defined, wherein the robot is designed and configured in such a way that the robot learns in input mode positions POSPS of the point PS and/or poses of the structural element S in a work space of the robot, wherein the user, for moving the structural element S, exerts an input force {right arrow over (F)}EING on the movable robot structure, which is conveyed to the point PS as {right arrow over (F)}EING,PS and/or which is conveyed to the structural element S as a torque {right arrow over (M)}EING,S.
The regulation device comprises a control device which is embodied and set up such that in the input mode the actuators are controlled on the basis of a predetermined virtual 3D grid which at least partially fills the work space such that the structural element S is moved with a predetermined force {right arrow over (F)}GRID(POSPS) which depends on the current position POSPS of the point PS in the 3D grid, to the adjacent grid point of the 3D grid or into a volume of grid points defined around the adjacent grid point of the 3D grid, wherein the point PS of the structural element S remains at the adjacent grid point or in this grid point volume, if: |{right arrow over (F)}EING,PS|<|{right arrow over (F)}GRID (POSPS), and/or the actuators in the input mode are controlled based on a predetermined virtual discrete 3D orientation space O, wherein the 3D orientation space O=: (αi, βj, γk) with i=1, 2, . . . , I, j=1, 2, . . . J, k=1, 2, . . . , K is defined or definable by predetermined angles αi, βj, γk, controlled in such a way that the structural element S is moved by a predetermined torque {right arrow over (M)}O({right arrow over (O)}RS) depending on the current orientation {right arrow over (O)}RS of structural element S to the adjacent discrete orientation of the 3D orientation space O=: (αi, βj, γk), wherein the structural element S remains in this adjacent discrete orientation of the 3D orientation space O in the case where: |{right arrow over (M)}EING,S|<|{right arrow over (M)}O({right arrow over (O)}RS)|.
Further developments of the proposed regulation device and the resulting advantages result from an analogous and conformal transfer of the above explanations.
The invention further relates to a digital storage medium with electronically readable control signals, wherein the control signals can interact with a programmable computer system such that a method as described above is carried out.
The invention further relates to a computer program product having program code stored on a machine-readable support for carrying out the method, as described above, when the program code is executed on a data processing device.
Finally, the invention relates to a computer program with program codes for carrying out the method, as described above, when the program runs on a data processing device. For this purpose, the data processing device can be designed as any computer system known from the prior art.
Further advantages, features and details emerge from the following description, in which at least one exemplary embodiment is described in detail, if necessary with reference to the drawing. The same, similar and/or functionally identical parts are provided with the same reference numerals.
In the drawings:
The robot structure 102 is presently a five-membered robot arm 102 at the distal end of which an effector S is arranged. In the present case, the effector S is the structural element S. At the effector S, a so-called “Tool Center Point”=TCP is defined, which is identical to the marked point PS=PTCP.
The robot is designed and set up in such a way that in an input mode the robot can learn positions POSTCP of the TCP and/or poses of the effector S in a work space of the robot, whereby the user, in order to move the effector S, exerts a force {right arrow over (F)}EING on the robot arm, which is conveyed to the point PTCP as {right arrow over (F)}EING,TCP and/or to the effector as {right arrow over (M)}EING,S.
The robot further comprises a control device which is embodied and configured in such a way that in the input mode the actuators 101 are controlled on the basis of a predetermined spatially fixed 3D virtual grid which at least partially fills the work space such that the effector S is moved with a given force {right arrow over (F)}GRID(POSTCP), which is dependent on the current position POSTCP of the tool center point TCP in the 3D grid, to the adjacent grid point of the 3D grid, wherein the point PTCP of the structural element S remains at this adjacent grid point if: |{right arrow over (F)}EING,PS|<|{right arrow over (F)}GRID(POSPS)|.
Moreover, the control device is configured in such a way that the actuators in the input mode are controlled based on a predetermined virtual discrete 3D orientation space O, wherein the 3D orientation space O=: (αi, βj, γk) with i=1, 2, . . . , I, j=1, 2, . . . J, k=1, 2, . . . , K is defined or definable by predetermined angles αi, βj, γk, controlled in such a way that the structural element S is moved by a predetermined torque {right arrow over (M)}O({right arrow over (O)}RS) depending on the current orientation {right arrow over (O)}RS of structural element S to the adjacent discrete orientation of the 3D orientation space O=: (αi, βj, γk), wherein the structural element S remains in this adjacent discrete orientation of the 3D orientation space O in the case where: |{right arrow over (M)}EING,S|<|{right arrow over (M)}O({right arrow over (O)}RS)|.
Although the invention has been detailed and explained by means of preferred exemplary embodiments, it is understood that the invention is not limited by the disclosed examples and that other variations may be derived by those skilled in the art, without leaving the protection scope of the invention. It is thus clear that a multiplicity of possible variants exists. It is also clear that the exemplary embodiments only represent examples, which are not intended to limit the protection scope, the possible applications or the configuration of the invention. The previous description and the description of the figures are actually construed in order to allow those skilled in the art to put the exemplary embodiments into practice, wherein those skilled in the art, based on the knowledge of the disclosed inventive idea, may introduce various modifications, for example regarding the functionality or the arrangement of individual elements cited in an exemplary embodiment, without leaving the protection scope, which is defined by the claims and their legal equivalents, as for example in a further explanation of the invention.
Number | Date | Country | Kind |
---|---|---|---|
10 2015 118 918.6 | Nov 2015 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2016/075674 | 10/25/2016 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2017/076697 | 5/11/2017 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5980082 | Watanabe et al. | Nov 1999 | A |
9272417 | Konolige | Mar 2016 | B2 |
20110015649 | Anvari | Jan 2011 | A1 |
20140025197 | Mattern | Jan 2014 | A1 |
20150081098 | Kogan | Mar 2015 | A1 |
20150331415 | Feniello | Nov 2015 | A1 |
20170021500 | Davis | Jan 2017 | A1 |
20170160721 | Gombert et al. | Jun 2017 | A1 |
Number | Date | Country |
---|---|---|
1205934 | Jan 1999 | CN |
1831468 | Sep 2006 | CN |
102216860 | Oct 2011 | CN |
102601684 | Jul 2012 | CN |
102785246 | Nov 2012 | CN |
104457566 | Mar 2015 | CN |
3606685 | Nov 1988 | DE |
4408982 | May 1995 | DE |
0440588 | Aug 1991 | EP |
H01175608 | Jul 1989 | JP |
1999-254361 | Sep 1998 | JP |
2002-73130 | Mar 2002 | JP |
2009-297853 | Dec 2009 | JP |
2017-504494 | Feb 2017 | JP |
WO-2015113757 | Aug 2015 | WO |
Entry |
---|
Conkur, “Path Planning Using Potential Fields for Highly Redundant Manipulators”, Robotics and Autonomous Systems, vol. 52, Issues 2-3, pp. 209-228, Aug. 31, 2005. |
Biagiotti et al., “A Multimodal Haptic Mouse for Visually Impaired People”, Proceedings Enactive, Nov. 17, 2005. |
International Search Report dated Jan. 20, 2017 for PCT Application No. PCT/EP2016/075674. |
International Preliminary Report on Patentability dated May 17, 2018 for PCT Application No. PCT/EP2016/075674. |
Number | Date | Country | |
---|---|---|---|
20190061148 A1 | Feb 2019 | US |