The present disclosure relates to a robot system.
Conventionally, robot control systems utilizing a tactile sense are known. For example, a manipulating device which manipulates a mobile robot, while obtaining a force feedback between a joystick and the mobile robot, is known (e.g., see Patent Document 1). Moreover, a robot hand provided with a tactile sensor system is known (e.g., see Patent Document 2). Moreover, a pressure-distribution information detecting device which is provided with tactile sensors at a robot hand thereof, and controls the robot hand based on a pressure distribution detected by the tactile sensors, is known (e.g., see Patent Document 3).
However, these conventional technologies still have room for an improvement in terms of practicality.
One purpose of the present disclosure is to improve practicality of a robot system in which the robot is remotely controlled based on tactile information defined by a pressure distribution.
The present inventors have diligently examined the problems described above in order to solve them. The present inventors have focused on a work which is performed by a human utilizing not a “force sensation” that is simply a force or pressure, but an essential “tactile sense,” i.e., senses, such as a degree of smoothness (uneven or irregular feel), a degree of friction (rough feel or smooth feel), etc. Such a work may be, for example, a work in which, when repairing a damaged member by smoothening the damaged surface, the damaged surface is finished while checking the degree of smoothness of the damaged surface with the tactile sense of a hand, a work in which the degree of smoothness of the surface of a member is inspected with the tactile sense of the hand, etc. The degree of smoothness (uneven feel) and the degree of friction (rough feel or smooth feel) are tactile senses defined by a pressure distribution which the human senses.
On the other hand, the manipulating device disclosed in Patent Document 1 controls using the “force sensation,” but does not use the essential “tactile sense.” The robot hand disclosed in Patent Document 2 uses the “tactile sense” defined by the pressure distribution, but it is difficult to control the operation of the robot hand exactly like the human performing the work because an arithmetic processor controls the operation of the robot hand based on detection outputs of the tactile sensors. The pressure-distribution information detecting device disclosed in Patent Document 3 is also difficult to control the operation of the robot hand exactly like the human performing the work because a behavior control device controls the operation of the robot hand based on the pressure distribution detected the tactile sensors similar to the robot hand disclosed in Patent Document 2.
Therefore, the inventors have arrived at that a human judges operation to be performed by a robot hand based on detection outputs of a tactile sensors provided to a robot hand, and instructs exact operation to the robot hand. This enables the operation of the robot hand to be controlled exactly like the human performing the work.
Therefore, a robot system according to one aspect of the present disclosure includes a robot including a tactile sensor having a plurality of pressure sensors arranged at mutually different spatial positions, and a hand having the tactile sensor, a robot controller configured to control operation of the hand of the robot according to robot manipulating information, a manipulator configured, when an operator operates the manipulator to manipulate the hand of the robot, to transmit to the robot controller the robot manipulating information according to the operation, a tactile information processor configured to generate tactile information defined by a pressure distribution based on pressures detected at least the plurality of pressure sensors and spatial positions of the plurality of pressure sensors, convert the tactile information into sensible tactile information that is sensible by the operator, and output the sensible tactile information, and a sensible tactile information presenting part configured to present to the operator the sensible tactile information outputted from the tactile information processor.
With this configuration, when the tactile sensor having the plurality of pressure sensors arranged at mutually different spatial positions detects an object at the hand of the robot, the tactile information processor generates the tactile information defined by the pressure distribution based on the pressures detected by at least the plurality of pressure sensors and the spatial positions of the plurality of pressure sensors, converts the tactile information into the sensible tactile information that is sensible by the operator, and outputs the sensible tactile information. Then, the sensible tactile information presenting part presents to the operator the sensible tactile information outputted from the tactile information processor. The operator grasps the tactile sense detected by the tactile sensor from the sensible tactile information, and operates the manipulator to manipulate the robot so that the robot performs a suitable work. Then, the manipulator transmits the robot manipulating information according to the manipulation to the robot controller, and the robot controller controls the operation of the hand of the robot according to the robot manipulating information. Thus, the operator judges the operation to be performed by the hand of the robot based on the detection output of the tactile sensor which the hand of the robot has. Since exact operation is able to be instructed to the hand of the robot, the operation of the hand of the robot is controllable exactly like the human performing the work. As a result, a practicality of the robot system in which the robot is remotely controlled based on the tactile information defined by the pressure distribution is improved.
The tactile sensor may include a base body and a plurality of pressure sensors fixed to the surface of the base body at given positions. The tactile information processor may generate the tactile information defined by the pressure distribution based on the pressures detected by the plurality of pressure sensors, and the given positions of the plurality of pressure sensors in the base body.
With this configuration, the degree of smoothness is detectable as the tactile sense.
The tactile sensor may include a base body, a plurality of pressure sensors fixed to the surface of the base body at given positions, and one or more position sensors fixed to the base body corresponding to the plurality of pressure sensors. The tactile information processor may generate the tactile information defined by a time change of the pressure distribution based on pressures detected and by the plurality of pressure sensors of, and spatial positions detected by the one or more position sensors.
With this configuration, the degree of smoothness or the degree of friction is detectable as the tactile sense.
The tactile information may be one of a degree of smoothness and a degree of friction.
The sensible tactile information may be sensed information defined so that a degree of sense by the operator changes corresponding to a degree of tactile in the tactile information.
With this configuration, the operator is able to grasp with the simple configuration the degree of tactile detected by the tactile sensor based on the degree of sense of the sensed information.
The sensed information may be one of visual information, hearing information, and vibration, and the sensible tactile information presenting part may be one of a display, a speaker, and an actuator.
With this configuration, the operator is able to suitably grasp the degree of tactile detected by the tactile sensor.
The manipulator may be a master arm, and an arm including the hand of the robot is a slave arm. The slave arm may be manipulated by the master arm.
With this configuration, the operator is able to suitably control the operation of the hand of the robot. Further, the slave arm is configured to be switchable among an automatic mode, a hybrid mode, and a manual mode so that a non-stopping robot is implemented by switching the mode to the hybrid mode or the manual mode when a trouble occurs.
The present disclosure is configured as described above, and is capable of improving the practicality of the robot system which remotely controls the robot based on the tactile information defined by the pressure distribution.
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that, below, the same reference characters are given to the same or corresponding elements throughout the figures to omit redundant description.
Referring to
The robot system 100 includes a slave arm 1 comprised of a first robot, a master arm 2 comprised of a second robot, a control device 3, a tactile sensor 5, an input device 9, a camera 11, and a monitor 12. The slave arm 1 may be comprised of a robot of any type. In Embodiment 1, the slave arm 1 is comprised of, for example, a well-known articulated robot, which includes a pedestal 1a, an articulated arm 1b provided to the pedestal 1a, and a wrist 1c provided to a tip end of the arm 1b. An end effector 4 is attached to the wrist 1c. The wrist 1c and the end effector 4 constitute a hand of the slave arm 1. The tactile sensor 5 is attached to the end effector 4.
The master arm 2 may be comprised of a robot of any type. This robot may be, for example, a simple device like a control lever, as long as it is capable of operating the slave arm 1 by the operator manipulating the robot. When the operator manipulates the hand of the slave arm 1, the master arm 2 transmits manipulating information (robot manipulating information) according to the manipulation to a robot controller 6 described later.
The control device 3 includes the robot controller 6, a tactile information processor 7, and a monitor controller 8. The control device 3 is comprised of a device having arithmetic processing capabilities, such as a computer, a microcontroller, and a microprocessor. The robot controller 6, the tactile information processor 7, and the monitor controller 8 are implemented by an arithmetic processor (not illustrated) of the control device 3 executing a given program stored in a memory part (not illustrated) of the control device 3. The hardware configuration of the control device 3 is arbitrary, and the control device 3 may be provided independently from other devices of the slave arm 1 etc., or may be provided integrally with other devices.
The input device 9 is comprised of man-machine interface(s), such as a touch panel and/or a keyboard. The input device 9 is mainly used in order to switch three modes of an automatic mode, a hybrid mode, and a manual mode of the slave arm 1, and input various data, etc. The information inputted into the input device 9 is transmitted to the robot controller 6.
The robot controller 6 controls operation of the slave arm 1 based on the information inputted into the input device 9 and the manipulating information transmitted from the master arm 2. Here, those information are suitably stored in the memory part of the control device 3.
The camera 11 is provided to be capable of imaging the operation of the slave arm 1 within all or part of a movable range of the slave arm 1. The image information imaged by the camera 11 is transmitted to the monitor controller 8. The monitor controller 8 controls the monitor 12 to display an image corresponding to the image information.
By the above configuration, the operator is able to operate the master arm 2 while looking at the monitor 12 to manipulate the slave arm 1 as he/she intended.
The tactile sensor 5 has a plurality of pressure sensors arranged at mutually different spatial positions, and pressures detected by the plurality of pressure sensors are transmitted to the tactile information processor 7, respectively. The tactile information processor 7 generates tactile information defined by a pressure distribution based on pressures detected by the plurality of these pressure sensors and the spatial positions of the plurality of pressure sensors, and converts the tactile information into sensible tactile information which is sensible by the operator. Then, the sensible tactile information is transmitted (outputted) to a sensible tactile information presenting part 10. The sensible tactile information presenting part 10 presents the operator the sensible tactile information transmitted from the tactile information processor 7. Specifically, the sensible tactile information is sensed information defined so that a degree of sense by the operator changes corresponding to a degree of tactile in the tactile information. Concrete examples of this will be described later. Thus, the operator is capable of grasping with the simple configuration the degree of tactile detected by the tactile sensor 5 of the slave arm 1 based on the degree of sense of the sensed information. The sensed information is visual information, hearing information, or tactile information. The sensible tactile information presenting part 10 is, for example, a display, a speaker, or an actuator. According to this configuration, the operator is capable of suitably grasping the degree of tactile detected by the tactile sensor 5.
Note that the pressures detected by the plurality of pressure sensors of the tactile sensor 5 are also transmitted to the robot controller 6. When the tactile sensor 5 is manipulated by the master arm 2 so as to be lowered, the robot controller 6 stops lowering of the tactile sensor 5 in response to a detection of a given maximum pressure Pmax by any of the plurality of pressure sensors of the tactile sensor 5.
Referring to
Next, operation of the robot system configured as described above is described using
Referring to
As illustrated in
The operator inputs by the input device 9 an instruction for switching the operating mode of the slave arm 1 to the manual mode. Then, the robot controller 6 switches the operating mode of the slave arm 1 to the manual mode.
Next, while the operator is looking at the monitor 12, he/she manipulates the master arm 2 so that the surface grinder and the tactile sensor 5 which are fixed to the end effector 4 of the slave arm 1 are alternately pressed against the damaged surface 32 of the damaged member 31 from above. Specifically, the operator first presses the tactile sensor 5 against the damaged surface 32 of the damaged member 31 from above. Then, the tactile sensor 5 transmits to the tactile information processor 7 the pressures which are respectively detected by the plurality of (here, 100) pressure sensors 22. The tactile information processor 7 generates the tactile information defined by the pressure distribution based on the pressures which are respectively detected by the plurality of pressure sensors 22 of the tactile sensor 5, and the positions of the plurality of pressure sensors 22 on the principal surface of the base body 21 stored in the memory part of the control device 3. Here, “generating the tactile information defined by the pressure distribution” means that, specifically, associating (corresponding) the pressures which are respectively detected by the plurality of pressure sensors 22 of the tactile sensor 5 with (to) the positions of the plurality of pressure sensors 22 on the principal surface of the base body 21 stored in the memory part of the control device 3. When such an association (correspondence) is performed, “the tactile information defined by the pressure distribution” is generated. Then, the tactile information processor 7 converts the “tactile information defined by the pressure distribution” into the sensible tactile information which is sensible by the operator.
In the conceptual diagrams of
0≤PL1<Pmax/3
Pmax/3≤PL2<2Pmax/3
2Pmax/3≤PL3<Pmax
In
The tactile information processor 7 generates the image (sensed information) like the conceptual diagrams illustrated in
Next, description returns to the repairing work of the damaged member 31. As described above, when the operator presses the tactile sensor 5 against the damaged surface 32 of the damaged member 31 from above, the image of the conceptual diagram illustrated in
Then, the operator inputs by the input device 9 an instruction for switching the operating mode of the slave arm 1 to the automatic mode. Then, the robot controller 6 switches the operating mode of the slave arm 1 to the automatic mode. Thus, even if a trouble occurs, stopping of the operation of the slave arm 1 is avoided.
As described above, according to Embodiment 1, the operator is able to judge the operation to be performed by the hand of the slave arm 1 based on the detection output of the tactile sensor 5 which the hand of the slave arm 1 has. Since exact operation is able to be instructed to the hand of the slave arm 1, the operation of the hand of the slave arm 1 is controllable exactly like the human performing the work. As a result, the practicality of the robot system in which the robot is remotely controlled based on the tactile information defined by the pressure distribution is improved. Moreover, since stopping of the operation of the slave arm 1 is avoided even if a trouble occurs, a non-stopping robot can be implemented.
Embodiment 2 of the present disclosure is different from Embodiment 1 in the sensible tactile information, and others are the same as Embodiment 1.
In Embodiment 2, the tactile information processor 7 generates simplified sensible tactile information without containing the positional information on the pressure-sensitive points based on the sensible tactile information in Embodiment 1 described above. This principle is described.
Then, the tactile information processor 7 corresponds the standard deviation sx to the operator's sensing level. Specifically, the tactile information processor 7 ranks the operator's sensing level into, for example, five levels of CL1-CL5 as illustrated in
Then, the tactile information processor 7 transmits the sensed information signals of these five levels to the sensible tactile information presenting part 10. If the sensible tactile information presenting part 10 is the display, the speaker, or the actuator provided to a seat on which the operator sits, the sensible tactile information presenting part 10 presents (outputs) to the operator, for example, a screen of brightness according to the level of the sensed information signals, sound of volume according to the level of the sensed information signals, or vibration of amplitude according to the level of the sensed information signals, respectively.
According to such Embodiment 2, the operator is able to suitably grasp with the simple configuration the degree of tactile detected by the tactile sensor 5 of the hand of the slave arm 1 based on the degree of sense of the sensed information.
Embodiment 3 of the present disclosure is different in the tactile sensor 5 from the tactile sensor 5 of Embodiment 1, and others are the same as those of Embodiment 1.
Referring to
The pressure sensor 72 and the position sensor 73 are arranged so that, for example, pair of the pressure sensor 72 and the position sensor 73 are distributed in a matrix on one of the principal surfaces of the base body 71. Standard positions of the pressure sensors 72 and the position sensors 73 on the principal surface of each base body 71 are stored in the memory part of the control device 3. Here, the “standard position” means the position in a state where the base body 71 is not deformed. The position sensor may be, for example, a displacement sensor. The displacement sensor may be, for example, an acceleration sensor, a gyroscope sensor, etc.
The tactile sensor 5 configured in this way is deformed due to a frictional force with the surface to be detected when the tactile sensor 5 is moved in a direction parallel to the principal surface in a state where the tactile sensor 5 is pressed against the surface to be detected in the thickness direction at a given pressure. In this case, a degree of deformation is detected by the position sensor 73, and a pressure distribution in the tactile sensor 5 is also detected. The tactile information processor 7 generates tactile information which is a degree of friction by the degree of deformation and a time change of the pressure distribution. The relation between “the degree of deformation and the time change of the pressure distribution,” and “the degree of friction” is determined beforehand according to experiments, simulations, etc.
Since subsequent processing of the tactile information is similar to those of Embodiments 1 and 2, description thereof is omitted. Note that, if the tactile sensor 5 is not moved in the direction parallel to the principal surface, the degree of irregularity of the surface to be detected is detectable similar to Embodiment 1.
According to such Embodiment 3, the degree of smoothness or the degree of friction is detectable as the tactile sense.
Embodiment 4 of the present disclosure is different from Embodiment 1 in that the robot system is provided with a normal robot and a manipulator which remotely controls the normal robot, and others are similar to those of Embodiment 1.
Referred to
Since the configurations are the same as Embodiment 1 other than the configurations described above, descriptions thereof are omitted.
According to such Embodiment 4, the robot system of the present disclosure is applicable to a common robot system in which a robot is remotely controlled by manual operation.
In Embodiment 1, instead of repairing work of the damaged surface 32 of the damaged member 31, a work to inspect the degree of smoothness of the surface of the member by the tactile sensor 5 of the hand of the slave arm 1 may be performed.
In Embodiments 1 to 4, the operator may sense the member indirectly through the tactile sensor 5 of the hand of the robot 81 or the slave arm 1, and the operator may manipulate the robot 81 or the slave arm 1 based on the sense to perform the work utilizing the detection output of the tactile sensor 5.
It is apparent for a person skilled in the art that many improvements and other embodiments of the present disclosure are possible from the above description. Therefore, the above description is to be interpreted only as illustration, and it is provided in order to teach a person skilled in the art the best mode which implements the present disclosure. Details of the structures and/or the functions may be substantially changed without departing from the spirit of the present disclosure.
The robot system of the present disclosure is useful as the robot system with an improved practicality.
Number | Date | Country | Kind |
---|---|---|---|
2015-165479 | Aug 2015 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2016/003067 | 6/24/2016 | WO | 00 |