The present disclosure relates to an intermediation device and an intermediating method which cause industrial robots to operate based on operations of manipulation terminals by a plurality of operators, respectively.
Conventionally, a game system in which a plurality of operators operate controllers to cause corresponding robots to fight against each other, is known (e.g., see Patent Document 1). In a game system disclosed in Patent Document 1, a plurality of operators remotely manipulate robots having the same structure using controllers, respectively, and cause the robots to fight against each other in a circular battle field with a diameter of about 5 m.
The robot of the game system is provided with a superiority-and-inferiority determining part. This superiority-and-inferiority determining part monitors all the time whether a physical energy value calculated by a physical-energy-value calculating part becomes zero, and whether a limit time has lapsed. When the physical energy value of the robot is detected to be zero, the superiority-and-inferiority determining part determines that the robot is defeated.
Meanwhile, in recent years, labor shortage at companies etc., has been a problem, and accordingly, labor saving and automation are demanded. In this respect, industrial robots are gathering people's expectations. The industrial robots can compensate the shortage of labors in many industries. Therefore, such industrial robots are demanded to be spread, and in order to achieve this, public interest in the industrial robots needs to be enhanced. However, the conventional system merely determines the superiority and inferiority in the game, and is unlikely to achieve the improvement in people's interest in the industrial robots.
Therefore, one purpose of the present disclosure is to provide an intermediation device and an intermediating method, capable of improving public interest in an industrial robot compared to before.
An intermediation device according to the present disclosure executes processing of receiving, from at least two manipulation terminals, or from at least one manipulation terminal and at least one computer, manipulation signals for manipulating at least two industrial robots each corresponding to the manipulation terminal or the computer and configured to perform a given work or a given game. The device executes processings of causing the at least two industrial robots to perform the given work or the given game based on the manipulation signals, and causing a display unit held by an operator of the manipulation terminal to display an image of a site of the work or the game performed by the at least two industrial robots, the image being captured by an imaging device.
According to the present disclosure, the operator can cause the industrial robot to perform the work or the game by remotely manipulating the industrial robot by the own manipulation terminal while visually recognizing the image (including a still image and a video) of the site of the work or the game by the industrial robot displayed on the display unit. Therefore, the operator can manipulate the industrial robot at home, outside the home, etc., as if the industrial robot is located near the operator. Accordingly, public interest in the industrial robots can be improved compared to before. As a result, the number of people who manipulate the industrial robot increases, and the spread of the industrial robot is expected to be accelerated.
In the present disclosure, the intermediation device may determine a manipulation level of the operator based on a given evaluation element.
According to this configuration, a manipulation skill of the operator can be grasped. Therefore, an operator with a high-level skill in the manipulation of the industrial robot can be easily secured, and a business model of offering a work of remotely manipulating the robot to such a skilled operator, can also be established.
In the present disclosure, the intermediation device may receive an evaluation from a game observing device configured to evaluate the work or the game performed by the industrial robot, and determine a manipulation level of the operator based on the evaluation.
According to this configuration, since the quality of the result of the work (e.g., a painting work) performed by the industrial robot may be sensed differently between people, the manipulation level of the operator can be diversely determined based on such evaluations. Moreover, by the work being opened to the public and observed, public interest in robots and in the robot manipulation can be improved.
In the present disclosure, the intermediation device may cause the display unit of the operator to display a host screen configured to invite participation in the work or the game.
According to this configuration, the operator can easily participate in the work or the game performed by the industrial robot by visually recognizing the indication on the display unit.
In the present disclosure, the intermediation device may accept participation of the operator in the work or the game, and connect the manipulation terminal to the industrial robot.
According to this configuration, the operator can freely participate in the work or the game performed by the industrial robot when he/she wants.
In the present disclosure, the intermediation device may disconnect the manipulation terminal of the operator from the industrial robot according to a contact from the manipulation terminal.
According to this configuration, by the operator informing to the intermediation device, he/she can leave the remote manipulation whenever he/she wants.
In the present disclosure, the intermediation device may cause the display unit to display an image of the site including all of the industrial robots.
According to this configuration, the operator can visually recognize the work progress or the game situation of the robot of a competitor.
In the present disclosure, the intermediation device may receive the manipulation signal from a game device to which a controller is connected, as the manipulation terminal.
According to this configuration, the operator does not need to buy a manipulation terminal for exclusive use, and can easily manipulate the robot remotely from home etc.
An intermediating method according to the present disclosure includes the step of receiving, from at least two manipulation terminals, or from at least one manipulation terminal and at least one computer, manipulation signals for manipulating at least two industrial robots each corresponding to the manipulation terminal or the computer and configured to perform a given work or a given game. The method includes the steps of causing the at least two industrial robots to perform the given work or the given game based on the manipulation signals, and causing a display unit held by an operator of the manipulation terminal to display an image of a site of the work or the game performed by the at least two industrial robots, the image being captured by an imaging device.
An intermediation device according to the present disclosure includes a receiver configured to receive, from at least two manipulation terminals, or from at least one manipulation terminal and at least one computer, manipulation signals for manipulating at least two industrial robots each corresponding to the manipulation terminal or the computer and configured to perform a given work or a given game. The device includes an executer configured to cause the at least two industrial robots to perform the given work or the given game based on the manipulation signals, and a display configured to cause a display unit held by an operator of the manipulation terminal to display an image of a site of the work or the game performed by the at least two industrial robots, the image being captured by an imaging device.
According to the present disclosure, an intermediation device and an intermediating method, capable of improving public interest in an industrial robot compared to before, can be provided.
Hereinafter, a robot manipulation system having an intermediation device according to one embodiment of the present disclosure is described with reference to the drawings. The intermediation device described below is merely one embodiment of the present disclosure. Therefore, the present disclosure is not limited to the following embodiment, and it can be added, omitted, or changed without departing from the spirit of the present disclosure.
Although in this embodiment a mode in which a configuration and functions of the intermediation device are assigned to the server device is described, the assignment is not limited to this. The configuration and functions of the intermediation device may be assigned to a game device held by an operator, or may be assigned to an industrial robot.
In a robot manipulation system 1 of this embodiment, at least two operators (e.g., players of a game) remotely manipulate industrial robots using controllers connected to one of various known game devices via a communication network, respectively, and cause the corresponding industrial robots to compete against each other for performing a given work.
The given work may be, for example, a painting work as will be described later, or other than that, it may be a picking work, a dishing up work in a Bento box, or a welding work. The given work may be any work, as long as a part of the process includes a work (a work using a human body or intelligence for a certain purpose based on a certain plan).
The game device 3 has a communication part 32, such as internet communication, and is connectable to the communication network 4. The game device 3 is, for example, a stationary-type game device or a mobile game device. The game device 3 to which a controller 38 (described later) is connected corresponds to a “manipulation terminal.” The manipulation terminal includes, in addition to various known game devices, a personal data assistant (PDA), a smart phone, a personal computer, a tablet, and a remote manipulator dedicated for a robot.
As illustrated in
The CPU 310 controls operation of each part of the game device 3. The ROM 311 stores a basic program etc., of the game device 3. The memory 33 stores a program (a remote manipulation program) for operating the robot by a remote manipulation, a program (a game program) for executing each kind of game, etc. A working area used when the CPU 310 executes the game program is set for the RAM 312. Note that although in this embodiment the remote manipulation program is essential to be stored, the game program is not essential.
The image processor 313 is provided with a GPU (Graphics Processing Unit) which can generate a game screen. A video RAM (VRAM) 34 is connected to the image processor 313, and a display unit 35 is connected to the VRAM 34. The display unit 35 acquires, via the communication part 32, a video and a still image of the site where the plurality of industrial robots 5 work, which are captured by an imaging device CA (described later), and displays them. Note that the image processor 313 generates a game space according to a command of the CPU 310. The display unit 35 also has a function to display an image in the game space as a game screen.
The audio processor 314 is provided with a DSP (Digital Signal Processor) which generates game sound. The audio processor 314 sends the generated game sound to an amplifier 36 including a D/A converter. The amplifier 36 amplifies this sound signal and transmits it to a speaker 37.
The controller 38 is connected to the manipulation part 315. The controller 38 includes a cross button, a push switch, a joystick, a mouse, a keyboard, and a touch panel. Moreover, the manipulation part 315 detects a signal of manipulation by a user via the controller 38, and transmits the manipulation signal to the CPU 310.
The communication part 32 communicates with the industrial robot 5 via the communication network 4. By the operator operating the own controller 38, the controlling part 31 outputs an operation command to the industrial robot 5 via the communication part 32. Accordingly, the industrial robot 5 can be remotely manipulated by the operator operating the controller 38.
Moreover, the controlling part 31 progresses the game or downloads the game program by executing data communication between the game device 3 and the server device 2.
As illustrated in
As illustrated in
Here, as illustrated in
Each industrial robot 5 is provided with a painting gun 206 which is a painting device body, a manipulator 204 which is a moving device, a supplying device 202 which supplies to the painting gun 206, liquid, such as paint, to be discharged from a nozzle 207 (described later), and a control device (a robot controller) 201 which controls operation of the manipulator 204. Moreover, a placing stand 210 on which a workpiece 211 is placed is disposed near the industrial robot 5. Note that a surface 212 of the workpiece 211 may be made of a material including a color-changeable substance, and water as the liquid may be discharged from the nozzle 207 of the painting gun 206 to the surface 212 of the workpiece 211 so that a part of the surface 212 wet by the water is changed in color and painted.
The control device 201 is provided with a processor, which executes decoding, arithmetic processing, etc., of a stored program and various signals inputted from externally, and is configured to control the operation of the manipulator 204 and output signals from various output ports.
The painting gun 206 is attached to a wrist 205 of the manipulator 204. The nozzle 207 constitutes a tip-end part of the painting gun 206, and the paint is discharged therefrom. A driving device 203 controls ON and OFF of discharging the paint from the nozzle 207 of the painting gun 206, and also controls an amount of the discharge. This driving device 5 is controlled by the control device 201.
The workpiece 211 to be painted is placed on the placing stand 210. By the operation of the manipulator 204, the nozzle 207 discharges the paint to the surface 212 of the workpiece 211 while moving near the surface 212. Thus, the surface 212 of the workpiece 211 is painted.
The two industrial robots 5 which perform the work, such as the painting work as described above, are disposed closely to each other. Moreover, the site where the two industrial robots 5 are caused to work is captured by the imaging devices CA, such as cameras. Note that although in
When the industrial robots 5 compete for the painting work as described above, first, the inviting module 27 of the server device 2 causes the display unit 35 of the game device 3 of the operator to display invitation for participation in the work. In this case, for example as illustrated in
Each operator visually recognizes the display screen 35a of the display unit 35, and when participating in the painting work by the industrial robot 5, the operator performs a given operation to the controller 38 so as to transmit to the server device 2 a signal indicating that he/she wants to participate. The accepting module 40 of the server device 2 accepts the participation of the operator in the work, and connects the game device 3 to the industrial robot 5 via the communication network 4. In this case, the server device 2 may assign a given ID to the operator, and store the correspondence between the operator and the ID. The operator can participate by inputting the ID. After the game device 3 of each operator is connected to the industrial robot 5 via the communication network 4, the operator can cause the corresponding industrial robot 5 to perform the painting work by operating the controller 38. In this case, the measuring module 28 of the server device 2 measures time taken from the start of the work to the end of the work. Moreover, the controlling part 20 of the server device 2 displays a lapse time from the start of the work to the current time measured by the measuring module 28 on the display screen 35a of the display unit 35 as will be described later. Note that the control device (the robot controller) 201 of the industrial robot 5 controls each operation of the industrial robot 5 based on an operation signal converted from a signal according to the operation of the controller 38. Therefore, the operator can cause the industrial robot 5 to operate in the painting work by operating the controller 38.
While the industrial robots 5 compete for the painting work, each display unit 35 displays videos of the worksite including all of the industrial robots 5 (two industrial robots 5 in this embodiment). In detail, as illustrated in
When each industrial robot 5 finishes the painting work, the level determining module 26 determines a manipulation level of the operator based on a given evaluation element related to the painting work of the industrial robot 5. As the evaluation element, in an example of the work such as the painting work, the time required to finish the work, a quality of work result, etc., may be adopted. The quality of the result of the painting work includes coloring and brightness of the painting, a degree of painting beyond a border-line, etc.
Moreover, although the manipulation level of the operator is determined by the level determining module 26 as described above, in addition to this configuration, the one or more game observing device(s) 6 connectable to the server device 2 via the communication network 4 may be provided as illustrated in
Moreover, for example, a plurality of manipulation levels associated with time spans required for the painting work may be stored in advance in the memory 24. In this case, the level determining module 26 certifies a concrete manipulation level to a winner, and also certifies a concrete manipulation level to a loser. That is, the given manipulation level may be certified not only to the winner but also to the loser.
The disconnecting module 41 disconnects the game device 3 of the operator from the industrial robot 5 in response to a contact from the game device 3.
As described above, according to the server device 2 of the robot manipulation system 1 in this embodiment, the operator can cause the industrial robot 5 to perform the work by remotely manipulating the industrial robot 5 by the own controller 38 while visually recognizing the images (including the still image and the video) of the worksite of the industrial robot 5 displayed on the display unit 35. Therefore, the operator can manipulate the industrial robot 5 at home, outside the home, etc., as if the industrial robot 5 is located near the operator. Accordingly, the interest in the industrial robot 5 can be improved compared to before. As a result, the number of people who manipulate the industrial robot 5 increases, and the spread of the industrial robot 5 is expected to be accelerated.
Moreover, in this embodiment, since the manipulation level of the operator is determined based on the given evaluation element, the manipulation skill of the operator can be grasped. Therefore, an operator with a high-level skill in the manipulation of the industrial robot 5 can be easily secured, and a business model of offering a work of remotely manipulating the robot to such a skilled operator, can also be established.
Moreover, in this embodiment, since the server device 2, which is the intermediation device, has the level determining module 25, information on the operators who can manipulate the industrial robot 5 at high skill can be easily collected.
Moreover, in this embodiment, since the videos of the site including all the industrial robots 5 are displayed on the display unit 35, the operator can visually recognize the work progress of the industrial robot 5 of the competitor. Therefore, the operator can be expected to improve his/her concentration and enthusiasm for the work.
Moreover, in this embodiment, since the controlling part 20 of the server device 2 is provided with the inviting module 27 which causes the display unit 35 to display the invitation for participation in the painting work, the operator can easily participate in the painting work by visually recognizing the invitation displayed on the display screen 35a of the display unit 35.
Moreover, in this embodiment, the disconnecting part 41 of the server device 2 cuts the connection between the game device 3 and the industrial robot 5 in response to the contact from the game device 3 of the operator. Therefore, the operator can leave the remote manipulation whenever he/she wants.
Moreover, in this embodiment, since the game device 3 to which the controller 38 is connected is adopted as the manipulation terminal, the operator does not need to buy a manipulation terminal for exclusive use, and can easily manipulate the industrial robot 5 remotely from home etc.
Although in the embodiment described above the industrial robots 5 compete for the painting work as the given work, below, the industrial robots 5 participate in a given competition, such as a sport and a game (match).
As illustrated in
The given game includes, for example, ball games (e.g., tennis and baseball), athletic sports (e.g., running, jumping, and throwing), combat sports (e.g., Kendo and Judo), on-ice or on-snow sports (e.g., skiing and skating), water sports (e.g., swimming and diving), boating sports involving a yacht, a boat, etc., sports involving a vehicle (e.g., a bicycle and an automobile), dance sports, and intellectual sports (e.g., Shogi and Go).
Moreover, although in the embodiments described above the manipulation signals of the industrial robots 5 (5A) are given from the controllers 38 of the plurality of operators, respectively, in other embodiments, the manipulation signals of the industrial robots 5 (5A) are given from at least one manipulation terminal and at least one computer (including an AI), respectively. That is, at least one competitor of the operator is the computer. Although the computer is provided to the server device 2, it is not limited to this, and may be provided to the game device 3 or the industrial robot 5 (5A).
Also according to this, the interest on the industrial robot 5 (5A) can be improved compared to before similarly to the embodiments described above. Therefore, the number of people who manipulate the industrial robot 5 (5A) increases, and the spread of the industrial robot 5 (5A) is expected to be accelerated.
Moreover, the industrial robots 5 (5A) of the embodiments may be configured to be self-propelled robots. Thus, moving ranges of the industrial robots 5 (5A) can be widened.
Moreover, the level determining module 26 may determine the manipulation level of the operator based on the number of the same series of operations of the controller 38, repeated by the operator within a given period of time. This is based on that, generally, as the number of the same series of operations of the controller 38 repeated within the given time period increases, the manipulation level is considered to be high. Therefore, the manipulation skill of the operator can be grasped highly accurately.
Number | Date | Country | Kind |
---|---|---|---|
2018-151917 | Aug 2018 | JP | national |
2019-105753 | Jun 2019 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2019/031646 | 8/9/2019 | WO | 00 |