Patent Application
20210335148
The present invention relates to a content presentation system for presenting training content including 3D CG for simulating an on-site work of a work target device in a simulated work space.
For example, in various types of devices such as industrial products, many of them require expert skills in their manufacturing and maintenance works. Therefore, it is important to conduct training for the aforementioned various works for workers who perform the aforementioned works, in particular, those who do not have expert skills.
Today, with the progress of virtual reality and augmented reality technology, it is becoming possible to deem various devices as work target devices and to expand and display information of work instructions or the like on various places of the target device, so that the workers perform the work such as an on-site work of the work target device according to the information.
On the other hand, some of the work target devices have structural elements that can be dangerous factors in the work, such as high temperature, high voltage, etc., and there is an increasing need for a training to suppress the danger such as a burn or an electric shock prior to the on-site work of the work target device having such structural elements.
As a measure to prevent danger of workers in the on-site work and the like, Patent Document 1 proposes a technology for displaying information of a danger prediction scoring table and for scoring the danger prediction of a trainee based on the dangerous item factors narrowed down by the trainees who become workers, so as to improve the workers' awareness of dangers.
However, even though it is possible to acquire the knowledge of the danger of the trainee using the danger prediction scoring table by the technology described in Patent Document 1, since there is no consideration for simulating an accident, there is a problem that it is impossible to secure sufficient safety when performing the on-site work of the work target device.
The present invention has been made to solve the conventional problem as described above, and for the purpose of providing a content presentation system that causes a simulated accident in a training stage so as to strongly impress a trainee with a risk of an accident, thereby making it possible to securely suppress the risk of the accident in the on-site work of the work target device.
In order to solve the above problem, a content presentation system according to claim 1 is a content presentation system that presents a training content to a trainee (R1) based on a three-dimensional shape information of a work target device and a work procedure, and causes a simulated work of an on-site work executed in accordance with the work procedure in a simulated work space of virtual reality or augmented reality, the content presentation system comprising: a content output device (3) that has a storage unit (36a) that stores the training content that includes the three-dimensional shape information of the work target device and evaluation criterion information on a work operation of the work procedure and an output unit (35e, 43) that outputs the training content so as to be presented to the trainee; an operation measurement device (35a, 65a) that acquires a three-dimensional work operation of a worker (R2) who executes the on-site work or the trainee as measurement information; an evaluation criterion creation device (35b, 65b) that creates evaluation criterion information on the work operation based on the measurement information of the three-dimensional work operation; and a content creation device (35c, 65c) that creates the training content based on the measurement information of the three-dimensional work operation and the evaluation criterion information, wherein the evaluation criterion creation device, when predetermined information is inputted that can be an accident occurrence factor in the on-site work from a predetermined three-dimensional body motion of the worker or the trainee, adjusts the evaluation criterion information on the work operation related to the information in a specific stage or other stage of the work procedure, and the content creation device updates the training content, so as to increase a probability of occurrence of a simulated accident with respect to the work operation in the specific stage or other stage during the simulated work, and impress the trainee with the occurrence of the accident at occurrence of the simulated accident.
With this configuration, the content presentation system according to claim 1 of the present invention can strongly impress the trainee with the risk of the occurrence of the accident when experiencing the on-site work of the work target device in the simulated work space in the training stage. As a result, when the trainee finishes the training and executes the on-site work of the work target device as a worker at the work site, the worker can be strongly aware of the risk of the occurrence of the accident, thereby making it possible to remarkably reduce the risk of the occurrence of the accident, compared to the conventional on-site works in which the aforementioned awareness has been insufficient.
A content presentation system according to claim 2 of the present invention is characterized in that the content creation device impresses the trainee with the occurrence of the simulated accident by sound, text message, light, vibration, or the like.
By this configuration, the content presentation system according to claim 2 of the present invention can more strongly and securely impress the trainee who experience the simulated accident in the training stage with the risk of the occurrence of the accident, thereby making it possible to more securely suppress the risk in the work site.
A content presentation system according to claim 3 of the present invention further comprises a dangerous action determination processing unit (75b, 76b) that extracts a work item having a high occurrence probability of the simulated accident and defines a risk occurrence factor for the work item; and a dangerous action suppression control unit (65f) that notifies the worker of the dangerous action caused by the risk occurrence factor in the work of the work item in the on-site work.
By this configuration, the content presentation system according to claim 3 of the present invention enables the trainee who experienced the occurrence of the accident in the training stage to suppress the risk in a step-wise manner when executing the work at the work site as the worker.
A content presentation system according to claim 4 of the present invention further comprises: a creation unit (75a, 76a) that creates a work report describing a work environment of the on-site work; and an update unit (65f) that determines whether or not there is a description that the work environment has changed from a current state between the created work report and an existing work report already created, and updates the definition of the risk occurrence factor for the work item, in accordance with the changed environment, in the case that there is the description.
By this configuration, the content presentation system according to claim 4 of the present invention can suppress the risk in a stepwise manner in accordance with the change of the current state even when there is a change in the current state in the on-site work.
A content presentation system according to claim 5 of the present invention further comprises: a setting unit (75b) that sets a warning item to be executed in a step-wise manner during the on-site work including the work item, based on index information including a definition of the risk subject and a worker skill of the worker; and a warning unit (65f) that gives a warning in a step-wise manner based on the warning item during the on-site work.
By this configuration, the content presentation system according to claim 5 of the present invention makes it possible for the trainee who can experience an accident by the training, after finishing the training, to suppress the risk in a step-wise manner in accordance with the own skill and the like at the time when working in the site as a worker, with respect to the items having a high accident occurrence rate during the training.
By the present invention, it is possible to provide a content presentation system that causes a simulated accident in a training stage so as to strongly impress the trainee with the risk of the accident, thereby making it possible to securely suppress the risk of an accident in the on-site work of the work target device.
Hereinafter, an embodiment of a content presentation system 1 according to the present invention will be described with reference to the drawings. The present embodiment mainly discusses a case in which the training content of the maintenance work of the work target device is presented to the trainee R1, however the present invention can be applied to cases in which the training content of various on-site works for systems and facilities is presented.
As shown in
In the content presentation system 1, the training management server 3 and the site management server 6 are constituted by information processing devices such as PC (personal computer), for example. As for the training support terminal 4 and the site support terminal 7, for example, a portable terminal such as a smartphone, a tablet, an HMD (Head Mount Display), or the like is used.
Each of the training management server 3, the training support terminal 4, the site management server 6, and the site support terminal 7 has a three-dimensional graphic data drawing function. In other words, the content presentation system 1 not only makes use of information on the maintenance work of the work target device mutually between the training and the site, but also aggressively adopts 3D CG for processing images used for training and images used for on-site information collection. Particularly, in the present embodiment, in the training, 3D CG data of the work target device is used, and at the site, extended display (AR: Augmented Reality) such as a work instruction for the actual work target device is performed, based on the 3D CG of the work target device described above.
First, explanation will be given to the information collection for training content creation related to the maintenance work of the work target device (actual machine) by the model worker R2 at the site, and an outline of the work of training for the trainee R1 based on the training content.
In
When collecting the above-described body motion information, it is notified beforehand to the model worker R2 that a sensor for detecting body motion information such as an HMD, a glove with a DoF sensor, a microphone or the like is to be worn. This notification is made, for example, by displaying a message on the display unit 73 of the site support terminal 7. Upon completion of the above-described maintenance work, the site support terminal 7 distributes the work operation record stored during the maintenance work to the site management server 6.
Based on the work operation record distributed from the site support terminal 7, the site management server 6 creates training contents for simulating the maintenance work, and stores the training contents. In addition, the site management server 6 distributes the work operation record distributed from the site support terminal 7 to the training management server 3.
The training management server 3 creates training content for causing a simulated work to be executed based on the work operation record distributed from the site management server 6, and stores the training content. Thereafter, the training management server 3 transmits the stored training content to the training support terminal 4, for example, based on a training start command based on a predetermined operation by the trainee R1.
The training support terminal 4 receives the training content delivered from the training management server 3 and causes the simulated work to be executed based on the training content. To be specific, the training support terminal 4 displays the 3D CG data of the work target device on the display unit 43 (see
During execution of the simulated work by the trainee R1 by the simulated space, the training support terminal 4 displays the 3D CG data of the work target device on the display unit 43 based on the training content, and displays the 3D CG data in accordance with the work procedure of the maintenance work, and displays a work instruction conforming to the work procedure of the maintenance work composed of, for example, text sentences or the like on the display unit 43 in accordance with the progress of the simulated work and corresponding to each stage. As a result, the trainee R1 can train maintenance work of the work target device in accordance with work instructions displayed together with the work target device displayed in 3D CG in the virtual reality simulated work space.
In the above-described training (simulated work), the training support terminal 4 takes in the operation information (activity information) of the maintenance work on the virtual work target device of the trainee R1, as a training work operation record B together with the body motion information such as action of hands and arms and line of sight collected by a body motion information detection sensor. Further, the training support terminal 4 takes in a work operation record (hereinafter referred to as “collection time work operation record A”) at the time of maintenance work executed by the model worker R2, which is already acquired from the site management server 6 by the training management server 3, and evaluates the accuracy (skill level) of the work operation of the work procedure by the trainee R1 based on the training time work operation record B and the collection time work operation record A.
In the process of evaluating the accuracy of work, the training support terminal 4 compares each value of the training time work operation record B and the collection time work operation record A, and gives a higher evaluation value as the value of the training time work operation record B is closer to the value of the collection time work operation record A, while giving a low evaluation value when the value of the training time work operation record B deviates from to the value of the collection time work operation record A by more than the predetermined threshold value. At this time, the training support terminal 4 images and displays the evaluation result on the display unit 43, so that the trainee R1 can visually check it.
The 3D CG data handled by the training support terminal 4 and the site support terminal 7 in the training and the on-site information collection has three-dimensional coordinates. Therefore, by comparing the three-dimensional coordinates of the hand of the model worker R2 collected in the site in advance and the three-dimensional coordinates of the hand of the trainee R1 under training, it is possible to determine which part of the device the hand of the trainee R1 touched.
In particular, in the present embodiment, with respect to 3D CG processing under training, the content presentation system 1 determines a situation in which the hand or body of the trainee R1 is close to or in contact with a component corresponding to the risk subject factor (for example, the high-temperature generating element, the high voltage generating element) of the work target device is determined, and notifies that the work performed by trainee R1 is in a state close to failure or that failure has been made, in a way that strongly impresses trainee R1. This notification process will be described in detail later with reference to
The configuration and operation of the content presentation system 1 according to the present embodiment will be described in detail based on the outline of information collection and training at the site as described above.
First, the configuration of each device of the content presentation system 1 will be described. In the content presentation system 1, the training management server 3 and the training support terminal 4 included in the training management system 5 have, for example, the configuration shown in
As shown in
The memory 35 includes, for example, a ROM, a RAM, and the like, and stores various kinds of information such as a program for realizing a functional operation as the training management system 5. In this example, the memory 35 stores each of the programs for realizing a functional operation of processing units: the operation measurement processing unit 35a, the evaluation criterion creation processing unit 35b, the content creation processing unit 35c, the content distribution processing unit 35d, the simulated work processing unit 35e, and the dangerous action suppression processing unit 35f. Each of these processing units is realized by the CPU 31 reading each program from the memory 35 and executing the program.
The operation measurement processing unit 35a receives the activity information of the trainee R1 acquired by the measurement information acquisition unit 44 of the training support terminal 4, which will be described later, via the communication unit 32 and processes it as measurement information of the three-dimensional work operation of the trainee R1.
The evaluation criterion creation processing unit 35b creates evaluation criterion information on the work operation of the trainee R1 based on the measurement information of the three-dimensional work operation of the trainee R1. The evaluation criterion information is created in correspondence to the work operation in a specific stage (a work stage targeting a risk subject factor) or another stage in a work procedure of a maintenance work (simulated work) of a work target device executed by the trainee R1 in a simulated work space to be described later.
The content creation processing unit 35c creates a training content based on the measurement information of the three-dimensional work operation of the trainee R1 processed by the operation measurement processing unit 35a and the evaluation criterion information created by the evaluation criterion creation processing unit 35b.
The content distribution processing unit 35d distributes the training content created by the content creation processing unit 35c to the site management server 6 via the communication unit 32.
The simulated work processing unit 35e cooperates with the training support terminal 4 to perform processing for realizing the maintenance work of the work target device as a simulated work. To be specific, the simulated work processing unit 35e has the display unit 43 of the training support terminal 4 display the training contents based on the three-dimensional shape information of the work target device and the work procedure to presents the training contents to the trainee R1, and executes control for having the maintenance work executed in accordance with the work procedure in the simulated work space of the virtual reality or the augmented reality.
During the simulated work in the simulated work space, the dangerous action suppression processing unit 35f performs control for suppressing dangerous actions such as the trainee R1 contacting the risk subject factor of the work target device. The term “risk subject factor” refers to an element that poses a danger to the trainee R1 in working on the place, such as a high temperature generating element, a high voltage generating element, or a high place work to be described later.
The DB 36 has a content management DB 36a, a risk subject factor management DB 36b, and a training history management DB 36c. The content management DB 36a stores the above-described training content, and the risk subject factor management DB 36b stores and manages information on the risk subject factor to be used for the dangerous action suppression control of the dangerous action suppression processing unit 35f. The training history management DB 36c stores and manages history information that has been trained for the maintenance work of the work target device by the simulated work in the simulated work space.
Also as shown in
The measurement information acquisition unit 44 acquires detection signals of various sensors such as a ToF (Time Of Flight) sensor worn by the trainee R1 as activity information of the three-dimensional work operation of the trainee R1.
The memory 45 includes, for example, a ROM, a RAM, and the like, and stores various kinds of information such as a program for realizing a functional operation as the training management system 5. In this example, the memory 45 stores a program for realizing the dangerous action determination processing unit 45a. This means that the dangerous action determination processing unit 45a is realized by the CPU 41 reading the program from the memory 45 and executing the program. During the simulated work in the simulated work space, the dangerous action determination processing unit 45a performs control for determining the dangerous action such as the trainee R1 contacting the risk subject factor of the work target device.
The DB 46 has a risk subject factor management DB 46a. The risk subject factor management DB 46a stores and manages the information of the risk subject factor determined as the dangerous action by the dangerous action determination processing unit 45a.
In the configuration shown in
In the content presentation system 1, the site management server 6 and the site support terminal 7 have the configuration shown in
As shown in
The memory 65 includes, for example, a ROM, a RAM, and the like, and stores programs and the like for realizing various functional operations and various kinds of information. In this example, the memory 65 stores each program for realizing each of processing units: an operation measurement processing unit 65a, an evaluation criterion creation processing unit 65b, a content creation processing unit 65c, a content distribution processing unit 65d, a maintenance work processing unit 65e, and a dangerous action suppression processing unit 65f Each of these processing units is realized by the CPU 61 reading the respective program from the memory 65 and executing the program.
The operation measurement processing unit 65a receives an activity information of a model worker R2 or a worker R3 acquired by the measurement information acquisition unit 74 of the site support terminal 7 to be described later via the communication unit 72 and processes the activity information as the measurement information of the three-dimensional work operation of the model worker R2 or the worker R3. Here, the worker R3 is, for example, the trainee R1 who has completed training in the training management system 5.
The evaluation criterion creation processing unit 65b creates evaluation criterion information on the work operation of the model worker R2 or the worker R3 based on the measurement information of the three-dimensional work operation of the model worker R2 or the worker R3, for example. The evaluation criterion information is respectively created in correspondence to the work operation in the specific stage or another stage in a work procedure using the actual device of the work target device executed by the model worker R2 or the worker R3 using an AR screen of a display unit 73 of the site support terminal 7 to be described later.
Based on the measurement information of the three-dimensional work operation of the model worker R2 processed by the operation measurement processing unit 65a and the evaluation criterion information created by the evaluation criterion creation processing unit 65b, the content creation processing unit 65c creates a training content.
The content distribution processing unit 65d distributes the training content created by the content creation processing unit 65c to the training management server 3 via the communication unit 62.
The maintenance work processing unit 65e performs processing for cooperating with the site support terminal 7 and causing the worker R3 to execute the maintenance work of the work target device. To be specific, the maintenance work processing unit 65e additionally displays (AR display) a work instruction and the like based on the work procedure of the maintenance work with respect to the work target device (actual machine) on the display unit 73 constituting the site support terminal 7, composed of, for example, a transmissive screen of HMD, to thereby present the work instruction to the worker R3. As a result, the worker R3 can execute the maintenance work of the work target device while confirming the work instruction displayed in AR.
During execution of the maintenance work using the AR display screen, the dangerous action suppression processing unit 65f performs control to suppress a dangerous action such as the worker R3 contacting the risk subject factor of the work target device.
The DB 66 has a risk subject factor management DB 66a. The risk subject factor management DB 66a stores and manages information on the risk subject factor to be used for the dangerous action suppression control of the dangerous action suppression processing unit 65f.
Also, as shown in
The measurement information acquiring unit 74 acquires detection signals of various sensors such as ToF sensor worn by the model worker R2 or the worker R3 as the activity information of the three-dimensional work operation of the model worker R2 or the worker R3.
The memory 75 includes, for example, a ROM, a RAM, and the like, and stores programs and the like for realizing various functional operations and various kinds of information. In this example, the memory 75 stores programs for realizing the work report management processing unit 75a and the dangerous action determination processing unit 75b. This means that the work report management processing unit 75a and the dangerous action determination processing unit 75b are realized by the CPU 71 reading the program from the memory 75 and executing the program. The work report management processing unit 75a creates a work report on the maintenance work of the work target device using the AR display screen. The dangerous action determination processing unit 75b performs control for determining a dangerous action during execution of the maintenance work, for example, the worker R3 comes into contact with the risk subject factor of the work target device.
The DB 76 has a work report management DB 76a and a risk subject factor management DB 76b. The work report management DB 76a stores and manages the work report information created by the work report management processing unit 75a. The risk subject factor management DB 76b stores and manages information of the risk subject factor determined as the dangerous action by the dangerous action determination processing unit 75b.
In the configuration shown in
Next, a dangerous action suppression function in the content presentation system 1 (see
(First Risk Action Suppression Function)
The first dangerous action suppression function causes a simulated accident during maintenance work in the simulated working space in a training stage and suppresses the dangerous action by strongly impressing the trainee R1 with the occurrence of the accident.
In order to realize this function, for example, the dangerous action suppression processing unit 35f of the training management server 3 adjusts the evaluation criterion information on the work operation at the specific stage of the maintenance work related to the information or at other stages, when a predetermined information that can be an accident occurrence cause of the maintenance work is inputted from the predetermined three-dimensional body motion of the model worker R2.
In addition, the dangerous action suppression processing unit 35f increases the probability of occurrence of a simulated accident with respect to the work operation at the specific stage during the simulated work or another stage by the content creation processing unit 35c, and causes the trainee, and controls to update the training content that strongly impresses the trainee R1 with the accident occurrence.
In addition, the dangerous action suppression processing unit 35f is configured to give an impression to the trainee R1 by a sound, text message, light, vibration, and the like, of the occurrence of a simulated accident.
The control operation relating to the first dangerous action suppression function will be described with reference to
As shown in
Upon receiving the work instruction, the site support terminal 7 determines whether or not the start of the operation record has been detected (step S22). The start of the operation record can be instructed by a method such as holding the dedicated marker indicated by the hand gesture, which occurs as “start of work”, in front of the camera of the site support terminal 7, or the like. Here, if it is determined that the start of the operation record has not been detected (NO in step S22), the detection processing in step S22 is continued. On the other hand, if it is determined that the start of the operation record has been detected (YES in step S22), the operation measurement processing unit 65a takes in and stores the activity information acquired by the measurement information acquisition unit 74 of the site support terminal 7 through the communication unit 62 (step S23).
While the storage processing of the activity information is being executed, the operation measurement processing unit 65a determines whether or not it is a work stage corresponding to the risk subject factor (step S24). Here, if it is determined that it is not a work phase corresponding to the risk subject factor (NO in step S24), the process proceeds to step S26. On the other hand, if it is determined that it is a work stage corresponding to the risk subject factor (YES in step S24), the operation measurement processing unit 65a records that the activity information being recorded is a work stage corresponding to the risk subject factor, in association with the relevant work stage (step S25), and after the completion of the recording, proceeds to step S26.
In accordance with the process of step S24, for example, the model worker R2 executes an action to notify a dangerous part every time, for example, by voice, during the operation recording of the three-dimensional body movement. To be specific, during the execution of the maintenance work of the work target device step by step, the model worker R2 continues the work while speaking “Do not absolutely touch here.”, “You will get burnt if you touch here.”, “You will get an electric shock if you touch here.” and the like.
On the other hand, at the site support terminal 7, the dangerous action determination processing unit 75b identifies the risk subject factor based on the above-mentioned voices and stores the risk subject factor to the risk subject factor management DB 76b associated with each work stage in which the risk subject factor is spoken out. Then, the operation measurement processing unit 65a executes the process to determine whether it is the work stage corresponding to the risk subject factor in the above-described step S24, with reference to the risk subject factor management DB 76b.
In step S26, the operation measurement processing unit 65a determines whether or not the end of the work record is detected. If it is determined that the end of the work record has not been detected (NO in step S26), the processing of step S23 and thereafter is repeatedly executed. On the other hand, if it is determined that the end of the work record has been detected (YES in step S26), the evaluation criterion creation processing unit 65b creates the evaluation criterion information including the evaluation value corresponding to each work stage of the simulated work under training, based on the work record created up to then (step S27). Subsequently, the operation measurement processing unit 65a distributes the work record and the evaluation criterion information to the site management server 6 (step S28).
On the other hand, upon receiving the work record and the evaluation criterion information from the site support terminal 7, the site management server 6 determines whether or not the evaluation criterion information has already been created (step S12). Here, if it is determined that evaluation criterion information has not been created (NO in step S12), the evaluation criterion information corresponding to the work record is created based on the work record transmitted from the site support terminal 7 (step S13), and respectively stores the work record and the evaluation criterion information (step S16).
On the other hand, upon receiving the work record and the evaluation criterion information from the site support terminal 7, the site management server 6 determines whether or not the evaluation criterion information has already been created (step S12). Here, if it is determined that evaluation criterion information has been created (YES in step S12), it is determined whether there is a setting of the work stage corresponding to the risk subject factor in the work record transmitted from the site support terminal 7 (Step S14). Here, if it is determined that there is a setting of the work stage corresponding to the risk subject factor (the work stage corresponding to the risk subject factor is referred to as a “specific stage”) in the work record (YES in step S14), the site management server 6 adjusts the evaluation value of the evaluation criterion information corresponding to the relevant work stage in the work record (step S15), and after completion of the adjustment process, the series of processes is terminated. If it is determined that there is no setting of the work stage corresponding to the risk subject factor in the work record (NO in step S14), the process is immediately terminated.
After completion of the process of step S16 or after the adjustment process of the evaluation criterion information in step S15, the site management server 6 executes an information transmission process between the site/training with the training management server 3 according to the control sequence shown in
In the process shown in
Upon receiving the work operation record and the evaluation criterion information, the training management server 3 reads the existing training manual (step S41) and executes processing to create the training content based on the work operation record (step S42). This training content is information for causing the trainee R1 to execute maintenance work according to a predetermined work procedure of the work target device as a simulated work, and includes three-dimensional shape information of the work target device and a simulated work space for executing the work as a simulated work.
Upon completion of the training content creation processing in step S42, the training management server 3 displays a screen (creation screen) for displaying the created training content on the display unit 33 (step S43). For example, in the creation screen, in the work phase corresponding to the above-mentioned risk subject factor, content created by superimposing a dangerous action suppression message as a work instruction corresponding to the risk subject factor in the 3D CG image of the work target device may be displayed.
In addition, the training management server 3 determines whether or not there is an instruction to approve the content of the creation screen while displaying the creation screen in step S43 (step S44). Here, if it is determined that there is no instruction to approve the content of the creation screen (NO in step S44), the processing of step S42 and thereafter is continued. On the other hand, if it is determined that there is an instruction to approve the content of the creation screen (YES in step S44), the training content created in step S42 is stored in the content management DB 36a.
In the control sequence shown in
After completing the storing process of the training content at step S45 in
In the training work evaluation control shown in
Upon receiving the training content from the training management server 3, the training support terminal 4 starts execution of the training content (step S51). In the processing in step S51, the CPU 41 presents the trainee R1 with the three-dimensional shape information of the work target device and the training contents based on the operation procedure of the maintenance work of the work target device. Specifically, the CPU 41 causes the display unit 43 to display the simulated work space of the virtual reality or the augmented reality (AR), so as to have the trainee R1 execute the simulated work in the simulated work space, in accordance with the work procedure of the maintenance work of the work target device.
At that time, the trainee R1, like the skilled worker R2, executes the simulated work wearing the HMD, the glove with the DoF sensor, the microphone and the like. As a result, the body motion information such as the motion of the hands and feet or the line of sight and the like of the trainee R1 during the simulated work, is taken in from the measurement information acquisition unit 74 as measurement information. Then, from this measurement information, a work operation record in the simulated work of the trainee R1 is obtained and the work operation record is compared with the evaluation criterion information received together with the work operation record from the site support terminal 7 in the determination processing of S64 and S65 to be described hereinafter, so that the evaluation determination of the simulated work is executed.
After starting the simulated work of the maintenance work of the work target device in the simulated work space in step S61 described above, the training support terminal 4 determines whether or not the screen of the work stage requiring the evaluation determination of the maintenance work as the simulated work is displayed (Step S62). Here, if it is determined that the screen of the work stage requiring evaluation determination is not displayed (NO in step S62), the CPU 41 continues the processing of step S62.
On the other hand, if it is determined that the screen of the work stage requiring evaluation determination is displayed (YES in step S62), the CPU 41 then determines whether or not the determination subject is the risk subject factor (step S63). Here, if it is determined that the determination target is not a risk subject factor (NO in step S63), the CPU 41 executes the evaluation determination process of the maintenance work at this time based on the evaluation criterion information of the work stage, and executes a process of notifying the determination result (step S65).
In step S65, the CPU 41 executes an evaluation process concerning the work of the work stage displayed on the screen based on, for example, the evaluation criterion information acquired from the evaluation criterion creation processing unit 35b of the training management server 3.
On the other hand, if it is determined that the determination target is a risk subject factor (YES in step S63), the CPU 41 executes an evaluation determination process based on the evaluation criterion information of the work stage for the risk subject factor, and if the evaluation determination result is equal to or lower than the predetermined level, an informing process for emphasizing occurrence of a simulated accident is executed (step S64).
The process in step S64 will be described in more detail. According to the control sequence of
Returning to the control sequence of
To be specific, for example, such a message as shown in
In the example of
In the example of
In the above description, as shown in
An example of the training content handled by the content presentation system 1 according to the present embodiment will be described with reference to
In the progress table contents shown in
The procedure table contents shown in
In this procedure table contents, with respect to the task name “Air Conditioner, Electric Circuit Exchange” shown in
Then, based on this progress table contents, the training support terminal 4 displays a picture (item.jpg) or 3D CG (item.fbx) for specifying the work target area and the work target during the work operation of the index 1 and the explanation display (manual_1.txt) on the notes on the current work operation and the like.
Further, during the work operation of the index 2, in order to open the cover, a picture (Cover.jpg) or 3D CG (Cover.fbx) of the cover is displayed, and a video with sound (instruction_2.mp4) for explaining the contents of the current work operation is played back and an explanation (manual_2.txt) is displayed. During the work operation of the index 3, in order to remove the electric circuit before the exchange, a picture (electronic_circuit.jpg) of the electric circuit substrate and the like and the 3D CG (electronic_circuit.fbx) around the attachment position is displayed, and the video with sound (instruction_3.mp4) explaining the contents of the current work operation is played back and an explanation (manual_3.txt) is displayed.
During the work operation of the next index 4, in order to attach the new electric circuit to the exchange target portion, a picture (electronic_circuit.jpg) of the electric circuit substrate or the like and 3D CG (electronic_circuit.fbx) around the attachment position are displayed, and the video with sound (instruction_4.mp4) explaining the current working operation is played back and an explanation (manual_4.txt) is displayed.
During the work operation of the next index 5, in order to attach the cover, a picture (Cover.jpg) or 3D CG (Cover.fbx) of the cover is displayed, and a video with sound (instruction_5.mp4) for explaining the current work operation is played back and an explanation (manual_5.txt) is displayed. During the work operation of the last index 6, in order to confirm that there is no problem in the work operation at each stage in the series of the work procedure stages, a picture (Item.jpg) or 3D CG (item.fbx) for specifying the work target area and work target and an explanation (manual_6.txt) on the notes and the like on the current work operation notes is displayed.
In the present embodiment, when creating a training content accompanied by the information presentation as exemplified above, the skilled worker R2 wearing the site support terminal 7 executes a model work in a predetermined work procedure, before or during the creation of the content incorporating the work procedure, and at least the specific stage in the work operation in which the know-how of the skilled worker 2 should be utilized and the attention should be paid is identified, and the information on the work operation of the model work that constitutes the evaluation criteria for the work operation in the specific stage is obtained (See
With regard to the work of exchanging the electric circuit of the air conditioner shown in
As described above, when the predetermined information that can be a cause of the occurrence of accident in the maintenance work is inputted from the predetermined three-dimensional body motion of the worker R2 or the trainee R1, the first dangerous action suppression function adjusts the evaluation criterion information with respect to the work operation in the specific stage or other stages of the work procedure of the maintenance work related to the information (See S15 in
By the configuration having the first dangerous action suppression function, it is possible to strongly impress the trainee R1 with the risk with the occurrence of the accident, when having the trainee R1 experience the simulated accident in the maintenance work of the work target device in the simulated work space during the training stage. Thus, when the trainee R1 completes the training and executes the maintenance work of the work target device as a worker at the work site, the trainee R1 can be consciously aware of the risk of occurrence of the accident, thereby making it possible to greatly reduce the risk of the occurrence of the accident compared to the previous maintenance work in which the above-described consciousness has been insufficient.
Further, the first dangerous action suppression function is designed to impress the trainee R1 with the occurrence of the simulated accident by sound, text message, light, vibration and the like. By this configuration, it is possible to strongly and securely impress the trainee R1, who experiences the simulated accident occurrence during the training stage, with the risk of the occurrence of the accident, so that the dangerous action can be more securely suppressed.
(Second Dangerous Action Suppression Function)
The second dangerous action suppression function is a function to extract an item having a high occurrence rate of accident as a result of training of a simulated work related to a predetermined work in the training support terminal 4 based on control by the training management server 3, and to define a risk subject (risk occurrence factor) with regard to the item.
In order to realize this function, the content presentation system 1 has the following configuration in addition to the configuration for realizing the first dangerous action suppression function. For example, the training support terminal 4 has a dangerous action determination processing unit 45a and a risk subject factor management DB 46a, and the site support terminal 7 has a dangerous action determination processing unit 75b and a risk subject factor management DB 76b. In the training support terminal 4, the dangerous action determination processing unit 45a monitors the occurrence of the accident during the execution of the simulated work (training) of the predetermined work in the simulated work space, and defines the risk factor for the work item having the high accident occurrence rate. To be specific, for each item having a high accident occurrence rate, possible risk is identified and the content of the risk (risk occurrence factor) and the method of avoiding the risk are stored in the risk subject factor management DB 46a correspondingly to the above items.
In the risk subject factor management DB 46a, an item (first item) with high accident occurrence rate and danger content (second item) are provided as setting items. As a result of training, the dangerous action determination processing unit 45a sets (defines) “high place work” and “fall” to the first and the second item, respectively, as an item with high accident occurrence rate, in the case that, for example a high place work is extracted. Further, the dangerous action determination processing section 45a sets “damage of article” and “careless confirmation, careless walk” to the first and the second item, respectively, as an item with high accident occurrence rate, in the case that, for example, a damage of article is extracted.
The content presentation system 1 distributes the definition information set in the risk subject factor management DB of the training support terminal 4 to the site management server 6 via the training management server 3. The site management server 6 further distributes the definition content delivered from the training management server 3 to the site support terminal 7. In the site support terminal 7, the dangerous action determination processing unit 75b stores the definition content delivered from the site management server 6 in the risk subject factor management DB 76b.
Thereafter, at the site support terminal 7, under the control of the dangerous action suppression processing unit 65f of the site management server 6, the CPU 71 executes the dangerous action suppression control based on the definition of the risk subject stored in the risk subject factor management DB 76b. The dangerous action suppression control will be described with reference to
In the content presentation system 1, in order to cause the work on the work target device at the site support terminal 7 to be executed, as shown in
The site support terminal 7 starts the work for the work target device by receiving the maintenance work start instruction (step S81). When the work is started, the site support terminal 7 sequentially updates and displays screens corresponding to the respective stages of the work in accordance with the progress of the work (step S82). The screen of each work stage to be displayed is the content of the screen in which work instruction and the like in the work stages corresponding to the work target device (real machine) is displayed in AR.
The site support terminal 7 refers to the risk subject factor management DB 76b in accordance with the progress of the work and determines whether or not a risk subject is defined corresponding to the work stage (step S83). Here, if it is determined that the risk subject is defined (YES in step S38), the CPU 71 displays in AR a dangerous action suppression message on the screen (step S84). Here, for example, a message “Beware of falling” is displayed if it is a work stage of a high place work, and a message such as “Beware of confirmation. Beware of walking.” etc. is displayed if it is a work stage causing a damage of article. Thereafter, the site support terminal 7 moves to step S85.
On the other hand, if it is determined that the dangerous object is not defined (NO in step S83), the site support terminal 7 immediately proceeds to step S85. In step S85, the site support terminal 7 determines whether or not the work has ended. Here, if it is determined that the work has not ended (NO in step S85), the CPU 71 continues the processing in step S83 and thereafter. On the other hand, if it is determined that the work has ended (YES in step S85), the CPU 71 ends the series of the dangerous action suppression control described above.
In the above description, explanation is given to an example in which the dangerous action determination processing unit 45a of the training support terminal 4 has constructed the risk subject factor management DB 46a and distributes the definition information set in the risk subject factor management DB 46a to the site management server 6 and the site support terminal 7, however, the dangerous action determination processing unit 75b in the site support terminal 7 may, for example, monitor the occurrence of the accident during the maintenance work of the work target device by the worker R3, and define the risk subject factor as the risk subject factor management DB 76b for the work item having a high accident occurrence rate.
As described above, the second dangerous action suppression function defines a risk subject for an item having a high accident occurrence rate as a result of training using the simulated workspace, and at the time of the work in the work site, displays in AR the dangerous action suppression message based on the definition. By the configuration having this function, when the trainee R1, having experienced the accident in the training stage, executes the work as the worker R3 in the work site, it is possible to suppress danger in stages.
(Third Dangerous Action Suppression Function)
The third dangerous action suppression function updates the risk subject in accordance with the change in the current situation when there is a description showing the change from the current state in the work report prepared through the work in the work site.
As a component related to this function, the content presentation system 1 has the following configuration in addition to the configuration for realizing the above-described first and second dangerous action suppression functions. This means that the site support terminal 7 has a work report management processing unit 75a and a work report management DB 76a. The work report management processing unit 75a has, for example, a processing function to execute processing for creating a work report that describes the work content of the maintenance work of the work target device and the work environment, and to execute processing for registering the work report in the work report management DB 76a. Further, in the site support terminal 7, the CPU 71 has a processing function related to determining whether or not there is a description about the change in the work content and the work environment between a newly created work report and a work report already registered and the like.
Hereinafter, the third dangerous action suppression control at the site work at the site support terminal 7 will be described with reference to
Next, the work report management processing unit 75a reads the pre-work report registered in the work report management DB 76a (step S87), and determines, for example, whether there is a change between the new work report and the preexisting work report (step S88). This determination can be realized, for example, by checking whether or not there is a description indicating a fact that the description of the existing work report has changed with respect to items that can become a risk subject in the new work report.
If it is determined that the current status has changed (YES in step S88), the work report management processing unit 75a performs a process to update the risk subject set in the risk subject factor management DB 76b (step S89).
A specific example of the updating process of the risk subject in step S89 will be described. For example, in the determination in step S88, if there is a description in the new work report that a layout of the room in which the work target device is installed changes to indicate that a narrow passage has been formed, the dangerous action determination process unit 75b adds a new setting item to define an item “passage changes narrower due to layout change” as the first item and an item “wall damage in transportation” as the second item to the risk subject factor management DB 76b.
Thereafter, in the site support terminal 7, under the control of the dangerous action suppression processing unit 65f of the site management server 6, the CPU 71 executes the dangerous action suppression control based on the definition of the risk subject stored in the risk subject factor management DB 76b. The dangerous action suppression control can be executed by a procedure shown in a flowchart of
Thus, the third dangerous action suppression function is adapted to update the risk subject set in the risk subject factor management DB 76b when there is a description on the current status change in the work report. By the configuration having this function, even when there is a change in the current state in the work in the work site, by displaying in AR the dangerous action suppression message conforming to the current situation change on the screen showing a progress of the work, it is possible to suppress the danger in a stepwise manner in accordance with the change of the current state.
(Fourth Dangerous Action Suppression Function)
In order to realize a fourth dangerous action suppression function, the content presentation system 1 has the following configuration in addition to the configuration for realizing the first to third dangerous action suppression functions. For example, in the site support terminal 7, index information such as a type of the target device, site situation, worker skill, and the like are stored in a risk subject factor management DB 76b, in addition to the definition content of the above-described risk subject. This index information can be stored in advance, for example, under the control of a dangerous action determination processing section 75b. In addition, the dangerous action determination processing unit 75b has a function to extract step-wise warning elements from the index information based on the risk subject set in the risk subject factor management DB 76b, and a function to execute a step-wise warning display corresponding to the step-wise warning elements.
Hereinafter, the fourth dangerous action suppression control in the site support terminal 7 at the time of the work in the work site will be described with reference to
When this dangerous action suppression control is started in the site support terminal 7, the dangerous action determination processing unit 75b reads the risk subject item and the index information from the risk subject factor management DB 76b (step S91). Subsequently, the dangerous action determination processing unit 75b extracts the risk element from the risk subject item (step S92). Further, the dangerous action determination processing unit 75b determines the stepwise warning item based on the extracted risk element and the index information (step S93).
For example, in a case where the type of the work target device in the site, the site situation, and the worker skill are set as the index information, it is possible to determine the step-wise warning items such as “Call attention in accordance with the skill of the worker at the time of carrying in/out the work target device” and “Call attention in accordance with the skill of the worker at the time of the work of the work target device.” in the dangerous action determination processing unit 75b. Further, it is also possible to determine the step-wise warning items such as “Request preliminary confirmation to the control side”, “Forcibly turn off the power of the work target device” with respect to the work with a high degree of danger in the dangerous action determination processing unit 75b. The determined step-wise warning items are set in, for example, the risk subject factor management DB 76b.
After setting the step-wise warning items in the above step S93, the dangerous action suppression control moves to a stage of executing the maintenance work of the work target device in the site at the site support terminal 7 (See steps S81 to S85 in
As described above, the fourth dangerous action suppression function is adapted to extract the step-wise warning elements from information such as the target device on the site, the site situation, the worker skill, and the like, based on the risk subject set (defined) in the risk subject factor control DB 76b, and to give a step-wise warning display corresponding to the step-wise warning elements. By the configuration having this function, it is possible for the trainee R1 who can experience a simulated accident in the training in the training management system 5, after finishing the training, suppress the risk in a step-wise manner in accordance with own skill and the like at the time when working in the site as a worker, with respect to the items having a high accident occurrence rate during the training.
As described above, the content presentation system according to the present invention strongly impresses the trainee with the danger of the accident by generating a simulated accident in the training stage, so as to realize an effect to securely suppress the risk of the accident in the maintenance work of the work target device in the work site, thereby making it possible to be applied to a training system in general that executes the training using the 3D CG of the device having a constituent element which endanger the worker.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2018-124689 | Jun 2018 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2018/031353 | 8/24/2018 | WO | 00 |
