Patent Application
20240003766
The present disclosure relates to a contact information obtaining apparatus, a contact information obtaining system, a contact information obtaining method, and a contact information obtaining program.
Since there is a case where a tactile examination is used in an inspection of a machine and a device, technology to make the tactile examination remote is in demand. A main purpose of the tactile examination is to verify how firmly fastened target equipment is and to verify that the target equipment operates smoothly. Since there is a wide variety of target equipment for the tactile examination and work spaces at sites where the tactile examination is executed are often limited, a system that obtains information from a sense of touch of a worker without using a large-scale device at a time of making the tactile examination remote is necessary.
Patent Literature 1 discloses technology that deduces pressure that a finger applies to a target object by measuring force put on a gate shaped member covering a side surface of the finger and applying a measured result to a deducing model concerning the finger. In the present technology, the deducing model is switched depending on whether or not there is movement of a fingertip.
According to the technology disclosed in Patent Literature 1, since the force applied to the target object is deduced without taking an orientation of a pressure sensor that measures pressure that the finger applies to the target object and a characteristic of a hand of a worker into consideration, there is an issue where accuracy in deducing a reaction of the target object is low in a tactile examination.
The present disclosure aims to deduce force applied to a target object by taking an orientation of a pressure sensor that measures pressure that a finger applies to a target object and a characteristic of a hand of a worker into consideration.
A contact information obtaining apparatus according to the present disclosure includes:
According to the present disclosure, an applied-pressure direction is deduced using direction data and characteristic data. Consequently, according to the present disclosure, force applied to a target object can be deduced by taking an orientation of a pressure sensor that measures pressure that a finger applies to the target object and a characteristic of a hand of a worker into consideration.
In the description of the embodiment and in the drawings, the same reference signs are added to the same elements and corresponding elements. Descriptions of elements having the same reference signs added will be suitably omitted or simplified. Arrows in the drawings mainly indicate flows of data or flows of processes. “Unit” may be suitably replaced with “circuit”, “step”, “procedure”, “process”, or “circuitry”.
The present embodiment will be described in detail below by referring to the drawings.
***Description of Configuration***
The glove 20 is a glove that a worker wears at a time of executing a tactile examination. A pressure sensor 21 and a direction sensor 22 are attached to the glove 20. Any number of each of the pressure sensor 21 and the direction sensor 22 may be attached to the glove 20. The worker may wear the glove 20 on one hand or may wear the glove 20 on both hands.
The tactile examination, as a specific example, is to shake a target object 300, turn a pulley that is the target object 300, measure force put on a rope that is the target object 300, push or pull on the rope that is the target object 300, verify whether or not a connector that is the target object 300 is appropriately inserted, verify whether or not the target object 300 moves smoothly, verify in a time series how pressure is put on the target object 300 by moving a position of the target object 300 to detect the target object 300 being caught and the like, or to verify by pressing a switch that is the target object 300, whether or not the switch can be pressed smoothly. Here, the target object 300 is a target of the tactile examination, and there may be a plurality of target objects 300 of a type or there may be target objects 300 of a plurality of types.
The pressure sensor 21 is a sensor that measures pressure that the worker is applying to the target object 300 using the hand of the worker. The worker may exist in a plurality of numbers. The pressure sensor 21 is suitably attached to a part where a portion of a hand used at a time of the worker executing the tactile examination touches. The pressure sensors 21, as specific examples, are attached to the glove 20 on a part that touches a pad of each finger of the hand of the worker and on a part that touches a palm of the worker. The finger, unless otherwise noted, means the finger of the hand. The pressure sensor 21 may measure pressure that each finger of at least one finger of the hand of the worker is applying to the target object 300.
The direction sensor 22 is a sensor that measures a direction concerning the hand and is a sensor to measure a direction of the pressure sensor 21, and typically consists of an azimuth sensor and an acceleration sensor. The direction concerning the hand, as a specific example, is a direction of the finger or a direction of the palm. The direction, as a specific example, consists of an azimuth and an inclination from a horizontal slope. A coordinate system that specifies a direction may be defined in any manner. The direction sensors 22, as specific examples, are attached to a part that touches a dorsal side of each finger of the hand and that is opposite the part that the pressure sensor 21 is attached and to a part that touches a dorsal side of the palm of the worker. The direction sensor 22 may measure a direction of each finger of at least one finger of the hand of the worker.
The contact information obtaining apparatus 100 includes an applied-pressure direction deducing unit 110, a reaction calculation unit 120, a determination unit 130, and a characteristic DB 140.
The applied-pressure direction deducing unit 110, using pressure data that the pressure sensor 21 measured, direction data that the direction sensor 22 measured, and characteristic data that indicates a characteristic of the hand, deduces an applied-pressure direction. The applied-pressure direction is a direction of the pressure that the hand of the worker is applying to the target object 300, and is a direction relative to the target object 300. The applied-pressure direction deducing unit 110 may deduce a plurality of applied-pressure directions in a case where the worker is applying pressure to the target object 300 using a plurality of fingers.
The reaction calculation unit 120, using the pressure data and the applied-pressure direction that is deduced, calculates an applied-pressure reaction that is a reaction of the target object 300 caused by the worker applying pressure to the target object 300. The applied-pressure reaction, as a specific example, is at least one of excitation force on the target object 300 and a response of the target object 300.
The determination unit 130 determines whether or not the applied-pressure reaction is within a reference range. The reference range is a range of the applied-pressure reaction that must be satisfied in the tactile examination on the target object 300 and a range of the applied-pressure reaction that is quantified.
The characteristic DB 140 stores as the characteristic data, data that indicates a shape and an elasticity value of each finger of at least one finger of a hand of each worker. The shape of each finger, as specific examples, is a length and a thickness of each finger. Taking the elasticity value of each finger of each worker not always being constant, as a specific example, the elasticity value differs for each season into consideration, a plurality of types of elasticity values for each finger of each worker may be stored. The characteristic DB 140 may store a shape and an elasticity value of a different portion of the hand of each worker.
The reaction DB 200 stores data that indicates the applied-pressure reaction in the tactile examination on each target object 300. An information presentation device that is possible to reproduce sense of force information, vibration, or the like as physical motion may reproduce the tactile examination on each target object 300 using the data that the reaction DB 200 has stored. The information presentation device is a device that reproduces the applied-pressure reaction that the reaction calculation unit 120 calculated, and as a specific example, is a haptic device.
The contact information obtaining apparatus 100, as illustrated in the present diagram, is a computer that includes hardware such as a processor 11, a memory 12, an auxiliary storage device 13, input/output IF (Interface) 14, a communication device 15, and the like. These pieces of hardware are suitably connected through a signal line 19.
The processor 11 is an IC (Integrated Circuit) that performs a calculation process, and controls hardware that the computer includes. The processor 11, as a specific example, is a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or a GPU (Graphics Processing Unit).
The contact information obtaining apparatus 100 may include a plurality of processors that replace the processor 11. The plurality of processors share roles of the processor 11.
The memory 12 is typically a volatile storage device. The memory 12 is also called a main storage device or a main memory. The memory 12, as a specific example, is a RAM (Random Access Memory). Data stored in the memory 12 is saved in the auxiliary storage device 13 as necessary.
The auxiliary storage device 13 is typically a non-volatile storage device. The auxiliary storage device 13, as a specific example, is a ROM (Read Only Memory), an HDD (Hard Disk Drive), or a flash memory. Data stored in the auxiliary storage device 13 is loaded into the memory 12 as necessary.
The memory 12 and the auxiliary storage device 13 may be configured integrally.
The input/output IF 14 is a port to which an input device and an output device are connected. The input/output IF 14, as a specific example, is a USB (Universal Serial Bus) terminal. Input devices, as specific examples, are a keyboard and a mouse.
The output device, as a specific example, is a display.
The communication device 15 is a receiver and a transmitter. The communication device 15, as a specific example, is a communication chip or an NIC (Network Interface Card).
Each unit of the contact information obtaining apparatus 100 may suitably use the input/output IF 14 and the communication device 15 at a time of communicating with a different device and the like.
The auxiliary storage device 13 has stored a contact information obtaining program. The contact information obtaining program is a program that causes a computer to enable functions of each unit that the contact information obtaining apparatus 100 includes. The contact information obtaining program is loaded into the memory 12, and executed by the processor 11. The functions of each unit that the contact information obtaining apparatus 100 includes are enabled by software.
Data used at a time of executing the contact information obtaining program, data obtained by executing the contact information obtaining program, and the like are suitably stored in a storage device. Each unit of the contact information obtaining apparatus 100 suitably utilizes the storage device. The storage device, as a specific example, consists of at least one of the memory 12, the auxiliary storage device 13, a register in the processor 11, and a cache memory in the processor 11. There is a case where data and information have an equal meaning. The storage device may be a device that is independent of the computer.
Functions of the memory 12 and the auxiliary storage device 13 may be enabled by a different storage device.
The contact information obtaining program may be recorded in a computer-readable non-volatile recording medium. The non-volatile recording medium, as a specific example, is an optical disc or a flash memory. The contact information obtaining program may be provided as a program product.
***Description of Operation***
An operation procedure of the contact information obtaining apparatus 100 is equivalent to a contact information obtaining method. A program that enables operation of the contact information obtaining apparatus 100 is equivalent to the contact information obtaining program.
(Step S101)
The worker wearing the glove 20 executes the tactile examination on the target object 300 at a work site, and the pressure sensor 21 and the direction sensor 22 collect data. The data that the pressure sensor 21 and the direction sensor 22 collected is suitably transmitted to the contact information obtaining apparatus 100.
(Step S102)
The contact information obtaining apparatus 100 receives the data from the pressure sensor 21 and the direction sensor 22. The data that the contact information obtaining apparatus 100 receives may be raw data that each of the pressure sensor 21 and the direction sensor 22 obtained.
Below, the data that indicates pressure the pressure sensor 21 measured will be expressed as the pressure data, and the data that indicates a direction that the direction sensor 22 measured will be expressed as the direction data.
(Step S103)
The applied-pressure direction deducing unit 110 calculates a contact angle of the pressure sensor 21 with respect to the target object 300 based on the data received from the direction sensor 22.
(Step S104)
The applied-pressure direction deducing unit 110 locates as a work portion, each portion of the hand of the worker that the worker is using in the tactile examination based on the pressure data, and obtains from the characteristic DB 140, data that indicates a shape and an elasticity value of each work portion located. The work portion, as a specific example, is at least one of at least one of the fingers of the worker and the palm of the worker.
(Step S105)
The applied-pressure direction deducing unit 110 calculates a shape change amount of each work portion using the pressure data and the data on each work portion obtained from the characteristic DB 140, and corrects the contact angle calculated in step S103 based on each shape change amount calculated.
Here, an orientation of the pressure sensor 21 changes according to a shape change of the work portion. Furthermore, since there is a case where a misalignment also occurs between the orientation of the pressure sensor 21 and the applied-pressure direction, the applied-pressure direction deducing unit 110 deduces the applied-pressure direction using a deducing algorithm that deduces a shape change of the finger and a change in an orientation of force caused by the shape change of the finger. In a case where the work portion is a finger, when a sensor other than the pressure sensor 21 is provided on a side of the pad of the finger to deduce the shape change of the finger, workability in the tactile examination is lost. Therefore, in the present embodiment, the shape change of the finger is deduced by applying to the deducing algorithm, the data that the pressure sensor 21 measured without providing a sensor other than the pressure sensor 21 on the side of the pad of the finger, and the data that the characteristic DB 140 has stored.
Note that (b) of
Note that (c) of
(Step S106) In a case where a correction amount of the contact angle in step S105 is more than or equal to a certain amount, the contact information obtaining apparatus 100 returns to step S103. In other cases, the contact information obtaining apparatus 100 proceeds to step S107.
(Step S107)
The reaction calculation unit 120 calculates magnitude and a direction of the applied-pressure reaction at each point of contact of the target object 300 corresponding to each piece of pressure data using the pressure data corresponding to each pressure sensor 21 and the applied-pressure direction that is deduced. The point of contact is a point at which the target object 300 and the pressure sensor 21 are in contact directly or indirectly.
(Step S108)
The reaction calculation unit 120 calculates an applied-pressure reaction of an entire the target object 300 using the magnitude and the direction of the applied-pressure reaction at each point of contact of the target object 300 calculated in step S107.
The determination unit 130 determines whether or not the applied-pressure reaction calculated is within the reference range, and suitably outputs a result that is determined.
(Step S109)
The reaction calculation unit 120 registers the applied-pressure reaction calculated in step S107 and step S108 with the reaction DB 200.
As described above, according to the present embodiment, the applied-pressure reaction of the target object 300 can be deduced with relatively high accuracy while maintaining workability of the worker in the tactile examination relatively high.
***Other Configurations***
<Variation 1>
The target object DB 150 stores target object data that indicates a three-dimensional shape and rigidity of each target object 300. The target object DB 150 may store only a three-dimensional shape and rigidity of a gripping part of each target object 300.
An applied-pressure direction deducing unit 110 according to the present variation deduces the applied-pressure direction using the target object data.
A reaction calculation unit 120 according to the present variation calculates the applied-pressure reaction using the target object data.
Below, a difference between operation of the contact information obtaining system 90 according to the present variation and the operation of the contact information obtaining system 90 according to Embodiment 1 will mainly be described.
(Step S104)
The applied-pressure direction deducing unit 110 also obtains together, data that the target object DB 150 has stored.
(Step S105)
The applied-pressure direction deducing unit 110 corrects the contact angle calculated in step S103 using also the data obtained from the target object DB 150. As a specific example, the applied-pressure direction deducing unit 110 deduces a gripping posture of the worker using the target object data obtained from the target object DB 150, and adjusts, based on the gripping posture deduced, the applied-pressure direction that is found based on the pressure data and the data obtained from the characteristic DB 140.
In step S107 and step S108, the reaction calculation unit 120 calculates the applied-pressure reaction using the target object data obtained from the target object DB 150. As a specific example, the reaction calculation unit 120 calculates a degree to which the applied-pressure reaction is realistically achieved based on the three-dimensional shape and the rigidity of the target object 300, and finds an applied-pressure reaction that has a high degree of realistically being achieved.
According to the present variation, since the applied-pressure direction is deduced by taking the three-dimensional shape and the rigidity of the target object 300 into consideration, accuracy in deducing the applied-pressure direction increase.
<Variation 2>
The contact information obtaining apparatus 100 includes a processing circuit 18 instead of the processor 11, the processor 11 and the memory 12, the processor 11 and the auxiliary storage device 13, or the processor 11, the memory 12, and the auxiliary storage device 13.
The processing circuit 18 is hardware that enables at least a part of each unit that the contact information obtaining apparatus 100 includes.
The processing circuit 18 may be dedicated hardware and may be a processor that executes a program stored in the memory 12.
In a case where the processing circuit 18 is dedicated hardware, the processing circuit 18, as a specific example, is a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (ASIC is Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these.
The contact information obtaining apparatus 100 may include a plurality of processing circuits that replace the processing circuit 18. The plurality of processing circuits share roles of the processing circuit 18.
In the contact information obtaining apparatus 100, a part of functions may be enabled by dedicated hardware and the rest of the functions may be enabled by software or firmware.
The processing circuit 18, as a specific example, is enabled by hardware, software, firmware, or a combination of these.
The processor 11, the memory 12, the auxiliary storage device 13, and the processing circuit 18 are generically called “processing circuitry”. That is, functions of each functional element of the contact information obtaining apparatus 100 are enabled by the processing circuitry.
A description with regard to Embodiment 1 has been given, but within the present embodiment, a plurality of parts may be combined and executed. Or, the present embodiment may be executed partially. In addition, various changes may be made to the present embodiment as necessary, and the present embodiment may be arranged and executed in any manner, either fully or partially.
The embodiment mentioned above is an essentially preferred example, and is not intended to limit the present disclosure, the application of the present disclosure, and the scope of use. The procedures described using the flowchart and the like may be suitably changed.
This application is a Continuation of PCT International Application No. PCT/JP2021/015283, filed on Apr. 13, 2021, which is hereby expressly incorporated by reference into the present application.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2021/015283 | Apr 2021 | US |
| Child | 18367511 | US |
