This invention relates to an emotion improving apparatus and an emotion improving method for improving an emotion of users of a working machine.
Apparatuses have been known that estimate the emotions of multiple occupants of a vehicle and control the vehicle so that the vehicle improves the emotions (for example, see Patent Literature 1). In the case of the apparatus described in Patent Literature 1, when occupants start to quarrel with each other during a travel of a vehicle, it blows the maximum amount of cold blast on the occupants through the air outlet of an air-conditioner to give the occupants an opportunity to restore calm.
Patent Literature 1: Japanese Unexamined Patent Publication No. 2016-137200
It is desirable to configure a working machine such that if the emotions of users thereof deteriorate, the working machine can improve the emotions. Unfortunately, the apparatus of Patent Literature 1 is configured to improve the emotions of occupants of a vehicle, and it is difficult to apply the technology of Patent Literature 1 to a working machine, which is not premised on a ride in a vehicle.
An aspect of the present invention is an emotion improving apparatus for improving an emotion improving apparatus for improving an uncomfortable emotion of a user of a working machine, including: a biological information acquiring unit configured to acquire a biological information of the user; an uncomfortable emotion determining unit configured to determine whether a predetermined uncomfortable emotion occurs to the user based on the biological information acquired by the biological information acquiring unit; and a working machine controlling unit configured to control the working machine to perform a predetermined operation for improving the uncomfortable emotion to the user when it is determined by the uncomfortable emotion determining unit that the predetermined uncomfortable emotion occurs.
Another aspect of the present invention is an emotion improving method for improving an uncomfortable emotion of a user of a working machine, including: acquiring a biological information of the user; determining whether a predetermined uncomfortable emotion occurs to the user based on the biological information acquired; and controlling the working machine to perform a predetermined operation for improving the uncomfortable emotion to the user when it is determined that the predetermined uncomfortable emotion occurs.
According to the present invention, uncomfortable emotions of users of a working machine can be favorably improved on the basis of the operation of the working machine.
Now, an embodiment of the present invention will be described with reference to
A disc-shaped, lawn mowing blade 5 supported by a rotating shaft 5a protrudes toward the ground (lawn ground) GR from the bottom of the body 2. The working machine 1 is able to mow the lawn by rotating the blade 5 while traveling on the ground GR. The front end of the body 2 is provided with charging terminals 6 for charging a battery (
The camera 21, microphone 22, and thermography 23 form a biological information acquiring unit 20 that acquires biological information of users. Specifically, the camera 21 captures images of the upper-bodies of the users, including the faces, and detects the facial expressions or motions of the users; the microphone 22 acquires speeches uttered by the users, and the speeches acquired by the microphone 22 are recognized by a speech recognition unit (not shown) of the ECU 10; and the thermography 23 detects the body temperatures of the users, for example, the surface temperatures of the faces.
The biological information acquiring unit 20 (21 to 23) is used to estimate the emotions of the users. Note that the users include not only a person who is using the working machine 1, but also persons present around the working machine 1. That is, persons recognizable by the working machine 1, in other words, persons around the working machine 1 are referred to as the users herein.
The sensors 24 include a pair of magnetic sensors 24a spaced from each other in the vehicle width direction, and the magnetic sensors 24a detect the magnetic field strength. Although not shown, the sensors 24 also include a Yaw sensor that detects the angular velocity around an axis in the height direction of the working machine 1, a G sensor that detects the acceleration that acts on the working machine 1, an azimuth sensor that detects the azimuth of the working machine 1, a contact sensor that detects whether the working machine 1 has contacted an obstacle, a wheel speed sensor that detects the wheel speed of the left and right rear wheels 4, a GPS sensor that detects the position of the working machine 1, a voltage sensor that detects the remaining voltage of the battery 29, and the like. The speaker 25 outputs a speech to the users. The microphone 22 and speaker 25 allow the working machine 1 to interact with the user.
The working actuator 26 comprises an electric motor coupled to the rotating shaft 5a. The blade 5 is rotationally driven by driving the working actuator 26. The traveling actuator 27 comprises a pair of electric motors that are disposed inside the left and right rear wheels 4 in the left-right direction and independently drive the left and right rear wheels 4. The working machine 1 can be turned in any direction by making a difference in rotation speed between the left and right rear wheels 4.
The communication unit 28 includes a transmitting/receiving antenna and a signal processing circuit that processes a signal transmitted or received through the transmitting/receiving antenna. The working machine 1 is able to wirelessly communicate with external devices (e.g., a relay device or server disposed in the same site, mobile terminals carried by the users, etc.) through the communication unit 28. The battery 29 is used as a power supply for supplying power to the electric components of the working machine 1. The charging unit 30 is connected to the charging terminals 6 and battery 29 and stores power supplied from a charging station (
The working machine 1 thus configured works while autonomously traveling within a predetermined working area.
The magnetic field strength changes in accordance with the distance from the area wire 7. The ECU 10 (CPU 10A) determines whether the working machine 1 has reached the area wire 7, on the basis of signals from the magnetic sensors 24a. If it determines that the working machine 1 has reached the area wire 7, the ECU 10 outputs control signals to the traveling actuator 27 to turn the working machine 1 toward the inside of the working area AR, as shown by an arrow in
A charging station 8 for charging the battery 29 is disposed on the area wire 7. If the sensors 24 (e.g., a voltage sensor) detect a voltage shortage of the battery 29 while the working machine 1 works, the ECU 10 outputs control signals to the traveling actuator 27 to return the working machine 1 to the charging station 8, for example, along the area wire 7 and then charges the battery 29. When the charge of the battery 29 is complete, the ECU 10 outputs control signals to the traveling actuator 27 to cause the working machine 1 to leave the charging station 8. The ECU 10 then drives the working actuator 26 to cause the working machine 1 to restart to work.
As described above, the working area AR is set by installing the area wire 7, and the working machine 1 (ECU 10) works while recognizing the working area AR in accordance with the signals from the magnetic sensors 24a. However, the method for setting and recognizing the working area is not limited to that described above. For example, the ECU 10 may receive a beacon signal through the communication unit 28, and the working machine 1 may work in the working area while recognizing the working area using the received signal. Also, a map of the working area may be previously stored in the memory 10B of the ECU 10, and the working machine 1 may work in the working area while detecting its own position using a GPS sensor or the like. That is, the working area may be set using a working area setting unit other than the area wire 7, and the working machine may work while recognizing the working area using a position detector other than the magnetic sensors.
If multiple users (persons around the working machine 1) have uncomfortable emotions in the working area AR due to, for example, a quarrel between them, it is preferred to improve the uncomfortable emotions. In the present embodiment, an attempt is made to improve the uncomfortable emotions using the working machine 1. That is, the working machine 1 automatically works near the users and therefore the users tend to feel familiar with the working machine 1; and for this reason, in the present embodiment, the working machine 1 is configured as follows to provide the users with a predetermined service for improving the uncomfortable emotions if the users have uncomfortable emotions.
The emotion estimating unit 12 estimates the emotions of the users on the basis of biological information acquired by the biological information acquiring unit 20. For example, using the wheel of emotions of Plutchik, the emotions of the users can be categorized into eight basic emotions (anticipation, joy, acceptance, fear, surprise, sadness, disgust, and anger) and application emotions consisting of adjacent pairs of these emotions. The emotion estimating unit 12 selects one of these categorized emotions, that is, emotion models.
More specifically, the emotion estimating unit 12 first identifies the facial expressions (the mouth angles, etc.) or motions (gestures, etc.) of the users on the basis of image signals from the camera 21, identifies details of speeches uttered by the users or characteristics of the speeches, such as accent or pronunciation, on the basis of speech signals from the microphone 22, and identifies the facial temperatures of the users on the basis of temperature detection signals from the thermography 23. The emotion estimating unit 12 then estimates the emotions of the users by comparing the forms of these identified facial expressions, motions, speech details or characteristics, and facial temperatures with the forms of multiple facial expressions, motions, speech details or characteristics, and facial temperatures previously stored so as to be associated with multiple emotions and determining which of the previously stored forms the identified forms match.
The uncomfortable emotion determining unit 11 converts the emotions of the users estimated by the emotion estimating unit 12 into numerical values. For example, it converts comfortable emotions (positive emotions), such as joy and fun, into positive values and uncomfortable emotions (negative emotions), such as sadness and anger, into negative values. For example, a stronger emotion (a more inner emotion in the wheel of emotions) is given a greater value (absolute value) as a numerical value representing the emotion. Thus, the uncomfortable emotion determining unit 11 obtains the levels of the uncomfortable emotions (e.g., the levels of anger) of the users. If the obtained levels of the uncomfortable emotions reach a predetermined value, the uncomfortable emotion determining unit 11 determines that predetermined uncomfortable emotions to be improved are occurring.
The operation storing unit 13 stores multiple candidate improvement operations for improving uncomfortable emotions. Examples of the improvement operations include an operation in which the working machine 1 traverses between multiple users by driving the traveling actuator 27, an operation in which the working machine 1 travels in a predetermined pattern (e.g., in a zig-zag pattern) around users by driving the traveling actuator 27, an operation in which the working machine 1 mows the lawn in a predetermined pattern (e.g., in a heart pattern) by driving the working actuator 26 and traveling actuator 27, an operation in which the working machine 1 outputs a speech providing a topic or including apology words from the speaker 25, an operation in which the working machine 1 outputs from the speaker 25 an speech inputted through the microphone 22, like a parrot, an operation in which the working machine 1 outputs predetermined music from the speaker 25, an operation in which the working machine 1 performs transmission or placement of a predetermined message email or call to the mobile phones of users through the communication unit 28, and an operation in which the working machine 1 outputs one of past conversations recorded when users had comfortable emotions.
These improvement operations are stored with priorities. An improvement operation expected to improve an uncomfortable emotion to a greater degree is assigned a higher priority.
The operation selecting unit 14 selects an improvement operation to be applied to improve the uncomfortable emotions, from among the improvement operations stored in the operation storing unit 13. For example, it selects an improvement operation having the highest priority. Alternatively, the operation selecting unit 14 may determine an operation to be selected, in accordance with the levels of the uncomfortable emotions obtained by the uncomfortable emotion determining unit 11. For example, if the estimated levels of the uncomfortable emotions are low, the operation selecting unit 14 may select an improvement operation corresponding to the uncomfortable emotions rather than an improvement operation having the highest priority. Or, the operation selecting unit 14 may preferentially select an improvement operation that the working machine 1 can easily perform.
The working machine controlling unit 15 outputs control signals to at least one of the working actuator 26, traveling actuator 27 and speaker 25 so that the working machine 1 performs the improvement operation selected by the operation selecting unit 14, that is, the predetermined operation for improving the uncomfortable emotions.
The effect measuring unit 16 measures the degrees of improvement of the uncomfortable emotions when the working machine 1 performs the improvement operation selected by the operation selecting unit 14 on the basis of the command from the working machine controlling unit 15. Specifically, the emotions of the users on the basis of the biological information acquired by the biological information acquiring unit 20 is estimated, and the effect measuring unit 16 determines whether the levels of the uncomfortable emotions have been improved to a predetermined value or more, for example, whether the levels of the uncomfortable emotions (negative emotions) have become zero, that is, a sufficient uncomfortable emotion improving effect has been obtained.
If the effect measuring unit 16 determines that the degrees of improvement of the uncomfortable emotions made by performing the selected improvement operation are less than the predetermined value, the operation selecting unit 14 lowers the priority of that operation and selects another improvement operation. For example, if an improvement operation having the highest priority is selected and the degrees of improvement of the uncomfortable emotions made by performing this improvement operation are less than the predetermined value, the operation selecting unit 14 lowers the priority of the improvement operation by one level and selects an improvement operation having the second highest priority. Then, the selected improvement operation is performed. Thus, if the effect measuring unit 16 determines that the degrees of improvement of the uncomfortable emotions are the predetermined value or more, the operation selecting unit 14 raises the priority of that operation, that is, updates priorities of the improvement operations stored in the operation storing unit 13.
First, in step S1, the biological information acquiring unit 20 (camera 21, microphone 22, thermography 23) acquires biological information of the users. Then, in step S2, the emotion estimating unit 12 estimates the emotions of the users on the basis of the acquired biological information. Then, in step S3, the uncomfortable emotion determining unit 11 calculates the levels of the uncomfortable emotions of the users by converting the emotions of the users estimated in step S1 into numerical values. It also determines whether the levels of the uncomfortable emotions reach the predetermined value, that is, predetermined uncomfortable emotions are occurring.
If the determination in step S3 is YES, the process proceeds to step S4; if the determination is NO, the process ends. In step S4, the operation selecting unit 14 selects, for example, an improvement operation having the highest priority from among the improvement operations previously stored in the operation storing unit 13. Then, in step S5, the working machine controlling unit 15 controls the working machine 1 so that the working machine 1 performs the improvement operation selected in step S4. For example, the working machine controlling unit 15 outputs control signals to the traveling actuator 27 so that the working machine 1 performs a predetermined travel operation.
Then, in step S6, the effect measuring unit 16 estimates the emotions of the users on the basis of the biological information acquired by the biological information acquiring unit 20. That is, it measures the uncomfortable emotion improving effect. Then, in step S7, the effect measuring unit 16 determines whether the levels of the uncomfortable emotions have been improved to the predetermined value or more. If the determination in step S7 is NO, the process returns to step S4. In this case, the effect measuring unit 16 lowers the priority of the most recently selected improvement operation (e.g., an improvement operation having the highest priority) by one level and selects another improvement operation (e.g., an improvement operation having the second highest priority) to update priorities of the improvement operations stored in the operation storing unit 13. Hereafter, a similar process is repeated until the determination in step S7 becomes YES. When the determination in step S7 becomes YES, the process ends.
The operation of the emotion improving apparatus 100 according to the present embodiment will be described more specifically.
When the working machine 1 traverses between the users 201, 202 as described above, the attention of the users 201, 202 is directed to the working machine 1, that is, the operation of the working machine 1 gives the users 201, 202 an opportunity for restoring calm. Thus, the users 201, 202 stop quarrelling with each other, improving the levels of the uncomfortable emotions thereof to the predetermined value or more.
On the other hand, if the levels of the emotions of the users have not been improved to the predetermined value or more although the predetermined improvement operation has been performed, the working machine 1 lowers the priority of that improvement operation and selects another improvement operation (step S7 step S4). For example, the working machine 1 selects an improvement operation in which it travels in a zig-zag pattern around the users 201, 202, as an operation having the second highest priority. Thus, the working machine 1 travels in a zig-zag pattern around the users 201, 202, as shown by the arrow B in
The present embodiment can produce the following advantageous effects:
(1) The emotion improving apparatus 100 for improving uncomfortable emotions of users using the working machine 1 includes the biological information acquiring unit 20 that acquires biological information of the users, the uncomfortable emotion determining unit 11 that determines whether predetermined uncomfortable emotions are occurring to the users, on the basis of the biological information acquired by the biological information acquiring unit 20, and the working machine controlling unit 15 that if the uncomfortable emotion determining unit 11 determines that the predetermined uncomfortable emotions are occurring, controls the working machine 1 so that the working machine 1 performs a predetermined improvement operation for improving the uncomfortable emotions, toward the users (
(2) The uncomfortable emotion determining unit 11 includes the emotion estimating unit 12 that estimates the emotions of the users on the basis of the biological information acquired by the biological information acquiring unit 20 (
(3) The emotion improving apparatus 100 further includes the operation storing unit 13 that stores multiple improvement operations, which are predetermined candidate improvement operations, with priorities and the operation selecting unit 14 that selects an improvement operation having a high priority from among the improvement operations stored in the operation storing unit 13 (
(4) The emotion improving apparatus 100 further includes the effect measuring unit 16 that measures the degrees of improvement of the uncomfortable emotions of the users when the working machine 1 performs the operation selected by the operation selecting unit 14 (
(5) The biological information acquiring unit 20 includes the camera 21, microphone 22, and thermography 23 disposed on the working machine 1 (
(6) The working machine 1 comprises a lawn mower that mows the lawn while autonomously traveling within the working area AR (
(7) The working machine 1 is a moving working machine that performs predetermined work while autonomously traveling within the working area AR (
(8) The emotion improving method for improving uncomfortable emotions of users using the working machine 1 includes acquiring biological information of the users (step S1), determining whether predetermined uncomfortable emotions are occurring to the users, on the basis of the acquired biological information (step S3), and if it is determined that the predetermined uncomfortable emotions are occurring, controlling the working machine 1 so that the working machine 1 performs a predetermined improvement operation for improving the uncomfortable emotions, toward the users (step S5). Thus, the uncomfortable emotions of the users, such as anger, can be effectively improved.
The above embodiment can be modified into various forms, and modifications will be described below.
While, in the above embodiment, the single working machine 1 configures the emotion improving apparatus 100, multiple working machines may configure an emotion improving apparatus.
In an emotion improving apparatus 100B thus configured, one or more (e.g., all) of the lawn mower 1A, sprinkler 1B and lighting system 1C are provided with a biological information acquiring unit 20. The processor 101 determines whether predetermined uncomfortable emotions (e.g., angry emotions) are occurring to the users, on the basis of biological information acquired by the biological information acquiring unit 20. If it determines that predetermined uncomfortable emotions are occurring, the processor 101 controls the lawn mower 1A, sprinkler 1B, and lighting system 1C so that these devices perform a predetermined operation for improving the uncomfortable emotions, toward the users. For example, instead of or in addition to the operation of the lawn mower 1A, the processor 101 controls the solenoid valve of the sprinkler 1B so that the sprinkler 1B sprinkles water. In this case, the sprinkler 1B may be caused to sprinkle water considering the direction of the Sun so that a rainbow is produced. Also, the processor 101 may control the lighting system 1C so that the lighting system 1C blinks. The sprinkler 1B alone, for example, may be used as a working machine.
As described above, the working machine 1 may be non-self-propelled (fixed) rather than self-propelled (movable). Also, the configuration of the working machine is not limited to that described above. For example, the working machine may be a movable working machine that includes a movable arm and a movable hand and is able to grasp plants or the like. This working machine may be used to gather plants or the like to improve uncomfortable emotions of users. That is, the predetermined operations for improving the uncomfortable emotions are not limited to those described above, and the working machine controlling unit may be of any type as long as it controls the working machine so that, if it is determined that predetermined uncomfortable emotions are occurring, the working machine performs a predetermined operation for improving the uncomfortable emotions, toward the users.
While, in the above embodiment, the camera 21 as an imaging device, the microphone 22 as a sound collector, and the thermography 23 as a temperature imaging device detect states of users, which change in accordance with the work satisfaction level, a biological information acquiring unit is not limited to this configuration. For example, not all of the imaging device, sound collector, and temperature imaging device but at least one of these may acquire biological information. Also, another type of device (wearable device, etc.) may acquire the same biological information as that described above or another type of biological information (e.g., pulse or heart rate). The biological information acquiring unit may be disposed on an entity (e.g., the wall of a building) other than the working machine.
In the above embodiment, the emotion estimating unit 12 estimates the emotions of the users on the basis of the biological information acquired by the biological information acquiring unit 20, and the uncomfortable emotion determining unit 11 obtains the levels of the uncomfortable emotions of the users on the basis of the estimated emotions and, if the obtained levels reach the predetermined value (predetermined negative value), determines that predetermined uncomfortable emotions (e.g., uncomfortable emotions of angry) are occurring. However, an uncomfortable emotion determining unit may simply determine whether predetermined uncomfortable emotions are occurring to the users, without obtaining the levels of the uncomfortable emotions. Accordingly, an emotion estimating unit may be omitted.
In the above embodiment, multiple improvement operations, which are predetermined candidate operations for improving uncomfortable emotions, are stored with priorities in the operation storing unit 13, and the operation selecting unit 14 selects an operation having a high priority from among the stored operations. However, for example, a given operation may be always performed in order to improve uncomfortable emotions. Accordingly, an operation storing unit and an operation selecting unit may be omitted. While, in the above embodiment, the effect measuring unit 16 measures the degrees of improvement of the uncomfortable emotions of the users, an effect measuring unit may be omitted.
The above description is only an example, and the present invention is not limited to the above embodiment and modifications, unless impairing features of the present invention. The above embodiment can be combined as desired with one or more of the above modifications. The modifications can also be combined with one another.
1 working machine, 11 uncomfortable emotion determining unit, 12 emotion estimating unit, 13 operation storing unit, 14 operation selecting unit, 15 working machine controlling unit, 16 effect measuring unit, 20 biological information acquiring unit, 21 camera, 22 microphone, 23 thermography, 100, 100A, 100B emotion improving apparatus
Number | Date | Country | Kind |
---|---|---|---|
2016-253719 | Dec 2016 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2017/044774 | 12/13/2017 | WO | 00 |