The art disclosed herein relates to a control system.
Patent Document 1 describes an air conditioner provided with a speech recognition means and an operation control means. In this air conditioner, when a speech recognized by the speech recognition means is a control instruction, the operation control means controls operation of the air conditioner based on a speech recognition result thereof.
[Patent Document 1] JP 5020222 B
A home appliance such as an air conditioner may be installed in a house. Further, in a general household, a plurality of users who use the home appliance is present, and each user may have unique demand to the home appliance. Thus, in the description herein, an art that enables to meet demand suitable for an attribute of each user even in a case where users with various attributes are present.
The control system disclosed herein comprises a detector configured to detect speech of a plurality of users and a controller. The controller is configured to specify an attribute of the user who spoke based on a content and/or voice of the speech of the user detected by the detector, and output notification information suitable for the attribute and/or execute control suitable for the attribute.
A control system 1 of an embodiment will be described in detail with reference to the drawings. As shown in
The detector 10 is disposed in a living room of a house, for example. A position where the detector 10 is to be disposed is not particularly limited, and the detector 10 may for example be disposed in one of a kitchen, a dining room, a bedroom, and a nursery room of the house. The detector 10 is capable of wirelessly communicating with the plurality of home appliances 50 (50a, 50b, 50c, 50d, 50e, 50f) disposed in the house. A communication scheme of the detector 10 and the home appliances 50 is not particularly limited. Further, the detector 10 is connected to an external first server 90 through a wireless router 92, a modem 93, and the Internet 100, and is capable of communicating with the external first server 90. The detector 10 may be capable of communicating with the plurality of home appliances 50 through the first server 90. The first server 90 is connected to an external second server 96 through the Internet 100. The first server 90 is provided with a controller 91.
As shown in
The microphone 12 of the detector 10 is a device configured to acquire sounds in a surrounding of the detector 10. When the users of the control system 1 speak in the surrounding of the detector 10, speech thereof are acquired by the microphone 12. The microphone 12 may for example be configured to acquire speech in a range of 5 meters radius from the detector 10. The speech acquired by the microphone 12 is sent to the controller 20 of the detector 10.
The speaker 13 of the detector 10 is a device configured to output audio to the surrounding of the detector 10. The speaker 13 is configured to notify information to the users of the control system 1 by audio. For example, the speaker 13 notifies information related to the home appliances 50 in audio to the users who are present in the surrounding of the detector 10. The users who are present in the surrounding of the detector 10 can acknowledge the information notified by the audio outputted from the speaker 13.
The wireless communication module 14 of the detector 10 is provided for wireless communication with the plurality of home appliances 50 and the wireless router 92. Transmission and reception of information are executed through the wireless communication module 14.
The controller 20 of the detector 10 is provided with a speech receiving unit 21, an audio output unit 22, a storage unit 23, and a communication unit 24. The speech receiving unit 21 of the controller 20 is configured to receive signals of speech acquired by the microphone 12 from the microphone 12. Further, the audio output unit 22 is configured to output a signal of audio to be outputted to the surrounding of the detector 10 to the speaker 13. Further, the communication unit 24 is configured to execute transmission and reception of information through the wireless communication module 14. Further, the storage unit 23 stores analytic speech data for analyzing the speech which the speech receiving unit 21 received from the microphone 12. Details of control executed by the controller 20 of the detector 10 will be described later.
As shown in
Next, the speech of the users of the control system 1 will be described. In the house, the users of the control system 1 say various things. In such occasions, contents of the speech of the users may be related to one or more home appliances 50 in the control system 1. Specifically, as shown in
Further, a plurality of users who uses the control system 1 is present in a household. For example, as shown in
Next, the processes executed in the control system 1 will be described. As shown in
Next in step S102, the controller 20 executes analysis on the speech received by the speech receiving unit 21 by using the analytic speech data stored in the storage unit 23. The controller 20 analyzes the speech and extracts the keywords included therein. For example, the controller 20 analyzes the speech “what do we have in the fridge?” received by the speech receiving unit 21 and extracts the keyword “fridge” included in the speech (see
As shown in
Next in step S104, the controller 20 specifies the home appliance 50 related to the keyword(s) based on the keyword(s) extracted by the speech analysis. For example, the controller 20 specifies the home appliance 50 related to the extracted keyword “fridge”, that is, the “refrigerator 50a”, from among the plurality of home appliances 50 in the control system 1 (see
Next in step S105, the controller 20 determines notification information. The controller 20 determines the notification information suitable for the user and attribute specified in the above step S103. Further, the controller 20 determines the notification information suitable for the home appliance 50 specified in the above step S104. For example, in a case where the user 1 is specified in the above step S103 and the refrigerator 50a is specified in the above step S104, the controller 20 determines the notification information to be “we have beer and cheese.” (see
In step S105, the controller 20 determines the notification information that is suitable for the user and his/her attribute according to a predetermined algorithm prestored in the storage unit 23 and machine learning. For example, the controller 20 may execute a predetermined information process based on a past action history of the user and determine the notification information suitable for this user. Further, the controller 20 may determine the notification information suitable for this user based on a preset program. Moreover, the controller 20 may determine the notification information suitable for this user based on predetermined learning data. For example, in the case where the user 1 is specified in the above step S103, the controller 20 determines the notification information “we have beer and cheese.” suitable for the user 1 since the user 1 has a high frequency of inquiries related to alcohol to the detector 10 in the past (see
Further, for example, in a case where the user 1 is specified in the above step S103 and the TV 50f is specified as the home appliance 50 in the above step S104, the controller 20 determines the notification information “switching the channel to a news program.”, for example, in step S105 (see
Next, as shown in
In step S106, the controller 20 determines the control content suitable for the user and his/her attribute according to a predetermined algorithm prestored in the storage unit 23 and machine learning. For example, the controller 20 may execute a predetermined information process based on the past action history of the user and determine the control content suitable for this user. Further, the controller 20 may determine the control content suitable for this user based on a preset program. Moreover, the controller 20 may determine the control content suitable for this user based on predetermined learning data. For example, in the case where the user 1 is specified in the above step S103 and the user 1 had the preference of watching news programs in the past, the controller 20 learns this preference of the user 1 and determines the control content to “change the channel with priority to a news program.” that is suitable for the user 1 (see
Then, as shown in
In step S107, the controller 20 of the detector 10 sends the information acquisition request to the home appliance 50 (such as the refrigerator 50a or the TV 501). The controller 60 of the home appliance 50 receives this information acquisition request. Then, in step S108, the controller 60 of the home appliance 50 sends the home appliance-related information to the detector 10 in response to the received information acquisition request. This home appliance-related information is received by the controller 20 of the detector 10.
Next, in a case of outputting the notification information (such as “we have beer and cheese.” or “switching the channel to a news program.”) determined in the above step S105, the controller 20 of the detector 10 executes a process of step S109. In step S109, the controller 20 outputs the notification information determined in the above step S105 to the speaker 13 from the audio output unit 22. Audio of the notification information (such as “we have beer and cheese.” or “switching the channel to a news program.”) is outputted from the speaker 13 of the detector 10 to the surrounding of the detector 10. Due to this, the notification information is notified to the user 1 of the control system 1, and the user 1 can acknowledge the notification information.
Next, in a case of controlling the operation of the home appliance 50 specified in the above step S104 (such as TV 50f), the controller 20 of the detector 10 executes a process of step S110. The controller 20 operates the operation of the home appliance 50 (such as TV 50f) based on the control content determined in the above step S106 (such as “change the channel with priority to a news program.”).
In step S110, the controller 20 of the detector 10 sends control information to the home appliance 50 (such as TV 50f). This control information is received by the controller 60 of the home appliance 50. The control information is information related to the control content of the home appliance 50 (such as TV 50f). The control information includes information for changing the channel of the TV 50f, for example. Next in step S111, the controller 60 of the home appliance 50 sends control response information to the detector 10 in response to the received control information. This control response information is received by the controller 20 of the detector 10. Further, the controller 60 of the home appliance 50 executes control of its operation based on the received control information. For example, the controller 60f of the TV 50f executes the control to change the channel of the TV 50f.
As above, the control system of the first embodiment has been described. As it is apparent from the foregoing explanation, the control system 1 is provided with the detector 10 configured to detect the speech of the plurality of users 1 to 4, and the controller 20 in the detector 10. The controller 20 is configured to specify the attribute (such as being a male in his 50s) of the user who spoke based on the content and/or voice of the speech of the user detected by the detector 10, and output the notification information suitable for the attribute (such as “we have beer and cheese.”, “switching the channel to a news program.”). Further, the controller 20 is configured to specify the user who spoke (such as the user 1) based on the voice of the speech of the user, and output the notification information suitable for this user. Further, the controller 20 is configured to execute the control suitable for the specified user and his/her attribute (such as “change the channel with priority to a news program.”).
According to this configuration, for example, in the case where the user 1 who is a male in his 50s says “what do we have in the fridge?”, the notification information “we have beer and cheese.” suitable for this user 1 and his/her attribute is outputted. Further, for example, in the case where the user 1 who is a male in his 50s says “change the TV channel.”, the notification information “switching the channel to a news program.” suitable for this user 1 and his/her attribute is outputted. Further, the control to “change the channel with priority to a news program.” that is suitable for this user 1 and his/her attribute is executed. Due to this, even in the case where there are the users 1 to 4 with various attributes, each of the users 1 to 4 can obtain information that is suitable for his/her attribute. Each of the users 1 to 4 can obtain information that is suitable for himself/herself. Further, the control that is suitable for each of the users 1 to 4 and his/her attribute can be executed. Thus, the control system 1 can suitably meet demands of each user and his/her attribute. Alternatively, the controller 20 may be configured to execute only one of outputting and controlling of the notification information.
Further, in the above control system 1, the controller 20 is configured to output the notification information suitable for the user regarding the home appliance 50. Further, the controller 20 is configured to execute the control suitable for the user regarding the home appliance 50. Due to this, each of the users 1 to 4 can obtain information that is suitable for the home appliance 50. Further, the control that is suitable for the home appliance 50 can be executed.
Further, in the above control system 1, the controller 20 of the detector 10 is configured to output the notification information suitable for the specified user (such as the user 1) based on the past action history of the specified user (such as the action history of having the high frequency of inquiries related to alcohol to the detector 10 in the past). Due to this, each of the users 1 to 4 can obtain suitable information based on the past action history.
One specific embodiment has been described above, however, specific configuration is not limited to the foregoing embodiment. In the description below, configurations that are same as the configurations in the foregoing description will be given same reference signs and descriptions thereof will be omitted.
In the above embodiment, the controller 20 of the detector 10 outputs the notification information regarding the home appliance 50, however, no limitation is made to this configuration. In another embodiment, the controller 20 may output notification information on the detector 10 itself instead of the home appliance 50. Further, the controller 20 may execute control of the detector 10 itself instead of the home appliance 50. For example, as shown in
Further, in the above embodiment, the controller 20 of the detector 10 specifies the user and his/her attribute based on the voice of the speech of the user, however, no limitation is cast upon this configuration. In another embodiment, the user and his/her attribute may be specified based on the content of the speech instead of the voice of the speech of the user. The controller 20 of the detector 10 specifies the user and his/her attribute by the analytic speech data and a predetermined algorithm prestored in the storage unit 23 and machine learning. Further, the controller 20 may specify the user and his/her attribute based on a combination of the content of the speech and the voice of the user.
In the second embodiment, the controller 20 of the detector 10 may specify the user based on a user-specific trigger word included in the speech of the user. The user-specific trigger word is a word for specifying the user. For example, as shown in
In the third embodiment, the controller 20 of the detector 10 may execute control of the home appliance 50 based on positional information associated with the user specified in the above step S103. For example, as shown in
In the above embodiments, the controller 20 of the detector 10 specifies the user and his/her attribute, however, no limitation is made to this configuration, and the controller 91 of the first server 90 may specify the user and his/her attribute. In the control system 1 of the fourth embodiment, as shown in
Next in step S122, the controller 91 of the first server 90 determines whether or not analytic speech data for analyzing the speech received in step S121 is present in the first server 90. In a case where the analytic speech data is present in the first server 90, the controller 91 determines YES to step S122 and proceeds to step S125. On the other hand, in a case where the analytic speech data is not present in the first server 90, the controller 91 determines NO to step S122 and executes a process of step S123.
In step S123, the controller 91 of the first server 90 sends information acquisition request to the external second server 96. This information acquisition request is received by a controller (not shown) of the second server 96. Then in step S124, the controller of the second server 96 sends the analytic speech data to the first server 90 in response to the received information acquisition request. The analytic speech data is present in the second server 96. This analytic speech data is received by the controller 91 of the first server 90.
Next in step S125, the controller 91 of the first server 90 analyzes the speech received in the above step S121 by using the analytic speech data received in the above step S124. The controller 91 analyzes the speech and extracts keyword(s) included in the speech. For example, the controller 91 analyzes the speech “what do we have in the fridge?” and extracts the keyword “fridge” included in the speech.
Next in step S126, the controller 91 of the first server 90 specifies the user who spoke the speech detected by the detector 10 and his/her attribute. The controller 91 specifies the user and his/her attribute based on the speech analysis using the analytic speech data. For example, the controller 91 analyzes a frequency of the speech (“what do we have in the fridge?”) received in the above step S121 and specifies the user who spoke the speech and his/her attribute by vocal print analysis and the like. For example, if a particular user 1 among the plurality of users 1 to 4 says “what do we have in the fridge?”, the controller 91 specifies this user 1. Further, the controller 91 specifies the attribute (such as being a male in his 50s) of this user 1.
Next in step S127, the controller 91 of the first server 90 specifies the home appliance 50 related to the keyword(s) based on the keyword(s) extracted by the speech analysis. For example, the controller 91 specifies, from among the plurality of home appliances 50 in the control system 1, the home appliance 50 related to the extracted keyword “fridge”, that is, the “refrigerator 50a”. Next in step S128, the controller 91 sends the home appliance information of the home appliance 50 (refrigerator 50a) specified in step S127 to the detector 10. This home appliance information is received by the controller 20 of the detector 10.
Next in step S129, the controller 91 determines the notification information. The controller 91 determines the notification information suitable for the user and his/her attribute specified in the above step S126. Further, the controller 91 determines the notification information suitable for the home appliance 50 specified in the above step S127. For example, in the case where the user 1 is specified in the above step S126 and the refrigerator 50a is specified in the above step S127, the controller 91 determines the notification information “we have beer and cheese.” (see
Next in step S131, the controller 91 determines the control content for the home appliance 50 specified in the above step S127. At this occasion, the controller 91 determines the control content suitable for the user and his/her attribute specified in the above step S126. For example, in the case where the user 1 is specified in the above step S126 and the TV 50f is specified in the above step S127, the controller 91 determines the control content to “change the channel with priority to a news program.” (see
After this, the processes from step S107 to step S111 are executed based on the home appliance information, the notification information, and the control content information which the controller 20 of the detector 10 received in the above step S128, step S130, and step S132. Since the processes from step S107 to step S111 have been described in the first embodiment, detailed description thereof will be omitted.
According to the above configuration, since data is stored in the first server 90 in a larger volume than in the detector 10, the user and his/her attribute can be specified based on such large-volume data. According to this configuration, accuracy of the speech analysis becomes higher.
Specific examples of the present invention have been described in detail, however, these are mere exemplary indications and thus do not limit the scope of the claims. The art recited in the claims includes modifications and variations of the specific examples presented above. Technical features described in the description and the drawings may technically be useful alone or in various combinations, and are not limited to the combinations as originally claimed. Further, the art described in the description and the drawings may concurrently achieve a plurality of aims, and technical significance thereof resides in achieving any one of such aims.
Number | Date | Country | Kind |
---|---|---|---|
2017-193542 | Oct 2017 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2018/031590 | 8/27/2018 | WO | 00 |