Patent Application
20190189131
This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2017-243726 filed on Dec. 20, 2017 the disclosure of which is incorporated by reference herein.
The present disclosure relates to an onboard control device, a control device, a control method, a computer-readable medium storing a control program and a method of responding to an utterance.
U.S. Patent Application Publication No. 2016/180853 (Patent Document 1) discloses a voice system having a voice outputting device that is set within a facility that a user secures. In this voice system, the voice outputting device plays-back plural audio contents such as music and audio books and the like.
Further, U.S. Patent Application Publication No. 2017/083285 (Patent Document 2) discloses a technique of selecting, from plural devices, a device that outputs a response to an utterance of a user.
By the way, in a case in which plural persons exist within a predetermined region such as within a vehicle or the like, when information is outputted from an outputting device that outputs information such as a display device or a voice outputting device or the like, there is the problem that the information is conveyed also to persons to which it is not desired to convey the information. However, this problem is not considered in the techniques of Patent Document 1 and Patent Document 2.
The present disclosure was made in consideration of the above-described circumstances, and an object thereof is to convey information to the right person.
A first aspect includes: a deriving section that, on the basis of information that is an object of outputting, derives a conveying degree that expresses an extent to which it is desired to convey the information that is the object of outputting to each of plural vehicle occupants who exist within a vehicle; a selecting section that, in accordance with the conveying degrees of each of the vehicle occupants that have been derived by the deriving section, selects an outputting device that is to output the information that is the object of outputting, from among plural outputting devices that exist within the vehicle; and a control section that carries out control for causing the information, which is the object of outputting, to be outputted from the outputting device selected by the selecting section.
In accordance with the first aspect, on the basis of information that is the object of outputting, conveying degrees, which express extents to which it is desired to convey the information that is the object of outputting to the respective plural vehicle occupants existing within the vehicle, are derived. The outputting device, which corresponds to the derived conveying degrees per vehicle occupant, is selected from among the plural outputting devices that exist within the vehicle. Then, the information that is the object of outputting is outputted from the selected outputting device. Accordingly, information can be conveyed to the appropriate person.
Note that the second aspect is the first aspect that further includes a generating section that, on the basis of positional relationships between the respective plural outputting devices and the respective plural vehicle occupants, generates information that associates a conveying degree, which expresses ease of conveying information, with each combination of the respective plural outputting devices and the respective plural vehicle occupants, wherein the selecting section selects the outputting device by using the information generated by the generating section and the conveying degrees of information for each of the plural vehicle occupants that were derived by the deriving section.
In accordance with the second aspect, the outputting device is selected by using degrees of conveying of information to the respective plural vehicle occupants, and information that associates conveying degrees, which express the ease of conveying information, with respective combinations of the respective plural outputting devices and the respective plural vehicle occupants. Accordingly, information can be conveyed to a more suitable person.
Further, in a third aspect, in the second aspect, the outputting device is at least one of a voice outputting device that is installed in the vehicle, a display device that is installed in the vehicle, and a portable terminal that a vehicle occupant of the vehicle possesses.
In accordance with the third aspect, the outputting device is at least one of a voice outputting device, a display device and a portable terminal. Therefore, the outputting device that is to output information can be selected from among outputting devices having differing extents of ease of conveying information.
Further, in a fourth aspect, in the third aspect, in a case in which the outputting device is a display device, the generating section generates information that associates a conveying degree, which expresses ease of conveying information, with each combination of the respective plural vehicle occupants and at least one of sizes of characters and colors of characters displayed by the display device.
In accordance with the fourth aspect, information that associates a conveying degree, which expresses ease of conveying information, with each combination of the respective plural vehicle occupants and at least one of the sizes of characters and the colors of characters that are displayed by the display device, is generated. Accordingly, because an outputting device is selected by using even more combinations, information can be conveyed to a more suitable person.
In a fifth aspect, in the third aspect, in a case in which the outputting device is a voice outputting device, the generating section generates information that associates a conveying degree, which expresses ease of conveying information, with each combination of the respective plural vehicle occupants and volumes of a voice outputted by the voice outputting device.
In accordance with the fifth aspect, information that associates a conveying degree, which expresses ease of conveying information, with each combination of the respective plural vehicle occupants and volumes of the voice outputted by the voice outputting device, is generated. Accordingly, because an outputting device is selected by using even more combinations, information can be conveyed to a more suitable person.
Further, a sixth aspect includes: a deriving section that, on the basis of information that is an object of outputting, derives a conveying degree that expresses an extent to which it is desired to convey the information that is the object of outputting to each of plural persons who exist within a predetermined region; a selecting section that, in accordance with the conveying degrees of the respective persons that have been derived by the deriving section, selects an outputting device that is to output the information that is the object of outputting, from among plural outputting devices that exist within the region; and a control section that carries out control for causing the information, which is the object of outputting, to be outputted from the outputting device selected by the selecting section.
In accordance with the sixth aspect, in the same way as in the first aspect, information can be conveyed to the right person.
In a seventh aspect, a computer executes processing of: on the basis of information that is an object of outputting, deriving a conveying degree that expresses an extent to which it is desired to convey the information that is the object of outputting to each of plural vehicle occupants who exist within a vehicle; in accordance with the derived conveying degrees of the respective vehicle occupants, selecting an outputting device that is to output the information that is the object of outputting, from among plural outputting devices that exist within the vehicle; and carrying out control for causing the information, which is the object of outputting, to be outputted from the selected outputting device.
In accordance with the seventh aspect, in the same way as in the first aspect, information can be conveyed to the right person.
Note that, in an eighth aspect, in the seventh aspect, structure information within the vehicle of the plural outputting devices that exist within the vehicle, which structure information has been transmitted in advance from a control device installed in the vehicle, is received.
In accordance with the eighth aspect, the structures of the plural outputting devices within the vehicle can be grasped.
Further, a ninth aspect causes a computer to execute processing including: on the basis of information that is an object of outputting, deriving a conveying degree that expresses an extent to which it is desired to convey the information that is the object of outputting to each of plural vehicle occupants who exist within a vehicle; in accordance with the derived conveying degrees of the respective vehicle occupants, selecting an outputting device that is to output the information that is the object of outputting, from among plural outputting devices that exist within the vehicle; and carrying out control for causing the information, which is the object of outputting, to be outputted from the selected outputting device.
In accordance with the ninth aspect, in the same way as in the first aspect, information can be conveyed to the right person.
In a tenth aspect, a computer executes processing including: specifying seated positions of plural vehicle occupants within a vehicle; specifying, from among plural outputting devices that are set within the vehicle, an outputting device that is in a vicinity of a vehicle occupant who has made an utterance among the plural vehicle occupants; and effecting control so as to cause a response to the utterance to be outputted from the specified outputting device and not be outputted from other outputting devices.
In accordance with the tenth aspect, the outputting device, which is in a vicinity of the vehicle occupant who has made an utterance among the plural vehicle occupants, is specified from among the plural outputting devices that are set within the vehicle. Control is effected such that a response to the utterance is outputted from the specified outputting device and is not outputted from the other outputting devices. Accordingly, information can be conveyed to the right person.
As described above, in accordance with the present disclosure, the effect that information can be conveyed to the right person is achieved.
An embodiment for implementing the present disclosure is described in detail hereinafter with reference to the drawings.
First, the structures within a vehicle relating to the present embodiment are described with reference to
Further, in the following description, in order to differentiate the seating positions of the rear seat, the left side portion of the rear seat is called “seat A”, the center portion of the rear seat is called “seat B”, and the right side portion of the rear seat is called “seat C”. Further, in the following description, in order to differentiate among the occupants of the vehicle, the vehicle occupant who is seated in the driver's seat is called “vehicle occupant D”, and the vehicle occupant who is seated in the front passenger's seat is called “vehicle occupant P”. Similarly, the vehicle occupant seated in seat A is called “vehicle occupant A”, the vehicle occupant seated in seat B is called, “vehicle occupant B”, and the vehicle occupant seated in seat C is called “vehicle occupant C”. In the present embodiment, a form in which there are five vehicle occupants of the vehicle is described, but the present invention is not limited to this, and there may be four or fewer plural occupants of the vehicle.
The display device 12 is provided at a combination meter that is at the front side of the driver's seat. The display device 16 is provided at the instrument panel at the front side of the front passenger's seat, Further, the onboard control device 10 and the display device 14 are provided at the center console that is in front of the driver's seat and the front passenger's seat and is at the vehicle transverse direction center. The display of a car navigation system is an example of the display device 16.
The display device 18 is provided at the rear surface of the front passenger's seat. The display device 20 is provided at the rear surface of the driver's seat. The portable terminal 22 is disposed at the vehicle transverse direction outer side of the driver's seat. The portable terminal 24 is disposed at the vehicle transverse direction outer side of the front passenger's seat
The hardware structures of the onboard control device 10 are described next with reference to
A threshold value table 40, a conveying degree table 42 and a control program 44 are stored in the storage section 33.
An example of the conveying degree table 42 is shown in
Further, “display 1” in
The functional structures of the onboard control device 10 relating to the present embodiment are described next with reference to
The identifying section 50 identifies the vehicle occupants who are seated in the respective seats that are the driver's seat, the front passenger's seat, seat A, seat B and seat C. For example, the identifying section 50 identifies the vehicle occupants who are sitting the respective seats by carrying out image analyzing processing, such as processing that detects faces of people or the like, on images that are captured by onboard cameras that are provided within the vehicle. Note that the identifying section 50 may acquire, via the voice inputting section 36, utterances of the vehicle occupants who are within the vehicle, and may identify the vehicle occupants seated in the respective seats on the basis of the voiceprints of the acquired utterances. Further, the vehicle occupants who are seated in the respective seats may be set in advance in the onboard control device 10.
The generating section 52 grasps the petitions of the portable terminals 22, 24 by carrying out wireless communication with the portable terminals 22, 24 via the communication I/F 34. Further, on the basis of the positional relationships between the respective seats and the respective outputting devices that are the voice outputting section 37 of the onboard control device 10, the display devices 12, 14, 16, 18, 20 and the portable terminals 22, 24, the generating section 52 derives conveying degrees that express the ease of conveying information, for each of the combinations of the respective outputting devices and the respective seats. Further, the generating section 52 replaces the respective seats with the vehicle occupants that have been identified by the identifying section 50, and stores the conveying degree for each combination of the respective outputting devices and the respective vehicle occupants in the conveying degree table 42.
The receiving section 54 receives information that is the object of outputting, which information has been generated by an application that runs on the onboard control device 10.
An application that reads aloud messages received by a messaging service, an application that reads aloud news or weather reports or the like, and the like are examples of applications that run on the onboard control device 10. Further, an application that conveys the arrival of a birthday that is registered in advance, and the like also are examples of applications that run on the onboard control device 10.
On the basis of the information received by the receiving section 54, the deriving section 56 derives a conveying degree that expresses the extent to which it is desired to convey information to each of the plural vehicle occupants who exist within the vehicle. Note that the conveying degree of each vehicle occupant may be set in advance for each combination of the information that is received by the receiving section 54 and the application that is the source of generation of the information, or may be derived by the deriving section 56 analyzing the contents of the information received by the receiving section 54.
Concretely, for example, in a case in which the information received by the receiving section 54 is a message addressed to vehicle occupant D that has been received by a messaging service, the deriving section 56 derives “definitely want to convey” as the degree of conveying to the vehicle occupant D. Further, in this case, the deriving section 56 derives “do not want to convey” as the degrees of conveying to the vehicle occupants P, A, B, C.
Further, for example, in a case in which the information received by the receiving section 54 is a message that conveys that the day is the birthday of vehicle occupant P, the deriving section 56 derives “do not want to convey” as the degree of conveying to the vehicle occupant P. Further, in this case, the deriving section 56 derives “definitely want to convey” as the degree of conveying to the vehicle occupant D, and derives “do not particularly want to convey” as the degrees of conveying to the vehicle occupants A, B, C. Note that this assumes the conveying of the information to persons carrying out plans to celebrate the birthday of the vehicle occupant P as a surprise.
In accordance with the conveying degrees for each of the vehicle occupants that have been derived by the deriving section 56, and from among the plural outputting devices that exist with the vehicle, the selecting section 58 selects outputting device(s) that is/are to output the information received by the receiving section 54. In the present embodiment, the selecting section 58 refers to the threshold value table 40, and acquires the threshold values that correspond to the conveying degrees of the respective vehicle occupants that have been derived by the deriving section 56. Further, by comparing the numeral value expressing the conveying degree of each of the vehicle occupants of the conveying degree table 42 and the acquired threshold value of each of the vehicle occupants, the selecting section 58 specifies one output destination or a combination of plural output destinations, and thereby selects the outputting device(s). Note that, at this time, in a case in which plural output destinations are combined, the selecting section 58 uses the values of the conveying degrees that are higher. Concretely, for example, with the combination of “display 1” and “display 2”, the numerical values expressing the conveying degrees of the information to the (vehicle occupant D, vehicle occupant P, vehicle occupant A, vehicle occupant B, vehicle occupant C) are (4.0, 4.0, 1.0, 1.0, 1.0).
In a case in which the acquired threshold value is a numerical value corresponding to “do not convey” or “difficult to convey”, the selecting section 58 selects the outputting device whose numerical value, which expresses the conveying degree of the corresponding vehicle occupant in the conveying degree table 42, is less than or equal to the acquired threshold value. Further, in a case in which the acquired threshold value is a numerical value corresponding to “definitely convey” or “convey”, the selecting section 58 selects the outputting device whose numerical value, which expresses the conveying degree of the corresponding vehicle occupant in the conveying degree table 42, is greater than or equal to the acquired threshold value.
Note that, in a case in which the acquired threshold value is a numerical value corresponding to “do not convey”, the selecting section 58 may select the outputting device whose numerical value, which expresses the conveying degree of the corresponding vehicle occupant in the conveying degree table 42, is less than or equal to the acquired threshold value. In this case, in a case in which the acquired threshold value is a numerical value corresponding to “definitely convey”, “convey” or “difficult to convey”, the selecting section 58 selects the outputting device whose numerical value, which expresses the conveying degree of the corresponding vehicle occupant in the conveying degree table 42, is greater than or equal to the acquired threshold value.
The control section 60 carries out control that outputs the information, which was received by the receiving section 54, from the outputting device(s) selected by the selecting section 58. Concretely, in a case in which the display devices 12, 14, 16, 18, 20 are selected by the selecting section 58, the control section 60 carries out control that displays the information received by the receiving section 54 onto the selected display devices 12, 14, 16, 18, 20.
Further, in a case in which the voice outputting section 37 of the onboard control device 10 is selected by the selecting section 58, the control section 60 effects control that outputs the information, which was received by the receiving section 54, by voice from the voice outputting section 37 of the onboard control device 10. Further, in a case in which the portable terminals 22, 24 are selected by the selecting section 58, the control section 60 effects control that notifies the selected portable terminals 22, 24 of the information received by the receiving section 54. Note that this notification may be, for example, notification by email transmission, or notification by a telephone call.
Operation of the onboard control device 10 relating to the present embodiment is described next with reference to
In step S10 of
In step S12, the generating section 52 grasps the positions of the portable terminals 22, 24 by carrying out wireless communication with the portable terminals 22, 24 via the communication I/F 34. Further, on the basis of the positional relationships between the respective seats and the respective outputting devices that are the voice outputting section 37 of the onboard control device 10, the display devices 12, 14, 16, 18, 20 and the portable terminals 22, 24, the generating section 52 derives a conveying degree, which expresses the ease of conveying information, for each combination of the respective outputting devices and the respective seats. Further, the generating section 52 replaces the respective seats with the vehicle occupants that were identified by the processing of step S10, and stores the conveying degree per combination of the respective outputting devices and the respective vehicle occupants in the conveying degree table 42. When the processing of step S12 ends, the conveying degree table generating processing end.
In step S20 of
In step S24, as described above, in accordance with the conveying degree for each vehicle occupant that were derived by the processing of step S22, the selecting section 58 selects the outputting device(s) that is/are to output the information, from among the plural outputting devices that exist within the vehicle. In step S26, as described above, the control section 60 effects control so as to output the information, which was received by the processing of step S20, from the outputting device(s) selected by the processing of step S24. When the processing of step S26 ends, the output control processing end.
A concrete example of the output control processing is described next. A case is described in which, for example, by the processing of step S22 of the output control processing, “definitely want to convey” is derived as the degree of conveying to vehicle occupant D, and “do not want to convey” is derived as the degrees of conveying to the vehicle occupants P, A, B, C.
In this case, (4.0, 1.0, 1.0, 1.0, 1.0) are acquired as the threshold values of (vehicle occupant D, vehicle occupant P, vehicle occupant A, vehicle occupant B, vehicle occupant C) by the processing of step S24 of the output control processing. In this case, the outputting device is selected at which the numerical values expressing the conveying degrees of the respective vehicle occupants of the conveying degree table 42 of
Namely, in this case, “portable terminal 1”, at which the numerical values expressing the conveying degrees of the respective vehicle occupants of the conveying degree table 42 of
Next is described a case in which, for example, by the processing of step S22 of the output control processing, “do not want to convey” is derived as the degree of conveying to the vehicle occupant D, and “definitely want to convey” is derived as the degrees of conveying to the vehicle occupants P, A, B, C.
In this case, (1.0, 4.0, 4.0, 4.0, 4.0) are acquired as the threshold values of (vehicle occupant D, vehicle occupant P, vehicle occupant A. vehicle occupant B, vehicle occupant C) by the processing of step S24 of the output control processing. In this case, the outputting device is selected at which the numerical values expressing the conveying degrees of the respective vehicle occupants of the conveying degree table 42 of
Namely, in this case, “portable terminal 2”, “display 4” and “display 5”, at which the numerical values expressing the conveying degrees of the respective vehicle occupants of the conveying degree table 42 of
As described above, in accordance with the present embodiment, the conveying degree of each vehicle occupant is derived on the basis of the information that is object of outputting, and the outputting device(s), which correspond(s) to the derived conveying degree per vehicle occupant, is/are selected from among the plural outputting devices. Accordingly, information can be conveyed to the right person(s).
Note that the above embodiment describes a case in which the generating section 52 generates the conveying degree table 42. However, the present invention is not limited to this. For example, in a case in which the set positions of all of the outputting devices within the vehicle are fixed, the conveying degree table 42 may be stored in advance in the storage section 33.
Further, in the above-described embodiment, for example, in a case in which the outputting device are display devices, the generating section 52 may derive conveying degrees that express the ease of conveying information, for each combination of the respective plural passengers and at least one of the size of the characters and the color of the characters that the display devices display. Further, for example, in a case in which the outputting devices are voice outputting devices, the generating section 52 may derive conveying degrees that express the ease of conveying information, for each combination of the respective plural passengers and the volumes of voices that the voice outputting devices output.
An example of the conveying degree table 42, which associates a conveying degree, which expresses the ease of conveying information, with each combination of the respective plural vehicle occupants and the sizes of characters at the display devices, is shown in
The above embodiment describes a case in which the outputting device(s) that is/are to output the information that is the object of outputting is/are selected from among the plural outputting devices that exist within the vehicle, but the present invention is not limited to this. For example, there may be a form in which the outputting device(s) that is/are to output the information that is the object of outputting is/are selected from among plural outputting devices that exist within a predetermined region such as a house, or the like.
Further, there may be a form in which the conveying degree table generating processing and output control processing that are carried out by the CPU 31 of the onboard control device 10 in the above-described embodiment are executed by a computer that is connected to the onboard control device 10 via a network. In this case, the onboard control device 10 transmits, to the computer and via the network, identification information of the vehicle occupants who are seated in the respective seats within the vehicle, and structure information that includes positional information and type information and the like of the respective outputting devices that exist within the vehicle (e.g., information such as the fact that a display device is provided at the rear surface of the front passenger's seat, or the like). Further, in this case, the computer executes the processing of step S12 of the conveying degree table generating processing, and the processing of step S20 through step S26 of the output control processing, by using the identification information of the vehicle occupants and the structure information of the respective outputting devices that have been transmitted from the onboard control device 10. In this case, in step S26, the computer outputs (transmits) the information indicating the selected outputting device, and the information that is the object of outputting, to the onboard control device 10 via the network. Then, the onboard control device 10 carries out control that outputs the information, which is the object of outputting, from the outputting device indicated by the information transmitted from the computer.
Further, in the above-described embodiment, there may be a form in which the onboard control device 10 does not use the threshold value table 40 and the conveying degree table 42. In this case, for example, voice inputting devices such as a microphones or the like are respectively provided in the vicinities of the respective seats within the vehicle. Note that, in a case in which outputting devices that have voice inputting sections, such as smart phones or AI speakers or the like, are provided in vicinities of the respective seats within the vehicle, the voice inputting sections of these outputting devices may be used.
Further, in this case, by using images that have been captured by onboard cameras provided within the vehicle, the onboard control device 10 identifies the vehicle occupants who are seated in the respective seats that are the driver's seat, the front passenger's seat, seat A, seat B and seat C, and specifies the seated positions of the respective vehicle occupants. Further, in this case, when an utterance is made by a given vehicle occupant, the onboard control device 10 specifies, among the voice inputting devices to which the voice corresponding to that utterance was inputted, the seat corresponding to the voice inputting device at which the voice having the greatest volume was inputted, as the seating position of the vehicle occupant who made the utterance. Then, in this case, on the basis of the specified seating position of the vehicle occupant, and the set positions of the plural outputting devices that exist within the vehicle, the onboard control device 10 specifies, from among the plural outputting devices, the outputting device that is in the vicinity of the vehicle occupant who made the utterance (e.g., the outputting device that is at the position closest to the vehicle occupant who made the utterance). Then, the onboard control device 10 effects control so as to output, from the specified outputting device, a response to the utterance, and so as to not output the response from the other outputting devices. Note that a question such as, for example, “How's the weather today?” is an example of the utterance in this case, and a reply such as, for example, “Sunny” is an example of the response to this utterance.
Further, description has been given of a case in which the conveying degree table generating processing and the output control processing that are carried out by the CPU 31 in the above-described embodiment are software processing that are carried out by the execution of programs, but these may be processing that are carried out by hardware. Further, the conveying degree table generating processing and the output control processing may be processing that are carried out by combining both hardware and software. Moreover, the control program 44 that is stored in the storage section 33 may be stored on any of various types of storage media and distributed.
The present disclosure is not limited to the above-described embodiment, and, other than the above, can of course be implemented by being modified in various ways within a scope that does not depart from the gist thereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-243726 | Dec 2017 | JP | national |
