The present disclosure relates to a vehicle control system that causes a vehicle to perform a predetermined operation.
A smart system in which a user carrying an electronic key or the like verified to match a vehicle through wireless communication, performs a predetermined manipulation such as a touch on a door handle such that an operation of door unlocking or the like can be controlled has been proposed (see Japanese Unexamined Patent Application Publication No. 2015-169008 (JP 2015-169008 A)).
Meanwhile, a terminal device called a hearable device, having an earhole (external ear canal) verification function, which is mounted on an ear of a user, emits a reference sound from sound emission means to an ear canal, receives a reflected sound of the reference sound using sound collection means, and identifies the user using characteristics of the reflected sound has been proposed (see Japanese Unexamined Patent Application Laid-Open No. 2010-86328).
When a hearable device becomes widespread, performance of an verification process with both a user and a vehicle using the healable device instead of an electronic key of a smart system is conceivable. However, when a general communication standard in which an area in which communication with the vehicle is possible is wider than in the related art and is about 10 meters from a vehicle is used, there is a likelihood of an unlocking manipulation or the like being performed by a third party near the vehicle in comparison with the user after successful verification.
The present disclosure provides a vehicle control system in which a likelihood of an operation of a vehicle being executed by a third party is further reduced.
A first aspect of the present disclosure relates to a vehicle control system. The vehicle control system includes a terminal device including an ear mounting unit to be mounted on an ear of a user, and a vehicle that performs wireless communication with the terminal device. The terminal device includes a user identification unit configured to identify the user based on an acoustic reflected sound in an earhole, a first verification unit configured to verify whether the terminal device matches the vehicle through wireless communication when the terminal device enters an area in which wireless communication between the terminal device and the vehicle is available, and an operation instruction unit configured to receive an instruction to execute a predetermined operation of the vehicle from the user after the user identification unit has identified the user and the first verification unit has verified that the terminal device matches the vehicle, and transmit a signal according to the instruction to the vehicle. The vehicle includes a second verification unit configured to communicate with the first verification unit and verify whether the vehicle matches the terminal device, and an operation controller configured to receive the signal from the operation instruction unit and execute the predetermined operation according to the signal.
According to the first aspect of the present disclosure, since the user can cause the vehicle to execute the operation by performing utterance to the terminal device mounted on the user, it is possible to further reduce a likelihood that a third party near the vehicle causing the vehicle to execute the operation.
A second aspect of the present disclosure relates to a vehicle control system. The vehicle control system includes a terminal device including an ear mounting unit to be mounted on an ear of a user, and a vehicle that performs wireless communication with the terminal device. The terminal device includes a user identification unit configured to identify the user based on an acoustic reflected sound in an earhole: a first verification unit configured to verify whether the terminal device matches the vehicle through wireless communication when the terminal device enters an area in which wireless communication between the terminal device and the vehicle is available, and an operation instruction unit configured to transmit a signal according to an instruction to prohibit the operation of the vehicle according to a predetermined manipulation to the vehicle when the instruction is received from the user within a predetermined period from reception of a detection signal indicating that a detection is made that a predetermined manipulation is performed with respect to the vehicle when the signal is received from the vehicle after the user identification unit has identified the user and the first verification unit has verified that the terminal device matches the vehicle. The vehicle includes a second verification unit configured to communicate with the first verification unit and verify whether the vehicle matches the terminal device, a manipulation detection unit configured to detect the predetermined manipulation and notify the operation instruction unit of the predetermined manipulation when the second verification unit verifies that the vehicle matches the terminal device, and an operation controller configured to execute the operation of the vehicle corresponding to the predetermined manipulation when the signal according to the instruction is not received from the operation instruction unit within the predetermined period after the manipulation detection unit detects the predetermined manipulation, and the operation controller being configured not to execute the operation of the vehicle when the signal according to the instruction is received from the operation instruction unit within the predetermined period after the manipulation detection unit detects the predetermined manipulation.
According to the second aspect of the present disclosure, even when a predetermined manipulation is performed by a third party, the user can cancel the operation of the vehicle according to the manipulation of the third party. Accordingly, it is possible to further reduce a likelihood that a third party near the vehicle causing the vehicle to execute the operation.
A third aspect of the present disclosure relates to a vehicle control system. The vehicle control system includes a terminal device including an ear mounting unit to be mounted on an ear of a user, and a vehicle that performs communication with the terminal device. The terminal device includes a user identification unit configured to identify the user based on an acoustic reflected sound in an earhole: a first verification unit configured to verify whether the terminal device matches the vehicle through wireless communication when the terminal device enters an area in which wireless communication between the terminal device and the vehicle is available, and a first human body communication unit provided to include an electrode that comes into contact with the user when the ear mounting unit is mounted on the ear of the user, and configured to verify whether the terminal device matches the vehicle through communication via a body of the user when the user comes into contact with the vehicle and performs a predetermined manipulation after the user identification unit has identified the user and the first verification unit has verified that the terminal device matches the vehicle. The vehicle includes a second identification unit configured to communicate with the first identification unit and verify whether the vehicle matches the terminal device, a second human body communication unit provided to include an electrode that comes into contact when the user performs the predetermined manipulation, and configured to detect the predetermined manipulation, and the second human body communication unit verifying whether the vehicle matches the terminal device through communication via a body of the user with the first human body communication unit, and an operation controller configured to execute the operation of the vehicle corresponding to the predetermined manipulation when the second human body communication unit verifies that the vehicle matches the terminal device.
According to the third aspect of the present disclosure, since the verification between the vehicle and the terminal device is performed through human body communication according to a predetermined manipulation of a user having the terminal device mounted thereon, it is possible to further reduce a likelihood that a third party near the vehicle causing the vehicle to execute the operation.
In the vehicle control system according to the first to third aspects of the present disclosure, the terminal device may further include a notification unit configured to perform a notification to the user when the user identification unit identifies the user and the first verification unit verifies that the terminal device matches the vehicle.
According to the first to third aspects of the present disclosure, the user can recognize that the user is within a predetermined distance from the vehicle.
In the vehicle control system according to the second aspect of the present disclosure, the terminal device may further include a notification unit configured to perform a notification to the user according to a detection signal indicating that a detection is made that the predetermined manipulation is performed with respect to the vehicle.
According to the second aspect of the present disclosure, when a third party performs a predetermined manipulation, the user can more reliably recognize the manipulation of the third party.
In the vehicle control system according to the first to third aspects of the present disclosure, the notification unit of the terminal device may perform the notification through vibration.
According to the first to third aspects of the present disclosure, it is possible to further reduce a likelihood of the user feeling annoying in comparison with a notification through voice or the like.
In the vehicle control system according to the first to third aspects of the present disclosure, the predetermined operation may include at least one of locking or unlocking of a door, startup of an engine, opening of a trunk, and opening of a fuel filler port.
According to the first to third aspects of the present disclosure, it is possible to further control various operations and to further improve convenience.
According to the aspects of the present disclosure, since the vehicle operation is controlled by performing an operation instruction or an operation prohibition instruction with respect to a terminal device mounted on a user or human body communication via the user having the terminal device mounted thereon, it is possible to provide a vehicle control system in which a likelihood of the operation of the vehicle being executed by a third party is further reduced.
Features, advantages, and technical and industrial significance of exemplary embodiments will be described below with reference to the accompanying drawings, in which like numerals denote like elements, and wherein:
A vehicle control system performs an instruction or cancelation of a vehicle operation based on an operation instruction or an operation prohibition instruction with respect to a terminal device mounted on a user. Alternatively, the vehicle control system performs human body communication via the user having the terminal device mounted thereon to control the vehicle operation. Therefore, it is possible to further reduce a likelihood of the operation of the vehicle being executed by a third party.
Hereinafter, each embodiment will be described in detail with reference to the drawings.
The terminal device 110 is a small device including an ear mounting unit that is a mounted on an ear of a user. The terminal device 110 includes a user identification unit 111, an output unit 112, an input unit 113, an operation instruction unit 114, a notification unit 115, a first verification unit 116, and a first communication unit 117. The output unit 112 includes a speaker capable of emitting sound to an external ear canal (hereinafter referred to as an earhole) of the user. The input unit 113 includes an identification microphone that collects acoustic reflected sound in the earhole of the user, and an utterance microphone that collects uttered sound of the user. The input unit 113 has a function of recognizing voice from the collected uttered sound of the user. The vehicle 210 includes an operation controller 211, a second verification unit 212, and a second communication unit 213. Each of the terminal device 110 and the vehicle 210 may have a controller that appropriately controls an operation of each of the above-described units. The notification unit 115 generates content of notification for the user as voice or the like, and causes the output unit 112 to output the notification.
Step S101: The terminal device 110 performs earhole identificationi. The earhole identification may be performed when the terminal device 110 is mounted on the ear and may be then performed periodically or may be performed before any operation each time the terminal device 110 performs the operation. The user identification unit 111 of the terminal device 110 emits an identification sound from the output unit 112 to the ear canal, acoustic reflected sound of the identification sound is acquired by the identification microphone of the input unit 113, and characteristics of the acoustic reflected sound are compared with characteristics of an acoustic reflected sound of the user registered in advance to identify user. In the case of identification failure, the subsequent processes are not performed and this sequence is ended. The identification sound may be a sound in an audible band or may be a sound in an inaudible band such as ultrasonic waves. In the case of the sound in the audible band, the user can recognize that the identification process is performed through the sound. In the case of the sound in the inaudible band, a notification may be sent to the user by voice such as “the identification is performed” before the identification process.
Step S102: When the terminal device 110 enters a range in which communication with the vehicle 210 is possible, the first communication unit 117 of the terminal device 110 performs wireless communication with the second communication unit 213 of the vehicle 210, for example, upon reception of a radio signal periodically transmitted by the vehicle 210.
Step S103: When the verification in step S102 is successful, the notification unit 115 of the terminal device 110 drives the output unit 112 to perform a notification to the user. Accordingly, the user can recognize that the terminal device 110 has entered the range in which communication with the vehicle 210 is possible. A method of the notification is not limited. The notification may be performed by a voice that is output from the speaker of the output unit 112, or the output unit 112 may include a vibrator and perform the notification through vibration. Voice is easier to understand, but the voice is annoying when the voice is frequent, and therefore, a degree of vibration felt by the user may be used. Either the voice or the vibration may be selected by the user.
Step S104: When the user receives the notification, the user issues an instruction to execute a predetermined operation of the vehicle 210. The instruction can be made, for example, by uttering predetermined words such as “unlock a door” or “open a door”. The voice is input to the utterance microphone of the input unit 113 of the terminal device 110. The operation instruction unit 114 of the terminal device 110 receives the input predetermined words as an operation instruction for the vehicle. Here, the same earhole identification as in step S101 may be performed and identification of the uttering user may be performed.
Step S105: The operation instruction unit 114 of the terminal device 110 transmits a signal indicating the received operation instruction to the vehicle 210 via the first communication unit 117.
Step S106: The operation controller 211 of the vehicle 210 receives the signal indicating the operation instruction from the operation instruction unit 114 of the terminal device 110 via the second communication unit 213 and executes an operation such as door unlocking according to the signal. The sequence is then ended.
According to the above process, the user can recognize that the terminal device 110 enters the range in which communication with the vehicle 210 is possible and that the operation of the vehicle according to this embodiment can be executed. Thereafter, the user can cause the vehicle to execute the operation by performing utterance to the mounted terminal device 110. Accordingly, even when a communicable area is wider than in the related art, it is possible to further reduce a likelihood that a third party near the vehicle causing the vehicle to execute the operation.
Step S201: The terminal device 120 identifies the user through earhole identification, as in step S101 of the first embodiment.
Step S202: When the terminal device 120 enters a range in which communication with the vehicle 220 is possible, the terminal device 120 and the vehicle 220 perform wireless communication with each other and perform identification, as in step S102 of the first embodiment.
Step S203: The notification unit 115 of the terminal device 120 notifies the user that the verification in step S202 has been successful, as in step S103 of the first embodiment.
Step S204: A case in which, in this step to step S208, the user performs a predetermined manipulation such as touching a door handle with respect to the vehicle 220 with intention of causing the vehicle to perform an operation such as door unlocking will be described. In this step, when the user performs the predetermined manipulation, the manipulation detection unit 224 of the vehicle 220 detects the manipulation.
Step S205: The manipulation detection unit 224 of the vehicle 220 transmits a signal indicating that the predetermined manipulation has been performed via the second communication unit 213 and notifies the terminal device 120 of the fact. The operation instruction unit 114 of the terminal device 120 receives the signal via the first communication unit 117.
Step S206: The operation instruction unit 114 of the terminal device 120 causes the notification unit 115 to execute notification to the user according to the signal received in step S205. For example, when the predetermined manipulation is a touch manipulation with respect to the door handle, the notification unit 115 outputs a voice “unlock the door” or “Please perform a stop action when you want to stop unlocking” in addition to this from the speaker of the output unit 112. Through this step, when a manipulation not intended by the user is performed on the vehicle, the user can be reliably notified of this, but when the third party is nearby, this can be noticed and the notification is annoying to some users. Therefore, this step may be omitted. The notification may be executed through vibration. It may be able to be customized by user whether or not the notification is executed.
Step S207: The operation instruction unit 114 of the terminal device 120 waits for a predetermined prohibition instruction to be input from the user for a predetermined period from the notification in step S206. The prohibition instruction input will be described below. The operation controller 211 of the vehicle 220 also waits for the same period as in the operation instruction unit 114. The operation instruction unit 114 may cause the user identification unit 111 to execute the same earhole identification as in step S201 and perform identification of the user. It is desirable for the predetermined period to be, for example, equal to or greater than 0.5 seconds and equal to or smaller than one second.
Step S208: Since there is no prohibition instruction that is input from the user for a predetermined period in this step, the vehicle 220 executes the operation of the vehicle according to the predetermined manipulation detected in step S204. The sequence is then ended.
Step S214: In this step to step S218, a case where a third party other than the user is near the vehicle and performs a predetermined manipulation such as touching of a door handle with respect to the vehicle 220 with intention of causing the vehicle to perform an operation such as door unlocking without a legitimate right or a case where the user cancels the operation of the vehicle based on the above-described manipulation when the user or the third party accidentally or erroneously performs the above-described manipulation will be described. In this step, when the predetermined manipulation as described above is performed, the manipulation detection unit 224 of the vehicle 220 detects the manipulation, as in step S204.
Step S215: The manipulation detection unit 224 of the vehicle 220 transmits a signal indicating that the predetermined manipulation has been performed and notifies the terminal device 120 of the fact, as in step S205.
Step S216: The operation instruction unit 114 of the terminal device 120 causes the notification unit 115 to execute a notification to the user, as in Step S206.
Step S217: The operation instruction unit 114 of the terminal device 120 waits for a predetermined prohibition instruction to be input from the user for a predetermined period from the notification in step S216. The operation instruction unit 114 of the terminal device 120 may perform the identification of the user by causing the user identification unit 111 to execute the earhole identification, as in step S207. In this step, since the user does not intend to operate the vehicle, the operation instruction unit 114 performs a prohibition instruction. The prohibition instruction can be performed, for example, by uttering predetermined words such as “Do not unlock the door”. The voice is input to the utterance sound microphone of the input unit 113 of the terminal device 120. A method of inputting the instruction is not limited thereto and, for example, when the input unit 113 includes a motion sensor, the user can perform the instruction input through an operation of shaking his or her head twice.
Step S218: The operation instruction unit 114 of the terminal device 120 transmits a signal indicating the received prohibition instruction to the vehicle 220 via the first communication unit 117. The operation controller 211 of the vehicle 220 receives a signal indicating an operation instruction from the operation instruction unit 114 of the terminal device 110 via the second communication unit 213 and cancels an operation such as door unlocking based on a manipulation such as the touch of the door handle received in step S214 according to the signal. The sequence is then ended.
According to the above process, the user can recognize that the terminal device 120 enters a range in which communication with the vehicle 220 is possible and that the operation can be executed by the manipulation with respect to the vehicle according to the present embodiment. Even when a predetermined manipulation is performed by a third party, the user can cancel the operation of the vehicle according to the manipulation of the third party. Accordingly, even when a communicable area is wider than in the related art, it is possible to further reduce a likelihood that a third party near the vehicle causing the vehicle to execute the operation.
Step S301: The terminal device 130 identifies the user through earhole identification, as in step S101 of the first embodiment.
Step S302: When the terminal device 130 enters a range in which communication with the vehicle 220 is possible, the terminal device 130 and the vehicle 230 perform wireless communication with each other and perform verification, as in step S102 of the first embodiment.
Step S303: The notification unit 115 of the terminal device 130 notifies the user that the verification in step S302 has been successful, as in step S103 of the first embodiment.
Step S304: When the user performs a predetermined manipulation, the second human body communication unit 235 of the vehicle 230 detects the manipulation. The second human body communication unit 235 has an electrode provided at a position with which the user comes into contact according to various manipulations, such as a door handle, an engine startup switch, or a brake pedal.
Step S305: The first human body communication unit 137 of the terminal device 130 has an electrode that comes into contact with the ear of the user or the like in a state in which the user has the terminal device 130 mounted thereon (or, an electrode located very close to the ear or the like without coming into contact with the ear or the like). Therefore, when the user performs a predetermined manipulation in step S302, a path of human body communication in which a body of the user is used as a communication path is formed between the first human body communication unit 137 and the second human body communication unit 235. In this step, the terminal device 130 and the vehicle 230 perform verification through human body communication. The verification includes, for example, a notification of an identification result in steps S301 and S302 or a new verification process between the terminal device 130 and the vehicle 230 using human body communication. Earhole identification may be performed again in this step. When the identification as described above fails, subsequent processes are not executed and the sequence is ended.
Step S306: When the verification is successful in step S305, the operation controller 211 of the vehicle 230 executes an operation such as door unlocking based on the predetermined manipulation performed in step S302. The sequence is then ended.
According to the above process, the user can recognize that the vehicle 230 is nearby according to the terminal device 130 entering the range in which communication with the vehicle 230 is possible. Since the verification through human body communication with the vehicle can be performed according to a predetermined manipulation of the user having the terminal device 130 mounted thereon, it is possible to further reduce a likelihood of a third party near the vehicle causing the vehicle to execute an operation even when the communicable area is wider than in the related art.
Since the verification between the terminal device 130 and the vehicle 230 can be performed through the human body communication in step S304, step S302 may be omitted when the notification in step S303, that is, the notification of the fact that the vehicle is nearby is not needed. In this case, the wireless communication is not needed.
In each of the above-described embodiments, the door unlocking has been described as an example of the operation of the vehicle that is a control target, but the embodiment is not limited thereto, and various operations such as door locking, engine startup, opening of a trunk, and opening of a fuel filler port may be control targets for further improvement of convenience.
The terminal device may have a configuration in which, for example, all of the units are included in the ear mounting unit to be mounted on the ear of the user or may have a configuration in which at least the output unit is included in the ear mounting unit, the other units are included in a mobile terminal device such as a smartphone, and the ear mounting unit and the mobile terminal device may perform wireless or wired communication.
The embodiment can be regarded not only as a system including a terminal device and a vehicle, but also as a method that is executed by a single body of a terminal device or a single vehicle, or one or more computers including a processor, or a program thereof.
The present embodiment is useful for a vehicle control system that controls an operation of a vehicle or the like.
Number | Date | Country | Kind |
---|---|---|---|
2017-186794 | Sep 2017 | JP | national |
This is a Continuation of application Ser. No. 17/679,577 filed Feb. 24, 2022, which in turn is a Continuation of application Ser. No. 16/929,844 filed Jul. 15, 2020, which in turn is a Continuation of application Ser. No. 16/117,601 filed Aug. 30, 2018, which claims the benefit of Japanese Priority Application No. 2017-186794 filed Sep. 27, 2017. The disclosure of each of the prior applications is hereby incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 17679577 | Feb 2022 | US |
Child | 18748993 | US | |
Parent | 16929844 | Jul 2020 | US |
Child | 17679577 | US | |
Parent | 16117601 | Aug 2018 | US |
Child | 16929844 | US |