Patent Grant
10558310
This application is a U.S. National Phase Application under 35 U.S.C. 371 of International Application No. PCT/JP2017/013163 filed on Mar. 30, 2017. This application is based on and claims the benefit of priority from Japanese Patent Application No. 2016-086272 filed on Apr. 22, 2016. The entire disclosures of all of the above applications are incorporated herein by reference.
The present disclosure relates to an onboard operation apparatus installed in a vehicle and touch-operated by a fingertip of a user.
An operation apparatus described in Patent Literature 1 has an operation panel having an operation face touch-operated by a fingertip of a user and a vibration instrument applying vibration to the user by vibrating the operation panel. Multiple operation elements (for example, Japanese syllabary including 50 sounds) are displayed in the operation face, and an operation signal corresponding to the touch-operated operation element is outputted. For example, while the fingertip touches the operation face, when an operation (tracing operation) moving the fingertip from a first operation element to a second operation element is performed, an operation signal corresponding to the first operation element is output. And then, an operation signal corresponding to the second operation element is output.
Patent Literature 1: JP 2014-52787 A
It is supposed that the user performs a blind operation without seeing the operation face since this kind of an operation apparatus is mounted on a vehicle. It is required to apply vibration corresponding to the touch-operation to the user. The apparatus described above informs the user by vibrating the vibration instrument that a desired operation signal is normally outputted. That is, in a case where the tracing operation described above is performed, the user may be possible to recognize that the fingertip exits from the first operation element through vibration (exiting vibration) at when the touch position moves from the inside to the outside of the first operation element. After that, the user may be possible to recognize that the fingertip enters the second operation element through vibration at when the touch position moves from the outside to the inside of the second element (entering vibration).
According to the method of the vibration described above, the entering vibration is performed immediately after the exiting vibration at when the fingertip quickly moves and the tracing operation is performed. In the case, the user is difficult to discriminate the exiting vibration and the entering vibration or the user recognizes the exiting vibration and the entering vibration as successive different signals since the exiting vibration and the entering vibration is successively performed without an interval. That is, the user may become difficult to recognize notification content by the vibration.
By contrast, Patent Literature 1 describes a vibration control forbidding the entering vibration until a predetermined time lapses after the exiting vibration is performed. According to the vibration control, when the tracing operation is performed with a quick movement performed so that a time from the exiting time to the entering time is less than the predetermined time, the entering vibration after the exiting vibration is prohibited. The above difficulty is solved
However, in the vibration control described above, the tracing operation is performed with the fingertip quickly moving, so that the exiting vibration occurs and the entering vibration does not occur. Therefore, the user is difficult to recognize whether the fingertip can enter the second operation element since the entering vibration does not occur by quickly moving the fingertip in both cases where the fingertip can enter the second operation element desired by the user and where the fingertip cannot enter the second operation element desired by the user.
A user who is used to performing the blind operation in a state where the positional relationship between the operation element and the fingertip is roughly understood tends to quickly move the fingertip performing the tracing operation. Therefore, a user, who is used to performing the blind operation, concerns about whether the user can enter the second operation element, greater than a concern about whether the user can leave the first operation element. Therefore, the entering vibration is more useful than the exiting vibration for the user who is used to quickly moving the fingertip. Thereby, the control vibration without occurrence of the entering vibration is difficult to sufficiently satisfy expectations of the user, and usability is low.
It is an object of the present disclosure to provide an onboard operation apparatus causing a user to easily recognize notification content by vibration and also having a high usability for the user moving the fingertip quickly.
According to one aspect of the present disclosure, an onboard operation apparatus includes: an operation panel that is installed in a vehicle and has an operation face that is touch-operated by a fingertip of a user; an output part that outputs an operation signal corresponding to an operation element that is touch-operated, the operation element being one of multiple operation elements arranged on the operation face; a vibration instrument that vibrates the operation panel, causing the user performing a touch operation to feel vibration; a position sensor that detects a touch position by the fingertip on the operation face; a vibration control part that controls actuation of the vibration instrument corresponding to the touch position detected by the position sensor; a trace calculation part that calculates a movement trace of the touch position based on a detection history by the position sensor; and a prediction part that predicts based on the movement trace inside a first operation element of the multiple operation elements, whether the touch position reaches a second operation element of the multiple operation elements within a predetermined time, when the touch position moves from inside of the first operation element to outside of the first operation element. The vibration control part has an entering vibration control part that actuates the vibration instrument regardless of a prediction result by the prediction part at when the touch position moves from outside of the second operation element to inside of the second operation element, and the vibration control part also has a holding control part that holds the actuation of the vibration instrument and causes the vibration instrument not to vibrate at when the touch position moves from the inside of the first operation element to the outside of the first operation element in a case where the prediction by the prediction part affirms a reaching.
According to the present disclosure, since the holding control part is included, actuation of the vibration instrument (hereinafter, referred to as an exiting vibration) is held when entering to the second operation element within the predetermined time is predicted at when the touch position exits the first operation element. In a case where the tracing operation is performed from the first operation element to the second operation element, the entering to the second operation within the predetermined time is predicted and the exiting vibration is held when the user moves the fingertip quickly. The exiting vibration notifying the exiting from the first operation element and the entering vibration notifying the entering to the second operation element are avoided to be successively performed without an interval. Therefore, it may be possible to reduce that the user is difficult to recognize the notification content provided by the vibration.
Furthermore, according to the embodiment, the entering vibration is performed regardless of the prediction result by the prediction part at when the touch position enters the second operation element since the entering vibration control part is included. Not only when the speed of the fingertip entering the second operation element is slow but also when the speed of the fingertip entering the second operation element is quick, the entering vibration is performed. As described above, it may be possible to improve the usability for the user moving the fingertip quickly since the entering vibration is more useful than the exiting vibration for the user being used to moving the fingertip quickly.
The above and other aspects, features and advantages of the present disclosure will become more apparent from the following detailed description made with reference to the accompanying drawings. In the drawings:
Multiple embodiments of the present disclosure will be explained in reference to the drawings. In each of the embodiments, a component including identical or similar function each other will be omitted by attaching identical numerals as needed. In each of the embodiments, when only a part of the configuration is explained, the other part of the embodiment can be referred to the other embodiment explained previously and applied.
The onboard operation apparatus according to the embodiment includes an input device 10 shown in
As shown in
It may be possible to view the display device 30 without largely moving a visual line at the time of driving. It may be possible to operate the input device 10 positioned at hand without changing a posture of the driving user, by placing the input device 10 and the display device 30 in different positions.
The input device 10 operates the operation contents of various instruments installed in the vehicle. Specific examples of instrument include a navigation instrument, an audio instrument, an air conditioner or the like. The display device 30 displays operation contents of various instruments in addition to the operation contents of the above described various devices.
As shown in
The circuit board 13 is placed on a side opposite to the vehicle interior with respect to the operation panel 11. The detection sheet 12 is placed between the circuit board 13 and the operation panel 11. The operation panel 11, the detection sheet 12 and the circuit board 13 are housed and retained in a housing (not shown) in a state that the detection sheet 12 is placed with facing the operation panel 11 and the circuit board 13. The detection sheet 12 is stuck to the operation panel 11 with adhesive.
The detection sheet 12 is placed in the opposite side of the operation face 11a to the operation panel 11. The detection sheet 12 has a structure retaining multiple electrodes (not shown) in an insulation sheet. The electrodes form an electrostatic capacitance between the operation face 11a and the fingertip F, which touch operates the operation face 11a. The electrodes output a detection signal corresponding to the electrostatic capacitance. For example, the detection sheet 12 of a matrix type in which the multiple electrodes are arranged with longitudinally and transversely crossing as a grid shape is used, for example.
The circuit board 13 detects the touch position by the fingertip F on the operation face 11a based on a detection signal outputted from the electrodes. The circuit board 13 transmits information (position information) on the detected touch position to the control device 20. The detection of the touch position and the transmission of the position information are repeatedly performed in a predetermined cycle (for example, 10 milliseconds). For example, when the detection signal outputted from the electrode exceeds a predetermined threshold value, it is determined as presence of touch operation. It is determined that a grid point of the multiple grid points at a portion exceeding the threshold value is the touch position. It is determined that the tracing operation in which the fingertip F is moved with touching the operation face 11a is performed, when the position of the grid point exceeding the threshold value moves successively.
A vibration instrument 14 is electrically connected with the circuit board 13. The vibration instrument 14 contacts with the operation panel 11 in a state that the operation panel 11, the detection sheet 12 and the circuit board 13 are combined. For example, the vibration instrument 14 includes an electric motor and a vibrator. When the electric motor is driven to rotate by energization from the circuit board 13, the vibrator attached to a rotating shaft of the electric motor rotates and vibration is generated. Hence, a vibration pattern by the vibrator is changed by changing duration of the energization or the on-off pattern of the energization. The user who performs a touch operation to the operation face 11a feels the vibration generated by the vibration instrument 14 since the vibration instrument 14 contacts with the operation panel 11.
As shown in
Further, the processor 20a controls (vibration control) the actuation of the vibration instrument 14 based on the position information acquired from the input device 10 and display control contents. The processor 20a at the time of performing the vibration control corresponds to a vibration control part 22.
An operation signal is outputted to various kinds the onboard instrument installed in the vehicle (output control) based on the position information acquired from the input device 10 or the display control content. As specific example of the onboard instrument, the air conditioner that performs air conditioning the interior of the vehicle, the navigation device that navigates a traveling route of the vehicle, the audio device or the like is given. The processor 20a at the time of performing the output control corresponds to an output part 23.
The display device 30 can be switched to various display modes, such as a mode for displaying the traveling route of the vehicle, a mode for displaying operation contents of the audio device, a mode for displaying the air conditioning state, or the like. In a mode exemplified in
In an operation area of the operation face 11a, areas corresponding to each of the icon buttons B1, B2, B3, B4, B5, and B6 are set as operation elements A1, A2, A3, A4, A5, A6. For example, as shown by a solid line in
First, in S10 of
In S12, a correspondence relation between areas of the operation face 11a set as operation elements A1 to A6 and the touch position acquired in S10 is determined. In S12, the touch position to an operation element is determined. Specifically, it is determined based on the touch position acquired in S10 and the movement trace calculated in S11, that any of correspondence relations is applied, the correspondence relation being “Inside of operation element”, “Exiting from operation element”, “Outside of operation element”, or “Entering to operation element” explained as bellow.
“Inside of operation element” represents a correspondence relation that the touch position exists inside the multiple operation elements A1 to A6, in the other words, inside a circle area surrounded by the dashed line of
Hence, for example, the tracing operation is performed from a solid line position to the dotted line position of
When it is determined as “Inside of operation element” in S12, the process of
When it is determined as “Exiting from operation element” in S12, a future movement trace is predicted based on the history of the touch position until the present time in S13. Specifically, the movement trace after the present time is predicted based on the movement trace until the present time and also the touch position at when the predetermined time lapses from the present time is predicted based on the movement speed of the touch position until the present time.
For example, movement traces shown by the solid line in a situation (1) of
In S14, it is predicted whether the touch position reaches the operation element within the predetermined time from the present time, based on the relation among the movement trace and the prediction position predicted in S13 and the multiple operation elements A1 to A6 set on the operation face 11a. The processor 20a at the time of executing the processes in S13, S14 corresponds to a prediction part predicting whether the touch position reaches any operation element (a second operation element) within the predetermined time based on the movement trace inside the first operation element.
For example, as shown in a situation (3) of
When it is determined in S14 as a negative determination not to reach, the vibration instrument 14 is actuated in S15, and a hold flag is set to off. Thereby, the vibration at the time of exiting the first operation element (exiting vibration) is performed. The user recognizes that the fingertip F exits the first operation element. The processor 20a at the time of executing the process in S15 corresponds to an exiting vibration control part, the entering vibration control part performing the exiting vibration in the case where the prediction result denies the reaching.
When an affirmation determination of reaching is performed in S14, the actuation of the vibration instrument 14 to notify the exiting from the first operation element in S16 (exiting vibration) is held. The hold flag is set to turn on. The processor 20a at the time of executing the process in S16 corresponds to a hold control part, the hold control part holing the exiting vibration without performing the exiting vibration in the case where the prediction result affirms the reaching.
When it is determined as “Outside of operation element” in S12, the future movement trace is predicted based on the history of the touch position until the present time in S17. In S17, the movement trace of the touch position is additionally predicted. Specifically, similarly to S13, the movement trace after the present time is predicted based on the movement trace until the present time. In addition, the touch position at when the predetermined time lapses from an exiting time from the first operation element is predicted based on the movement speed of the touch position until the present time. That is, in addition to the prediction result at the exiting time in S13, the prediction is performed also while it is determined as “Outside of the operation” after the exiting time.
In S18, it is predicted whether the touch position reaches the operation element within the predetermined time from the exiting time based on the relation among the additionally predicted movement trace in S17, the prediction position in S17, and the positions of the operation elements A1 to A6 set on the operation face 11a. The processor 20a at the time of executing the processes in S17 and S18 corresponds to an additional prediction part. The additional prediction part additionally predicts whether the touch position reaches the any of the operation elements (a second operation element) within the predetermined time from the exiting time, based on the movement trace from the exiting time to the present time.
When the negative determination of not reaching is performed in S18, the held exiting vibration is performed by actuating the vibration instrument 14, and the hold flag is set to be off in S19. Thereby, the vibration is performed slightly later than the exiting time from the first operation element. The user recognizes that the fingertip F exits the first operation element. The exiting vibration in S19 is performed in a condition that the hold flag turns on. The processor 20a executing the process in S19 corresponds to a hold release part. The hold release part releases the hold of the exiting vibration and performs the exiting vibration when the additional prediction result denies the reaching.
When the affirmation determination affirming the reaching is performed in S18, a state of the hold flag is maintained without actuating the vibration instrument 14, and the process of
When it is determined as “Entering to operation element” in S12, the vibration instrument 14 is actuated in S20. Thereby, the vibration is performed at entering time to the second operation element (entering vibration), and the user recognizes that the fingertip F enters the second operation element. In S20, the hold flag turns off when turns on, and the hold flag continues to turn off when turns off. The processor 20a at the time of executing the process in S20 corresponds to an entering vibration control part. The entering vibration control part actuates the vibration instrument 14 regardless of the prediction result by the prediction part.
As shown in the example 3 and the example 4 of
According to the embodiment, since the holding control part in S16 is provided, at when the touch position exits the first operation element, the exiting vibration is held and the vibration is not performed in a case where it is predicted that the second operation element is entered within the predetermined time. When the tracing operation is performed from the first operation element to the second operation element, for example, in a case where the user moves the fingertip F as exemplified in the example 4 of
Furthermore, according to the embodiment, the entering vibration control part in S20 is provided, and the entering vibration is performed regardless of the prediction result by the prediction part in S13 and S14 at when the touch position enters the second operation element. Not only when the speed of the fingertip F entering the second operation element is slow (refer to the example 3 in
According to the embodiment, the vibration control part 22 has the exiting vibration control part in S15. The exiting vibration control part actuates the vibration instrument 14 at the exiting time that the touch position moves from the inside to the outside of the first operation element (exiting vibration) when the prediction result of the prediction part in S13, S14 denies the reaching. Therefore, since the exiting vibration is performed in the case of not having the possibility that the exiting vibration and the entering vibration are successively performed without intervals, it is not caused that the user is difficult to recognize the notification content. It may enable the user to recognize the exiting from the first operation element.
According to the embodiment, the additional prediction part in S17, S18 is included, and also the vibration control part 22 includes the holding release part in S19. When the touch position is outside the first operation element and the second operation element, the additional prediction part additionally predicts whether the touch position reaches the second operation element based on the movement trace until the present time after the predictions in S13, S14 are performed. The holding release part releases the holding control by the holding control part and actuates the vibration instrument 14 (exiting vibration) when the additional prediction by the additional prediction part denies the reaching.
In a case where the reaching is predicted at the time of exiting from the first operation element and the exiting vibration is held, when the direction or the speed of the tracing operation changes, the holding of the exiting vibration can be released corresponding to the change. For example, when a tracing operation direction deviates from the second operation element or a tracing speed becomes slow after the exiting time, the situation is changed to a situation that the second operation element becomes difficult to be reached within the predetermined time. Therefore, it is not caused that the user is difficult to recognize the notification content corresponding to the change of the situation. It may enable the user to recognize the exiting from the first operation element.
According to the embodiment, the vibration control part 22 continues the holding by the holding control part when the additional prediction by the additional prediction part affirms the reaching. Therefore, it may be possible to improve certainty for avoiding that the exiting vibration and the entering vibration are successively performed without intervals.
In the first embodiment, the input device 10 and the display device 30 are separately placed as shown in
The input device 100 has a display panel 31, the detection sheet 12 and the circuit board 13. The display panel 31 has a liquid crystal layer retaining a liquid crystal and an electrode layer applying voltage to the liquid crystal. The display panel 31 displays an image with using a back light (not shown) as light source. A display face of the display panel 31 functions as an operation face 31a touch-operated by the fingertip F of the user, and the display panel 31 corresponds to the operation panel. The detection sheet 12 is stuck to a rear face of the display panel 31 with adhesive. The display panel 31, the detection sheet 12 and the circuit board 13 are housed in the hosing (not shown), and the display panel 31, the detection sheet 12 and the circuit board 13 are retained.
In a state that the display panel 31, the detection sheet 12 and the circuit board 13 are combined, the vibration instrument 14 contacts the display panel 31. Therefore, the user touch-operating the operation face 31a feels the vibration of the vibration instrument 14. The vibration control by the control device 20 and the control content of the display control device or the like are similar to the vibration control of the first embodiment. In the embodiment, an effect similarly to the first embodiment is provided.
In the above, the embodiment of the present disclosure is explained. However, the present disclosure is not limited to the embodiment explained above and can be provided with variation exemplified as bellow. It may be possible to provide not only combination of parts clearly showing that the combination of the parts can be specifically provided in each embodiment but also combination of a part of each embodiment without clearly shown when obstacle of the combination does not especially occur.
In the first embodiment, the specific areas of the operation face 11a are set as the operation elements A1 to A6. However, size, shape, position, number or the like of the area may be changed corresponding to the display content in the display device 30 or the display panel 31.
According to the first embodiment, though the additional prediction part in S17, S18 is included, the additional prediction part may be abolished. In the case, since the prediction result at the time of exiting is unchanged, the holding is maintained until a next entering is detected when the exiting vibration at the time of exiting is hold. That is, the holding in the case means for prohibiting the exiting vibration.
In an explanation of the first embodiment, though the operation element A1 being one of the multiple operation elements A1 to A6 and positioned at the lower left is explained as the first operation element, another element may be set to the first operation element. In the explanation of the first embodiment, though the specific operation element A2 being one of the multiple operation elements A1 to A6 is explained as the second operation element, another element may be set to the second operation element.
According to the first embodiment, the electrostatic position sensor by the detection sheet 12 and the circuit board 13 is employed. By contrast, a resistance position sensor causing the electric resistance to vary corresponding to the touch position may be employed. Though the vibration instrument 14 with the electric motor and the vibrator is employed on the first embodiment, a vibration instrument with use of piezoelectric element may be employed.
Software stored in a tangible storage medium and a computer executing the software, only the software, only hardware, or combination of them may be possible to provide a method and/or function provided by the control device 20. For example, when the control device 20 is provided by an electronic circuit being hardware, it may be possible to provide by a digital circuit including multiple logic circuits or analog circuits.
It is noted that a flowchart or the processing of the flowchart in the present application includes multiple steps (also referred to as sections), each of which is represented, for instance, as S10. Further, each step can be divided into several sub-steps while several steps can be combined into a single step.
In the above, the embodiment, the configuration, an aspect of the onboard operation apparatus according to the present disclosure are exemplified. However, the present disclosure is not limited to every embodiment, every configuration and every aspect related to the present disclosure are exemplified. For example, the field of the embodiment, the configuration, the aspect relate to the present disclosure includes the embodiment, the configuration, the aspect obtained by accordingly combining each technical part disclosed in different embodiment, configuration and aspect.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2016-086272 | Apr 2016 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2017/013163 | 3/30/2017 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2017/183408 | 10/26/2017 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20100169773 | Yoo | Jul 2010 | A1 |
| 20120154316 | Kono | Jun 2012 | A1 |
| 20130215021 | Morikawa | Aug 2013 | A1 |
| 20170277498 | Wood, Jr. | Sep 2017 | A1 |
| Number | Date | Country |
|---|---|---|
| 2013073426 | Apr 2013 | JP |
| 2014052787 | Mar 2014 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20190138126 A1 | May 2019 | US |
