This application claims benefit of priority to Japanese Patent Application No. 2017-096052 filed on May 12, 2017, which is hereby incorporated by reference in its entirety.
The present disclosure relates to an input device that can present tactile feedback corresponding to a touch operation performed by a user regarding changing a display form of a display object.
Processing such as enlarging/reducing or rotating display objects are performed on a conventional input device having a touch sensor, by movement of two fingers in contact with an operating screen. That is to say, the display object is enlarged or reduced by performing pinching operations where the distance between two fingers is changed, and the display angle of the display object is changed by a rotating operation where two fingers are moved in an arc (e.g., Japanese Unexamined Patent Application Publication No. 2013-205980).
However, with the above-described conventional input device, a great load is placed on the user, since fine adjustments need to be continuously made while carefully watching the screen to achieve the desired form when changing the display form of the display screen (display object), such as enlarging, reducing, or rotating the display screen. This has also restricted other operations and actions. This problem has also been manifested when returning the display screen that has been subjected to enlargement, reduction, or rotation, to the original form. In a case where the input device is a separate entity from the display, there is a need to continue to watch the screen even more carefully, since intuitive operations are more difficult than in a case where these are integrated.
An input device includes an operating surface at which touch operations relating to changing a display form of a display object are performed, a contact sensor configured to detect touch operations as to the operating surface, a pressure sensor configured to detect pressing operations as to the operating surface, a tactile feedback presentation element configured to present tactile feedback corresponding to operations detected by the touch sensor, and a tactile feedback controller configured to control the tactile feedback presented by the tactile feedback presentation element. In a case where an operation detected by the touch sensor is a specified operation specified beforehand out of the contact operations relating to changing the display form, the tactile feedback sense controller causes the tactile feedback presentation element to present tactile feedback corresponding to that specified operation.
Accordingly, when changing of the display form of the display object is a specified operation serving as a separation, a tactile feedback is presented to the user touching the operating surface, so the user does not need to continuously watch the display object. Accordingly, the load on the user can be reduced, and the desired display form can be accurately yielded.
An input device according to an embodiment of the present invention will be described below in detail, with reference to the drawings. This input device is used in a keyboard device for a personal computer, a touch panel used in a smartphone or tablet, and instrument panel of an automobile, and so forth. The entire input device can be configured of transparent materials, and thus be disposed overlaid upon a displays such as a color liquid crystal panel or the like (on the front side of the display). A display device may be provided separately, without being overlaid by the input device. The drawings show X-Y-Z axes as reference axes. The Z axis is in the direction in which a glass plate serving as an operating surface, a piezoelectric sensor serving as a pressure sensor, and an electrostatic sensor serving as a touch sensor, are layered. The X-Y axis is a plane orthogonal to the Z axis. In the following description, the direction of the Z axis will be referred to as “vertical direction”, and a viewing along the Z axis from the upper side will be referred to as “plan view”.
Although the piezoelectric sensor 30 is used as a pressure sensor in the present embodiment, a piezoelectric sensor having a configuration other than that illustrated in
Suspension members 51, 52, 53, and 54 are attached to the four corners of a bottom face 10a of the electrostatic sensor 10, as illustrated in
The piezoelectric sensor 30 is fixed to the electrostatic sensor 10 by an adhesive agent (omitted from illustration). Performing a downward (in the down direction in
A vibrating element 60 serving as a tactile feedback presenting element is provided at the middle of the bottom face 10a of the electrostatic sensor 10. The vibrating element 60 has a configuration where a vibrator 61 is supported by springs 63 and 64 within a metal case (cover) 62 so as to be capable of vibrating, as illustrated in
The vibrating element 60 operates in accordance with vibration request signals provided by the controller 70, and presents vibrations with varying intensity of vibration, vibration time, cycles and so forth. The controller 70 detects operations performed as to the glass plate 40, based on output signals from the electrostatic sensor 10. Operations detected by the controller 70 include operations regarding change in the display state of a display object on the display 80, e.g., enlarging, reducing, and rotating. The controller 70 detects whether such operations include operations specified beforehand and stored in a storage unit within the controller 70 (hereinafter may be referred to as “specified operation”). With regard to such specified operations, enlargement/reduction of the display object may include
(1) a specified display scale, and
(2) a specified scale (proportion) as to the current display size. Examples of such scale include integer multiples, integer inverses, and percentage values in increments of 10%. Rotation of the display object may include
(1) a specified angle as to a reference axis, and
(2) a rotation angle as to the current display angle. Examples of such angle include angle values in 15-degrees increments. The controller 70 distinguishes whether or not an operation that has been detected is a specified operations, and if a specified operation, causes the vibrating element 60 to present predetermined vibration information as tactile feedback as to the specified operation. The presented information may be in common for all specified operations, or may have different intensity of vibration, cycle, and so forth, for each specific value of enlargement/reduction scale or rotation angle.
The controller 70 distinguishes whether or not the display object has returned to a reference display form, and in a case of having distinguishes that the display object has returned to the reference display form, acts as a tactile feedback controller and causes the vibrating element 60 to present predetermined vibration information. This predetermined vibration information may be vibration information that differs from the vibration information corresponding to the specified operation. The reference display form may be either that set by the controller 70 or set by the user, and for example is an original display form in the state before having performed the specified operation.
The structure of the electrostatic sensor 10 will be described with reference to
A shield electrode layer 14 that is set to grounding potential is provided on the entire face of the lower surface of the insulating base member 11 (lower side in the Z-axial direction), as illustrated in
Each of the multiple driving electrodes 21 are formed extending in the Y direction, with predetermined spacing therebetween in the X direction. The driving electrodes 21 are formed with square (rhombic form) main electrode portions 21a and linking portions 21b continuing alternatingly, as an integrated form, as illustrated in
The sensing electrodes 22 are formed continuing in the X direction with predetermined spacing therebetween in the Y direction. Each of the sensing electrodes 22, and the linking portions 21b of the driving electrodes 21, intersect with the inter-electrode insulating layer 12 interposed therebetween. Sensing effect portions 22a that are slightly larger in the width dimension are provided between intersections between the sensing electrodes 22 and the driving electrodes 21.
The electroconductive layer 23 is formed on the same level as the sensing electrodes 22, on the surface of the inter-electrode insulating layer 12 facing upwards. The electroconductive layer 23 is connected neither to the sensing electrodes 22, nor to the driving electrodes 21 situated on the level below. Accordingly, the upward-facing surface of the electroconductive layer 23 is situated on the same imaginary plane parallel to the X-Y plane as the upward-facing surface of the sensing electrode 22.
The upward-facing surfaces of the sensing electrodes 22 and the electroconductive layer 23 situated therebetween is the same face, which makes it easier to smoothen an upward-facing surface 13a of the upper insulating layer 13 that covers the sensing electrodes 22 and electroconductive layer 23. Accordingly, the strength of adhesion when applying a sheet-like piezoelectric sensor 30 onto the smooth surface 13a can be made to be great. Accordingly, even if shearing force is generated in the piezoelectric sensor 30 by applying downward pressing force to the glass plate 40, the fixed state of the piezoelectric sensor 30 and electrostatic sensor 10 can be maintained. Also, the electroconductive layer 23 is formed into blocks, which are square, while the main electrode portions 21a of the driving electrodes 21 are rhombic, but the main electrode portions 21a and the blocks of the electroconductive layer 23 in the X direction and Y direction generally match in width. When driving power is applied to the driving electrodes 21, the main electrode portions 21a of the driving electrodes 21 are coupled with the electroconductive layer 23 situated thereabove through electrostatic capacitance.
The shield electrode layer 14 illustrated in
Next, the structure of the piezoelectric sensor 30 will be described with reference to
Examples of piezoelectric paste include perovskite ferroelectric powder such as potassium niobate, sodium potassium, niobate barium titanate, or the like, being mixed in a thermoplastic polyester urethane resin to form a paste.
It can be seen from
A first electrode wiring layer 35 that connects to all first electrodes 32, and a second electrode wiring layer 36 that connects to all second electrodes 34, are provided on the inner side of an edge portion of the film base member 31 of the piezoelectric sensor 30 that extends in the X direction, as illustrated in
The first electrode wiring layer 35 and second electrode wiring layer 36 are connected to a multiplexer 45 at the driving detection circuit 44, as illustrated in
As illustrated in
Note that the first electrodes 32 and second electrodes 34 of the piezoelectric sensor 30 are of the same shape and same dimensions, and completely overlaid in the vertical direction. The first electrodes 32 and the wide portions 34a of the second electrode 34 are overlaid further above the main electrode portions 21a of the driving electrode 21 and the electroconductive layer 23 situated thereabove.
Next, the operations of the input device 100 will be described. First, the detection operations at the electrostatic sensor 10 and piezoelectric sensor 30 will be described.
The driving detection circuit 44 illustrated in
When ON output illustrated in
As illustrated in
The sides of the first electrodes 32 and wide portions 34a of the second electrodes 34 form rhombic shapes that are angled as to the X-Y direction, while the sides of the blocks of the electroconductive layer 23 form squares extending in the X-Y direction, as illustrated in
Regions on the electrostatic sensor 10 where the first electrodes 32 of the piezoelectric sensor 30 and wide portions 34a of the second electrodes 34 do not exist are primary electrostatic detection regions S, as illustrated in
Driving voltage is applied to the multiple driving electrodes 21 in order in the electrostatic sensor 10, but the main electrode portions 21a of the driving electrodes 21 are coupled with the electroconductive layer 23 in a floating state via electrostatic capacitance, so an electric field is formed above the glass plate 40 of the input device 100, from the electroconductive layer 23 to the sensing electrodes 22, at the electrostatic detection regions S. Accordingly, the coordinate position where a finger has touched the surface of the glass plate 40 can be detected with relatively high sensitivity, by monitoring change in current values flowing through the sensing electrodes 22 in order.
Overlaying the first electrodes 32 and second electrodes 34 of the piezoelectric sensor 30 so as to following the driving electrodes 21 of the electrostatic sensor 10, and overlaying the first electrodes 32 and the wide portions 34a of the second electrodes 34 above the wide main electrode portions 21a of the driving electrode 21 and the electroconductive layer 23 enables the footprint of the first electrodes 32 and second electrodes 34 to be maximized, and the detection sensitivity of the piezoelectric sensor 30 can be increased, as illustrated in
Note that the touch sensor and pressure sensor are not restricted to the above configurations. For example, the pressure sensor is not restricted to a piezoelectric sensor, and other types of pressure sensors, such as electric resistance or electrostatic capacitance sensors may be used. The pressure sensor may be disposed on the lower side of the board of the touch sensor, or may be disposed at the four corners of the board of the touch sensor.
Next, presentation of tactile feedback will be described with reference to flowcharts illustrating the flow of vibration processing in
In the processing illustrated in
In a case of having distinguishing that this is the first detection in step S12 (Yes in step S12), information of the display object currently displayed, i.e., information of current contents is obtained, and stored in the storage unit of the controller 70 as “scale 100% information” (step S13). The content information is obtained by the controller 70 from an image generating unit 81 that generates display objects on a display 80, and includes at least the overall size of the object, and coordinate information of multiple specification points that have been optionally set in the object. Further, the controller 70 calculates a value obtained by dividing the scale of the display object by tactile resolution (TactileStep value, hapstep[0]), and stores this in the storage unit (step S14). Tactile resolution is a resolution for detecting a specified operation, and corresponds to the smallest value of the percentage of enlargement/reduction to serve as sectionings of tactile feedback presentation. For example, in a case of sectioning in 10% intervals, such as 10%, 20%, . . . , 80%, 90%, 100%, 110%, 120%, and so forth, the tactile resolution is set to 10. Accordingly, in a case where the current scale of the display object is the scale to use for sectioning, the TactileStep value is an integer, and otherwise is a decimal number. The tactile resolution is a fixed value that has been set beforehand and saved in the storage unit, but can be changed by the user. For example, the user can change this from a user interface of a driver or application.
On the other hand, in a case where it has been distinguished in the step S12 that this is not the first time for detection (NO in step S12), the controller 70 distinguishes whether the operation is a pinch operation or not, based on output signals from the electrostatic sensor 10 (step S15). If not a pinch operation, the processing ends (NO in step S15).
In a case of having distinguished that this is a pinch operation in step S15 (YES in step S15), a threshold value for message output for pinch operation (pinch thresh) is set to A1 (step S16), and further, tactile resolution (resol pinch) is set to B1 (step S17).
Next, the controller 70 makes judgement regarding whether or not the pressing force by the operation when starting the pinch operation is a threshold value (predetermined value) or higher (step S18). In a case where the pressing force is the threshold value or higher (YES in step S18), the threshold value for message output for pinch operation (pinch thresh) is changed to A2 (step S19), and further the tactile resolution (resol pinch) is changed to B2 (step S20).
Now, the threshold value A2 set in step S19 preferably is a different value from the threshold value A1 set in step S16, but may be the same value as the threshold value A1. Also, the resolution B2 set in step S20 preferably is a different value from the resolution B1 set in step S17, but may be the same value as the resolution B1. In a case where the threshold value A2 is made to be the same value as the threshold value A1, and the resolution B2 is made to be the same value as the resolution B1, the aforementioned steps S18, S19, and S20 may be omitted. Also, the threshold value A2 and resolution B2 may be set to any of multiple values set in stages beforehand, in accordance with the magnitude of the pressing force when starting the pinch operation. Accordingly, the threshold value and resolution can be easily changed by intuitive operations by the user.
In a case where the pressing force is below the threshold value in step S18, after the step S19 and S20 have been executed (NO in step S18), a predetermined pinch message is output in a case where the state of the display contents has changed from the state of the previous time by the threshold value “pinch thresh” (step S21). The change judged here is change in the size of the display contents.
Next, the controller 70 obtains information of the display object currently displayed, i.e., information of current contents, calculates the scale of enlargement or reduction as to the “scale 100% information” obtained at the first detection, based on change in the coordinates of the multiple feature points and so forth, and saves in the storage unit (step S22). Next, the value (TactileStep value, hapstep[1]) obtained by dividing the scale calculated in step S22 by the tactile resolution is calculated, and saved in the storage unit (step S23).
Next, the controller 70 distinguishes whether the TactileStep value (hapstep[1]) calculated in step S23 has changed from the TactileStep value (hapstep[0]) calculated the previous time (step S24). In a case where there has been change in the TactileStep value in step S24, the vibration request issuing processing (step S50) illustrated in
Now, at the third and subsequent times of pinch operation processing, the scale calculated in step S22, and the TactileStep value (hapstep[1]) calculated in step S23 are updated to the newest calculated values.
In the processing illustrated in
In a case of having distinguishing that this is the first detection in step S32 (Yes in step S32), information of the display object currently displayed, i.e., information of current contents is obtained, and stored in the storage unit of the controller 70 as “0-degree information” (step S33). The controller 70 further calculates a value obtained by dividing the current angle of the display object by tactile resolution (TactileStep value, hapstep[0]), and stores this in the storage unit (step S34). This TactileStep value is saved separately for those regarding pinch operations and those regarding rotation operations. Tactile resolution used here corresponds to the smallest value of the rotation angle serving as sectionings of tactile feedback presentation. For example, in a case of sectioning in 15-degree intervals, such as −30 degrees, −15 degrees, 0 degrees, 15 degrees, 30 degrees, and so forth, the tactile resolution is set to 15. Accordingly, in a case where the current angle of the display object is the rotation angle to use for sectioning, the TactileStep value is an integer, and otherwise is a decimal number. The tactile resolution is a fixed value that has been set beforehand and saved in the storage unit, but can be changed by the user. For example, the user can change this from a user interface of a driver or application.
On the other hand, in a case where it has been distinguished in the step S32 that this is not the first time for detection (NO in step S32), the controller 70 distinguishes whether the operation is a rotation operation or not, based on output signals from the electrostatic sensor 10 (step S35). If not a rotation operation, the processing ends (NO in step S35).
In a case of having distinguished that this is a rotation operation in step S35 (YES in step S35), a threshold value for message output for rotation operation (rot thresh) is set to A11 (step S36), and further, tactile resolution (resol rot) is set to B11 (step S37).
Next, judgement is made regarding whether or not the pressing force by the operation when starting the rotation operation is a threshold value (predetermined value) or higher (step S38). In a case where the pressing force is the threshold value or higher (YES in step S38), the threshold value for message output for rotation operation (rot thresh) is changed to A12 (step S39), and further the tactile resolution (resol rot) is changed to B12 (step S40).
Now, the threshold value A12 set in step S39 preferably is a different value from the threshold value A11 set in step S36, but may be the same value as the threshold value A11. Also, the resolution B12 set in step S40 preferably is a different value from the resolution B11 set in step S37, but may be the same value as the resolution B11. In a case where the threshold value A12 is made to be the same value as the threshold value A11, and the resolution B12 is made to be the same value as the resolution B11, the aforementioned steps S38, S39, and S40 may be omitted. Also, the threshold value A12 and resolution B12 may be set to any of multiple values set in stages beforehand, in accordance with the magnitude of the pressing force when starting the rotation operation. Accordingly, the threshold value and resolution can be easily changed by intuitive operations by the user.
In a case where the pressing force is below the threshold value in step S38, after the step S39 and S40 have been executed (NO in step S38), a predetermined rotate message is output in a case where the state of the display contents has changed from the state of the previous time by the threshold value “rot thresh” (step S41). The change judged here is change in the rotation angle of the display contents.
Next, the controller 70 obtains information of the display object currently displayed, i.e., information of current contents, calculates the rotation angle as to the “0-degree information” obtained at the first detection, based on change in the coordinates of the multiple feature points and so forth, and saves in the storage unit (step S42). Next, the value (TactileStep value, hapstep[1]) obtained by dividing the rotation angle calculated in step S42 by the tactile resolution is calculated, and saved in the storage unit (step S43).
Next, the controller 70 distinguishes whether the TactileStep value (hapstep[1]) calculated in step S43 has changed from the TactileStep value (hapstep[0]) calculated the previous time (step S44). In a case where there has been change in the TactileStep value in step S44, the vibration request issuing processing (step S50) illustrated in
Now, at the third and subsequent times of rotation operation processing, the rotation angle calculated in step S42, and the TactileStep value (hapstep[1]) calculated in step S43 are updated to the newest calculated values. Vibration Request Issuing Processing (
The controller 70 distinguishes, with regard to the TactileStep value obtained by the pinch operation processing illustrated in
In a case where the TactileStep value has increased, i.e., hapstep[1]>hapstep[0] (YES in step S51), hapstep[0] is incremented by 1 (step S52). On the other hand, in a case where the TactileStep value has not increased (NO in step S51), whether or not the TactileStep value has decreased is distinguished (step S53). In a case where the TactileStep value has decreased (YES in step S53), hapstep[0] is decremented by 1 (step S54). In a case where the TactileStep value has not decreased (NO in step S53), this means that there has been no change in the TactileStep value, i.e., that neither size change nor rotation has been performed regarding the display object, so the processing ends.
Next, the controller 70 distinguishes whether the hapstep[0] incremented in step S52 or decremented in step S54 is a multiple of a predetermined value (step S55). Accordingly, how much the enlargement/reduction or rotation has been performed as to the original contents (step S13 in
Now, an arrangement may be made regarding selection of vibration pattern A and vibration pattern B (Step S55 through S57), where vibration pattern B is selected (step S56) in a case where conditions of angle or scale indicated by a driver or application have been satisfied (YES in step S55), and vibration pattern A that differs from vibration pattern B is selected (step S57) in a case where the conditions are not satisfied (NO in step S55).
Due to being configured as described above, tactile feedback is presented to the user touching a pad face (operating face) of the glass plate 40 serving as an operating surface in the present embodiment when a specified operation is made so that change in the display form of a display object is for a sectioning, more specifically when a touch operation is performed for a display scale or rotation angle which, when divided by tactile resolution, yields an integer value. Accordingly, the user does not have to continuously watch the display object when changing the display form of the display object, so the load on the user is reduced, reduction in work efficiency can be prevented, and a desired display form can be accurately yielded.
A modification will be described below. An arrangement is preferably made where, after change in the display form is performed, the display form before the change in display form was performed is returned to, and further, when the display object returns to the original display form, tactile feedback corresponding thereto is presented by the vibrating element 60 serving as the tactile feedback presenting element. Accordingly, the user can easily recognize that the display object has returned to the original state.
The controller 70 and display 80 may both be included in the input device 100 illustrated in
Vibration information presented by the vibrating element 60 may be the same vibration information presented for each sectioning scale or angle, or different vibration information may be presented for each scale or angle. The intensity direction, or cycle, for example, of vibration, may be changed as vibration information. Further, in addition to the vibration information, sound may be emitted, an object may be additionally displayed, warm or cool sensation may be presented, or the like, to facilitate user recognition of change in the display form.
An arrangement where vibration information is presented when the piezoelectric sensor 30 serving as a pressure sensor detects pressure as well, enables the user to perform touch operations detected by the electrostatic sensor 10 and pressing operations detected by the piezoelectric sensor 30, appropriately distinguished.
Also, an arrangement may be made where, in a case that the user performing a pinch operation on the pad face 41 does not involve a pressing operation, the display may be consecutively enlarged/reduced without presenting vibrations, and in a case where a pinch operation is made in a state where the pad face 41 is pressed down upon, vibration is presented each time the enlargement/reduction reaches a predetermined scale increment.
Also, an arrangement may be made where, in a case that the user performing a rotation operation on the pad face 41 does not involve a pressing operation, the display may be consecutively rotated without presenting vibrations, and in a case where a rotation operation is made in a state where the pad face 41 is pressed down upon, vibration is presented each time the rotation reaches a predetermined angle increment.
In a case where the pressure detected by the piezoelectric sensor 30 when a pinch operation is performed is at the threshold value or higher, the frequency of presenting the tactile feedback may be changed in accordance with that pressure. Thus, the user can be presented with the magnitude of the pressing force when operating, accurately and intuitively.
Four suspension members 151, 152, 153, and 154 are attached to the four corners of a bottom face 110a of the electrostatic sensor 110, in the same way as in the input device 100 illustrated in
The spacer 165 is formed of a non-electroconductive synthetic resin, for example, and is formed thinner than the voltage sensors 130A and 130B. Accordingly, in a state where no external force is being applied to the glass plate 140, a gap is maintained between the spacer 165 and the glass plate 140, while in a case where external force of a predetermined magnitude is applied to the glass plate 140, the spacer 165 and the bottom face of the glass plate 140 come into contact.
When pressing force is applied to the input device 200, as external force from the upper side in the Z-axial direction, a range of the voltage sensors 130A and 130B corresponding to the glass plate 140 is pressured. Now, the amount of deformation of the voltage sensors 130A and 130B supported by adhesive agent is greater than the amount of contraction of the suspension members 151 through 154 due to difference in elasticity, so shearing force is applied in the direction of pressing (vertical direction) at the voltage sensors 130A and 130B, and the voltage sensors 130A and 130B contract downwards at a range corresponding to the glass plate 140. Thus, two voltage sensors 130A and 130B are used, and disposed to straddle the edge faces of the glass plate 140, so the pressing force on the glass plate 140 is concentrated as shearing force, and accordingly detection sensitivity can be improved.
Although the present invention has been described by way of the above-described embodiment, the present invention is not restricted to the above-described embodiment, and improvements or modifications may be made within the object of improvement and the scope of the spirit of the present invention.
The input device according to the present invention is useful in that it can reduce the load on the user when changing the display form of a display object and when returning the changed display form to the original form, and a desired display form can be accurately obtained.
Number | Date | Country | Kind |
---|---|---|---|
2017-096052 | May 2017 | JP | national |