1. Field of the Invention
The present invention relates to an input device mounted on a portable device or another electronic device and operated by causing a finger or the like to come into contact with an operation panel.
2. Description of the Related Art
An input device capable of detecting a position coordinate and a load of a pressing point when an operation surface is operated with a finger or the like is described in Japanese Unexamined Patent Application Publication Nos. 2009-87311, 2010-146206, 2010-211399, and 2010-244514 shown below.
In these Patent Literatures, the number of pressing points in which both the position coordinate and the load are able to be detected is 1, and detection of a load at each pressing point when a plurality of points are simultaneously pressed is not described.
Further, Japanese Unexamined Patent Application Publication Nos. 2010-272143, 11-212725, and 62-172420 disclose a configuration in which a load sensor is arranged under an operation surface. Also, sensitivity of the load sensor is described in these Patent Literatures. However, detection of a load of each pressing point when the operation surface is simultaneously pressed at a plurality of positions is not described, similarly to Japanese Unexamined Patent Application Publication Nos. 2009-87311, 2010-146206, 2010-211399, and 2010-244514.
The present invention provides an input device capable of obtaining each load of a plurality of simultaneously pressed pressing points without performing a complicated calculation even when a plurality of points are simultaneously pressed, and a method of detecting a load at a plurality of points using the input device.
According to an aspect of the present invention, an input device includes a position detection sensor capable of detecting a pressing position on an operation surface, a plurality of load sensors configured to output a sensor output depending on a load, and a control unit configured to calculate respective loads at a plurality of pressing points simultaneously pressed on the operation surface through the following process:
(1) calculating sensitivity at a plurality of different reference points on the operation surface from the sensor output of each load sensor, and holding the sensitivity,
(2) obtaining the sensor output from each load sensor and detecting a position coordinate of each pressing point from the position detection sensor when the operation surface is simultaneously pressed at the plurality of pressing points,
(3) obtaining position rates of each pressing point within a region surrounded by the plurality of reference points close to each pressing point based on the position coordinates of each pressing point and each reference point,
(4) obtaining the sensitivity of each pressing point based on the sensitivity of each reference point used in (3) and the position rates of each pressing point, and
(5) calculating the load of each pressing point based on the sensitivity of each pressing point obtained in (4) and the sensor output of each load sensor obtained in (2).
Further, according to another aspect of the present invention, a method of detecting a pressing point in an input device including a position detection sensor capable of detecting a pressing position on an operation surface, a plurality of load sensors configured to output a sensor output depending on a load, and a control unit configured to calculate respective loads at a plurality of pressing points simultaneously pressed on the operation surface, the method including steps of:
(1) calculating sensitivity at a plurality of different reference points on the operation surface from the sensor output of each load sensor, and holding the sensitivity;
(2) obtaining the sensor output from each load sensor and detecting a position coordinate of each pressing point from the position detection sensor when the operation surface is simultaneously pressed at the plurality of pressing points;
(3) obtaining, in the control unit, position rates of each pressing point within a region surrounded by the plurality of reference points close to each pressing point based on the position coordinates of each pressing point and each reference point;
(4) obtaining, in the control unit, the sensitivity of each pressing point based on the sensitivity of each reference point used in (3) and the position rates of each pressing point; and
(5) calculating, in the control unit, the load of each pressing point based on the sensitivity of each pressing point obtained in (4) and the sensor output of each load sensor obtained in (2).
In the aspect of the present invention, the sensitivities at the plurality of reference points in the operation surface are held in advance as shown in (1), and when the plurality of points (a plurality of pressing points) are simultaneously pressed on the operation surface, the sensor output of each load sensor and the position coordinate of each pressing point are first detected in (2), and then, the position rates of each pressing point within the region surrounded by a plurality of reference points close to each pressing point are obtained in (3). The position rate can be obtained based on the position coordinate at each pressing point and each reference point. Then, in (4), the sensitivity of each pressing point is obtained based on the sensitivity of each reference point and the position rate of each pressing point. Also, in (5), the load of each pressing point can be calculated based on the sensitivity of each pressing point and the sensor output of the load sensor.
According to an aspect of the present invention, it is possible to appropriately and simply obtain the loads of the plurality of simultaneously pressed pressing points without using a complicated calculation.
Particularly, according to the input device and the method of detecting a pressing point in the aspect of the present invention, it is possible to obtain the load of each pressing point even when the number of a plurality of simultaneously pressed pressing points is equal to the number of load sensors. That is, it is possible to obtain the load of each pressing point, for example, if the number of simultaneously pressed pressing points is equal to or smaller than 4 when four load sensors are provided.
In the aspect of present invention, it is preferable that, in an XY coordinate system, each lattice point obtained through crossing in an X direction and an Y direction is the reference point, and in (3), a position rate u in the X direction and a position rate v in the Y direction of each pressing point within a smallest lattice surrounded by four reference points close to each pressing point are obtained. Accordingly, it is possible to reduce a sensitivity error at each pressing point and to accurately obtain the load of each pressing point.
In the aspect of present invention, it is preferable for 4 or more load sensors to be provided. Accordingly, it is possible to obtain the load of each pressing point even when the number of simultaneously pressed pressing points is 4 or more, which is equal to the number of load sensors.
An input device 1 in this embodiment includes a capacitive touch panel sensor 4, and a plurality of load sensors A to D provided on a back surface 4c of the capacitive touch panel sensor 4.
The capacitive touch panel sensor 4 includes an operation panel formed of light transmitting glass or plastic, and a light transmitting sensor layer provided on a back surface of the operation panel. A surface of the capacitive touch panel sensor 4 is an operation surface 4a.
When the operation surface 4a of the capacitive touch panel sensor 4 is pressed with an operation body such as a finger, a change in capacitance occurs and a pressing position (operation position) of the operation body is able to be detected based on the capacitance change. In the capacitive touch panel sensor 4, even when a plurality of points on the operation surface 4a are simultaneously pressed, an X coordinate and a Y coordinate of each pressing point are able to be detected based on the capacitance change described above. Further, a resistive film type or the like may be used in place of the capacitive type. In the case of the resistive film type, for example, a resistance layer of the same plane is divided into a plurality of portions, and when a plurality of points are simultaneously pressed, position coordinates of the respective pressing points are able to be simultaneously detected. However, with the capacitive type, when a plurality of points are simultaneously pressed, it is possible to detect respective position coordinates of a plurality of pressing points more accurately.
As illustrated in
Each of the load sensors A to D includes a sensor substrate 12, and a base surface 13, as illustrated in
The load sensors A to D in this embodiment may have a configuration other than the configuration illustrated in
As illustrated in
Further, a support structure of the load sensors A to D in the touch panel 1 is not limited to the structure illustrated in
The input device 1 of this embodiment includes a capacitive touch panel sensor 4, a plurality of load sensors A to D, and a control unit (IC) 2 connected to the capacitive touch panel sensor 4 and the respective load sensors A to D, as illustrated in
The control unit 2 includes a storage unit 22 and a calculation unit 23, as illustrated in
Further, the calculation unit 23 is able to calculate, for example, each load of each pressing point when the plurality of points on the operation surface 4a are simultaneously pressed.
Hereinafter, an algorithm for obtaining loads of respective pressing points that have been simultaneously pressed will be described using
First, calibration is performed. However, the operation surface 4a is divided in a lattice form in an XY coordinate system, as illustrated in
Position coordinates of the respective reference points p01 to p35 are stored in the storage unit 22.
Further, a timing of the calibration is not limited, but in this description, the calibration is performed prior to shipment of the input device 1.
Prior to the shipment, the respective reference points p01 to p35 are sequentially pressed with a constant load. That is, the respective reference points p01 to p35 are sequentially pressed one by one with a constant load instead of being simultaneously pressed. In this case, it is possible to obtain sensor outputs from the respective load sensors A to D. In step ST1 illustrated in
Also, Table 1 below including the position coordinates and the sensitivities of the reference points p01 to p35 is stored in the storage unit 22 (step ST2 of
When the reference point p01 (the lattice point of the position coordinate (X, Y)) is pressed, the sensitivity of the load sensor A is highest and the sensitivity of the load sensor C is lowest, as shown in Table 1. This is because a distance between the reference point p01 and the load sensor A is shortest in comparison with the load sensors B to D, and a distance between the reference point p01 and the load sensor C is longest in comparison with the load sensors A, B, and D, as illustrated in
The calibration ends through steps ST1 and ST2 of
In step ST3 of
Further, the pressing point may be one point. However, in the following description, pressing points Ito IV are four points, as illustrated in
In step ST4, the number of pressing points and the position coordinates of the respective pressing points I to IV are acquired from the capacitive touch panel sensor 4.
In this embodiment, since the capacitive touch panel sensor 4 is used as the position detection sensor, it is possible to simply and appropriately detect the number of pressing points and the position coordinates of the respective pressing points I to IV. That is, the capacitive touch panel sensor 4 is configured to include, for example, a large number of X electrodes and a large number of Y electrodes, and a change in capacitance between the operation body such as a finger and the X electrode close to the operation body and a change in capacitance between the operation body and the Y electrode close to the operation body occur. Thus, by detecting the electrodes in which the capacitance change occurs, it is possible to detect the number of pressing points and the position coordinates of the respective pressing points I to IV even when a plurality of pressing points are simultaneously pressed. The position coordinates of the respective pressing points I to IV are shown in Table 2.
Then, the sensor outputs of the respective load sensors A to D are acquired in step ST5 of
The position coordinate of the pressing point I is shown as a specific numerical value in Table 2, but is hereinafter indicated as (x1, y1). In addition, the position coordinate of the pressing point II is indicated as (x2, y2), the position coordinate of the pressing point III is indicated as (x3, y3), and the position coordinate of the pressing point IV is indicated as (x4, y4).
Here, for example, the pressing point is assumed to be only one point of I. In this case, the sensor output (Out A) of the load sensor A, the sensor output (Out B) of the load sensor B, the sensor output (Out C) of the load sensor C, and the sensor output (Out D) of the load sensor D are expressed as a product of the load of the pressing point I and the sensitivities of the respective load sensors A to D and are shown in Equation 1 below.
Out—A=a(x1,y1)·Z(1)
Out—B=b(x1,y1)·Z(1)
Out—C=c(x1,y1)·Z(1)
Out—D=d(x1,y1)·Z(1) [Equation 1]
Here, a(x1, y1) in Equation 1 indicates the sensitivity of the load sensor A when the pressing point I is pressed, b (x1, y1) indicates the sensitivity of the load sensor B, c (x1, y1) indicates the sensitivity of the load sensor C, and d (x1, y1) indicates the sensitivity of the load sensor D. Further, Z(1) indicates the load when the pressing point I is pressed.
Therefore, when the pressing points are four points Ito IV as illustrated in
Out A=a(x1, y1)·Z(1) a(x2, y2)·Z(2)+a(x3, y3)·Z(3)+a(x4, v4)·Z(4)
Out—B=b(x1, y1)·Z(1)+b(x2, y2)·Z(2)+b(x3, y3)·Z(3)+b(x4, y4)·Z(4)
Out—C=c(x1, y1)·Z(1)+c(x2, y2)·Z(2)+c(x3, y3)·Z(3)+c(x4, y4)·Z(4)
Out—D=d(x1, y1)·Z(1)+d(x2, y2)·Z(2)+d(x3, y3)·Z(3)+d(x4, y4)·Z(4) [Equation 2]
The sensor output (Out A) of the load sensor A in Equation 2 will be described. Sensitivity a(x1, y1) is sensitivity of the load sensor A when it is assumed that only the pressing point I is pressed, sensitivity a(x2, y2) is sensitivity of the load sensor A when it is assumed that only the pressing point II is pressed, sensitivity a(x3, y3) is sensitivity of the load sensor A when it is assumed that only the pressing point III is pressed, and sensitivity a(x4, y4) is sensitivity of the load sensor A when it is assumed that only the pressing point IV is pressed. Further, a load Z(1) is a load when the pressing point I is pressed, a load Z(2) is a load when the pressing point II is pressed, a load Z(3) is a load when the pressing point III is pressed, and a load Z(4) is a load when the pressing point IV is pressed. Therefore, the sensor output (Out A) of the load sensor A may be expressed as a sum of respective products of the sensitivities a(x1, y1) to a(x4, y4) of the respective pressing points and the loads Z(1) to Z(4) of the respective pressing points. The sensor output (Out B) of the load sensor B, the sensor output (Out C) of the load sensor C, and the sensor output (Out D) of the load sensor D shown in Equation 2 may be considered similarly to the sensor output of the load sensor A. Further, the sensitivities shown in Equation 2 have different values. For example, in terms of the sensor output (Out A) of the load sensor A, since the pressing point is close to the load sensor A in an order of III, I, and II, and the pressing point farthest from the load sensor A is IV, it can be predicted that the sensitivity a(x3, y3) is maximum and the sensitivity a(x4, x4) is minimum. Further, in terms of the sensitivities a(x1, y1), b(x2, y2), c(x3, y3), and d(x4, y4) in the respective load sensors A to D at the pressing point I, since the load sensors are close to the pressing point I in an order of D, A, and B, and the load sensor farthest from the pressing point I is C, it can be predicted that the sensitivity d(x1, y1) is maximum and the sensitivity c(x1, x1) is minimum.
Here, the pressing point I is considered. As illustrated in
In this embodiment, in step ST6 illustrated in
Sensitivities of the respective reference points p23, p24, p30, and p31 are extracted from Table 1 showing the values acquired by the calibration.
Further, sensitivities of the respective load sensors A to D at the pressing point I are shown in Table 4, but these sensitivities are unclear at present. Position rates u and v of the pressing point I in the smallest lattice 30 are obtained so as to obtain the sensitivities of the respective load sensors A to D at this pressing point I. The position rate u in the X direction and the position rate v in the Y direction were obtained using Equation 3 below.
u=(I(x)−p23(x))/(p24(x)−p23(x))=(140−100)/(200−100)=40/100=0.4
v=(I(y)−p23(y))/(p30(y)−p23(y)=(290−255)/(340−255)=35/85=0.412 [Equation 3]
According to Equation 3, the position rate u in the X direction of the pressing point I within the smallest lattice 30 was obtained using the X coordinate of the reference point p23 as a reference position. Further, the position rate v in the Y direction of the pressing point I within the smallest lattice 30 was obtained using the Y coordinate of the reference point p23 as a reference position.
As shown in Equation 3, the position rate in the X direction was 0.4, and the position rate in the Y direction was 0.412. That is, when a length in the X direction within the smallest lattice 30 illustrated in
Further, the position rates u and v of the pressing point II, the pressing point III, and the pressing point IV within the smallest lattice surrounded by four reference points that are close to the pressing point II, the pressing point III, and the pressing point IV can be similarly obtained according to Equation 3.
The position coordinates of the reference point p5, p6, p12, and p13, the sensitivities of the respective load sensors A to D at the respective reference points, the position coordinate of the pressing point II, and the sensitivities of the respective load sensors A to D at the pressing point II, which are used to obtain the position rates u and v of the pressing point II, and the position rates u and v of the pressing point II within the smallest lattice are shown in Table 5 below.
The position coordinates of the reference point p8, p9, p15, and p16, the sensitivities of the respective load sensors A to D at the respective reference points, the position coordinate of the pressing point III, and the sensitivities of the respective load sensors A to D at the pressing point III, which are used to obtain the position rates u and v of the pressing point III, and the position rates u and v of the pressing point III within the smallest lattice are shown in Table 6.
The position coordinates of the reference point p20, p21, p27, and p28, the sensitivities of the respective load sensors A to D at the respective reference points, the position coordinate of the pressing point IV, and the sensitivities of the respective load sensors A to D at the pressing point IV, which are used to obtain the position rates u and v of the pressing point IV, and the position rates u and v of the pressing point IV within the smallest lattice are shown in Table 7.
Then, in step ST7 of
In this embodiment, it is assumed that the sensitivity changes in proportion to a rate of lengths between the reference point p23 and the reference point p24, between the reference point p23 and the reference point p30, between the reference point p30 and the reference point p31, and between the reference point p24 and the reference point p31, which surround the pressing point I. That is, for example, when the sensitivity (see Table 4) of the load sensor A at the pressing point I is considered, the sensitivity at the reference point p23 is 0.54 and the sensitivity at the reference point p24 is 0.40, and thus, it is assumed that the sensitivity of the load sensor A at a middle point between the reference point p23 and the reference point p24 is 0.47.
As described above, the sensitivity becomes high (low) as the pressing point is closer to the load sensor (farther from the load sensor). In this case, even when the sensitivity is regarded as changing as a linear function in the X direction and the Y direction within the smallest lattice 30 illustrated in
As described above, if it is assumed that the sensitivities of the respective load sensors A to D within the smallest lattice 30 are obtained by performing proportional conversion on the sensitivities at the respective reference points p23, p24, p30, and p31 constituting the smallest lattice 30, the sensitivity in the position of I′ illustrated in
Also, since the pressing point is in a position obtained by moving at the position rate v in the Y1 direction from the position of I′, the sensitivity at the pressing point I can be shown in Equation 4 below.
Sensor A sensitivity (point 1)=|(Sensor A sensitivity (p24)−Sensor A sensitivity (p23)*u+Sensor A sensitivity (p23)|+v|((Sensor A sensitivity (p31)−Sensor A sensitivity (p30)*u+Sensor A sensitivity (p30))−((Sensor A sensitivity (p24)−Sensor A sensitivity (p23))*u+Sensor A sensitivity (p23))| [Equation 4]
Further, Equation 4 shows sensitivity of the load sensor A at the pressing point I. The sensitivities of the load sensor A at the respective pressing points II to IV and the load sensors B to D at the pressing points I to IV are also able to be obtained according to Equation 4.
Accordingly, the sensitivities of the load sensors A to D at the respective pressing points I to IV were able to be obtained. The position coordinates of the respective pressing points I to IV, the sensitivities of the respective load sensors A to D at the respective pressing points I to IV, and the sensor outputs of the respective load sensors A to D are collectively shown in Table 8.
“A” at the pressing point I in column “sensitivity” shown in Table 8 indicates sensitivity of the load sensor A at the pressing point I and corresponds to sensitivity a(x1, y1) in Equation 2, “B” at the pressing point I corresponds to sensitivity b(x1, y1) in Equation 2, “C” at the pressing point I corresponds to sensitivity c(x1, y1) in Equation 2, and “D” at the pressing point I corresponds to sensitivity d(x1, y1) in Equation 2. The same applies to a relationship between “A” to “D” at the respective pressing points II-IV in column “sensitivity” in Table 8 and the sensitivities a(x2, y2) to d(x4, y4) shown in Equation 2.
Further, when each sensor output and each sensitivity shown in Table 8 are applied to Equation 2, Equation 5 below is obtained.
0.22Z(1)+0.43Z(2)+0.23Z(3)+0.20Z(4) 151
0.09Z(1)+0.31Z(2)+0.05Z(3)+0.53Z(4)=152
0.73Z(1)+0.29Z(2)+0.32Z(3)+0.40Z(4)=208 [Equation 5]
Here, unknowns are four loads Z(1) to Z(4). Meanwhile, since a simultaneous linear equation includes four equations as shown in Equation 5, Equation 5 is able to be solved and the respective loads Z(1) to Z(4) are able to be obtained. A calculation in Equation 5 is performed by the calculation unit 23 of the control unit 2.
A result of solving Equation 5 showed that the load Z(1) at the pressing point I was 100, the load Z(2) at the pressing point II was 202, the load Z(3) at the pressing point III was 50, and the load Z(4) at the pressing point IV was 149 (step ST8 in
As described above, in this embodiment, the sensitivities at the plurality of reference points p01 to p35 on the operation surface 4a are held by the calibration in advance (
Thus, in this embodiment, it is possible to appropriately and simply obtain the loads of a plurality of pressing points I to IV simultaneously pressed, without using a complicated calculation.
Particularly, according to this embodiment, it is possible to obtain the loads of the respective pressing points even when the number of the plurality of simultaneously pressed pressing points is equal to the number of load sensors A to D. That is, in the above-described embodiment, since the four load sensors A to D are provided, it is possible to obtain the loads Z of the respective pressing points I to IV even when the operation surface 4a is simultaneously pressed at four points. The simultaneous linear equation including the same number of equations as the number of load sensors as shown in Equations 2 and 5 can be obtained, unknowns in this case are only the loads of the respective pressing points, and since the number of unknowns is equal to the number of equation in the simultaneous linear equation, the simultaneous linear equation can be solved. Further, as a matter of course, when the four load sensors A to D are provided, it is possible to obtain the load of each pressing point using the above-described equation even when the number of pressing points on the operation surface 4a is 1 to 3.
Further, the number of load sensors is not particularly limited as long as the number of load sensors is 2 or more. However, when the number of pressing points is greater than 3, a calculation when a load of each pressing point is obtained is complicated or disabled in a method of the related art, and thus, it is preferable for the number of load sensors to be 4 or more.
The calibration illustrated in
Further, after the calibration is performed before shipment, the user is also able to perform the calibration. In this case, the user may be caused to press all the reference points p01 to p35 illustrated in
In this embodiment, when the position rates u and v of the respective pressing points I to IV are to be obtained, it is preferable to obtain the position rate u in the X direction and the position rate v in the Y direction of the respective pressing points I to IV within the smallest lattice surrounded by the four reference points close to the respective pressing points I to IV. For example, it is possible to also obtain the position rates u and v of the pressing point I within a slightly larger region using the reference points p15, p18, p29, and p32 that are lattice points of the slightly larger region without using the reference points p23, p24, p30, and p31 constituting the smallest lattice, for example, so as to obtain the position rates u and v of the pressing point I. However, since a sensitivity obtained through proportional conversion from the sensitivities at the respective reference points surrounding the pressing point I using the position rates u and v is regarded as the sensitivity at the pressing point I as described above, when the region surrounding the pressing point I is increased, a sensitivity error at the pressing point I is easily correspondingly generated. Therefore, it is possible to preferably reduce the sensitivity error by obtaining the sensitivities at the respective pressing points I to IV in the region surrounded by the reference points close to the respective pressing points I to IV.
Further, in this embodiment, it is preferable that the respective lattice points obtained through crossing in the X direction and the Y direction in the XY coordinate system are the reference points p01 to p35, and the position rates u and v at the respective pressing points Ito IV in the smallest lattice surrounded by the four references close to the respective pressing points I to IV are obtained. For example, each crossing point obtained by obliquely crossing the X direction and the Y direction may be the reference point. However, in this configuration, a shape obtained by connecting the four reference points close to the pressing point around the pressing point in a straight line shape is a diamond shape rather than the rectangular or square lattice shape as illustrated in
The input device (touch panel) 1 in this embodiment is applicable to a portable telephone, a portable information processing device, a portable storage device, a portable game device, or the like.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims of the equivalents thereof.
Number | Date | Country | Kind |
---|---|---|---|
2012-225837 | Oct 2012 | JP | national |
This application is a Continuation of International Application No. PCT/JP2013/077563 filed on Oct. 10, 2013, which claims benefit of Japanese Patent Application No. 2012-225837 filed on Oct. 11, 2012. The entire contents of each application noted above are hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2013/077563 | Oct 2013 | US |
Child | 14625476 | US |