Patent Application
20110179374
1. Field of the Invention
The present invention relates to an information processing apparatus and a program for improving the operability of a software keyboard.
2. Description of the Related Art
In recent years, there is proposed a method of displaying a predetermined software keyboard on a display screen of an apparatus including a touch panel, and making a key input by a finger touching the screen on which keys of the software keyboard are displayed (see, for example, Japanese Patent Application Laid-open No. 2006-86934).
However, in a case where inputs are made with a software keyboard in touch typing, since keys are not physically independent, the positions of the respective keys are difficult to be distinguished, as compared to a hardware-type (mechanical-type) keyboard. As a result, typing errors are increased and an input speed is lowered, which is not necessarily a comfortable input environment.
On the other hand, in a case where the size of each key of the software keyboard is uniformly increased, a space for displaying other information is reduced on the screen, which lacks convenience. Particularly, since a display screen of a portable device is not large, it may be impossible to enlarge a display area of the software keyboard immoderately.
In view of the circumstances as described above, it is desirable to provide a new and improved information processing apparatus and program that are capable of automatically changing the display of a software keyboard in accordance with operation situations of a user.
According to an embodiment of the present invention, there is provided a display apparatus including: a housing including a touch panel, configured to display a predetermined software keyboard including keys on a display screen; an operation position specification section configured to specify an operation position of each of the keys of the software keyboard; and a display control section configured to automatically change display of the keys based on variations of the operation positions of the keys, the operation positions being specified by the operation position specification section.
With this structure, based on the variations of the operation positions of the keys of the software keyboard, the display of the keys is automatically changed. In other words, based on the variations of the operation positions of the keys, the software keyboard automatically adjusts the position, size, and shape of the keys to the operation states of a user. Accordingly, it is possible to improve the operability of the software keyboard, reduce typing errors, raise an input speed, and streamline operations.
The display control section may display an operation area of the key having a large variation more largely than that of the key having a small variation based on the variations of the operation positions of the keys.
The display control section may obtain the center of the operation positions of each of the keys based on the variations of the operation positions, and change a display position of each of the keys in accordance with the obtained center of the operation positions.
The display control section may obtain a standard deviation of each of the keys based on the variations of the operation positions, and set a width of each of the keys in accordance with a width of the obtained standard deviation.
When each of the keys is displayed based on the center of the operation positions and the width of the key, and adjacent keys are displayed in an overlapping manner, the display control section may set a portion displayed in the overlapping manner as a dead zone to which a key input is incapable of being made.
According to another embodiment of the present invention, there is provided a display apparatus including: a housing including a touch panel, configured to display a predetermined software keyboard including keys on a display screen; a number-of-operations specification section configured to specify the number of operations made to each of the keys of the software keyboard; and a display control section configured to automatically change display of the keys based on the number of operations made to the keys, the number of operations being specified by the number-of-operations specification section.
With this structure, based on the number of operations made to the keys of the software keyboard, the display of the keys is automatically changed. In other words, based on the number of operations made to the keys, the software keyboard automatically adjusts the position, size, and shape of the keys to the operation states of a user. Accordingly, it is possible to improve the operability of the software keyboard, reduce typing errors, raise an input speed, and streamline operations.
The display control section may display an operation area of the key having a large number of operations more largely than that of the key having a small number of operations based on the number of operations made to the keys.
The number-of-operations specification section may obtain a peak position of the operations made to each of the keys based on the number of operations made to each of the keys, and the display control section may obtain a peak position of the operations made to each of the keys based on the number of operations made to each of the keys and change a display position of the key based on the peak position.
The display control section may set a boundary between the peak positions of adjacent keys in accordance with a ratio of the numbers of operations of the adjacent keys.
Further, according to another embodiment of the present invention, there is provided a display apparatus including: a housing including a touch panel, configured to display a predetermined software keyboard including keys on a display screen; an erroneous input position specification section configured to specify an erroneous input position of each of the keys of the software keyboard; and a display control section configured to automatically change display of the keys based on the erroneous input positions of the keys, the erroneous input positions being specified by the erroneous input position specification section.
With this structure, based on the erroneous input positions of the keys of the software keyboard, the display of the keys is automatically changed. For example, the display control section may display an operation area of the key having a large number of erroneous inputs more largely than that of the key having a small number of erroneous inputs based on the erroneous input positions of the keys. Further, the display control section may change a display position of each of the keys based on the erroneous input positions of the keys.
As described above, based on the erroneous input positions of the keys, the software keyboard automatically adjusts the position, size, and shape of the keys to the operation states of a user. Accordingly, it is possible to improve the operability of the software keyboard, reduce typing errors, raise an input speed, and streamline operations.
The display control section may change at least one of a display position and an operation area of a key adjacent to each of the keys based on the erroneous input positions of the keys.
The display control section may change display of at least one of a key operation area for a right hand and a key operation area for a left hand, based on the erroneous input positions of the keys.
The display control section may change display of the keys by varying a boundary position of each key one of per given period of time during which the software keyboard is operated and per given number of times typing is made on the software keyboard.
Further, according to another embodiment of the present invention, there is provided a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an operation position specification section configured to specify an operation position of each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on variations of the operation positions of the keys, the operation positions being specified by the operation position specification section.
Further, according to another embodiment of the present invention, there is provided a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of a number-of-operations specification section configured to specify the number of operations made to each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on the number of operations made to the keys, the number of operations being specified by the number-of-operations specification section.
Further, according to another embodiment of the present invention, there is provided a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an erroneous input position specification section configured to specify an erroneous input position of each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on the erroneous input positions of the keys, the erroneous input positions being specified by the erroneous input position specification section.
As described above, according to the embodiments of the present invention, it is possible to automatically change display of a software keyboard in accordance with operation situations of a user.
These and other objects, features and advantages of the present invention will become more apparent in light of the following detailed description of best mode embodiments thereof, as illustrated in the accompanying drawings.
Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. It should be noted that in this specification and drawings, constituent elements having substantially the same functional structure are denoted by the same reference numeral and overlapping description thereof is omitted.
It should be noted that the embodiments of the present invention will be described in the following order.
[Example of display screen of PC]
[Functional structure of PC]
[Display change of software keyboard]
[Results on display change of software keyboard]
[Operation example of display screen of PC]
[Functional structure of PC]
[Display change of software keyboard]
[Results on display change of software keyboard]
[Example of erroneous input of PC]
[Functional structure of PC]
[Display change of software keyboard]
[Results on display change of software keyboard]
[Display change of software keyboard]
[Example of display screen of PC]
First, an example of an initial display screen of a PC (Personal Computer) 100 as a display apparatus according to the first embodiment of the present invention will be described with reference to
The PC 100 as a display apparatus according to the first embodiment includes a housing 140 including a touch panel 110, in which a predetermined software keyboard 130 is displayed on a display screen 120. The touch panel 110 is a sensor that can detect a position of a finger of a user.
As the display screen 120, for example, an LCD (Liquid Crystal Display) or an organic electroluminescence display (organic EL, OELD) can be used.
In this embodiment, a QWERTY keyboard is displayed as the software keyboard 130, but this embodiment is not limited thereto. This embodiment is applicable to various software keyboards 130 such as a numerical keypad.
It should be noted that the PC 100 incorporates a chip including a CPU, a RAM, a nonvolatile memory, and the like (not shown). In various memories, information on a screen operation detected by the touch panel 110 (for example, key input history information) is stored. Further, in the various memories, a program for executing display change processing that will be described later is stored. The CPU executes the display change processing by acquiring necessary data from the memories while reading the program.
[Functional Structure of PC]
A functional structure of the PC 100 according to this embodiment will be described with reference to
The key input history storage section 150 stores logs (histories) of user operations made to the software keyboard 130, which are detected using the touch panel 110.
The operation position specification section 155 specifies an operation position of each key of the software keyboard 130.
The display control section 160 automatically changes the display of keys based on variations of the operation positions of the keys, which are specified by the operation position specification section 155. On the display screen 120, the software keyboard 130 with the changed keys is displayed.
[Display Change of Software Keyboard]
Next, the display change of the software keyboard according to this embodiment will be described with reference to a relationship between key input histories and key display changes shown in
In this embodiment, based on the variations of the operation positions of the keys (note that only history information of correct input operations is used), the display of each key is automatically changed. In other words, the shape of the key is changed in accordance with habits of key input made by each user. As the habits of key input made by each user, positions at which typographical errors are liable to be caused, variations of position (variations of touch position), and the like are included.
The left-side illustration of
The above operations will be described with reference to the flowchart of the display change processing of the software keyboard 130 shown in
First, in S405, the operation position specification section 155 acquires key input history information from the key input history storage section 150. In S410, the operation position specification section 155 judges whether the key input is correct. For example, in a case where an input is intended to be made with the W key, when a point within the operation area of the W key is hit, the key input is correct and accordingly the processing proceeds to S415.
In S415, the operations of S405 to S415 are repeated until a predetermined period of time is passed or a predetermined number of pieces of key input history information is obtained, and continues acquiring the key input history information. In S420, the operation position specification section 155 specifies operation positions of each key (coordinate histories) that are included in the key input history information, and obtains a standard deviation and a center point of the key input area. In S425, the display control section 160 automatically changes the display of the key based on variations of the operation positions of the key that are specified by the operation position specification section 155. Specifically, the display control section 160 sets the obtained standard deviation as a key width and arranges the key at the position of the obtained center point serving as the center.
Next, in S430, the display control section 160 judges whether the arranged key overlaps an adjacent key. When it is judged that the arranged key does not overlap an adjacent key, the processing proceeds to S435. The display control section 160 determines an operation area of the key that is arranged while the set center point and key width are held as they are, and displays the operation area on the display screen 120 in S440, thus completing the change in arrangement.
On the other hand, in a case where it is judged that the key arranged in S430 overlaps an adjacent key, the processing proceeds to S445. The display control section 160 sets the portion displayed as an overlapping portion, as a dead zone in which a key input is not made. For example, in
In addition, in a case where the key input is incorrect in S410, the processing proceeds to S450 and an erroneous input processing routine is executed. The erroneous input processing routine is executed based on a flowchart shown in
[Results on Display Change of Software Keyboard]
Processing results of this embodiment will be described with reference to
As described above, in this embodiment, the display control section 160 displays, based on the variations in operation positions of the keys, an operation area of a key having a large variation more largely than an operation area of a key having a small variation. Further, the display control section 160 obtains the center of the operation positions of each key based on the variations of the operation positions, and changes a display position of each key in accordance with the obtained center of the operation position.
As described above, in this embodiment, the shape of the key is changed in accordance with a correct key input. Particularly, in this embodiment, the key is enlarged when a shift of the typing position of the key is large. Accordingly, it is possible to improve the operability of the software keyboard 130, reduce typing errors, raise an input speed, and streamline operations.
It should be noted that when the typing position of the key is not shifted so much, the key operation area can be reduced, or the key operation area can be left as it is without change. For example, as shown in
Further, in this embodiment, the boundary between the keys adjacent in the lateral direction is changed. However, a boundary between keys adjacent in a vertical direction can be changed or both the boundaries between the keys adjacent in the lateral and vertical directions may be changed.
Next, an automatic display change method for a software keyboard according to a second embodiment of the present invention will be described using an example of a display screen operation of a PC 100 shown in
[Operation Example of Display Screen of PC]
In
[Functional Structure of PC]
A functional structure of the PC 100 according to this embodiment will be described with reference to
The number-of-operations specification section 165 specifies the number of operations made to each key of the software keyboard 130, and based on the specified number of operations made to each key, obtains a peak position of the operations made to each key. Thus, a peak position of each key is obtained as shown below the software keyboard 130 in
The display control section 160 automatically changes a key width based on the number of operations made to each key, which is specified by the number-of-operations specification section 165. On the display screen 120, the software keyboard 130 with the changed keys is displayed.
[Display Change of Software Keyboard]
In this embodiment, based on the number of operations of each key (note that only history information of correct input operations is used), the display of each key is automatically changed. For example, keys used frequently by a user are increased in size, and keys not used frequently are reduced in size.
The above operations will be described with reference to a flowchart of the display change processing of the software keyboard 130 shown in
First, in S705, the number-of-operations specification section 165 acquires key input history information from the key input history storage section 150. In S710, the number-of-operations specification section 165 judges whether the key input is correct. For example, in a case where an input is made with an A key, when a point within an operation area of the A key is hit, the key input is correct and accordingly the processing proceeds to S715.
In S715, the operations of S705 to S715 are repeated until a predetermined period of time is passed or a predetermined number of pieces of key input history information is obtained, and continues acquiring the key input history information. In S720, the number-of-operations specification section 165 specifies operation positions of each key (coordinate histories) that are included in the key input history information, and obtains a peak position of the operations of each key from the distribution of the operation positions of each key. In S725, the display control section 160 automatically changes the display of each key based on the number of operations made to each key, with the peak position specified by the number-of-operations specification section 165 being set as the center of each key. Specifically, the display control section 160 sets a boundary between the peaks of adjacent keys in accordance with a ratio of the number of operations (number of presses) of the adjacent keys.
Next, in S730, the display control section 160 displays an operation area of the determined key on the display screen 120, and completes the change in arrangement. In addition, in a case where the key input is incorrect in S710, the processing proceeds to S735 and an erroneous input processing routine is executed. The erroneous input processing routine is executed based on the flowchart shown in
[Results on Display Change of Software Keyboard]
Processing results of this embodiment will be described with reference to
As described above, in this embodiment, the display control section 160 displays an operation area of a key whose number of operations is large, more largely than that of a key whose number of operations is small, based on the number of operations made to each key. Further, the number-of-operations specification section 165 obtains a peak position of operations made to each key, based on the number of operations made to each key. The display control section 160 changes a display position of each key based on the peak position.
As described above, in this embodiment, the shape of the key is changed in accordance with a correct key input. Further, a key width is determined based on the number of times each key is pressed. Particularly, a boundary between peak positions adjacent to each other is determined in accordance with a ratio of the number of times the adjacent keys are pressed. Accordingly, in this embodiment, an operation area of a key not used frequently is reduced, but an operation area of a key used frequently is increased. Consequently, it is possible to improve the operability of the software keyboard 130, reduce typing errors, raise an input speed, and streamline operations.
It should be noted that when keys are not used by a predetermined number of times or more per unit time, the key operation area can be reduced, or the key operation area can be left as it is without change. Further, in this embodiment, the boundary between the keys adjacent in the lateral direction is changed. However, a boundary between keys adjacent in a vertical direction can be changed or both the boundaries between the keys adjacent in the lateral and vertical directions may be changed.
Next, an automatic display change method for a software keyboard according to a third embodiment of the present invention will be described using an example of a display screen operation of a PC 100 shown in
[Example of Erroneous Input of PC]
The left-side illustration of
In addition, in the middle illustration of
[Functional Structure of PC]
A functional structure of the PC 100 according to this embodiment will be described with reference to
The erroneous input history storage section 170 stores the erroneous input history information as described above. The erroneous input position specification section 175 specifies an erroneous input position of each key of the software keyboard 130 based on the erroneous input history information stored in the erroneous input history storage section 170.
The display control section 160 automatically changes the display of each key based on the erroneous input position of each key, which is specified by the erroneous input position specification section 175. On the display screen 120, the software keyboard 130 with the changed keys is displayed.
[Display Change of Software Keyboard]
In this embodiment, based on the number of erroneous operations of each key (that is, only history information of erroneous input operations is used), the display of each key is automatically changed. For example, keys erroneously touched by a user frequently are increased in size, and keys erroneously touched by a user less frequently are reduced in size.
The above operations will be described with reference to a flowchart of the display change processing of the software keyboard 130 shown in
First, in S1105, the erroneous input position specification section 175 acquires erroneous input history information from the erroneous input history storage section 170. In S1110, the erroneous input position specification section 175 judges whether a deleted key is one (one letter). In a case where a deleted key is one, the processing proceeds to S1115.
In S1115, the operations S1105 to S1115 are repeated until a predetermined period of time is passed or a predetermined number of pieces of erroneous input history information is obtained, and continues acquiring the erroneous input history information. In S1120, the erroneous input position specification section 175 specifies operation positions of each key (coordinate histories) that are included in the erroneous input history information, and increases a key width to a position where an erroneous input is made. In S1125, the display control section 160 widens an operation area of each key to the key width specified by the erroneous input position specification section 175, and displays the operation area on the display screen 120, thus completing the change in arrangement.
On the other hand, in a case where the erroneous input position specification section 175 judges that the deleted key is not one (one letter) in S1110, the processing proceeds to S1130. In S1130, the erroneous input position specification section 175 deletes the deleted acquisition history (erroneous input history information) from the erroneous input history storage section 170.
It should be noted that the above processing in
[Results on Display Change of Software Keyboard]
As the processing results of this embodiment, as shown in the right-side illustration of
As described above, in this embodiment, the display control section 160 changes a display position of each key based on the erroneous input positions of each key. Specifically, the display control section 160 displays an operation area of a key erroneously input with frequency more largely than that of a key erroneously input with less frequency, based on the erroneous input positions of the keys.
In this manner, the shape of the key is changed in accordance with an erroneous key input. Accordingly, in this embodiment, an operation area of a key erroneously input is increased. Consequently, it is possible to improve the operability of the software keyboard 130, reduce typing errors, raise an input speed, and streamline operations.
It should be noted that the display control section 160 may move a display position of a key adjacent to each key, or change an operation area thereof based on the erroneous input positions of the keys.
Further, the operation area of a key may be widened to a position at which an erroneous input is detected, or may be widened in a stepwise manner by a given width. Further, in this embodiment, the boundary between the keys adjacent in the lateral direction is changed. However, a boundary between keys adjacent in a vertical direction can be changed or both the boundaries between the keys adjacent in the lateral and vertical directions may be changed.
A display change method for a software keyboard will be described in detail with reference to
Finally, a display change method for a software keyboard according to a modified example will be described with reference to
In this regard, in the modified example, a key operation area for the right hand is shifted obliquely rightward of a key operation area for the left hand, and the key operation area for the right hand and the key operation area for the left hand are displayed so as to be separated from each other. In this manner, the display control section 160 may judge shifts of a plurality of keys for each hand, and change the display so as to move the entire keyboard, the key operation area for the right hand (keyboard on the right side), and the key operation area for the left hand (keyboard on the left side) in conjunction with one another.
As described above, in the modified example, the display position of the software keyboard 130 or display of the operation areas of the keys can be changed in various units. Accordingly, it is possible to improve the operability of the software keyboard 130, reduce typing errors, raise an input speed, and streamline operations.
According to the embodiments and the modified example described above, the software keyboard automatically adjusts the position of keys, shape of keys, and size of keys to the operations and preference of the user, while a user does not become conscious of the position of keys. Accordingly, it is possible to improve the operability of the software keyboard.
In the first to third embodiments, the operations of the respective sections are associated with one another, and can be replaced by each other as a series of operations and a series of processing while taking the mutual association into consideration. With this structure, the embodiments of the display apparatus can be applied to embodiments of a program for causing a computer to realize a function that the display apparatus has, and a storage medium storing the program.
With this structure, it is possible to provide a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an operation position specification section configured to specify an operation position of each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on variations of the operation positions of the keys, the operation positions being specified by the operation position specification section.
Further, with this structure, it is possible to provide a storage medium storing a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an operation position specification section configured to specify an operation position of each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on variations of the operation positions of the keys, the operation positions being specified by the operation position specification section.
Further, with this structure, it is possible to provide a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an number-of-operations specification section configured to specify the number of operations made to each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on the number of operations made to the keys, the number of operations being specified by the number-of-operations specification section.
Further, with this structure, it is possible to provide a storage medium storing a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an number-of-operations specification section configured to specify the number of operations made to each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on the number of operations made to the keys, the number of operations being specified by the number-of-operations specification section.
Further, with this structure, it is possible to provide a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an erroneous input position specification section configured to specify an erroneous input position of each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on the erroneous input positions of the keys, the erroneous input positions being specified by the erroneous input position specification section.
Further, with this structure, it is possible to provide a storage medium storing a program causing a computer to execute: a function of a display apparatus including a housing that includes a touch panel and is configured to display a predetermined software keyboard including keys on a display screen; a function of an erroneous input position specification section configured to specify an erroneous input position of each of the keys of the software keyboard; and a function of a display control section configured to automatically change display of the keys based on the erroneous input positions of the keys, the erroneous input positions being specified by the erroneous input position specification section.
Hereinabove, the suitable embodiments of the present invention will be described in detail with reference to the attached drawings, but the present invention is not limited thereto. It is apparent that a person having an ordinary skill in the technical field to which the present invention pertains can arrive at various modified examples or corrected examples in the category of the technical idea disclosed in claims, and it is understood that those examples are naturally included in the technical range of the present invention.
For example, in the embodiments described above, the PC is exemplified as a display apparatus, but the display apparatus according to an embodiment of the present invention is not limited thereto. For example, the display apparatus according to an embodiment of the present invention can be used in information processing apparatuses such as a laptop PC and a desktop PC. Further, the display apparatus according to an embodiment of the present invention is not limited to PCs, and can be used in, for example, portable terminals such as a cellular phone, a portable music player, and a PDA (Personal Digital Assistant).
Further, the display control section according to an embodiment of the present invention may change the display of the keys with respect to the operations made to the software keyboard 130 in a predetermined period of time or more, or change the display of the keys with respect to a predetermined number of operations or more made to the software keyboard 130.
Further, the display control section according to an embodiment of the present invention can determine a maximum value and a minimum value of the operation area of a key in advance, and can set the operation area so as not to be too smaller than the minimum value of the operation area of the key, or too larger than the maximum value of the operation area of the key.
It should be noted that a switch to turn on/off the function of the display apparatus according to an embodiment of the present invention can also be provided. For example, it may be possible to update the display of the software keyboard 130 with use of the display change method according to an embodiment of the present invention when a PC serving as the display apparatus according to an embodiment of the present invention is activated, and not to change the display of the software keyboard 130 until the next activation. Accordingly, the processing load on the CPU can be reduced.
The erroneous input processing routine of the first and second embodiments may not be indispensable for the first and second embodiments, and may be present or absent in the first and second embodiments. In a case where the erroneous input processing routine is executed in the first and second embodiments, the erroneous input history storage section 170 and the erroneous input position specification section 175 (see
In the present invention, it is possible to identify a user and display a software keyboard applied to the identified user, out of software keyboards stored for each user in advance.
The present application contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2010-010405 filed in the Japan Patent Office on Jan. 20, 2010, the entire content of which is hereby incorporated by reference.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2010-010405 | Jan 2010 | JP | national |
