The present disclosure relates to an information processing device, an information processing method, and a computer program. More specifically, the present disclosure relates to an information processing device, an information processing method, and a computer program that perform a process of calling associated information associated with information displayed on a display unit.
Mobile terminals such as smartphones or tablet terminals have no physical buttons or have a small number of physical buttons provided thereon, and are based on operations input to touch panels. Such terminals allow operations to be input through a gesture such as tap, flick, pinch-in, or pinch-out that has not been able to be implemented with conventional information terminals that are based on operations input to keys (e.g., see JP 2010-108061A).
Meanwhile, as the number of physical buttons is small, and as the number of operations that can be input to the touch panel as well as the display area of the mobile terminal are limited, it would be necessary to devise information that is displayed on the display area and allocation of a function executed through input of an operation. For example, if a menu calling function for calling a menu in accordance with context from an item displayed on the display area is allocated to a long-pressing operation, a menu is displayed when the target item is pressed for a long time.
However, as a method of calling a menu through a long-pressing operation is not intuitive, it is often the case that a user does not notice the operation. Although it is possible to display a menu around the target item in accordance with context in advance, the design would become complex, and it would be difficult to secure a space for displaying a menu in advance on a mobile terminal with a narrow display area.
Thus, it is desirable to provide a method that allows a user to execute a function intuitively through natural input of an operation.
According to an embodiment of the present disclosure, there is provided an information processing device, including: a position determination unit configured to, on the basis of a touch position of an input object on a display unit that displays first information, determine a touch on a display object that displays second information associated with the first information; an operation input determination unit configured to determine if a predetermined operation is input to the display object; and a display processing unit configured to, on the basis of determination results obtained by the position determination unit and the operation input determination unit, move a display position of the first information so that the second information is displayed at a position in which the moved first information has been displayed.
According to the embodiment of the present disclosure, when a predetermined operation is input to the display object displayed on the first information, the first information is moved so that the second information associated with the first information is displayed. At this time, by moving the first information in accordance with an operation input to the display object, a user is able to display the second information through an operation that is intuitively easy to understand.
According to another embodiment of the present disclosure, there is provided an information processing method, including: determining, on the basis of a touch position of an input object on a display unit that displays first information, a touch on a display object that displays second information associated with the first information; determining if a predetermined operation is input to the display object; and moving, on the basis of determination results obtained by the position determination unit and the operation input determination unit, a display position of the first information so that the second information is displayed at a position in which the moved first information has been displayed.
According to still another embodiment of the present disclosure, there is provided a computer program causing a computer to function as an information processing device, the information processing device including: a position determination unit configured to, on the basis of a touch position of an input object on a display unit that displays first information, determine a touch on a display object that displays second information associated with the first information; an operation input determination unit configured to determine if a predetermined operation is input to the display object; and a display processing unit configured to, on the basis of determination results obtained by the position determination unit and the operation input determination unit, move a display position of the first information so that the second information is displayed at a position in which the moved first information has been displayed.
As described above, according to the embodiments of the present disclosure, an information processing device, an information processing method, and a computer program are provided that allow a user to execute a function intuitively through natural input of an operation.
Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
Note that the description will be made in the following order.
1. First Embodiment (Determination based on Pressing Time)
2. Second Embodiment (Determination based on pressure)
3. Exemplary Hardware Configuration
An information processing device in accordance with the first embodiment of the present disclosure is a device, which performs a process of calling a function, of a terminal that receives an operation input using a touch panel such as a mobile phone like a smartphone or a tablet terminal. Specifically, the information processing device performs a process of calling associated information that is associated with information displayed on a display unit. In this case, the process is performed by the information processing device so that the function can be executed intuitively by a user through natural input of an operation. Hereinafter, the configuration of the information processing device and a function calling process performed by the information processing device will be described in detail.
First, the functional configuration of an information processing unit 120 that is the information processing device in accordance with the first embodiment of the present disclosure will be described with reference to
The mobile terminal 100 in accordance with this embodiment includes an operation input detection unit 110, the information processing unit 120, and a display unit 130 as shown in
The operation input detection unit 110 is an example of an input device that allows a user to input an operation to operate information, and detects a touch at the position of an input object such as a finger. For the operation input detection unit 110, for example, a capacitive touch panel that detects a touch of an input object by sensing an electric signal through static electricity, a pressure-sensitive touch panel that detects a touch of a finger by sensing a change in pressure, or the like can be used. The operation input detection unit 110 is provided in a manner stacked on the display unit 130 that displays information. Thus, the user is able to operate information displayed on the display unit 130 by moving a finger or the like on the display area. The operation input detection unit 110, upon detecting a touch of an input object, outputs the detection ID provided to identify the touch of the input object, positional information, and touch time as a detection signal to the information processing unit 120.
The information processing unit 120 performs a process of calling associated information that is associated with the information displayed on the display unit. The information processing unit 120 includes, as shown in
The position determination unit 122 identifies the operation target on the basis of the touch position of the input object detected by the operation input detection unit 110. The information processing unit 120 in accordance with this embodiment performs a process of calling associated information that is associated with the information displayed on the display unit 130. At this time, the position determination unit 122 determines if a display object (indicated by reference numeral 214 in
The operation input determination unit 124, on the basis of a movement of the input object detected by the operation input detection unit 110, determines if a predetermined operation is input to the display object. The operation input determination unit 124 determines the type of the input operation by continuously monitoring a detection signal of the detection ID provided when the input object has touched the display object. A predetermined operation input for starting a process of calling associated information can be, for example, a long-pressing operation or a short-pressing operation on the display object. The determination result obtained by the operation input determination unit 124 is output to the display processing unit 126.
The display processing unit 126 determines whether to start a process of calling associated information on the basis of the determination results obtained by the position determination unit 122 and the operation input determination unit 124, and processes display information displayed on the display unit 130 in accordance with the determination. The display processing unit 126 starts a process of calling associated information when it is determined that the display object is selected as the operation target and a predetermined operation is input to the display object. The process of calling the associated information is described in detail below. The display processing unit 126, when changing the display information, performs a process of changing the display information, and outputs the updated display information to the display unit 130.
The storage unit 128 stores various information used for the process of calling associated information with the information processing unit 120. The storage unit 128 stores, for example, the type of a predetermined operation input for starting a process of calling associated information, threshold information used for determination (e.g., first determination time and second determination time or end determination time described below). In addition, the storage unit 128 may include memory (not shown) for temporarily storing information when a process of calling associated information is performed. The memory stores, for example, a detection signal (the touch time for the detection ID and positional information at that time) detected by the operation input detection unit 110.
The display unit 130 is a display device that displays information, and a liquid crystal display, an organic EL display, or the like can be used therefor, for example. The display unit 130 displays the display information upon receiving an instruction from the display processing unit 126.
Next, a process of calling associated information with the information processing unit 120 in accordance with this embodiment will be described with reference to
(1) Summary of Process of Calling Associated Information with Music Application
In this embodiment, an operation of a music application on the mobile terminal 100 will be exemplarily described. As shown in the left view of
The list of playlists 210 may be represented as if it is floated on water, for example. In such a case, an object 212 (212a to 212e) representing each playlist 212 resembles a single plate. When the list of playlists 210 is represented such that it includes a plurality of objects 212 floated on water, the objects 212 are displayed such that they slightly sway, whereby it becomes possible to indicate that each object 212 is movable. As another method of indicating that each object 212 is movable, it is also possible to make each object 212 sway slightly only when a finger touches the playlist 210.
Each playlist includes music pieces constituting the playlist. The object 212 of each playlist displays, for example, the name of the playlist, the number of music pieces included in the playlist, and an icon representing the playlist. For example, a playlist “Playlist 1” associated with the object 212a includes 20 music pieces, and a playlist “Playlist 2” associated with the object 212b includes 12 music pieces.
In addition, at one end (a right end in the example shown in
When a predetermined operation is input to the display object 214, the object 212 of the playlist moves. In this embodiment, movement of the object 212 is represented such that the object 212 moves on the basis of the principle of leverage when an operation of pressing in the display object 214 is input. Specifically, movement of the object 212 is represented such that, with the display object 214 serving as the point of effort, the opposite end of the display object 214 moves toward a user who is opposite the display area 200 of the display unit 130. As described above, when an operation input by the user is made to have relevance to the movement of the object 212, it becomes possible for the user to move the object 212 naturally.
When the object 212 of the playlist is moved, associated information that is associated with the playlist is displayed at a position where the moved object 212 has been displayed. In this embodiment, as shown in the right view of
Hereinafter, a process of calling an associated function will be described in detail with reference to
The information processing unit 120, upon receiving the detection signal, determines if the touch position of the input object is the display object 214 displayed on the object 212 of the playlist with the position determination unit 122. When the input object does not touch the display object 214, a process of calling an associated function is not executed. Meanwhile, when the input object touches the display object 214, the operation input determination unit 124 determines if a predetermined operation for starting execution of a process of calling an associated function has been input to the display object 214 (S100).
In this embodiment, long-press of the display object 214 is used as a requirement to determine that a predetermined operation is input. Specifically, the operation input determination unit 124 determines if the pressing time in which the display object 214 is pressed is longer than the first determination time and, if the pressing time is determined to be longer than the first determination time, starts a process of calling associated information. First, with the display processing unit 126, the object 212 on which the selected display object 214 is displayed is moved, so that the associated information display area 220 is displayed (S110). For example, in the example shown in
Then, the display processing unit 126 displays the function menu 222 in the associated information display area 220 displayed at a position where the moved object 212 has been located (S120). In the example shown in
The object 212 of the playlist that has been moved in step S110 is still moved while the display object 214 of the object 212 is pressed, so that a state in which the function menu 222 is displayed is maintained. When the finger is lifted off the display object 214, the operation input determination unit 124 determines whether to restore the display position of the object 212 to the initial state shown in the left view of
Specifically, the operation input determination unit 124 determines if the pressing time in which the display object 214 is pressed is longer than the first determination time or determines if a predetermined time (referred to as an “end determination time”) has not elapsed from the previous pressing time. If the pressing time is shorter than the first determination time and the end determination time has elapsed from the previous pressing time, it can be determined that the function menu 222 is not used. The end determination time can be set to any given time from the perspective of increasing the operability for the user, and can be set to about five seconds, for example.
Accordingly, while the determination condition for restoring the display position of the object 212 to the initial state is not satisfied in step S130, the process of from step S120 is repeated. Meanwhile, when the determination condition for restoring the display position of the object 212 to the initial state is satisfied in step S130, the display processing unit 126 performs a display process of restoring the object 212 to the initial state (S140). In the process of restoring the object 212 to the initial state, the object 212 may be lowered slowly, for example, in five seconds.
Referring back to the description of step S100, when it is determined that the pressing time is longer than the first determination time in step S100, it is determined if the object 212 is moved while being lifted as shown in the right view of
The process of calling associated information in accordance with this embodiment has been described. In the process of calling associated information with the information processing unit 120 in accordance with this embodiment, the object 212 of each playlist included in the list of playlists 210 is provided with a movement such as sway that indicates that the object 212 is movable. In addition, each object 212 is provided with the display object 214 that becomes an operation target when the object 212 is moved. When a predetermined operation such as long-press is input to the display object 214 by a user, the display processing unit 126 starts a process of calling associated information. Accordingly, the display object 214 is pressed in and the object 212 is lifted, whereby a display process is performed in which the associated information display area 220 hidden behind appears. As the associated information display area 220 displays functions having high relevance to the information displayed on the object 212, the user is able to easily execute such functions.
Although
In the process flow in
(3-a. Display of Associated Information Display Area)
In the example shown in
For example, in
The associated information display area 220 can be expanded by displaying an expansion area 220a that expands in a balloon shape from the original associated information display area 220 as shown in
(3-b. Gradual Movement of Object)
In the example shown in
When the associated information display area 220 increases, the number of icons that can be displayed in the area 220 increases. Thus, as shown in the right view of
In the examples shown in
In addition, the display processing unit 126 may, when the display object 214 of the moved object 212b is further pressed in from the state in which the object 212 is initially moved, display the lower-level information of the operation target information.
(3-c. Display of Associated Information in Accordance with the Movement Direction of Object)
Although the movement direction of the object 212 is a single direction in the example shown in
For example, as shown in
Meanwhile, when a predetermined operation such as long-press is input to the second display object 214L, the display processing unit 126 lifts the object 212 to a side opposite to the second display object 214L with the second display object 214L serving as the point of effort as shown in the lower right view of
Hereinafter, description will be made of a case where a predetermined operation is input to each of the display object 214A provided on one side of the object 212 and the display object 214B provided at the corner of the object 212. First, when a predetermined operation such as long-press is input to the display object 214A, the display processing unit 126 lifts the object 212 to a side opposite to the display object 214A with the display object 214A serving as the point of effort as shown in the upper right view of
Meanwhile, when a predetermined operation such as long-press is input to the display object 214B, the display processing unit 126 lifts the object 212 from a corner that is opposite the display object 214B with the display object 214B serving as the point of effort as shown in the lower right view of
Note that the shape of the object 212 may be, other than a plate and a rectangle shown in
Next, a process of calling associated information with the information processing unit 120, which is an information processing device in accordance with the second embodiment of the present disclosure, will be described with reference to
The functional configuration of the mobile terminal 100 having the information processing unit 120 in accordance with this embodiment is substantially identical to the configuration of the mobile terminal 100 in accordance with the first embodiment shown in
Next, a process of calling associated information with the information processing unit 120 in accordance with this embodiment will be described with reference to
The operation input detection unit 110 of the mobile terminal 100 in accordance with this embodiment continuously monitors contact of an input object on the display unit 130. Then, upon detecting a touch of the input object on the display unit 130, the operation input detection unit 110 outputs a detection signal to the information processing unit 120.
The information processing unit 120, upon receiving the detection signal, determines if the touch position of the input object is the display object 214 displayed on the object 212 of the playlist with the position determination unit 122. If the input object does not touch the display object 214, a process of calling an associated function is not executed. Meanwhile, if the input object touches the display object 214, the operation input determination unit 124 determines if a predetermined operation is input to the display object 214 for starting execution of a process of calling an associated function (S200).
In this embodiment, press-in of the display object 214 is used as a requirement to determine that a predetermined operation is input. Specifically, the operation input determination unit 124 determines if pressure applied to the display object 214 is greater than the determination pressure, and if the applied pressure is determined to be greater than the determination pressure, starts a process of calling associated information. First, with the display processing unit 126, the object 212 on which the selected display object 214 is displayed is moved, so that the associated information display area 220 is displayed (S210).
For example, in the example shown in
The object 212 of the playlist that has been moved in step S210 is still moved while the display object 214 of the object 212 is pressed, so that a state in which the function menu 222 is displayed is maintained. When a finger is lifted off the display object 214, the operation input determination unit 124 determines whether to restore the display position of the object 212 to the initial state shown in the left view of
Specifically, the operation input determination unit 124 determines if the pressure applied to the display object 214 is greater than the determination pressure or determines if the end determination time has not elapsed from the previous pressing time. If the applied pressure is less than the determination pressure and the predetermined time has elapsed from the previous pressing time, it can be determined that the function menu 222 is not used. Accordingly, when a determination condition for restoring the display object of the object 212 to the initial state is not satisfied in step S230, the process of from step S220 is repeated. Meanwhile, when a determination condition for restoring the display position of the object 212 to the initial state is satisfied in step S230, the display processing unit 126 performs a display process of restoring the object 212 to the initial state (S240).
Back to the description of step S200, if the applied pressure is determined to be greater than the determination pressure in step S200, it is determined if the object 212 is moved while being lifted as shown in the right view of
The process of calling associated information in accordance with this embodiment has been described. In the process of calling associated information with the information processing unit 120 in accordance with this embodiment, the object 212 of each playlist included in the list of playlists 210 is provided with a movement such as sway that indicates that the object 212 is movable. In addition, each object 212 is provided with the display object 214 that becomes an operation target when the object 212 is moved. When a predetermined operation such as press-in is input to the display object 214 by a user, the display processing unit 126 starts a process of calling associated information. Accordingly, the display object 214 is pressed in and the object 212 is lifted, whereby a display process is performed in which the associated information display area 220 hidden behind appears. As the associated information display area 220 displays functions having high relevance to the information displayed on the object 212, the user is able to easily execute such functions.
A process of the mobile terminal 100 having the information processing unit 120 in accordance with this embodiment can be executed either by hardware or software. In such a case, the mobile terminal 100 can be configured as shown in
The mobile terminal 100 in accordance with this embodiment can be realized by a processing device such as a computer as described above. The mobile terminal 100 includes, as shown in
The CPU 901 functions as an arithmetic processing unit and a control unit, and controls the overall operation within the mobile terminal 100 in accordance with various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs, operation parameters, and the like that are used by the CPU 901. The RAM 903 temporarily stores programs used in execution of the CPU 901, parameters that change as appropriate during the execution of the CPU 901, and the like. These components are mutually connected by the host bus 904a including a CPU bus or the like.
The host bus 904a is connected to the external bus 904b such as a PCI (Peripheral Component Interconnect/Interface) bus via the bridge 904. Note that the host bus 904a, the bridge 904, and the external bus 904b need not be provided separately, and the functions of such components may be integrated into a single bus.
The input device 906 includes input means for a user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever; an input control circuit that generates an input signal in response to a user's input and outputs the signal to the CPU 901, and the like. Examples of the output device 907 include a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a lamp; and an audio output device such as a speaker.
The storage device 908 is an exemplary storage unit of the mobile terminal 100. This is a device for storing data. The storage device 908 may include a memory medium, a recording device for recording data on the memory medium, a reading device for reading data from the memory medium, an erasing device for erasing data recorded on the memory medium, and the like. The storage device 908 is, for example, an HDD (Hard Disk Drive). The storage device 908 stores programs and various data that drive the hard disk and are executed by the CPU 901.
The drive 909 is a reader/writer for a memory medium, and is incorporated in or externally attached to the mobile terminal 100. The drive 909 reads information recorded on a mounted removable recording medium such as a magnetic disk, an optical disc, a magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 903.
The connection port 911 is an interface to be connected to an external device. This is a connection port to an external device that can transfer data via a USB (Universal Serial Bus), for example. The communication device 913 is a communication interface including a communication device or the like to be connected to a communications network 5. The communication device 913 may be any of a communication device supporting a wireless LAN (Local Area Network), a communication device supporting a wireless USB, and a wired communication device that performs wired communication.
Although the preferred embodiments of the present disclosure have been described in detail with reference to the appended drawings, the present disclosure is not limited thereto. It is obvious to those skilled in the art that various modifications or variations are possible insofar as they are within the technical scope of the appended claims or the equivalents thereof. It should be understood that such modifications or variations are also within the technical scope of the present disclosure.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
For example, although the aforementioned embodiments illustrate examples in which the information processing unit 120 is provided in the mobile terminal 100, the present technology is not limited thereto. For example, the function of the information processing unit 120 may be provided in a server that is connected to the mobile terminal 100 via a network in a communicable manner. At this time, the mobile terminal 100 can implement the aforementioned process by transmitting a detection result obtained by the operation input detection unit 110 to a server via a communication unit (not shown), performing a process with an information processing unit provided in the server, and transmitting the processing result to the mobile terminal 100.
In addition, although the aforementioned embodiments illustrate examples in which after the object 212 of the playlist represented in the shape of a plate is moved, the moved object 212 is restored to the initial state upon input of a predetermined operation, the present technology is not limited thereto. For example, a process of restoring the moved object 212 to the initial state may be started when the list of playlists 210 is scrolled or when a back key of the mobile terminal 100 is pressed, for example. Alternatively, the moved object 212 may be restored to the initial state by directly moving the object 212 with a finger back to the original position.
Further, although the aforementioned embodiments illustrate examples in which a process of calling associated information with the information processing unit 120 is applied to a music application, the present technology is not limited thereto. The aforementioned process can also be applied to an application that displays lists such as, for example, an e-mail list of e-mail software, a phone number list and posting/browse services of phone book software, or an RSS reader.
Additionally, the present technology may also be configured as below.
(1) An information processing device, comprising:
a position determination unit configured to, on the basis of a touch position of an input object on a display unit that displays first information, determine a touch on a display object that displays second information associated with the first information;
an operation input determination unit configured to determine if a predetermined operation is input to the display object; and
a display processing unit configured to, on the basis of determination results obtained by the position determination unit and the operation input determination unit, move a display position of the first information so that the second information is displayed at a position in which the moved first information has been displayed.
(2) The information processing device according to (1), wherein the operation input determination unit determines if a long-pressing operation in which the input object touches the display object for a time longer than or equal to a first determination time is performed.
(3) The information processing device according to claim (1), wherein the operation input determination unit determines if a short-pressing operation in which the input object touches the display object for a time shorter than a second determination time is performed.
(4) The information processing device according to (1), wherein the operation input determination unit determines if the input object has applied pressure that is greater than or equal to determination pressure to the display object.
(5) The information processing device according to any one of (1) to (4), wherein
the display object is provided at an end portion of a first display area in which the first information is displayed, and
when the input object touches the display object and a predetermined operation is input to the display object, the display processing unit displays the first display area so that the first display area is lifted toward a user who is opposite the display unit with the display object serving as the point of effort, and displays a second display area in which the second information is displayed below the moved first display area.
(6) The information processing device according to (5), wherein when an entirety of the second information is not displayed in the second display area displayed on the display unit by a movement of the first display area, the display processing unit displays an additional display object indicating that there remains part of the second information that is not displayed in the second display area, and displays, when the additional display object is selected, at least a part of the second display information that has not been displayed on the display unit.
(7) The information processing device according to (5) or (6), wherein when an entirety of the second information is not displayed on the second display area displayed on the display unit by a movement of the first display area, the display processing unit displays at least a part of the second information that has not been displayed by expanding the second display area.
(8) The information processing device according to any one of (5) to (7), wherein when the input object touches the display object and a predetermined operation is input to the display object again after the second information is displayed on the basis of the determination results obtained by the position determination unit and the operation input determination unit, the display processing unit increases a movement amount of the first display area so that the second display area is enlarged.
(9) The information processing device according to any one of (5) to (7), wherein when the input object touches the display object and a predetermined operation is input to the display object again after the second information is displayed on the basis of the determination results obtained by the position determination unit and the operation input determination unit, the display processing unit further displays lower-level information associated with the second information.
(10) The information processing device according to any one of (1) to (9), wherein the display processing unit, after displaying the second information on the basis of the determination results obtained by the position determination unit and the operation input determination unit, displays the first information at a position after the movement until the input object is moved away from the display object.
(11) The information processing device according to any one of (1) to (10), wherein the display processing unit changes the second information displayed in the second display area in accordance with a movement direction of the first display area.
(12) The information processing device according to any one of (1) to (11), wherein the display processing unit provides the first information displayed on the display unit with a movement indicating that the first information is movable.
The present disclosure contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2011-244344 filed in the Japan Patent Office on Nov. 8, 2011, the entire content of which is hereby incorporated by reference.
Number | Date | Country | Kind |
---|---|---|---|
2011244344 | Nov 2011 | JP | national |