Patent Grant
7239305
The present invention relates to an information processing system including input/output (I/O) devices such as a touch panel, a mouse, etc. capable of inputting information with an operation against a display on a screen.
In the information processing system including the above-described I/O devices like, e.g., the touch panel, a sensor for detecting a touch (or press-down) on a screen from outside is provided in overlap with a touch panel display screen for displaying the information. When an operator of the information processing system presses down a position of a button, etc. displayed on the screen, the sensor detects coordinates of that touch position, and an operation instruction is given to the information processing system.
This type of invention known as the information processing system is disclosed in Japanese Patent Laying-Open Application No.9-26832. This type of information processing system includes a large-sized main LCD having high resolution, a main CPU for controlling the main LCD, a small-sized sub LCD having low resolution, a touch panel on the sub LCD, and a sub CPU for controlling the sub LCD. According to this invention, a necessity for providing the touch panel on the main LCD is eliminated by combining the small-sized low resolution sub LCD with the touch panel provided on the sub LCD, and declines both in contrast of the main LCD and in display function are thereby prevented. Further, this invention has a scheme for reducing a consumption of electric power by operating only the sub LCD and a sub processor in operations not requiring the high resolution.
Further, in some other conventional information processing systems, both of the touch panel and another pointing device, e.g., the mouse can be used as the pointing devices. In this type of information processing system, when detecting that the operator manipulates the mouse, a mouse cursor is displayed on the screen, and, when detecting that the operator operates the touch panel, the mouse cursor is not displayed.
The reason for taking a mode in which the mouse cursor is not displayed when operating the touch panel, is that the operator is able to directly specify desired coordinates on the screen by use of a finger or a pen.
In the case of performing the demonstration and the presentation by operating the touch panel in this information processing system, however, the audience is unable to follow up with the operation of the operator and hard to understand how the operator operates it.
Further, this type of information processing system may generally be a small-sized information terminal such as a notebook type personal computer, a pen-inputting type personal computer, a PDA, etc., and an area of a display screen thereof is small in general. Therefore, other external display device such as a liquid crystal projector or a large-screen CRT is connected via a cable, and the demonstration or the presentation is conducted for the audiences by use of this external display device in many cases. In this case, if a video controller incorporated into the information processing system is used for controlling display on the external display device, the same content as that displayed on the external display device can not be displayed on the screen of the self-device in some cases in terms of a limit of performance of the video controller. Hence, the operator must operate the touch panel in a state of displaying nothing on the screen of the information processing system, and it is difficult to pinpoint the exact coordinates on the screen by operating the touch panel.
Further, other type of information processing system incorporates two pieces of video controllers. One of the two video controllers controls the display on the touch panel screen, while the other controller controls the display on the external display device. Therefore, this information processing system displays different contents on the two screens. In this type of information processing system, it is difficult to specify a menu, a button or an icon by use of the touch panel because they are displayed on the external display device but are not displayed on the touch panel.
In any case, the audiences have been demanding for a contrivance for pinpointing the touched coordinates to make the operation clearly understandable irrespective of whether the information is displayed on the touch panel or not.
On the other hand, the operators have been demanding for a method of controlling the information processing system by use of a touch panel capable of easily operating the menu, the button or the icon displayed on only the external display device.
Moreover, in an information processing system having no such touch panel described above and using only, e.g., a mouse as a pointing device, a mouse cursor is always displayed on the screen.
In the demonstration and the presentation for the audience, however, the operator frequently moves the mouse cursor to the desired menu, button or icon, and hence it is difficult for the audience to grasp the operation by the operator as in the case of the information processing system including the touch panel described above.
Accordingly, the contrivance for making the content of operation by the operator easily understandable to the audience, is also required of the information processing system using a pointing device other than the touch panel.
It is a primary object of the present invention, which was devised to obviate the problems inherent in the prior arts, to provide an information processing system, a display control method and a recording medium recorded with a program for an execution of the control thereof, which are capable of making an operation of an operator easily understandable to an audience.
It is another object of the present invention to provide an information processing system, a display control method and a recording medium recorded with a program for an execution of the control thereof, which are capable of making the operator's operation using an external display device connected to the information processing system easily understandable to the audience, and making the operator's operation easily understandable and handleable to the operator himself or herself.
It is still another object of the present invention to provide an information processing system including an input/output device like a touch panel serving as a pointing device incorporating the above function, a display control method and a recording medium recorded with a program for an execution of the control thereof.
To accomplish the above objects, according to the present invention, an information processing system comprises an operation screen unit capable of displaying information and detecting a touch operation on a surface thereof, a first display control unit for controlling display of the information on the operation screen unit, and an operation mode selecting unit for selecting any one of two or more operation modes with respect to the touch operation. The operation mode selecting unit selects the following operation modes.
A first operation mode provides the touch operation on the operation screen unit with a first function corresponding to the touch operation. The touch operation is defined as an operation of selecting a display item by touching such as, e.g., a menu, a button or an icon displayed on the operation screen unit. The first function implies that a specified application program is started up by, e.g., the menu being chosen.
On the other hand, a second operation mode provides the touch operation on the operation screen unit, instead of providing the first function corresponding to the touch operation, or together with providing the first function, with a second function of displaying a marker for indicating a detection of the touch in a touch position.
According to the present invention, the information processing system may further comprise a connecting module for connecting a display device capable of displaying information in addition to the operation screen unit. The first display control unit controls the display of the information on the display device connected to the connecting module and the display of the information on the operation screen unit. In this case also, the second operation mode provides the touch operation on the operation screen unit, instead of providing the first function corresponding to the touch operation, or together with providing the first function, with a second function of displaying a marker for indicating a detection of the touch in at least one of a touch position and a display position on the display device which is determined based on the touch operation.
Herein, the display position on the display device which is determined based on the touch operation is a position on the screen of the display device corresponding to the operation screen unit. For instance, this position is, for example, a position determined as absolute coordinates on the display device, which correspond to absolute coordinates on the operation screen, or a position determined by a relative moving quantity on the screen of the display device that is based on a relative moving quantity by the operation on the operation screen.
According to the present invention, the first display control unit may execute the control so that the information is exclusively displayed on any one of the display device and the operation screen unit. Namely, the first display control unit may control so that the information is displayed on only one of the display device and the operation screen unit.
According to the present invention, the information processing system may further comprise a second display control unit. That is, the first display control unit controls display of a first item of information on the operation screen unit, and the second display control unit controls display of a second item of information on the display device. Based on this, for instance, pieces of information having different contents may be displayed on the operation screen unit and the display device.
Herein, the information having different contents implies what the information displayed on the screen differs as by the menu, the button or the message.
According to the present invention, a control unit for distinguishing between the operation modes on the operation screen unit may be provided as a substitute for the operation mode selecting unit for selecting the operation modes on the operation screen unit with respect to the touch operation. The control unit makes a judgement to pick up any one of two or more operation modes for the touch operation on the operation screen unit.
Namely, the operation in a first mode is provided with a first function corresponding to this operation, and the operation in a second mode is provided with, instead of providing the first function, or together with providing the first function, a second function of displaying a marker for indicating a detection of the touch in this touch position.
According to the present invention, the information processing system, to which a display unit for displaying information and a pointing device for indicating coordinates on the display unit are connectable, comprises a detection unit for detecting an operator's input operation of indicating the coordinates by use of the pointing device, and a display control unit for displaying a marker for showing the respective coordinates on the display indicated by the input operation. Herein, the display unit capable of displaying the information may embrace a display device such as a display, etc. connected to, e.g., a computer. Further, the pointing device may embrace a device such as a mouse, a track ball, a joy stick, etc., connected to the computer, for indicating the coordinates on the display unit, or a touch panel, etc.
The display control unit may erase the marker after the marker has been displayed for a predetermined time.
The display control unit may, if an elapse time till a posterior coordinate indication since an anterior coordinate indication is longer than the predetermined time (for which the marker continues to be displayed), erase the marker displayed by the anterior coordinate indication and display the marker at the coordinates indicated posteriorly.
According to the present invention, the information processing system may further comprise a display unit, and a connecting module to which other display device on which to set display coordinates corresponding to the coordinates on the display unit, is connected. The display control unit may control display of information on at least one of the display unit and the other display device, and display the marker on at least one of the display unit and the other display device on which the information is being displayed.
According to the present invention, there is provided a readable-by-computer recording medium recorded with a program comprising a step of setting an operation screen unit capable of displaying information and detecting a touch panel on its surface to any one of two operation modes, a step of displaying the information on at least one of the operation screen unit and other display device to be connected to the information processing system, a step of providing the touch operation on the operation screen unit with a first function corresponding to the touch operation in a first operation mode, and a step of providing, in a second operation mode, the touch operation on the operation screen unit, instead of providing the first function corresponding to this touch operation, or together with providing the first function, with a second function of displaying a marker for indicating a detection of the touch in at least one of a touch position and a display position on the display device which is determined based on the touch operation.
According to the present invention, there is provided a readable-by-computer recording medium recorded with a program for making a computer to executes
a step of displaying information on at least one of an operation screen unit capable of displaying the information and detecting a touch operation on its surface, and other display device being connected to the computer,
a step of detecting the touch operation on the operation screen unit,
a step of distinguishing between operation modes on the operation screen unit,
a step of providing the operation in a first mode on the operation screen unit with a first function corresponding to the first mode operation, and
a step of providing the operation in a second mode on the operation screen unit, instead of providing the first function, or together with providing the first function, with a second function of displaying a marker for indicating a detection of the touch in at least one of a touch position and a display position on the display device which is determined based on the touch operation.
According to the present invention, there is provided a readable-by-computer recording medium recorded with a program for making a computer, to which a display unit and a pointing device can be connected, execute a step of detecting an operator's input operation of indicating the coordinates on the display unit by use of a pointing device, and a step of displaying a marker for showing the respective coordinates on the display unit indicated by the input operation.
This program may further make a computer execute a step of selecting any one of a first operation mode for providing a first function of executing a normal process corresponding to the operator's input operation using the pointing device, and a second operation mode for providing a second function of executing a process different from the first operation mode, and a step of displaying the marker on the basis of the selection of the second operation mode.
This program may further make a computer execute a step of erasing the marker after the marker has been displayed for a predetermined time. Further this program may further make a computer execute a step of calculating an elapse time till a posterior coordinate indication since an anterior coordinate indication, and a step of displaying the marker at the coordinates indicated posteriorly after erasing the marker displayed by the anterior coordinate indication if the elapse time is longer than the predetermined time (for which the marker continues to be displayed).
This program may further make a computer execute a step of controlling the display of the information on at least one of the display unit provided on the computer and other display device, connected to the computer, on which display coordinates corresponding to the coordinates on the display unit are set, and a step of displaying the marker on at least one of the display unit and the other display device on which the information is being displayed.
As discussed above, according to the present invention, instead of providing the function corresponding to the operation of the information processing system, or together with providing the function corresponding to this operation, the marker for indicating the detection of the touch is displayed in the touch position. It is therefore feasible to make the operation of the operator understandable to the audience in the demonstration and the presentation.
Further, in the demonstration and the presentation using the external display device connected to the information processing system, it is possible to make the operator's operation easily understandable and handleable to the operator himself or herself.
Preferred embodiments of the present invention will hereinafter be discussed with reference to the accompanying drawings.
An information processing system in a first embodiment of the present invention will be described with reference to
<Configuration>
The CPU 1 provides a user with a function as the information processing system by executing the input device driver 12, the display device driver 13 and a variety of information processing programs.
The memory 2, on which the OS 11, the input device driver 12 and the display device driver 13 are developed, stores those pieces of software.
The touch panel 4 is controlled by the display control unit 3 and thereby displays, on its screen, information of the program executed by the CPU 1, e.g., menus, buttons, icons, messages, etc. Further, when the user pinpoints the indicator such as the menu, or the button or the icon displayed on the screen by use of a touch panel pen 20 (which is hereinafter simply called the pen 20), the touch panel 4 detects coordinates of this pinpoint (touch) position and notifies the CPU 1 of the coordinates thereof by interrupt.
The projector 5 can be connected to the present information processing system via the external connecting terminal 7. The projector 5 is, as in the case of the touch panel 4, controlled by the display control unit 3, and displays the output information of the program executed by the CPU 1. In a state where the projector 5 is not connected, the output information of the program executed by the CPU 1 is displayed on only the touch panel 4.
The display control unit 3 receives the information from the CPU 1, develops this item of information into display data on the screen, e.g., bitmap formatted data such as the menu, the button, the icon, the message, etc., and the thus developed data are displayed on the touch panel 4 and the projector 5 as well.
The input mode switching key 6 is used for switching over an operation mode when the user operates by touching the touch panel 4, i.e., the operation mode for inputting through the touch panel 4. An instruction given by this input mode switching key 6 is stored in the memory 2 and referred to from the OS 11, the input device driver 12 and the display device driver 13.
In a state where the input mode switching key 6 is not pressed down (a first operation mode), when the pen 20 manipulated by the user touches the indicator such as the menu, the button, the icon, etc. on the touch panel 4, the input device driver 12 detects an event occurred upon touching the touch panel 4 (which is hereinafter referred to as a touch event). The input device driver 12 notifies the OS 11 of this touch event and coordinates of the touch position thereof. Further, the OS 11 notifies a predetermined application program of these pieces of data.
As a result, in the first operation mode, the information processing system in the first embodiment provides the user's touch operation (press-down) on the touch panel 4 with a function (corresponding to a first function) corresponding to this touch operation.
In a state where the input mode switching key 6 is pressed down (a second operation mode), when the user presses the indicator such as the menu, the button, the icon, etc. on the touch panel 4 with the pen 20, the input device driver 12 detects a touch event, and notifies the OS 11 of an instruction to display a mark 21 (corresponding to the marker) on the screen and of the display coordinates thereof. The OS 11 thereby indicates the display device driver 13 to display the mark 21 at the display coordinates. While on the other hand, the touch event itself is discarded by the input device driver 12 without the OS 11 being notified of this touch event.
Consequently, as shown in
The input device driver 12 detects the touch operation on the touch panel 4. Namely, when the user touches the touch panel 4 with the pens 20, the input device driver 12 detects an event occurred by the touch operation (touch event) and a touch position. The input device driver 12, in the first operation mode, notifies the OS 11 of the touch event. On the other hand, the input device driver 12, in the second operation mode, discards this touch event, and notifies the OS 11 of an instruction for displaying the mark 21 and of display coordinates thereof.
The display device driver 13 receives display information displayed on the touch panel 4 and on the projector 5 from the OS 11, and transfers the display information to the display control unit 3.
<Operation>
A register Time for storing a time when the mark 21 was displayed last time, is set beforehand. Null is set in this register Time when erasing the mark 21 being displayed and when in an initializing process. That is to say, a value in Time is cleared.
To start with, the input device driver 12 initializes Time to Null (step S101, of which a representation is hereinafter simplified such as S101).
Next, the input device driver 12 judges whether Time is Null or not (S102).
If Time is not Null, the input device driver 12 compares a difference between the present time and Time with a predetermined value T0 (S103).
As a result of this comparison, if the difference is larger than T0, the input device driver 12 erases the mark 21 being displayed (S104), and checks an input to the touch pane 14 (S105).
If Time is judged to be Null in the process in S102, and if the difference between the present time and Time is judged to be equal to T0 or smaller, the input device driver 12 shifts the control to the process of checking the input to the touch panel 4 in S105.
When the user touches the screen 4a of the touch panel 4 by use of the pen 20 (S106), the input device driver 12 detects its touch operation (which is termed an occurrence of the touch event), and further calculates coordinates of a touch position thereof (S107). Moreover, if there is no input to the touch panel 4, the input device driver 12 repeats the processes of checking the value of Time and of erasing the mark 21 in S102 through S104.
Next, after calculating the coordinates of the touch position in S107, the input device driver 12 judges whether or not the input mode switching key 6 is in a press-down state (S108).
If during the press-down, the input device driver 12 judges that the second operation mode occurs, and does not notify the OS 11 of the occurrence of the user's touch event on the screen 4a of the touch panel 4. Namely, the input device driver 12, instead of notifying of the occurrence of this touch event, indicates the OS 11 to display the mark 21 (corresponding to the marker for indicating a detection of the touch) for showing the occurrence of the touch event in the touched-by-the-user position on the touch panel 4, or a position, corresponding to this touch position, on the screen 5a of the projector 5 (S109).
The OS 11 thereby issues a command to the display device driver 13 to display the mark 21 in the position concerned, whereby the mark 21 is displayed by the display control unit 3 through the display device driver 13.
After displaying the mark 21, the present time is set in Time (S10a).
On the other hand, if the input mode switching key 6 is not being depressed (the key 6 is released), the input device driver 12 judges that the first operation mode occurs, and notifies the OS 11 of the information (touch event) showing that coordinates data of the touched-by-the-user position on the touch panel 4 and the touch operation have been detected (S10b). Thereafter, Time is set to Null (S10c).
The OS 11, when notified of the touch event, to begin with, if the mark 21 is displayed, erases this mark 21. Further, the OS 11 notifies the predetermined application program of the information which the OS 11 itself has been notified of. An essential function of the application program (or the function as the information processing system) is thereby provided.
As discussed above, in the state where the user presses down the input mode switching key 6, the mark 21 indicating that the touch operation in the touch position has been detected, is merely displayed on the screen 5a of the projector as well as on the touch panel 4 for a predetermined period of time (the second function), however, the function (the first function) as the information processing system is not provided. While in the state where the user releases the input mode switching key 6, the function (the first function) of the information processing system which corresponds to the touch operation is provided for the touch operation on the touch panel 4.
Therefore, on the occasion of performing demonstration and presentation by use of this information processing system, the operator halts a proceeding of the demonstration, etc. by pressing down the input mode switching key 6, and is thereby able to pinpoint the touch position on the touch panel 4. As a result, an audience can easily follow up with the operation when in the demonstration.
<Modified Example>
<Process of Displaying Mark (Providing Second Function) for Indicating Detection of Touch together with Providing Function of Information Processing System>
The first embodiment has exemplified the information processing system constructed such that in the state where the user (operator) depresses the input mode switching key 6, the mark 21 indicating that the touch operation in the touch position has been detected, is merely displayed on the screen 5a of the projector 5 as well as on the screen 4a of the touch panel 4 for the predetermined period of time with respect to the touch operation on the touch panel 4, however, the essential function is not provided. Instead of this, the information processing system may also be constructed in such a way that in the state where the user presses down the input mode switching key 6, the mark 21 indicating that the touch operation in the touch position has been detected, is merely displayed on the screen 5a of the projector 5 as well as on the screen 4a of the touch panel 4 for the predetermined period of time with respect to the touch operation on the touch panel 4, and the essential function as the information processing system may be provided.
The processes shown in
Further, the OS 11 notifies the predetermined application program of the touch event and the coordinates data which the OS 11 itself has been notified of. With this operation, the essential function (or the function as the information processing system) of the application program is provided (corresponding to the first function). Further, the OS 11 issues a command to the display device driver 13 to display the mark 21 in the position concerned. Then, the mark 21 is displayed by the display control unit 3 through the display device driver 13 (corresponding to the second function).
As a consequence, when in the demonstration, etc. of the application program, if during the press-down of the input mode switching key 6, the mark 21 indicating the touch position is displayed on the screen 4a of the touch panel 4 and on the screen 5a of the projector 5 in accordance with the operation on the touch panel 4, with the proceeding of the application program. The audience of the demonstration, etc. is therefore able to easily follow up with the operation of the operator.
In the first embodiment, the first and second operation modes are switched over depending on whether the input mode switching key 6 is being depressed or not. These first and second operation mode may be switched over based on the manipulation mode of the pen 20 on the touch panel 4. The followings are processes of distinguishing between a first mode operation and a second mode operation on the basis of a time interval and a positional interval.
<Modified Example; Process of Distinguishing between Mode Operations by Time Interval>
To start with,
While on the other hand, when a predetermined time elapses since the touch of the first time, the display of the mark 21 disappears. Hence, even if the user touches again the screen with the pen 20 (corresponding to the second mode operation), the mark 21 is merely displayed, but the no function as the information processing system is provided.
In the processing in
When the user touches the screen 4a of the touch panel 4 by using the pens 20 (S111), the input device driver 12 detects this touch operation, and at first sets the present time to CurrentTime (S112). Next, the input device driver 12 calculates coordinates of the touch position (S113).
Next, the input device driver 12 judges whether or not a predetermined time n elapses till an input operation time (stored in CurrentTime) detected this time is reached since the input operation time (stored in OldTime) detected last time (S114).
Herein, if the predetermined time n elapses, the input device driver 12 judges that the second operation mode occurs, and does not notify the OS 11 of the occurrence of the event of the user's touching the screen 4a of the touch panel 4. That is, the input device driver 12 indicates the OS 11 to display the mark 21 (corresponding to the marker for indicating the detection the touch) for showing the occurrence of the touch event in the touched-by-the-user position on the touch panel 4, and a position, corresponding to this touch position, on the screen 5a of the projector 5 (S115). The OS 11 thereby issues a command to the display device driver 13 to display the mark 21 in the position concerned. Then, the mark 21 is displayed by the display control unit 3 through the display device driver 13. This mark 21 is erased after being displayed for a predetermined time.
Whereas if the predetermined time n does not elapse, the input device driver 12 judges that the first operation mode occurs, and notifies the OS 11 of the information showing that coordinates data of the touched-by-the-user position on the touch panel and the touch operation have been detected (S116).
The OS 11 at first, when the mark 21 is displayed, erases this mark 21. Further, the OS 11 notifies the predetermined application program of the information which the OS 11 itself has been notified of. The essential function of the application program (or the function as the information processing system) is thereby provided.
Moreover, if the touch operation is not detected for the predetermined time after the touch operation of the last time, a timer incorporated into the OS 11 starts up a program for an execution of the processing shown in
As described above, with respect to the touch operation of the user on the touch panel 4 at the interval of the predetermined time, the mark 21 indicating that the touch operation in the touch position has been detected, is merely displayed on the screen 5a of the projector as well as on the touch panel 4 for the predetermined period of time (the second function), however, the function (the first function) as the information processing system is not provided. On the other hand, for a plurality of touch operations of the user on the touch panel 4 within the interval of the predetermined time, the function (the first function), corresponding to these touch operations, of the information processing system is provided.
Hence, on the occasion of performing the demonstration and presentation by use of this information processing system, the operator halts the proceeding of the demonstration, etc. by controlling the time interval of the touch operation on the touch panel 4, and is thereby able to pinpoint the touch position on the touch panel 4. As a result, the audience can easily follow up with the operation when in the demonstration.
<Modified Example; Process of Distinguishing between Operation Modes by Positional Interval>
In the modified example given above, there has been explained the process of the information processing system, by which the first and second mode operations are switched over based on the time interval of the touch operation on the touch panel 4. Instead of this time interval, the mode operations may be switched over by an interval between coordinates of two points touched consecutively.
Referring to
To begin with, the input device driver 12 initializes a variable CurrentCord stored with coordinates of the present touch position and a variable OldCord stored with coordinates of the touch position of the last time (S120).
Next, the input device driver 12 waits for the user's operation on the touch pane 14 (S121). After the user's operation, the input device driver 12 detects and stores the coordinates of this touch position in CurrentCord (S123).
Subsequently, the input device driver 12 compares the coordinates (OldCord) of the touch position of the user with the present coordinates (CurrentCord). Then, the input device driver 12 judges whether or not the present touch position is apart a predetermined distance (d) from the touch position of the last time (S124).
If judged to be apart the predetermined distance (d) from the touch position of the last time, the input device driver 12 judges it as the second mode operation and does not notify the OS 11 of the occurrence of the event by the user's touching as the screen 4a of the touch panel 4. Namely, the input device driver 12, instead of notifying of the occurrence of this touch event, indicates the OS 11 to display the mark 21 (corresponding to the marker for indicating the detection of the touch) in the touched-by-the-user position on screen 4a of the touch panel 4 and a position, corresponding to this touch position, on the screen 5a of the projector 5 (S125).
While on the other hand, if judged to be within the predetermined distance (d) from the touch position of the last time, the input device driver 12 judges it as the first mode operation, and notifies the OS 11 of the touch event indicating that the coordinates data of the touched-by-the-user position on the touch panel 4 and the touch operation thereof have been detected (S126).
As discussed above, even when the user repeatedly touches a position apart the predetermined distance (d) from the touch position of the last time on the touch panel 4, the mark 21 indicating that the touch operation in that touch position is detected, is merely displayed on the screen 4a of the touch panel 4 and on the screen 5a of the projector 5, however, the function as the information processing system is not provided. On the other hand, if the user touches somewhere within the a predetermined distance (d) a plurality of times on the touch panel 4, there is provided the function, corresponding to this operation, of the information processing system.
Therefore, as in the first embodiment, when performing the demonstration and the presentation by use of this information processing system, the operator stops the proceeding of the demonstration, etc. by controlling the position of the touch operation on the touch panel 4, and is able to pinpoint the touch position on the touch panel 4. As a result, the audience can easily follow up with the operation when in the demonstration.
<Other Modified Examples>
In accordance with the first embodiment, in the second mode operation, the input device driver 12, the OS 11 and the display device driver 13 display the mark 21 in the touch position pinpointed by the pen 20. The mark 21 may be displayed by any one of the OS 11 the input device driver 12 and the display device driver 13, or may also be displayed by combining one or more.
Further, those processes may be executed in other programs, e.g., a program layered between the OS 11 and the individual application program (which is termed “Middleware” exemplified by, e.g., a window system for adapting the OS of Character User Interface to Graphical User Interface), or may also be executed in the individual application program.
In the case of executing this process by the Middleware such as the window system, as by the information processing system in the first embodiment, the function in the first embodiment is actualized uniformly by all the application programs using this window system, etc. While on the other hand, even when the above process is attained by the individual application program, what the function thereof is actualized is limited to that application program.
The first embodiment discussed above have exemplified the operation mode in which the touch panel is touched by the pen 20, however, the present invention is not limited to this mode. For instance, the touch panel 4 touched by a human finger may also be used.
The information processing system in the modified example given above involves the use of the time interval of touching the touch panel 4 or the interval between the touch positions in order to distinguish between the operation modes, however, the present invention is not confined to these intervals. The information processing system may distinguish between the operation of the first mode and the operation of the second mode on the basis of, for example, a time length of one touch kept on the touch pane 14, the touch operation similar to double-clicks and triple-clicks of the mouse) performed consecutively a plurality of times in the same position, a trajectory (e.g., whether a closed curve is included or not) of the manipulation of the pens 20 on the screen 4a, and so forth.
The information processing system in a second embodiment of the present invention will hereinafter be described with reference to
The configuration of the information processing system and the processing of the programs in the second embodiment are the same as those in the first embodiment, and will be explained referring to
As described above, the configuration of this information processing system is illustrated in
On the other hand, the information processing system, when the user releases the input mode switching key 6, provides the essential function (corresponding to the first operation mode).
This process can be executed as shown in a flowchart in
<Modified Example>
While in the state where the user does not depress the input mode switching key 6 (the first operation mode), the mark 21 is not displayed on the screen 5a of the projector 5. In this state, when the user touches the screen 4a of the touch panel 4 with the pen 20, there is provided a function, corresponding to this operation, of the information processing system. This process is executed as shown in a flowchart in
While on the other hand, even when the user touches the screen once again after the mark 21 has disappeared (the second mode operation), the mark 21 is merely displayed again, and no function corresponding to this operation as the information processing system is provided. This process is executed based on flowcharts in
Thus, when the user implements the demonstration and the presentation by using the information processing system, the user halts the proceeding of the demonstration, etc. by controlling the time interval of the touch operation on the touch panel 4, and is thereby able to pinpoint the touch position on the touch panel 4. As a result, the audience can easily follow up with the operation when in the demonstration. Further, the user is, after looking at the mark 21 displayed on the screen 5a of the projector 5 and thus confirming the corresponding position on the screen 4a of the touch panel 4 by controlling the time interval of the touch operation, able to operate a desired menu, button or icon.
While on the other hand, even when the user touches again a position apart the predetermined distance or farther from the display position of the mark 21 (the second mode operation), the mark 21 simply moves to this position, there is provided no function corresponding to this touch operation as the information processing system.
This process is executed based on a flowchart in
The information processing system in a third embodiment of the present invention will hereinafter be described with reference to
As shown in
As illustrated in
While in the state where the input mode switching key 6 is depressed (corresponding to the second operation mode), the mark 21 is displayed in a position on the screen 5a of the projector 5, which corresponds to the touch position of the last time on the screen 4a of the touch panel 4. In this state, as shown in
That is to say, the mark 21 moves to the position on the projector 5, which corresponds to the touch position on the touch panel 4. The user touches the touch panel and is thereby able to operate the menu, the button or the icon which are different from those on the touch panel 4 and displayed on only the screen 5a of the projector 5 by touching the touch panel. The user is therefore able to be provided with a function (corresponding to the function indicted by the marker) of the application program which is displayed on only the screen 5a.
<Modified Example>
The information processing system in the third embodiment is constructed so that the coordinates on the touch panel 4 and the coordinates on the projector are set in a one-to-one correspondence, and the mark 21 displayed on the screen 5a of the projector 5 is moved. Instead of this mode, the movement of the mark 21 displayed on the screen 5a of the projector 5 may be controlled by, when the pens 20 is slid on the touch panel 4, relatively calculating how far and where the mark 21 should be moved to on the basis of a displacement (moving distance and direction) of the pen 20.
The input device driver 12 and the display device driver 13 explained in the first embodiment, or the Middleware such as the window system explained in <Other Modified Example>, may be recorded on a readable-by-computer recording medium, and read by a computer, thereby executing those pieces of software together with the OS 11 and the variety of application programs incorporated into the computer. The information processing system in a fourth embodiment can be thus actualized.
Namely, in the embodiment of the present invention, the operation mode of the information processing system using the operation screen unit (e.g., the touch panel 4) on which the information can be displayed and the touch operation on the surface can be detected, is set to any one of the first and second operation modes. Then, the information is displayed on at least one of the operation screen unit and the projector 5 as the different one, and the touch operation is detected via the operation screen unit.
The first operation mode provides the touch operation via the operation screen unit with the first function corresponding to this touch operation.
In the second operation mode, instead of providing the touch operation via the operation screen unit with the first function corresponding to this touch operation, or together with providing the first function, the program for displaying the marker for indicating the detection of the touch in at least one of the above touch position and the display position on the projector 5 which is determined based on the above touch operation, is recorded on the readable-by-computer recording medium, and read and executed by the computer. In this case, the whole of the OS 11 or the window system is not necessarily recorded on the recording medium.
The readable-by-computer recording medium given herein embraces recording mediums on and from which the information such as data and programs can be stored electrically, magnetically, optically, mechanically or chemically and read by the computer. Those recording mediums may be, e.g., a floppy disk, a magneto-optic disk, a CR-ROM, a CD-R/W, a DVD, a DAT, an 8 mm tape, a memory card, etc. Further, the above program is stored in a hard disk and a memory of the computer and can be downloaded into other computers via communications lines. As a result, the computer downloaded with the input device driver 12 and the display device driver 13 or the Middleware such as the window system, etc. can be made to function as the information processing system in the fourth embodiment.
As the information processing system in the embodiment of the present invention, there has been exemplified the hardware architecture of the typical computer, wherein the program of the present invention which is recorded on the hard disk is developed on the memory and executed by the CPU. The embodiment of the present invention is not limited to this hardware architecture. The present invention can be embodied with such a computer hardware architecture that, for example, the program of the present invention is recorded not on the hard disk but on a ROM and executed by the CPU.
The first to third embodiments discussed above have exemplified the information processing system involving the use of the touch panel 4 as a pointing device, however, the present invention is not necessarily confined to this type of pointing device. In the information processing system using, e.g., a mouse as the pointing device, a coordinate indication of the mouse used by the operator, i.e., an input of the coordinate indication by, e.g., clicking the button thereof, is detected, and the mark 21 according to the present invention may be displayed in a position of the coordinates detected above.
The mark 21 in the fifth embodiment is not a mouse cursor following up with the movement of the mouse 8 but a mark (corresponding to the marker) that pinpoints the position given when the button of the mouse 8 is pressed down (clicked).
The audience is thereby able to follow up with the operation of the operator and easily understand the method of operating the information processing system and the application programs as well.
| Number | Date | Country | Kind |
|---|---|---|---|
| 11-292527 | Oct 1999 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5428417 | Lichtenstein | Jun 1995 | A |
| 5448263 | Martin | Sep 1995 | A |
| 5528263 | Platzker et al. | Jun 1996 | A |
| 5539429 | Yano et al. | Jul 1996 | A |
| 5815142 | Allard et al. | Sep 1998 | A |
| 6088023 | Louis et al. | Jul 2000 | A |
| 6088481 | Okamoto et al. | Jul 2000 | A |
| 6215479 | Matsui | Apr 2001 | B1 |
| 6380929 | Platt | Apr 2002 | B1 |
| 6492977 | Marshall | Dec 2002 | B1 |
| Number | Date | Country |
|---|---|---|
| 0828211 | Mar 1998 | EP |
| 09-297656 | Nov 1997 | JP |
